2024-04-22T07:11:09.491 INFO:root:teuthology version: 0.0.1.dev269+g9481b1d 2024-04-22T07:11:09.491 DEBUG:teuthology.run:Teuthology command: teuthology --name leonidus-2024-04-22_05:52:53-fs-wip-lusov-quiescer-distro-default-smithi --verbose --archive /home/teuthworker/archive/leonidus-2024-04-22_05:52:53-fs-wip-lusov-quiescer-distro-default-smithi/7668166 --description fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-bitmap overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down pg_health prefetch_dirfrags/no prefetch_dirfrags/yes prefetch_entire_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/1 tasks/{1-thrash/with-quiesce 2-workunit/suites/iozone}} --owner scheduled_leonidus@teuthology -- /home/teuthworker/archive/leonidus-2024-04-22_05:52:53-fs-wip-lusov-quiescer-distro-default-smithi/7668166/orig.config.yaml 2024-04-22T07:11:09.543 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-22T07:11:09.631 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/leonidus-2024-04-22_05:52:53-fs-wip-lusov-quiescer-distro-default-smithi/7668166 branch: wip-lusov-quiescer description: fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-bitmap overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down pg_health prefetch_dirfrags/no prefetch_dirfrags/yes prefetch_entire_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/1 tasks/{1-thrash/with-quiesce 2-workunit/suites/iozone}} email: null first_in_suite: false job_id: '7668166' kernel: client: sha1: distro kdb: true sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: leonidus-2024-04-22_05:52:53-fs-wip-lusov-quiescer-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-lusov-quiescer ceph: cephfs: session_timeout: 300 conf: client: client mount timeout: 600 client_shutdown_timeout: 120 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds oft prefetch dirfrags: true mds op complaint time: 180 mds verify scatter: true mds_dir_prefetch: true mds_sleep_rank_change: 5000000.0 osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd blocked scrub grace period: 3600 osd failsafe full ratio: 0.95 osd max markdown count: 1000 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - \(SLOW_OPS\) - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - timeout on replica - late reservation from - MON_DOWN - OSDMAP_FLAGS - OSD_DOWN - PG_DEGRADED - PG_AVAILABILITY - POOL_APP_NOT_ENABLED - mons down - mon down - out of quorum sha1: 86f7587a5a09af35f0895e1a2d08527638fae697 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 86f7587a5a09af35f0895e1a2d08527638fae697 kclient: syntax: v2 selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-lusov-quiescer sha1: 86f7587a5a09af35f0895e1a2d08527638fae697 owner: scheduled_leonidus@teuthology priority: 70 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - mds.e - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - mds.d - mds.f - osd.4 - osd.5 - osd.6 - osd.7 seed: 4362 sha1: 86f7587a5a09af35f0895e1a2d08527638fae697 sleep_before_teardown: 0 subset: 222/111111 suite: fs suite_branch: wip-lusov-quiescer suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_86f7587a5a09af35f0895e1a2d08527638fae697/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 86f7587a5a09af35f0895e1a2d08527638fae697 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi037.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBWX1+yrY/C9HKkCV1N2hQSWVXCqNwEoWp5HEc28YuKOKCUMOyzaQNKguQJ/YACbZAQdlBYARX+PeTM8vBxlWQM= smithi196.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNRFdyFezLuHDXiUeiaFik5w/mcSetLHXTxUVX2NGSAKuMHAjbJ3NA1zEdV0xEO6g25VnL3c/ftyVR34YM1BQYY= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - kclient: null - quiescer: null - workunit: clients: all: - suites/iozone.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17 timestamp: 2024-04-22_05:52:53 tube: smithi user: leonidus verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-04-22T07:11:09.631 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_86f7587a5a09af35f0895e1a2d08527638fae697/qa; will attempt to use it 2024-04-22T07:11:09.631 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_86f7587a5a09af35f0895e1a2d08527638fae697/qa/tasks 2024-04-22T07:11:09.632 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-04-22T07:11:09.633 INFO:teuthology.task.internal:Checking packages... 2024-04-22T07:11:09.657 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '86f7587a5a09af35f0895e1a2d08527638fae697' 2024-04-22T07:11:09.657 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-22T07:11:09.657 INFO:teuthology.packaging:ref: None 2024-04-22T07:11:09.657 INFO:teuthology.packaging:tag: None 2024-04-22T07:11:09.657 INFO:teuthology.packaging:branch: wip-lusov-quiescer 2024-04-22T07:11:09.657 INFO:teuthology.packaging:sha1: 86f7587a5a09af35f0895e1a2d08527638fae697 2024-04-22T07:11:09.657 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-lusov-quiescer 2024-04-22T07:11:09.821 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-3156.g86f7587a 2024-04-22T07:11:09.822 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-04-22T07:11:09.829 INFO:teuthology.task.internal:no buildpackages task found 2024-04-22T07:11:09.830 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-04-22T07:11:09.871 INFO:teuthology.task.internal:Saving configuration 2024-04-22T07:11:09.889 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-04-22T07:11:09.903 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-22T07:11:09.933 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi037.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/leonidus-2024-04-22_05:52:53-fs-wip-lusov-quiescer-distro-default-smithi/7668166', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-22 07:06:03.372273', 'locked_by': 'scheduled_leonidus@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBWX1+yrY/C9HKkCV1N2hQSWVXCqNwEoWp5HEc28YuKOKCUMOyzaQNKguQJ/YACbZAQdlBYARX+PeTM8vBxlWQM='} 2024-04-22T07:11:09.966 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi196.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/leonidus-2024-04-22_05:52:53-fs-wip-lusov-quiescer-distro-default-smithi/7668166', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-22 07:06:03.370250', 'locked_by': 'scheduled_leonidus@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNRFdyFezLuHDXiUeiaFik5w/mcSetLHXTxUVX2NGSAKuMHAjbJ3NA1zEdV0xEO6g25VnL3c/ftyVR34YM1BQYY='} 2024-04-22T07:11:09.966 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-04-22T07:11:09.973 INFO:teuthology.task.internal:roles: ubuntu@smithi037.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2024-04-22T07:11:09.973 INFO:teuthology.task.internal:roles: ubuntu@smithi196.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2024-04-22T07:11:09.973 INFO:teuthology.run_tasks:Running task console_log... 2024-04-22T07:11:10.050 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fe319a7b0d0>, signals=[15]) 2024-04-22T07:11:10.050 INFO:teuthology.run_tasks:Running task internal.connect... 2024-04-22T07:11:10.057 INFO:teuthology.task.internal:Opening connections... 2024-04-22T07:11:10.057 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi037.front.sepia.ceph.com 2024-04-22T07:11:10.059 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-22T07:11:10.146 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi196.front.sepia.ceph.com 2024-04-22T07:11:10.147 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-22T07:11:10.230 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-04-22T07:11:10.238 DEBUG:teuthology.orchestra.run.smithi037:> uname -m 2024-04-22T07:11:10.256 INFO:teuthology.orchestra.run.smithi037.stdout:x86_64 2024-04-22T07:11:10.256 DEBUG:teuthology.orchestra.run.smithi037:> cat /etc/os-release 2024-04-22T07:11:10.314 INFO:teuthology.orchestra.run.smithi037.stdout:NAME="CentOS Stream" 2024-04-22T07:11:10.314 INFO:teuthology.orchestra.run.smithi037.stdout:VERSION="9" 2024-04-22T07:11:10.314 INFO:teuthology.orchestra.run.smithi037.stdout:ID="centos" 2024-04-22T07:11:10.314 INFO:teuthology.orchestra.run.smithi037.stdout:ID_LIKE="rhel fedora" 2024-04-22T07:11:10.314 INFO:teuthology.orchestra.run.smithi037.stdout:VERSION_ID="9" 2024-04-22T07:11:10.314 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM_ID="platform:el9" 2024-04-22T07:11:10.314 INFO:teuthology.orchestra.run.smithi037.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-22T07:11:10.314 INFO:teuthology.orchestra.run.smithi037.stdout:ANSI_COLOR="0;31" 2024-04-22T07:11:10.314 INFO:teuthology.orchestra.run.smithi037.stdout:LOGO="fedora-logo-icon" 2024-04-22T07:11:10.315 INFO:teuthology.orchestra.run.smithi037.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-22T07:11:10.315 INFO:teuthology.orchestra.run.smithi037.stdout:HOME_URL="https://centos.org/" 2024-04-22T07:11:10.315 INFO:teuthology.orchestra.run.smithi037.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-22T07:11:10.315 INFO:teuthology.orchestra.run.smithi037.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-22T07:11:10.315 INFO:teuthology.orchestra.run.smithi037.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-22T07:11:10.315 INFO:teuthology.lock.ops:Updating smithi037.front.sepia.ceph.com on lock server 2024-04-22T07:11:10.343 DEBUG:teuthology.orchestra.run.smithi196:> uname -m 2024-04-22T07:11:10.360 INFO:teuthology.orchestra.run.smithi196.stdout:x86_64 2024-04-22T07:11:10.360 DEBUG:teuthology.orchestra.run.smithi196:> cat /etc/os-release 2024-04-22T07:11:10.417 INFO:teuthology.orchestra.run.smithi196.stdout:NAME="CentOS Stream" 2024-04-22T07:11:10.417 INFO:teuthology.orchestra.run.smithi196.stdout:VERSION="9" 2024-04-22T07:11:10.417 INFO:teuthology.orchestra.run.smithi196.stdout:ID="centos" 2024-04-22T07:11:10.417 INFO:teuthology.orchestra.run.smithi196.stdout:ID_LIKE="rhel fedora" 2024-04-22T07:11:10.417 INFO:teuthology.orchestra.run.smithi196.stdout:VERSION_ID="9" 2024-04-22T07:11:10.417 INFO:teuthology.orchestra.run.smithi196.stdout:PLATFORM_ID="platform:el9" 2024-04-22T07:11:10.417 INFO:teuthology.orchestra.run.smithi196.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-22T07:11:10.418 INFO:teuthology.orchestra.run.smithi196.stdout:ANSI_COLOR="0;31" 2024-04-22T07:11:10.418 INFO:teuthology.orchestra.run.smithi196.stdout:LOGO="fedora-logo-icon" 2024-04-22T07:11:10.418 INFO:teuthology.orchestra.run.smithi196.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-22T07:11:10.418 INFO:teuthology.orchestra.run.smithi196.stdout:HOME_URL="https://centos.org/" 2024-04-22T07:11:10.418 INFO:teuthology.orchestra.run.smithi196.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-22T07:11:10.418 INFO:teuthology.orchestra.run.smithi196.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-22T07:11:10.418 INFO:teuthology.orchestra.run.smithi196.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-22T07:11:10.418 INFO:teuthology.lock.ops:Updating smithi196.front.sepia.ceph.com on lock server 2024-04-22T07:11:10.451 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-04-22T07:11:10.461 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-04-22T07:11:10.472 INFO:teuthology.task.internal:Checking for old test directory... 2024-04-22T07:11:10.473 DEBUG:teuthology.orchestra.run.smithi037:> test '!' -e /home/ubuntu/cephtest 2024-04-22T07:11:10.475 DEBUG:teuthology.orchestra.run.smithi196:> test '!' -e /home/ubuntu/cephtest 2024-04-22T07:11:10.491 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-04-22T07:11:10.498 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-04-22T07:11:10.498 DEBUG:teuthology.orchestra.run.smithi037:> test -z $(ls -A /var/lib/ceph) 2024-04-22T07:11:10.533 DEBUG:teuthology.orchestra.run.smithi196:> test -z $(ls -A /var/lib/ceph) 2024-04-22T07:11:10.771 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-04-22T07:11:10.887 INFO:teuthology.run_tasks:Running task kernel... 2024-04-22T07:11:10.902 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'} 2024-04-22T07:11:10.902 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}} 2024-04-22T07:11:10.902 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}}, timeout 300 2024-04-22T07:11:10.903 DEBUG:teuthology.orchestra.run.smithi037:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-22T07:11:10.920 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-22T07:11:10.920 DEBUG:teuthology.orchestra.run.smithi037:> uname -r 2024-04-22T07:11:10.978 INFO:teuthology.orchestra.run.smithi037.stdout:5.14.0-437.el9.x86_64 2024-04-22T07:11:10.978 INFO:teuthology.task.kernel:Running kernel on smithi037: 5.14.0-437.el9.x86_64 2024-04-22T07:11:10.978 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum install -y kernel 2024-04-22T07:11:13.168 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS Stream 9 - BaseOS 13 MB/s | 8.0 MB 00:00 2024-04-22T07:11:15.070 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS Stream 9 - AppStream 24 MB/s | 19 MB 00:00 2024-04-22T07:11:19.228 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS Stream 9 - CRB 13 MB/s | 6.2 MB 00:00 2024-04-22T07:11:20.862 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS Stream 9 - Extras packages 37 kB/s | 16 kB 00:00 2024-04-22T07:11:40.504 INFO:teuthology.orchestra.run.smithi037.stdout:Extra Packages for Enterprise Linux 1.1 MB/s | 21 MB 00:19 2024-04-22T07:11:45.678 INFO:teuthology.orchestra.run.smithi037.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-04-22T07:11:47.668 INFO:teuthology.orchestra.run.smithi037.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-04-22T07:11:47.669 INFO:teuthology.orchestra.run.smithi037.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-04-22T07:11:47.749 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2024-04-22T07:11:47.750 INFO:teuthology.orchestra.run.smithi037.stdout:Nothing to do. 2024-04-22T07:11:47.750 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2024-04-22T07:11:47.855 DEBUG:teuthology.orchestra.run.smithi037:> echo no | sudo yum reinstall kernel || true 2024-04-22T07:11:48.375 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:00:03 ago on Mon 22 Apr 2024 07:11:45 AM UTC. 2024-04-22T07:11:48.499 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2024-04-22T07:11:48.520 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-04-22T07:11:48.520 INFO:teuthology.orchestra.run.smithi037.stdout: Package Architecture Version Repository Size 2024-04-22T07:11:48.520 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-04-22T07:11:48.520 INFO:teuthology.orchestra.run.smithi037.stdout:Reinstalling: 2024-04-22T07:11:48.520 INFO:teuthology.orchestra.run.smithi037.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-22T07:11:48.520 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-22T07:11:48.520 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction Summary 2024-04-22T07:11:48.520 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-04-22T07:11:48.521 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-22T07:11:48.521 INFO:teuthology.orchestra.run.smithi037.stdout:Total download size: 255 k 2024-04-22T07:11:48.521 INFO:teuthology.orchestra.run.smithi037.stdout:Installed size: 0 2024-04-22T07:11:48.521 INFO:teuthology.orchestra.run.smithi037.stderr:Operation aborted. 2024-04-22T07:11:48.585 INFO:teuthology.orchestra.run.smithi037.stdout:Is this ok [y/N]: 2024-04-22T07:11:48.585 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum reinstall -y kernel || true 2024-04-22T07:11:49.096 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:00:04 ago on Mon 22 Apr 2024 07:11:45 AM UTC. 2024-04-22T07:11:49.217 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2024-04-22T07:11:49.217 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-04-22T07:11:49.217 INFO:teuthology.orchestra.run.smithi037.stdout: Package Architecture Version Repository Size 2024-04-22T07:11:49.217 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-04-22T07:11:49.217 INFO:teuthology.orchestra.run.smithi037.stdout:Reinstalling: 2024-04-22T07:11:49.217 INFO:teuthology.orchestra.run.smithi037.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-22T07:11:49.218 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-22T07:11:49.218 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction Summary 2024-04-22T07:11:49.218 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-04-22T07:11:49.218 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-22T07:11:49.218 INFO:teuthology.orchestra.run.smithi037.stdout:Total download size: 255 k 2024-04-22T07:11:49.218 INFO:teuthology.orchestra.run.smithi037.stdout:Installed size: 0 2024-04-22T07:11:49.218 INFO:teuthology.orchestra.run.smithi037.stdout:Downloading Packages: 2024-04-22T07:11:50.031 INFO:teuthology.orchestra.run.smithi037.stdout:kernel-5.14.0-437.el9.x86_64.rpm 501 kB/s | 255 kB 00:00 2024-04-22T07:11:50.031 INFO:teuthology.orchestra.run.smithi037.stdout:-------------------------------------------------------------------------------- 2024-04-22T07:11:50.031 INFO:teuthology.orchestra.run.smithi037.stdout:Total 314 kB/s | 255 kB 00:00 2024-04-22T07:11:50.051 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction check 2024-04-22T07:11:50.246 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction check succeeded. 2024-04-22T07:11:50.247 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction test 2024-04-22T07:11:50.252 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction test succeeded. 2024-04-22T07:11:50.252 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction 2024-04-22T07:11:50.387 INFO:teuthology.orchestra.run.smithi037.stdout: Preparing : 1/1 2024-04-22T07:11:50.456 INFO:teuthology.orchestra.run.smithi037.stdout: Reinstalling : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-22T07:11:50.457 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-22T07:11:51.214 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: kernel-5.14.0-437.el9.x86_64 2/2 2024-04-22T07:11:51.215 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-22T07:11:51.928 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-22T07:11:51.928 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-22T07:11:51.928 INFO:teuthology.orchestra.run.smithi037.stdout:Reinstalled: 2024-04-22T07:11:51.929 INFO:teuthology.orchestra.run.smithi037.stdout: kernel-5.14.0-437.el9.x86_64 2024-04-22T07:11:51.929 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-22T07:11:51.929 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2024-04-22T07:11:52.094 DEBUG:teuthology.orchestra.run.smithi037:> rpm -q kernel | sort -rV | head -n 1 2024-04-22T07:11:52.141 INFO:teuthology.orchestra.run.smithi037.stdout:kernel-5.14.0-437.el9.x86_64 2024-04-22T07:11:52.142 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-437.el9.x86_64 2024-04-22T07:11:52.142 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2024-04-22T07:11:52.143 DEBUG:teuthology.parallel:result is None 2024-04-22T07:11:52.143 INFO:teuthology.run_tasks:Running task internal.base... 2024-04-22T07:11:52.151 INFO:teuthology.task.internal:Creating test directory... 2024-04-22T07:11:52.151 DEBUG:teuthology.orchestra.run.smithi037:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-22T07:11:52.153 DEBUG:teuthology.orchestra.run.smithi196:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-22T07:11:52.171 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-04-22T07:11:52.178 INFO:teuthology.run_tasks:Running task internal.archive... 2024-04-22T07:11:52.188 INFO:teuthology.task.internal:Creating archive directory... 2024-04-22T07:11:52.188 DEBUG:teuthology.orchestra.run.smithi037:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-22T07:11:52.209 DEBUG:teuthology.orchestra.run.smithi196:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-22T07:11:52.251 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-04-22T07:11:52.259 INFO:teuthology.task.internal:Enabling coredump saving... 2024-04-22T07:11:52.259 DEBUG:teuthology.orchestra.run.smithi196:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-22T07:11:52.301 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-22T07:11:52.302 DEBUG:teuthology.orchestra.run.smithi037:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-22T07:11:52.304 DEBUG:teuthology.orchestra.run.smithi196:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-22T07:11:52.375 INFO:teuthology.orchestra.run.smithi196.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-22T07:11:52.411 INFO:teuthology.orchestra.run.smithi196.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-22T07:11:52.451 INFO:teuthology.orchestra.run.smithi037.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-22T07:11:52.470 INFO:teuthology.orchestra.run.smithi037.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-22T07:11:52.472 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-04-22T07:11:52.479 INFO:teuthology.task.internal:Configuring sudo... 2024-04-22T07:11:52.479 DEBUG:teuthology.orchestra.run.smithi037:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-22T07:11:52.481 DEBUG:teuthology.orchestra.run.smithi196:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-22T07:11:52.509 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-04-22T07:11:52.518 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-04-22T07:11:52.518 DEBUG:teuthology.orchestra.run.smithi037:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-22T07:11:52.547 DEBUG:teuthology.orchestra.run.smithi196:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-22T07:11:52.567 DEBUG:teuthology.orchestra.run.smithi037:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-22T07:11:52.648 DEBUG:teuthology.orchestra.run.smithi037:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-22T07:11:52.688 DEBUG:teuthology.orchestra.run.smithi037:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-22T07:11:52.776 DEBUG:teuthology.orchestra.run.smithi037:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-22T07:11:52.809 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-04-22T07:11:52.810 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-22T07:11:52.873 DEBUG:teuthology.orchestra.run.smithi196:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-22T07:11:52.926 DEBUG:teuthology.orchestra.run.smithi196:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-22T07:11:52.969 DEBUG:teuthology.orchestra.run.smithi196:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-22T07:11:53.062 DEBUG:teuthology.orchestra.run.smithi196:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-22T07:11:53.094 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-04-22T07:11:53.094 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-22T07:11:53.160 DEBUG:teuthology.orchestra.run.smithi037:> sudo service rsyslog restart 2024-04-22T07:11:53.162 DEBUG:teuthology.orchestra.run.smithi196:> sudo service rsyslog restart 2024-04-22T07:11:53.195 INFO:teuthology.orchestra.run.smithi037.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-22T07:11:53.238 INFO:teuthology.orchestra.run.smithi196.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-22T07:11:53.677 INFO:teuthology.run_tasks:Running task internal.timer... 2024-04-22T07:11:53.686 INFO:teuthology.task.internal:Starting timer... 2024-04-22T07:11:53.686 INFO:teuthology.run_tasks:Running task pcp... 2024-04-22T07:11:53.696 INFO:teuthology.run_tasks:Running task selinux... 2024-04-22T07:11:53.705 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2024-04-22T07:11:53.705 DEBUG:teuthology.orchestra.run.smithi037:> sudo service auditd rotate 2024-04-22T07:11:53.775 INFO:teuthology.orchestra.run.smithi037.stdout:Rotating logs: 2024-04-22T07:11:53.777 DEBUG:teuthology.orchestra.run.smithi196:> sudo service auditd rotate 2024-04-22T07:11:53.826 INFO:teuthology.orchestra.run.smithi196.stdout:Rotating logs: 2024-04-22T07:11:53.828 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-04-22T07:11:53.828 DEBUG:teuthology.orchestra.run.smithi037:> /usr/sbin/getenforce 2024-04-22T07:11:53.846 INFO:teuthology.orchestra.run.smithi037.stdout:Permissive 2024-04-22T07:11:53.846 DEBUG:teuthology.orchestra.run.smithi196:> /usr/sbin/getenforce 2024-04-22T07:11:53.868 INFO:teuthology.orchestra.run.smithi196.stdout:Permissive 2024-04-22T07:11:53.868 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi037.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi196.front.sepia.ceph.com': 'permissive'} 2024-04-22T07:11:53.868 DEBUG:teuthology.orchestra.run.smithi037:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-22T07:11:53.911 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-22T07:11:53.911 DEBUG:teuthology.orchestra.run.smithi196:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-22T07:11:53.936 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-22T07:11:53.936 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-04-22T07:11:53.936 DEBUG:teuthology.orchestra.run.smithi037:> sudo /usr/sbin/setenforce permissive 2024-04-22T07:11:53.977 DEBUG:teuthology.orchestra.run.smithi196:> sudo /usr/sbin/setenforce permissive 2024-04-22T07:11:54.012 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-04-22T07:11:54.023 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-04-22T07:11:54.054 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-04-22T07:11:54.069 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi037.front.sepia.ceph.com,smithi196.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-04-22T07:15:48.342 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi037.front.sepia.ceph.com'), Remote(name='ubuntu@smithi196.front.sepia.ceph.com')] 2024-04-22T07:15:48.343 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi037.front.sepia.ceph.com' 2024-04-22T07:15:48.344 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-22T07:15:48.432 DEBUG:teuthology.orchestra.run.smithi037:> true 2024-04-22T07:15:48.515 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi037.front.sepia.ceph.com' 2024-04-22T07:15:48.515 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi196.front.sepia.ceph.com' 2024-04-22T07:15:48.516 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-22T07:15:48.603 DEBUG:teuthology.orchestra.run.smithi196:> true 2024-04-22T07:15:48.682 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi196.front.sepia.ceph.com' 2024-04-22T07:15:48.682 INFO:teuthology.run_tasks:Running task clock... 2024-04-22T07:15:48.693 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-04-22T07:15:48.693 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-22T07:15:48.693 DEBUG:teuthology.orchestra.run.smithi037:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-22T07:15:48.696 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-22T07:15:48.696 DEBUG:teuthology.orchestra.run.smithi196:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-22T07:15:48.725 INFO:teuthology.orchestra.run.smithi037.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-22T07:15:48.739 INFO:teuthology.orchestra.run.smithi037.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-22T07:15:48.751 INFO:teuthology.orchestra.run.smithi196.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-22T07:15:48.765 INFO:teuthology.orchestra.run.smithi037.stderr:sudo: ntpd: command not found 2024-04-22T07:15:48.765 INFO:teuthology.orchestra.run.smithi196.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-22T07:15:48.776 INFO:teuthology.orchestra.run.smithi037.stdout:506 Cannot talk to daemon 2024-04-22T07:15:48.788 INFO:teuthology.orchestra.run.smithi196.stderr:sudo: ntpd: command not found 2024-04-22T07:15:48.791 INFO:teuthology.orchestra.run.smithi037.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-22T07:15:48.799 INFO:teuthology.orchestra.run.smithi196.stdout:506 Cannot talk to daemon 2024-04-22T07:15:48.804 INFO:teuthology.orchestra.run.smithi037.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-22T07:15:48.812 INFO:teuthology.orchestra.run.smithi196.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-22T07:15:48.825 INFO:teuthology.orchestra.run.smithi196.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-22T07:15:48.861 INFO:teuthology.orchestra.run.smithi037.stderr:bash: line 1: ntpq: command not found 2024-04-22T07:15:48.865 INFO:teuthology.orchestra.run.smithi037.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-22T07:15:48.865 INFO:teuthology.orchestra.run.smithi037.stdout:=============================================================================== 2024-04-22T07:15:48.865 INFO:teuthology.orchestra.run.smithi037.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-22T07:15:48.865 INFO:teuthology.orchestra.run.smithi037.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-22T07:15:48.865 INFO:teuthology.orchestra.run.smithi037.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-22T07:15:48.865 INFO:teuthology.orchestra.run.smithi037.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-22T07:15:48.880 INFO:teuthology.orchestra.run.smithi196.stderr:bash: line 1: ntpq: command not found 2024-04-22T07:15:48.883 INFO:teuthology.orchestra.run.smithi196.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-22T07:15:48.883 INFO:teuthology.orchestra.run.smithi196.stdout:=============================================================================== 2024-04-22T07:15:48.883 INFO:teuthology.orchestra.run.smithi196.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-22T07:15:48.883 INFO:teuthology.orchestra.run.smithi196.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-22T07:15:48.883 INFO:teuthology.orchestra.run.smithi196.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-22T07:15:48.883 INFO:teuthology.orchestra.run.smithi196.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-22T07:15:48.884 INFO:teuthology.run_tasks:Running task install... 2024-04-22T07:15:48.893 DEBUG:teuthology.task.install:project ceph 2024-04-22T07:15:48.893 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '86f7587a5a09af35f0895e1a2d08527638fae697'}} 2024-04-22T07:15:48.893 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '86f7587a5a09af35f0895e1a2d08527638fae697'} 2024-04-22T07:15:48.893 INFO:teuthology.task.install:Using flavor: default 2024-04-22T07:15:48.899 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-04-22T07:15:48.899 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-04-22T07:15:48.899 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '86f7587a5a09af35f0895e1a2d08527638fae697', 'tag': None, 'wait_for_package': False} 2024-04-22T07:15:48.900 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=86f7587a5a09af35f0895e1a2d08527638fae697 2024-04-22T07:15:48.901 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '86f7587a5a09af35f0895e1a2d08527638fae697', 'tag': None, 'wait_for_package': False} 2024-04-22T07:15:48.901 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=86f7587a5a09af35f0895e1a2d08527638fae697 2024-04-22T07:15:49.059 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-lusov-quiescer/86f7587a5a09af35f0895e1a2d08527638fae697/centos/9/flavors/default/ 2024-04-22T07:15:49.059 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3156.g86f7587a 2024-04-22T07:15:49.070 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-lusov-quiescer/86f7587a5a09af35f0895e1a2d08527638fae697/centos/9/flavors/default/ 2024-04-22T07:15:49.070 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3156.g86f7587a 2024-04-22T07:15:49.187 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-lusov-quiescer/86f7587a5a09af35f0895e1a2d08527638fae697/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-lusov-quiescer/86f7587a5a09af35f0895e1a2d08527638fae697/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-lusov-quiescer/86f7587a5a09af35f0895e1a2d08527638fae697/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-22T07:15:49.187 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-04-22T07:15:49.187 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-22T07:15:49.213 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-04-22T07:15:49.213 DEBUG:teuthology.orchestra.run.smithi196:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/86f7587a5a09af35f0895e1a2d08527638fae697/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-22T07:15:49.251 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-lusov-quiescer/86f7587a5a09af35f0895e1a2d08527638fae697/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-lusov-quiescer/86f7587a5a09af35f0895e1a2d08527638fae697/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-lusov-quiescer/86f7587a5a09af35f0895e1a2d08527638fae697/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-22T07:15:49.251 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-04-22T07:15:49.251 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-22T07:15:49.277 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-04-22T07:15:49.277 DEBUG:teuthology.orchestra.run.smithi037:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/86f7587a5a09af35f0895e1a2d08527638fae697/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-22T07:15:49.279 DEBUG:teuthology.orchestra.run.smithi196:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-22T07:15:49.343 DEBUG:teuthology.orchestra.run.smithi037:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-22T07:15:49.352 DEBUG:teuthology.orchestra.run.smithi196:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-22T07:15:49.415 INFO:teuthology.orchestra.run.smithi196.stdout:check_obsoletes = 1 2024-04-22T07:15:49.417 DEBUG:teuthology.orchestra.run.smithi196:> sudo yum clean all 2024-04-22T07:15:49.418 DEBUG:teuthology.orchestra.run.smithi037:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-22T07:15:49.482 INFO:teuthology.orchestra.run.smithi037.stdout:check_obsoletes = 1 2024-04-22T07:15:49.484 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum clean all 2024-04-22T07:15:49.643 INFO:teuthology.orchestra.run.smithi196.stdout:48 files removed 2024-04-22T07:15:49.670 DEBUG:teuthology.orchestra.run.smithi196:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-04-22T07:15:49.718 INFO:teuthology.orchestra.run.smithi037.stdout:48 files removed 2024-04-22T07:15:49.745 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-04-22T07:15:50.400 INFO:teuthology.orchestra.run.smithi196.stdout:ceph packages for x86_64 178 kB/s | 83 kB 00:00 2024-04-22T07:15:50.424 INFO:teuthology.orchestra.run.smithi037.stdout:ceph packages for x86_64 206 kB/s | 83 kB 00:00 2024-04-22T07:15:50.792 INFO:teuthology.orchestra.run.smithi037.stdout:ceph noarch packages 36 kB/s | 12 kB 00:00 2024-04-22T07:15:50.817 INFO:teuthology.orchestra.run.smithi196.stdout:ceph noarch packages 31 kB/s | 12 kB 00:00 2024-04-22T07:15:51.209 INFO:teuthology.orchestra.run.smithi037.stdout:ceph source packages 4.9 kB/s | 1.9 kB 00:00 2024-04-22T07:15:51.251 INFO:teuthology.orchestra.run.smithi196.stdout:ceph source packages 4.7 kB/s | 1.9 kB 00:00 2024-04-22T07:15:51.809 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS Stream 9 - BaseOS 14 MB/s | 8.0 MB 00:00 2024-04-22T07:15:52.826 INFO:teuthology.orchestra.run.smithi196.stdout:CentOS Stream 9 - BaseOS 5.2 MB/s | 8.0 MB 00:01 2024-04-22T07:15:53.669 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS Stream 9 - AppStream 25 MB/s | 19 MB 00:00 2024-04-22T07:15:55.902 INFO:teuthology.orchestra.run.smithi196.stdout:CentOS Stream 9 - AppStream 9.3 MB/s | 19 MB 00:02 2024-04-22T07:15:59.295 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS Stream 9 - CRB 3.2 MB/s | 6.2 MB 00:01 2024-04-22T07:16:00.252 INFO:teuthology.orchestra.run.smithi196.stdout:CentOS Stream 9 - CRB 7.8 MB/s | 6.2 MB 00:00 2024-04-22T07:16:00.887 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS Stream 9 - Extras packages 40 kB/s | 16 kB 00:00 2024-04-22T07:16:01.979 INFO:teuthology.orchestra.run.smithi196.stdout:CentOS Stream 9 - Extras packages 29 kB/s | 16 kB 00:00 2024-04-22T07:16:04.205 INFO:teuthology.orchestra.run.smithi037.stdout:Extra Packages for Enterprise Linux 6.6 MB/s | 21 MB 00:03 2024-04-22T07:16:04.604 INFO:teuthology.orchestra.run.smithi196.stdout:Extra Packages for Enterprise Linux 8.3 MB/s | 21 MB 00:02 2024-04-22T07:16:09.430 INFO:teuthology.orchestra.run.smithi037.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-04-22T07:16:09.604 INFO:teuthology.orchestra.run.smithi196.stdout:lab-extras 26 kB/s | 1.7 kB 00:00 2024-04-22T07:16:11.631 INFO:teuthology.orchestra.run.smithi037.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-22T07:16:11.632 INFO:teuthology.orchestra.run.smithi037.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-22T07:16:11.643 INFO:teuthology.orchestra.run.smithi037.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-04-22T07:16:11.644 INFO:teuthology.orchestra.run.smithi037.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-04-22T07:16:11.645 INFO:teuthology.orchestra.run.smithi037.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-04-22T07:16:11.646 INFO:teuthology.orchestra.run.smithi037.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-04-22T07:16:11.647 INFO:teuthology.orchestra.run.smithi037.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-04-22T07:16:11.650 INFO:teuthology.orchestra.run.smithi037.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-04-22T07:16:11.650 INFO:teuthology.orchestra.run.smithi037.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-04-22T07:16:11.697 INFO:teuthology.orchestra.run.smithi196.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-22T07:16:11.697 INFO:teuthology.orchestra.run.smithi196.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-22T07:16:11.708 INFO:teuthology.orchestra.run.smithi196.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-04-22T07:16:11.709 INFO:teuthology.orchestra.run.smithi196.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-04-22T07:16:11.710 INFO:teuthology.orchestra.run.smithi196.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-04-22T07:16:11.711 INFO:teuthology.orchestra.run.smithi196.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-04-22T07:16:11.713 INFO:teuthology.orchestra.run.smithi196.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-04-22T07:16:11.715 INFO:teuthology.orchestra.run.smithi196.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-04-22T07:16:11.716 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2024-04-22T07:16:11.717 INFO:teuthology.orchestra.run.smithi196.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-04-22T07:16:11.725 INFO:teuthology.orchestra.run.smithi037.stdout:======================================================================================= 2024-04-22T07:16:11.725 INFO:teuthology.orchestra.run.smithi037.stdout: Package Arch Version Repository Size 2024-04-22T07:16:11.725 INFO:teuthology.orchestra.run.smithi037.stdout:======================================================================================= 2024-04-22T07:16:11.725 INFO:teuthology.orchestra.run.smithi037.stdout:Installing: 2024-04-22T07:16:11.726 INFO:teuthology.orchestra.run.smithi037.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-04-22T07:16:11.726 INFO:teuthology.orchestra.run.smithi037.stdout: ceph x86_64 2:19.0.0-3156.g86f7587a.el9 ceph 6.6 k 2024-04-22T07:16:11.726 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-base x86_64 2:19.0.0-3156.g86f7587a.el9 ceph 5.4 M 2024-04-22T07:16:11.726 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-fuse x86_64 2:19.0.0-3156.g86f7587a.el9 ceph 890 k 2024-04-22T07:16:11.726 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3156.g86f7587a.el9 ceph 145 k 2024-04-22T07:16:11.726 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr x86_64 2:19.0.0-3156.g86f7587a.el9 ceph 1.5 M 2024-04-22T07:16:11.726 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3156.g86f7587a.el9 ceph-noarch 142 k 2024-04-22T07:16:11.727 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3156.g86f7587a.el9 ceph-noarch 3.5 M 2024-04-22T07:16:11.727 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3156.g86f7587a.el9 ceph-noarch 7.4 M 2024-04-22T07:16:11.727 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-rook noarch 2:19.0.0-3156.g86f7587a.el9 ceph-noarch 49 k 2024-04-22T07:16:11.727 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-radosgw x86_64 2:19.0.0-3156.g86f7587a.el9 ceph 11 M 2024-04-22T07:16:11.727 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-test x86_64 2:19.0.0-3156.g86f7587a.el9 ceph 49 M 2024-04-22T07:16:11.727 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-volume noarch 2:19.0.0-3156.g86f7587a.el9 ceph-noarch 273 k 2024-04-22T07:16:11.727 INFO:teuthology.orchestra.run.smithi037.stdout: cephadm noarch 2:19.0.0-3156.g86f7587a.el9 ceph-noarch 763 k 2024-04-22T07:16:11.727 INFO:teuthology.orchestra.run.smithi037.stdout: cephfs-mirror x86_64 2:19.0.0-3156.g86f7587a.el9 ceph 225 k 2024-04-22T07:16:11.728 INFO:teuthology.orchestra.run.smithi037.stdout: cephfs-shell x86_64 2:19.0.0-3156.g86f7587a.el9 ceph 27 k 2024-04-22T07:16:11.728 INFO:teuthology.orchestra.run.smithi037.stdout: cephfs-top noarch 2:19.0.0-3156.g86f7587a.el9 ceph-noarch 18 k 2024-04-22T07:16:11.728 INFO:teuthology.orchestra.run.smithi037.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-04-22T07:16:11.728 INFO:teuthology.orchestra.run.smithi037.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-04-22T07:16:11.728 INFO:teuthology.orchestra.run.smithi037.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-04-22T07:16:11.728 INFO:teuthology.orchestra.run.smithi037.stdout: libcephfs-devel x86_64 2:19.0.0-3156.g86f7587a.el9 ceph 32 k 2024-04-22T07:16:11.728 INFO:teuthology.orchestra.run.smithi037.stdout: libcephfs2 x86_64 2:19.0.0-3156.g86f7587a.el9 ceph 747 k 2024-04-22T07:16:11.728 INFO:teuthology.orchestra.run.smithi037.stdout: librados-devel x86_64 2:19.0.0-3156.g86f7587a.el9 ceph 127 k 2024-04-22T07:16:11.728 INFO:teuthology.orchestra.run.smithi037.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-04-22T07:16:11.728 INFO:teuthology.orchestra.run.smithi037.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-04-22T07:16:11.728 INFO:teuthology.orchestra.run.smithi037.stdout: openssl-devel x86_64 1:3.0.7-27.el9 appstream 4.1 M 2024-04-22T07:16:11.729 INFO:teuthology.orchestra.run.smithi037.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-04-22T07:16:11.729 INFO:teuthology.orchestra.run.smithi037.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-04-22T07:16:11.729 INFO:teuthology.orchestra.run.smithi037.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-04-22T07:16:11.729 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cephfs x86_64 2:19.0.0-3156.g86f7587a.el9 ceph 162 k 2024-04-22T07:16:11.729 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rados x86_64 2:19.0.0-3156.g86f7587a.el9 ceph 320 k 2024-04-22T07:16:11.729 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rbd x86_64 2:19.0.0-3156.g86f7587a.el9 ceph 298 k 2024-04-22T07:16:11.729 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rgw x86_64 2:19.0.0-3156.g86f7587a.el9 ceph 100 k 2024-04-22T07:16:11.729 INFO:teuthology.orchestra.run.smithi037.stdout: rbd-fuse x86_64 2:19.0.0-3156.g86f7587a.el9 ceph 85 k 2024-04-22T07:16:11.729 INFO:teuthology.orchestra.run.smithi037.stdout: rbd-mirror x86_64 2:19.0.0-3156.g86f7587a.el9 ceph 3.1 M 2024-04-22T07:16:11.729 INFO:teuthology.orchestra.run.smithi037.stdout: rbd-nbd x86_64 2:19.0.0-3156.g86f7587a.el9 ceph 171 k 2024-04-22T07:16:11.729 INFO:teuthology.orchestra.run.smithi037.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-04-22T07:16:11.729 INFO:teuthology.orchestra.run.smithi037.stdout:Upgrading: 2024-04-22T07:16:11.729 INFO:teuthology.orchestra.run.smithi037.stdout: librados2 x86_64 2:19.0.0-3156.g86f7587a.el9 ceph 3.4 M 2024-04-22T07:16:11.729 INFO:teuthology.orchestra.run.smithi037.stdout: librbd1 x86_64 2:19.0.0-3156.g86f7587a.el9 ceph 3.1 M 2024-04-22T07:16:11.730 INFO:teuthology.orchestra.run.smithi037.stdout:Installing dependencies: 2024-04-22T07:16:11.730 INFO:teuthology.orchestra.run.smithi037.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-04-22T07:16:11.730 INFO:teuthology.orchestra.run.smithi037.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-04-22T07:16:11.730 INFO:teuthology.orchestra.run.smithi037.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-04-22T07:16:11.730 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-common x86_64 2:19.0.0-3156.g86f7587a.el9 ceph 21 M 2024-04-22T07:16:11.730 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3156.g86f7587a.el9 ceph-noarch 34 k 2024-04-22T07:16:11.730 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mds x86_64 2:19.0.0-3156.g86f7587a.el9 ceph 2.4 M 2024-04-22T07:16:11.730 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3156.g86f7587a.el9 ceph-noarch 249 k 2024-04-22T07:16:11.730 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mon x86_64 2:19.0.0-3156.g86f7587a.el9 ceph 4.7 M 2024-04-22T07:16:11.730 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-osd x86_64 2:19.0.0-3156.g86f7587a.el9 ceph 17 M 2024-04-22T07:16:11.730 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3156.g86f7587a.el9 ceph-noarch 16 k 2024-04-22T07:16:11.730 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-selinux x86_64 2:19.0.0-3156.g86f7587a.el9 ceph 25 k 2024-04-22T07:16:11.730 INFO:teuthology.orchestra.run.smithi037.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-04-22T07:16:11.731 INFO:teuthology.orchestra.run.smithi037.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-04-22T07:16:11.731 INFO:teuthology.orchestra.run.smithi037.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-04-22T07:16:11.731 INFO:teuthology.orchestra.run.smithi037.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-04-22T07:16:11.731 INFO:teuthology.orchestra.run.smithi037.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-22T07:16:11.731 INFO:teuthology.orchestra.run.smithi037.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-04-22T07:16:11.731 INFO:teuthology.orchestra.run.smithi037.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-04-22T07:16:11.731 INFO:teuthology.orchestra.run.smithi037.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-04-22T07:16:11.731 INFO:teuthology.orchestra.run.smithi037.stdout: libcephsqlite x86_64 2:19.0.0-3156.g86f7587a.el9 ceph 164 k 2024-04-22T07:16:11.731 INFO:teuthology.orchestra.run.smithi037.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-22T07:16:11.731 INFO:teuthology.orchestra.run.smithi037.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-22T07:16:11.731 INFO:teuthology.orchestra.run.smithi037.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-04-22T07:16:11.731 INFO:teuthology.orchestra.run.smithi037.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-22T07:16:11.731 INFO:teuthology.orchestra.run.smithi037.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-04-22T07:16:11.732 INFO:teuthology.orchestra.run.smithi037.stdout: libradosstriper1 x86_64 2:19.0.0-3156.g86f7587a.el9 ceph 500 k 2024-04-22T07:16:11.732 INFO:teuthology.orchestra.run.smithi037.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-04-22T07:16:11.732 INFO:teuthology.orchestra.run.smithi037.stdout: librgw2 x86_64 2:19.0.0-3156.g86f7587a.el9 ceph 5.4 M 2024-04-22T07:16:11.732 INFO:teuthology.orchestra.run.smithi037.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-22T07:16:11.732 INFO:teuthology.orchestra.run.smithi037.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-04-22T07:16:11.732 INFO:teuthology.orchestra.run.smithi037.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-04-22T07:16:11.732 INFO:teuthology.orchestra.run.smithi037.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-04-22T07:16:11.732 INFO:teuthology.orchestra.run.smithi037.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-04-22T07:16:11.732 INFO:teuthology.orchestra.run.smithi037.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-04-22T07:16:11.732 INFO:teuthology.orchestra.run.smithi037.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-04-22T07:16:11.732 INFO:teuthology.orchestra.run.smithi037.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-04-22T07:16:11.732 INFO:teuthology.orchestra.run.smithi037.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-04-22T07:16:11.732 INFO:teuthology.orchestra.run.smithi037.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-04-22T07:16:11.733 INFO:teuthology.orchestra.run.smithi037.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-04-22T07:16:11.733 INFO:teuthology.orchestra.run.smithi037.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-04-22T07:16:11.733 INFO:teuthology.orchestra.run.smithi037.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-22T07:16:11.733 INFO:teuthology.orchestra.run.smithi037.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-04-22T07:16:11.733 INFO:teuthology.orchestra.run.smithi037.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-04-22T07:16:11.733 INFO:teuthology.orchestra.run.smithi037.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-22T07:16:11.733 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-22T07:16:11.733 INFO:teuthology.orchestra.run.smithi037.stdout: python3-ceph-argparse x86_64 2:19.0.0-3156.g86f7587a.el9 ceph 45 k 2024-04-22T07:16:11.733 INFO:teuthology.orchestra.run.smithi037.stdout: python3-ceph-common x86_64 2:19.0.0-3156.g86f7587a.el9 ceph 135 k 2024-04-22T07:16:11.733 INFO:teuthology.orchestra.run.smithi037.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-22T07:16:11.733 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-04-22T07:16:11.733 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-22T07:16:11.733 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-22T07:16:11.733 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-04-22T07:16:11.734 INFO:teuthology.orchestra.run.smithi037.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-04-22T07:16:11.734 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-04-22T07:16:11.734 INFO:teuthology.orchestra.run.smithi037.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-04-22T07:16:11.734 INFO:teuthology.orchestra.run.smithi037.stdout: python3-google-auth noarch 1:2.28.2-1.el9 epel 203 k 2024-04-22T07:16:11.734 INFO:teuthology.orchestra.run.smithi037.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-04-22T07:16:11.734 INFO:teuthology.orchestra.run.smithi037.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-04-22T07:16:11.734 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-22T07:16:11.734 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-22T07:16:11.734 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-22T07:16:11.734 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-22T07:16:11.734 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-22T07:16:11.734 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-22T07:16:11.735 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-04-22T07:16:11.735 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-04-22T07:16:11.735 INFO:teuthology.orchestra.run.smithi037.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-22T07:16:11.735 INFO:teuthology.orchestra.run.smithi037.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-22T07:16:11.735 INFO:teuthology.orchestra.run.smithi037.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-04-22T07:16:11.735 INFO:teuthology.orchestra.run.smithi037.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-04-22T07:16:11.735 INFO:teuthology.orchestra.run.smithi037.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-22T07:16:11.735 INFO:teuthology.orchestra.run.smithi037.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-22T07:16:11.735 INFO:teuthology.orchestra.run.smithi037.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-04-22T07:16:11.735 INFO:teuthology.orchestra.run.smithi037.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-04-22T07:16:11.735 INFO:teuthology.orchestra.run.smithi037.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-04-22T07:16:11.735 INFO:teuthology.orchestra.run.smithi037.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-04-22T07:16:11.735 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-22T07:16:11.736 INFO:teuthology.orchestra.run.smithi037.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-04-22T07:16:11.736 INFO:teuthology.orchestra.run.smithi037.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-22T07:16:11.736 INFO:teuthology.orchestra.run.smithi037.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-04-22T07:16:11.736 INFO:teuthology.orchestra.run.smithi037.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-04-22T07:16:11.736 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-22T07:16:11.736 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-04-22T07:16:11.736 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-04-22T07:16:11.736 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-04-22T07:16:11.736 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-04-22T07:16:11.736 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-04-22T07:16:11.736 INFO:teuthology.orchestra.run.smithi037.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-22T07:16:11.736 INFO:teuthology.orchestra.run.smithi037.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-22T07:16:11.736 INFO:teuthology.orchestra.run.smithi037.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-04-22T07:16:11.736 INFO:teuthology.orchestra.run.smithi037.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-22T07:16:11.736 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-22T07:16:11.737 INFO:teuthology.orchestra.run.smithi037.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-04-22T07:16:11.737 INFO:teuthology.orchestra.run.smithi037.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-22T07:16:11.737 INFO:teuthology.orchestra.run.smithi037.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-04-22T07:16:11.737 INFO:teuthology.orchestra.run.smithi037.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-22T07:16:11.737 INFO:teuthology.orchestra.run.smithi037.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-04-22T07:16:11.737 INFO:teuthology.orchestra.run.smithi037.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-04-22T07:16:11.737 INFO:teuthology.orchestra.run.smithi037.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-22T07:16:11.737 INFO:teuthology.orchestra.run.smithi037.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-22T07:16:11.737 INFO:teuthology.orchestra.run.smithi037.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-22T07:16:11.737 INFO:teuthology.orchestra.run.smithi037.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-22T07:16:11.737 INFO:teuthology.orchestra.run.smithi037.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-04-22T07:16:11.737 INFO:teuthology.orchestra.run.smithi037.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-04-22T07:16:11.737 INFO:teuthology.orchestra.run.smithi037.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-22T07:16:11.737 INFO:teuthology.orchestra.run.smithi037.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-04-22T07:16:11.738 INFO:teuthology.orchestra.run.smithi037.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-22T07:16:11.738 INFO:teuthology.orchestra.run.smithi037.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-04-22T07:16:11.738 INFO:teuthology.orchestra.run.smithi037.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-04-22T07:16:11.738 INFO:teuthology.orchestra.run.smithi037.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-04-22T07:16:11.738 INFO:teuthology.orchestra.run.smithi037.stdout:Installing weak dependencies: 2024-04-22T07:16:11.738 INFO:teuthology.orchestra.run.smithi037.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-04-22T07:16:11.738 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-22T07:16:11.738 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction Summary 2024-04-22T07:16:11.738 INFO:teuthology.orchestra.run.smithi037.stdout:======================================================================================= 2024-04-22T07:16:11.738 INFO:teuthology.orchestra.run.smithi037.stdout:Install 148 Packages 2024-04-22T07:16:11.738 INFO:teuthology.orchestra.run.smithi037.stdout:Upgrade 2 Packages 2024-04-22T07:16:11.738 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-22T07:16:11.739 INFO:teuthology.orchestra.run.smithi037.stdout:Total download size: 218 M 2024-04-22T07:16:11.739 INFO:teuthology.orchestra.run.smithi037.stdout:Downloading Packages: 2024-04-22T07:16:11.775 INFO:teuthology.orchestra.run.smithi196.stdout:Dependencies resolved. 2024-04-22T07:16:11.790 INFO:teuthology.orchestra.run.smithi196.stdout:======================================================================================= 2024-04-22T07:16:11.790 INFO:teuthology.orchestra.run.smithi196.stdout: Package Arch Version Repository Size 2024-04-22T07:16:11.790 INFO:teuthology.orchestra.run.smithi196.stdout:======================================================================================= 2024-04-22T07:16:11.790 INFO:teuthology.orchestra.run.smithi196.stdout:Installing: 2024-04-22T07:16:11.790 INFO:teuthology.orchestra.run.smithi196.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-04-22T07:16:11.790 INFO:teuthology.orchestra.run.smithi196.stdout: ceph x86_64 2:19.0.0-3156.g86f7587a.el9 ceph 6.6 k 2024-04-22T07:16:11.790 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-base x86_64 2:19.0.0-3156.g86f7587a.el9 ceph 5.4 M 2024-04-22T07:16:11.790 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-fuse x86_64 2:19.0.0-3156.g86f7587a.el9 ceph 890 k 2024-04-22T07:16:11.790 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3156.g86f7587a.el9 ceph 145 k 2024-04-22T07:16:11.790 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mgr x86_64 2:19.0.0-3156.g86f7587a.el9 ceph 1.5 M 2024-04-22T07:16:11.791 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3156.g86f7587a.el9 ceph-noarch 142 k 2024-04-22T07:16:11.791 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3156.g86f7587a.el9 ceph-noarch 3.5 M 2024-04-22T07:16:11.791 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3156.g86f7587a.el9 ceph-noarch 7.4 M 2024-04-22T07:16:11.791 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mgr-rook noarch 2:19.0.0-3156.g86f7587a.el9 ceph-noarch 49 k 2024-04-22T07:16:11.791 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-radosgw x86_64 2:19.0.0-3156.g86f7587a.el9 ceph 11 M 2024-04-22T07:16:11.791 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-test x86_64 2:19.0.0-3156.g86f7587a.el9 ceph 49 M 2024-04-22T07:16:11.791 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-volume noarch 2:19.0.0-3156.g86f7587a.el9 ceph-noarch 273 k 2024-04-22T07:16:11.791 INFO:teuthology.orchestra.run.smithi196.stdout: cephadm noarch 2:19.0.0-3156.g86f7587a.el9 ceph-noarch 763 k 2024-04-22T07:16:11.791 INFO:teuthology.orchestra.run.smithi196.stdout: cephfs-mirror x86_64 2:19.0.0-3156.g86f7587a.el9 ceph 225 k 2024-04-22T07:16:11.791 INFO:teuthology.orchestra.run.smithi196.stdout: cephfs-shell x86_64 2:19.0.0-3156.g86f7587a.el9 ceph 27 k 2024-04-22T07:16:11.791 INFO:teuthology.orchestra.run.smithi196.stdout: cephfs-top noarch 2:19.0.0-3156.g86f7587a.el9 ceph-noarch 18 k 2024-04-22T07:16:11.791 INFO:teuthology.orchestra.run.smithi196.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-04-22T07:16:11.791 INFO:teuthology.orchestra.run.smithi196.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-04-22T07:16:11.791 INFO:teuthology.orchestra.run.smithi196.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-04-22T07:16:11.792 INFO:teuthology.orchestra.run.smithi196.stdout: libcephfs-devel x86_64 2:19.0.0-3156.g86f7587a.el9 ceph 32 k 2024-04-22T07:16:11.792 INFO:teuthology.orchestra.run.smithi196.stdout: libcephfs2 x86_64 2:19.0.0-3156.g86f7587a.el9 ceph 747 k 2024-04-22T07:16:11.792 INFO:teuthology.orchestra.run.smithi196.stdout: librados-devel x86_64 2:19.0.0-3156.g86f7587a.el9 ceph 127 k 2024-04-22T07:16:11.792 INFO:teuthology.orchestra.run.smithi196.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-04-22T07:16:11.792 INFO:teuthology.orchestra.run.smithi196.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-04-22T07:16:11.792 INFO:teuthology.orchestra.run.smithi196.stdout: openssl-devel x86_64 1:3.0.7-27.el9 appstream 4.1 M 2024-04-22T07:16:11.792 INFO:teuthology.orchestra.run.smithi196.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-04-22T07:16:11.792 INFO:teuthology.orchestra.run.smithi196.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-04-22T07:16:11.792 INFO:teuthology.orchestra.run.smithi196.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-04-22T07:16:11.792 INFO:teuthology.orchestra.run.smithi196.stdout: python3-cephfs x86_64 2:19.0.0-3156.g86f7587a.el9 ceph 162 k 2024-04-22T07:16:11.792 INFO:teuthology.orchestra.run.smithi196.stdout: python3-rados x86_64 2:19.0.0-3156.g86f7587a.el9 ceph 320 k 2024-04-22T07:16:11.792 INFO:teuthology.orchestra.run.smithi196.stdout: python3-rbd x86_64 2:19.0.0-3156.g86f7587a.el9 ceph 298 k 2024-04-22T07:16:11.792 INFO:teuthology.orchestra.run.smithi196.stdout: python3-rgw x86_64 2:19.0.0-3156.g86f7587a.el9 ceph 100 k 2024-04-22T07:16:11.792 INFO:teuthology.orchestra.run.smithi196.stdout: rbd-fuse x86_64 2:19.0.0-3156.g86f7587a.el9 ceph 85 k 2024-04-22T07:16:11.793 INFO:teuthology.orchestra.run.smithi196.stdout: rbd-mirror x86_64 2:19.0.0-3156.g86f7587a.el9 ceph 3.1 M 2024-04-22T07:16:11.793 INFO:teuthology.orchestra.run.smithi196.stdout: rbd-nbd x86_64 2:19.0.0-3156.g86f7587a.el9 ceph 171 k 2024-04-22T07:16:11.793 INFO:teuthology.orchestra.run.smithi196.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-04-22T07:16:11.793 INFO:teuthology.orchestra.run.smithi196.stdout:Upgrading: 2024-04-22T07:16:11.793 INFO:teuthology.orchestra.run.smithi196.stdout: librados2 x86_64 2:19.0.0-3156.g86f7587a.el9 ceph 3.4 M 2024-04-22T07:16:11.793 INFO:teuthology.orchestra.run.smithi196.stdout: librbd1 x86_64 2:19.0.0-3156.g86f7587a.el9 ceph 3.1 M 2024-04-22T07:16:11.793 INFO:teuthology.orchestra.run.smithi196.stdout:Installing dependencies: 2024-04-22T07:16:11.793 INFO:teuthology.orchestra.run.smithi196.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-04-22T07:16:11.793 INFO:teuthology.orchestra.run.smithi196.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-04-22T07:16:11.793 INFO:teuthology.orchestra.run.smithi196.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-04-22T07:16:11.793 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-common x86_64 2:19.0.0-3156.g86f7587a.el9 ceph 21 M 2024-04-22T07:16:11.793 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3156.g86f7587a.el9 ceph-noarch 34 k 2024-04-22T07:16:11.793 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mds x86_64 2:19.0.0-3156.g86f7587a.el9 ceph 2.4 M 2024-04-22T07:16:11.794 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3156.g86f7587a.el9 ceph-noarch 249 k 2024-04-22T07:16:11.794 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mon x86_64 2:19.0.0-3156.g86f7587a.el9 ceph 4.7 M 2024-04-22T07:16:11.794 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-osd x86_64 2:19.0.0-3156.g86f7587a.el9 ceph 17 M 2024-04-22T07:16:11.794 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3156.g86f7587a.el9 ceph-noarch 16 k 2024-04-22T07:16:11.794 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-selinux x86_64 2:19.0.0-3156.g86f7587a.el9 ceph 25 k 2024-04-22T07:16:11.794 INFO:teuthology.orchestra.run.smithi196.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-04-22T07:16:11.794 INFO:teuthology.orchestra.run.smithi196.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-04-22T07:16:11.794 INFO:teuthology.orchestra.run.smithi196.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-04-22T07:16:11.794 INFO:teuthology.orchestra.run.smithi196.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-04-22T07:16:11.794 INFO:teuthology.orchestra.run.smithi196.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-22T07:16:11.794 INFO:teuthology.orchestra.run.smithi196.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-04-22T07:16:11.794 INFO:teuthology.orchestra.run.smithi196.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-04-22T07:16:11.794 INFO:teuthology.orchestra.run.smithi196.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-04-22T07:16:11.795 INFO:teuthology.orchestra.run.smithi196.stdout: libcephsqlite x86_64 2:19.0.0-3156.g86f7587a.el9 ceph 164 k 2024-04-22T07:16:11.795 INFO:teuthology.orchestra.run.smithi196.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-22T07:16:11.795 INFO:teuthology.orchestra.run.smithi196.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-22T07:16:11.795 INFO:teuthology.orchestra.run.smithi196.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-04-22T07:16:11.795 INFO:teuthology.orchestra.run.smithi196.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-22T07:16:11.795 INFO:teuthology.orchestra.run.smithi196.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-04-22T07:16:11.795 INFO:teuthology.orchestra.run.smithi196.stdout: libradosstriper1 x86_64 2:19.0.0-3156.g86f7587a.el9 ceph 500 k 2024-04-22T07:16:11.795 INFO:teuthology.orchestra.run.smithi196.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-04-22T07:16:11.795 INFO:teuthology.orchestra.run.smithi196.stdout: librgw2 x86_64 2:19.0.0-3156.g86f7587a.el9 ceph 5.4 M 2024-04-22T07:16:11.795 INFO:teuthology.orchestra.run.smithi196.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-22T07:16:11.795 INFO:teuthology.orchestra.run.smithi196.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-04-22T07:16:11.795 INFO:teuthology.orchestra.run.smithi196.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-04-22T07:16:11.795 INFO:teuthology.orchestra.run.smithi196.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-04-22T07:16:11.796 INFO:teuthology.orchestra.run.smithi196.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-04-22T07:16:11.796 INFO:teuthology.orchestra.run.smithi196.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-04-22T07:16:11.796 INFO:teuthology.orchestra.run.smithi196.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-04-22T07:16:11.796 INFO:teuthology.orchestra.run.smithi196.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-04-22T07:16:11.796 INFO:teuthology.orchestra.run.smithi196.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-04-22T07:16:11.796 INFO:teuthology.orchestra.run.smithi196.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-04-22T07:16:11.796 INFO:teuthology.orchestra.run.smithi196.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-04-22T07:16:11.796 INFO:teuthology.orchestra.run.smithi196.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-04-22T07:16:11.796 INFO:teuthology.orchestra.run.smithi196.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-22T07:16:11.796 INFO:teuthology.orchestra.run.smithi196.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-04-22T07:16:11.796 INFO:teuthology.orchestra.run.smithi196.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-04-22T07:16:11.796 INFO:teuthology.orchestra.run.smithi196.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-22T07:16:11.796 INFO:teuthology.orchestra.run.smithi196.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-22T07:16:11.796 INFO:teuthology.orchestra.run.smithi196.stdout: python3-ceph-argparse x86_64 2:19.0.0-3156.g86f7587a.el9 ceph 45 k 2024-04-22T07:16:11.797 INFO:teuthology.orchestra.run.smithi196.stdout: python3-ceph-common x86_64 2:19.0.0-3156.g86f7587a.el9 ceph 135 k 2024-04-22T07:16:11.797 INFO:teuthology.orchestra.run.smithi196.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-22T07:16:11.797 INFO:teuthology.orchestra.run.smithi196.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-04-22T07:16:11.797 INFO:teuthology.orchestra.run.smithi196.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-22T07:16:11.797 INFO:teuthology.orchestra.run.smithi196.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-22T07:16:11.797 INFO:teuthology.orchestra.run.smithi196.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-04-22T07:16:11.797 INFO:teuthology.orchestra.run.smithi196.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-04-22T07:16:11.797 INFO:teuthology.orchestra.run.smithi196.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-04-22T07:16:11.797 INFO:teuthology.orchestra.run.smithi196.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-04-22T07:16:11.797 INFO:teuthology.orchestra.run.smithi196.stdout: python3-google-auth noarch 1:2.28.2-1.el9 epel 203 k 2024-04-22T07:16:11.797 INFO:teuthology.orchestra.run.smithi196.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-04-22T07:16:11.797 INFO:teuthology.orchestra.run.smithi196.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-04-22T07:16:11.798 INFO:teuthology.orchestra.run.smithi196.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-22T07:16:11.798 INFO:teuthology.orchestra.run.smithi196.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-22T07:16:11.798 INFO:teuthology.orchestra.run.smithi196.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-22T07:16:11.798 INFO:teuthology.orchestra.run.smithi196.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-22T07:16:11.798 INFO:teuthology.orchestra.run.smithi196.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-22T07:16:11.798 INFO:teuthology.orchestra.run.smithi196.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-22T07:16:11.798 INFO:teuthology.orchestra.run.smithi196.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-04-22T07:16:11.798 INFO:teuthology.orchestra.run.smithi196.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-04-22T07:16:11.799 INFO:teuthology.orchestra.run.smithi196.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-22T07:16:11.799 INFO:teuthology.orchestra.run.smithi196.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-22T07:16:11.799 INFO:teuthology.orchestra.run.smithi196.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-04-22T07:16:11.799 INFO:teuthology.orchestra.run.smithi196.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-04-22T07:16:11.799 INFO:teuthology.orchestra.run.smithi196.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-22T07:16:11.799 INFO:teuthology.orchestra.run.smithi196.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-22T07:16:11.799 INFO:teuthology.orchestra.run.smithi196.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-04-22T07:16:11.799 INFO:teuthology.orchestra.run.smithi196.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-04-22T07:16:11.799 INFO:teuthology.orchestra.run.smithi196.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-04-22T07:16:11.799 INFO:teuthology.orchestra.run.smithi196.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-04-22T07:16:11.799 INFO:teuthology.orchestra.run.smithi196.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-22T07:16:11.799 INFO:teuthology.orchestra.run.smithi196.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-04-22T07:16:11.799 INFO:teuthology.orchestra.run.smithi196.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-22T07:16:11.799 INFO:teuthology.orchestra.run.smithi196.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-04-22T07:16:11.800 INFO:teuthology.orchestra.run.smithi196.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-04-22T07:16:11.800 INFO:teuthology.orchestra.run.smithi196.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-22T07:16:11.800 INFO:teuthology.orchestra.run.smithi196.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-04-22T07:16:11.800 INFO:teuthology.orchestra.run.smithi196.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-04-22T07:16:11.800 INFO:teuthology.orchestra.run.smithi196.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-04-22T07:16:11.800 INFO:teuthology.orchestra.run.smithi196.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-04-22T07:16:11.800 INFO:teuthology.orchestra.run.smithi196.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-04-22T07:16:11.800 INFO:teuthology.orchestra.run.smithi196.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-22T07:16:11.800 INFO:teuthology.orchestra.run.smithi196.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-22T07:16:11.800 INFO:teuthology.orchestra.run.smithi196.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-04-22T07:16:11.800 INFO:teuthology.orchestra.run.smithi196.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-22T07:16:11.800 INFO:teuthology.orchestra.run.smithi196.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-22T07:16:11.800 INFO:teuthology.orchestra.run.smithi196.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-04-22T07:16:11.801 INFO:teuthology.orchestra.run.smithi196.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-22T07:16:11.801 INFO:teuthology.orchestra.run.smithi196.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-04-22T07:16:11.801 INFO:teuthology.orchestra.run.smithi196.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-22T07:16:11.801 INFO:teuthology.orchestra.run.smithi196.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-04-22T07:16:11.801 INFO:teuthology.orchestra.run.smithi196.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-04-22T07:16:11.801 INFO:teuthology.orchestra.run.smithi196.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-22T07:16:11.801 INFO:teuthology.orchestra.run.smithi196.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-22T07:16:11.801 INFO:teuthology.orchestra.run.smithi196.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-22T07:16:11.801 INFO:teuthology.orchestra.run.smithi196.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-22T07:16:11.801 INFO:teuthology.orchestra.run.smithi196.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-04-22T07:16:11.801 INFO:teuthology.orchestra.run.smithi196.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-04-22T07:16:11.801 INFO:teuthology.orchestra.run.smithi196.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-22T07:16:11.801 INFO:teuthology.orchestra.run.smithi196.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-04-22T07:16:11.801 INFO:teuthology.orchestra.run.smithi196.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-22T07:16:11.802 INFO:teuthology.orchestra.run.smithi196.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-04-22T07:16:11.802 INFO:teuthology.orchestra.run.smithi196.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-04-22T07:16:11.802 INFO:teuthology.orchestra.run.smithi196.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-04-22T07:16:11.802 INFO:teuthology.orchestra.run.smithi196.stdout:Installing weak dependencies: 2024-04-22T07:16:11.802 INFO:teuthology.orchestra.run.smithi196.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-04-22T07:16:11.802 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-04-22T07:16:11.802 INFO:teuthology.orchestra.run.smithi196.stdout:Transaction Summary 2024-04-22T07:16:11.802 INFO:teuthology.orchestra.run.smithi196.stdout:======================================================================================= 2024-04-22T07:16:11.802 INFO:teuthology.orchestra.run.smithi196.stdout:Install 148 Packages 2024-04-22T07:16:11.802 INFO:teuthology.orchestra.run.smithi196.stdout:Upgrade 2 Packages 2024-04-22T07:16:11.802 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-04-22T07:16:11.803 INFO:teuthology.orchestra.run.smithi196.stdout:Total download size: 218 M 2024-04-22T07:16:11.803 INFO:teuthology.orchestra.run.smithi196.stdout:Downloading Packages: 2024-04-22T07:16:12.890 INFO:teuthology.orchestra.run.smithi037.stdout:(1/150): ceph-19.0.0-3156.g86f7587a.el9.x86_64. 19 kB/s | 6.6 kB 00:00 2024-04-22T07:16:13.155 INFO:teuthology.orchestra.run.smithi196.stdout:(1/150): ceph-19.0.0-3156.g86f7587a.el9.x86_64. 22 kB/s | 6.6 kB 00:00 2024-04-22T07:16:14.048 INFO:teuthology.orchestra.run.smithi037.stdout:(2/150): ceph-fuse-19.0.0-3156.g86f7587a.el9.x8 769 kB/s | 890 kB 00:01 2024-04-22T07:16:14.297 INFO:teuthology.orchestra.run.smithi196.stdout:(2/150): ceph-fuse-19.0.0-3156.g86f7587a.el9.x8 780 kB/s | 890 kB 00:01 2024-04-22T07:16:14.315 INFO:teuthology.orchestra.run.smithi037.stdout:(3/150): ceph-immutable-object-cache-19.0.0-315 543 kB/s | 145 kB 00:00 2024-04-22T07:16:14.530 INFO:teuthology.orchestra.run.smithi196.stdout:(3/150): ceph-immutable-object-cache-19.0.0-315 621 kB/s | 145 kB 00:00 2024-04-22T07:16:16.714 INFO:teuthology.orchestra.run.smithi196.stdout:(4/150): ceph-mds-19.0.0-3156.g86f7587a.el9.x86 1.1 MB/s | 2.4 MB 00:02 2024-04-22T07:16:16.740 INFO:teuthology.orchestra.run.smithi037.stdout:(4/150): ceph-mds-19.0.0-3156.g86f7587a.el9.x86 997 kB/s | 2.4 MB 00:02 2024-04-22T07:16:17.641 INFO:teuthology.orchestra.run.smithi196.stdout:(5/150): ceph-common-19.0.0-3156.g86f7587a.el9. 4.4 MB/s | 21 MB 00:04 2024-04-22T07:16:17.699 INFO:teuthology.orchestra.run.smithi037.stdout:(5/150): ceph-mgr-19.0.0-3156.g86f7587a.el9.x86 1.6 MB/s | 1.5 MB 00:00 2024-04-22T07:16:17.707 INFO:teuthology.orchestra.run.smithi196.stdout:(6/150): ceph-base-19.0.0-3156.g86f7587a.el9.x8 1.1 MB/s | 5.4 MB 00:04 2024-04-22T07:16:17.741 INFO:teuthology.orchestra.run.smithi196.stdout:(7/150): ceph-mgr-19.0.0-3156.g86f7587a.el9.x86 1.5 MB/s | 1.5 MB 00:01 2024-04-22T07:16:18.433 INFO:teuthology.orchestra.run.smithi196.stdout:(8/150): ceph-mon-19.0.0-3156.g86f7587a.el9.x86 5.9 MB/s | 4.7 MB 00:00 2024-04-22T07:16:18.474 INFO:teuthology.orchestra.run.smithi037.stdout:(6/150): ceph-base-19.0.0-3156.g86f7587a.el9.x8 927 kB/s | 5.4 MB 00:05 2024-04-22T07:16:18.500 INFO:teuthology.orchestra.run.smithi196.stdout:(9/150): ceph-selinux-19.0.0-3156.g86f7587a.el9 379 kB/s | 25 kB 00:00 2024-04-22T07:16:20.607 INFO:teuthology.orchestra.run.smithi037.stdout:(7/150): ceph-mon-19.0.0-3156.g86f7587a.el9.x86 1.6 MB/s | 4.7 MB 00:02 2024-04-22T07:16:22.441 INFO:teuthology.orchestra.run.smithi196.stdout:(10/150): ceph-radosgw-19.0.0-3156.g86f7587a.el 2.3 MB/s | 11 MB 00:04 2024-04-22T07:16:22.599 INFO:teuthology.orchestra.run.smithi196.stdout:(11/150): cephfs-mirror-19.0.0-3156.g86f7587a.e 1.4 MB/s | 225 kB 00:00 2024-04-22T07:16:22.667 INFO:teuthology.orchestra.run.smithi196.stdout:(12/150): cephfs-shell-19.0.0-3156.g86f7587a.el 406 kB/s | 27 kB 00:00 2024-04-22T07:16:22.733 INFO:teuthology.orchestra.run.smithi196.stdout:(13/150): libcephfs-devel-19.0.0-3156.g86f7587a 477 kB/s | 32 kB 00:00 2024-04-22T07:16:23.000 INFO:teuthology.orchestra.run.smithi196.stdout:(14/150): libcephfs2-19.0.0-3156.g86f7587a.el9. 2.7 MB/s | 747 kB 00:00 2024-04-22T07:16:23.117 INFO:teuthology.orchestra.run.smithi196.stdout:(15/150): libcephsqlite-19.0.0-3156.g86f7587a.e 1.4 MB/s | 164 kB 00:00 2024-04-22T07:16:23.184 INFO:teuthology.orchestra.run.smithi196.stdout:(16/150): librados-devel-19.0.0-3156.g86f7587a. 1.9 MB/s | 127 kB 00:00 2024-04-22T07:16:23.409 INFO:teuthology.orchestra.run.smithi196.stdout:(17/150): libradosstriper1-19.0.0-3156.g86f7587 2.2 MB/s | 500 kB 00:00 2024-04-22T07:16:23.885 INFO:teuthology.orchestra.run.smithi196.stdout:(18/150): ceph-osd-19.0.0-3156.g86f7587a.el9.x8 2.7 MB/s | 17 MB 00:06 2024-04-22T07:16:23.926 INFO:teuthology.orchestra.run.smithi196.stdout:(19/150): python3-ceph-argparse-19.0.0-3156.g86 1.1 MB/s | 45 kB 00:00 2024-04-22T07:16:23.986 INFO:teuthology.orchestra.run.smithi196.stdout:(20/150): python3-ceph-common-19.0.0-3156.g86f7 2.2 MB/s | 135 kB 00:00 2024-04-22T07:16:24.052 INFO:teuthology.orchestra.run.smithi196.stdout:(21/150): python3-cephfs-19.0.0-3156.g86f7587a. 2.4 MB/s | 162 kB 00:00 2024-04-22T07:16:24.153 INFO:teuthology.orchestra.run.smithi196.stdout:(22/150): python3-rados-19.0.0-3156.g86f7587a.e 3.1 MB/s | 320 kB 00:00 2024-04-22T07:16:24.253 INFO:teuthology.orchestra.run.smithi196.stdout:(23/150): python3-rbd-19.0.0-3156.g86f7587a.el9 2.9 MB/s | 298 kB 00:00 2024-04-22T07:16:24.274 INFO:teuthology.orchestra.run.smithi037.stdout:(8/150): ceph-common-19.0.0-3156.g86f7587a.el9. 1.8 MB/s | 21 MB 00:11 2024-04-22T07:16:24.311 INFO:teuthology.orchestra.run.smithi196.stdout:(24/150): python3-rgw-19.0.0-3156.g86f7587a.el9 1.7 MB/s | 100 kB 00:00 2024-04-22T07:16:24.332 INFO:teuthology.orchestra.run.smithi037.stdout:(9/150): ceph-selinux-19.0.0-3156.g86f7587a.el9 434 kB/s | 25 kB 00:00 2024-04-22T07:16:24.379 INFO:teuthology.orchestra.run.smithi196.stdout:(25/150): rbd-fuse-19.0.0-3156.g86f7587a.el9.x8 1.3 MB/s | 85 kB 00:00 2024-04-22T07:16:24.746 INFO:teuthology.orchestra.run.smithi196.stdout:(26/150): librgw2-19.0.0-3156.g86f7587a.el9.x86 4.0 MB/s | 5.4 MB 00:01 2024-04-22T07:16:24.787 INFO:teuthology.orchestra.run.smithi196.stdout:(27/150): rbd-nbd-19.0.0-3156.g86f7587a.el9.x86 4.0 MB/s | 171 kB 00:00 2024-04-22T07:16:24.829 INFO:teuthology.orchestra.run.smithi196.stdout:(28/150): ceph-grafana-dashboards-19.0.0-3156.g 821 kB/s | 34 kB 00:00 2024-04-22T07:16:24.832 INFO:teuthology.orchestra.run.smithi037.stdout:(10/150): ceph-radosgw-19.0.0-3156.g86f7587a.el 2.5 MB/s | 11 MB 00:04 2024-04-22T07:16:24.888 INFO:teuthology.orchestra.run.smithi196.stdout:(29/150): ceph-mgr-cephadm-19.0.0-3156.g86f7587 2.4 MB/s | 142 kB 00:00 2024-04-22T07:16:25.030 INFO:teuthology.orchestra.run.smithi196.stdout:(30/150): rbd-mirror-19.0.0-3156.g86f7587a.el9. 4.7 MB/s | 3.1 MB 00:00 2024-04-22T07:16:25.225 INFO:teuthology.orchestra.run.smithi037.stdout:(11/150): ceph-osd-19.0.0-3156.g86f7587a.el9.x8 2.5 MB/s | 17 MB 00:06 2024-04-22T07:16:25.250 INFO:teuthology.orchestra.run.smithi037.stdout:(12/150): cephfs-mirror-19.0.0-3156.g86f7587a.e 539 kB/s | 225 kB 00:00 2024-04-22T07:16:25.317 INFO:teuthology.orchestra.run.smithi037.stdout:(13/150): cephfs-shell-19.0.0-3156.g86f7587a.el 294 kB/s | 27 kB 00:00 2024-04-22T07:16:25.342 INFO:teuthology.orchestra.run.smithi037.stdout:(14/150): libcephfs-devel-19.0.0-3156.g86f7587a 344 kB/s | 32 kB 00:00 2024-04-22T07:16:25.505 INFO:teuthology.orchestra.run.smithi196.stdout:(31/150): ceph-mgr-dashboard-19.0.0-3156.g86f75 5.7 MB/s | 3.5 MB 00:00 2024-04-22T07:16:25.509 INFO:teuthology.orchestra.run.smithi037.stdout:(15/150): libcephsqlite-19.0.0-3156.g86f7587a.e 981 kB/s | 164 kB 00:00 2024-04-22T07:16:25.560 INFO:teuthology.orchestra.run.smithi037.stdout:(16/150): libcephfs2-19.0.0-3156.g86f7587a.el9. 3.0 MB/s | 747 kB 00:00 2024-04-22T07:16:25.589 INFO:teuthology.orchestra.run.smithi196.stdout:(32/150): ceph-mgr-modules-core-19.0.0-3156.g86 2.9 MB/s | 249 kB 00:00 2024-04-22T07:16:25.619 INFO:teuthology.orchestra.run.smithi037.stdout:(17/150): librados-devel-19.0.0-3156.g86f7587a. 1.1 MB/s | 127 kB 00:00 2024-04-22T07:16:25.631 INFO:teuthology.orchestra.run.smithi196.stdout:(33/150): ceph-mgr-rook-19.0.0-3156.g86f7587a.e 1.2 MB/s | 49 kB 00:00 2024-04-22T07:16:25.665 INFO:teuthology.orchestra.run.smithi196.stdout:(34/150): ceph-prometheus-alerts-19.0.0-3156.g8 493 kB/s | 16 kB 00:00 2024-04-22T07:16:25.731 INFO:teuthology.orchestra.run.smithi196.stdout:(35/150): ceph-volume-19.0.0-3156.g86f7587a.el9 4.0 MB/s | 273 kB 00:00 2024-04-22T07:16:25.802 INFO:teuthology.orchestra.run.smithi037.stdout:(18/150): libradosstriper1-19.0.0-3156.g86f7587 2.0 MB/s | 500 kB 00:00 2024-04-22T07:16:25.902 INFO:teuthology.orchestra.run.smithi037.stdout:(19/150): python3-ceph-argparse-19.0.0-3156.g86 452 kB/s | 45 kB 00:00 2024-04-22T07:16:25.923 INFO:teuthology.orchestra.run.smithi196.stdout:(36/150): ceph-mgr-diskprediction-local-19.0.0- 8.3 MB/s | 7.4 MB 00:00 2024-04-22T07:16:25.957 INFO:teuthology.orchestra.run.smithi196.stdout:(37/150): cephadm-19.0.0-3156.g86f7587a.el9.noa 3.3 MB/s | 763 kB 00:00 2024-04-22T07:16:25.982 INFO:teuthology.orchestra.run.smithi196.stdout:(38/150): cephfs-top-19.0.0-3156.g86f7587a.el9. 312 kB/s | 18 kB 00:00 2024-04-22T07:16:26.107 INFO:teuthology.orchestra.run.smithi196.stdout:(39/150): fuse-2.9.9-15.el9.x86_64.rpm 535 kB/s | 80 kB 00:00 2024-04-22T07:16:26.144 INFO:teuthology.orchestra.run.smithi037.stdout:(20/150): python3-ceph-common-19.0.0-3156.g86f7 557 kB/s | 135 kB 00:00 2024-04-22T07:16:26.157 INFO:teuthology.orchestra.run.smithi196.stdout:(40/150): libgfortran-11.4.1-3.el9.x86_64.rpm 4.5 MB/s | 803 kB 00:00 2024-04-22T07:16:26.200 INFO:teuthology.orchestra.run.smithi196.stdout:(41/150): libquadmath-11.4.1-3.el9.x86_64.rpm 2.1 MB/s | 195 kB 00:00 2024-04-22T07:16:26.236 INFO:teuthology.orchestra.run.smithi037.stdout:(21/150): python3-cephfs-19.0.0-3156.g86f7587a. 1.7 MB/s | 162 kB 00:00 2024-04-22T07:16:26.250 INFO:teuthology.orchestra.run.smithi196.stdout:(42/150): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.7 MB/s | 253 kB 00:00 2024-04-22T07:16:26.308 INFO:teuthology.orchestra.run.smithi196.stdout:(43/150): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 106 kB 00:00 2024-04-22T07:16:26.342 INFO:teuthology.orchestra.run.smithi196.stdout:(44/150): python3-cryptography-36.0.1-4.el9.x86 8.6 MB/s | 1.2 MB 00:00 2024-04-22T07:16:26.361 INFO:teuthology.orchestra.run.smithi037.stdout:(22/150): python3-rados-19.0.0-3156.g86f7587a.e 2.5 MB/s | 320 kB 00:00 2024-04-22T07:16:26.402 INFO:teuthology.orchestra.run.smithi196.stdout:(45/150): python3-pycparser-2.20-6.el9.noarch.r 1.4 MB/s | 135 kB 00:00 2024-04-22T07:16:26.434 INFO:teuthology.orchestra.run.smithi196.stdout:(46/150): python3-requests-2.25.1-8.el9.noarch. 1.3 MB/s | 125 kB 00:00 2024-04-22T07:16:26.462 INFO:teuthology.orchestra.run.smithi037.stdout:(23/150): python3-rbd-19.0.0-3156.g86f7587a.el9 2.9 MB/s | 298 kB 00:00 2024-04-22T07:16:26.528 INFO:teuthology.orchestra.run.smithi037.stdout:(24/150): python3-rgw-19.0.0-3156.g86f7587a.el9 1.5 MB/s | 100 kB 00:00 2024-04-22T07:16:26.587 INFO:teuthology.orchestra.run.smithi037.stdout:(25/150): rbd-fuse-19.0.0-3156.g86f7587a.el9.x8 1.4 MB/s | 85 kB 00:00 2024-04-22T07:16:26.860 INFO:teuthology.orchestra.run.smithi196.stdout:(47/150): ceph-test-19.0.0-3156.g86f7587a.el9.x 5.9 MB/s | 49 MB 00:08 2024-04-22T07:16:26.910 INFO:teuthology.orchestra.run.smithi196.stdout:(48/150): python3-urllib3-1.26.5-5.el9.noarch.r 422 kB/s | 215 kB 00:00 2024-04-22T07:16:26.960 INFO:teuthology.orchestra.run.smithi196.stdout:(49/150): automake-1.16.2-8.el9.noarch.rpm 1.3 MB/s | 689 kB 00:00 2024-04-22T07:16:27.002 INFO:teuthology.orchestra.run.smithi196.stdout:(50/150): bison-3.7.4-5.el9.x86_64.rpm 6.5 MB/s | 943 kB 00:00 2024-04-22T07:16:27.027 INFO:teuthology.orchestra.run.smithi196.stdout:(51/150): boost-program-options-1.75.0-8.el9.x8 913 kB/s | 107 kB 00:00 2024-04-22T07:16:27.029 INFO:teuthology.orchestra.run.smithi037.stdout:(26/150): librgw2-19.0.0-3156.g86f7587a.el9.x86 3.8 MB/s | 5.4 MB 00:01 2024-04-22T07:16:27.044 INFO:teuthology.orchestra.run.smithi196.stdout:(52/150): elfutils-libelf-devel-0.190-2.el9.x86 256 kB/s | 21 kB 00:00 2024-04-22T07:16:27.078 INFO:teuthology.orchestra.run.smithi196.stdout:(53/150): flexiblas-3.0.4-8.el9.x86_64.rpm 654 kB/s | 33 kB 00:00 2024-04-22T07:16:27.096 INFO:teuthology.orchestra.run.smithi037.stdout:(27/150): rbd-nbd-19.0.0-3156.g86f7587a.el9.x86 2.5 MB/s | 171 kB 00:00 2024-04-22T07:16:27.103 INFO:teuthology.orchestra.run.smithi196.stdout:(54/150): flex-2.6.4-9.el9.x86_64.rpm 3.0 MB/s | 313 kB 00:00 2024-04-22T07:16:27.137 INFO:teuthology.orchestra.run.smithi196.stdout:(55/150): flexiblas-openblas-openmp-3.0.4-8.el9 312 kB/s | 18 kB 00:00 2024-04-22T07:16:27.153 INFO:teuthology.orchestra.run.smithi196.stdout:(56/150): libaio-devel-0.3.111-13.el9.x86_64.rp 222 kB/s | 11 kB 00:00 2024-04-22T07:16:27.154 INFO:teuthology.orchestra.run.smithi037.stdout:(28/150): ceph-grafana-dashboards-19.0.0-3156.g 587 kB/s | 34 kB 00:00 2024-04-22T07:16:27.204 INFO:teuthology.orchestra.run.smithi196.stdout:(57/150): librabbitmq-0.11.0-7.el9.x86_64.rpm 909 kB/s | 45 kB 00:00 2024-04-22T07:16:27.221 INFO:teuthology.orchestra.run.smithi037.stdout:(29/150): ceph-mgr-cephadm-19.0.0-3156.g86f7587 2.1 MB/s | 142 kB 00:00 2024-04-22T07:16:27.229 INFO:teuthology.orchestra.run.smithi196.stdout:(58/150): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.7 MB/s | 160 kB 00:00 2024-04-22T07:16:27.296 INFO:teuthology.orchestra.run.smithi196.stdout:(59/150): flexiblas-netlib-3.0.4-8.el9.x86_64.r 12 MB/s | 3.0 MB 00:00 2024-04-22T07:16:27.313 INFO:teuthology.orchestra.run.smithi037.stdout:(30/150): rbd-mirror-19.0.0-3156.g86f7587a.el9. 4.3 MB/s | 3.1 MB 00:00 2024-04-22T07:16:27.346 INFO:teuthology.orchestra.run.smithi196.stdout:(60/150): libuuid-devel-2.37.4-18.el9.x86_64.rp 511 kB/s | 25 kB 00:00 2024-04-22T07:16:27.380 INFO:teuthology.orchestra.run.smithi196.stdout:(61/150): librdkafka-1.6.1-102.el9.x86_64.rpm 3.7 MB/s | 662 kB 00:00 2024-04-22T07:16:27.430 INFO:teuthology.orchestra.run.smithi196.stdout:(62/150): libzstd-devel-1.5.1-2.el9.x86_64.rpm 568 kB/s | 47 kB 00:00 2024-04-22T07:16:27.464 INFO:teuthology.orchestra.run.smithi196.stdout:(63/150): libtool-2.4.6-45.el9.x86_64.rpm 2.4 MB/s | 582 kB 00:00 2024-04-22T07:16:27.498 INFO:teuthology.orchestra.run.smithi196.stdout:(64/150): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.4 MB/s | 292 kB 00:00 2024-04-22T07:16:27.514 INFO:teuthology.orchestra.run.smithi196.stdout:(65/150): openblas-0.3.21-2.el9.x86_64.rpm 700 kB/s | 35 kB 00:00 2024-04-22T07:16:27.539 INFO:teuthology.orchestra.run.smithi196.stdout:(66/150): lua-5.4.4-4.el9.x86_64.rpm 1.7 MB/s | 188 kB 00:00 2024-04-22T07:16:27.731 INFO:teuthology.orchestra.run.smithi196.stdout:(67/150): postgresql-13.14-1.el9.x86_64.rpm 8.3 MB/s | 1.6 MB 00:00 2024-04-22T07:16:27.798 INFO:teuthology.orchestra.run.smithi196.stdout:(68/150): openblas-openmp-0.3.21-2.el9.x86_64.r 16 MB/s | 4.7 MB 00:00 2024-04-22T07:16:27.899 INFO:teuthology.orchestra.run.smithi196.stdout:(69/150): postgresql-private-libs-13.14-1.el9.x 1.3 MB/s | 133 kB 00:00 2024-04-22T07:16:27.930 INFO:teuthology.orchestra.run.smithi037.stdout:(31/150): ceph-mgr-dashboard-19.0.0-3156.g86f75 5.0 MB/s | 3.5 MB 00:00 2024-04-22T07:16:27.965 INFO:teuthology.orchestra.run.smithi196.stdout:(70/150): openssl-devel-3.0.7-27.el9.x86_64.rpm 9.2 MB/s | 4.1 MB 00:00 2024-04-22T07:16:27.999 INFO:teuthology.orchestra.run.smithi196.stdout:(71/150): postgresql-contrib-13.14-1.el9.x86_64 3.3 MB/s | 911 kB 00:00 2024-04-22T07:16:28.034 INFO:teuthology.orchestra.run.smithi037.stdout:(32/150): ceph-mgr-modules-core-19.0.0-3156.g86 2.4 MB/s | 249 kB 00:00 2024-04-22T07:16:28.058 INFO:teuthology.orchestra.run.smithi196.stdout:(72/150): python3-attrs-20.3.0-7.el9.noarch.rpm 1.5 MB/s | 87 kB 00:00 2024-04-22T07:16:28.100 INFO:teuthology.orchestra.run.smithi037.stdout:(33/150): ceph-mgr-rook-19.0.0-3156.g86f7587a.e 719 kB/s | 49 kB 00:00 2024-04-22T07:16:28.142 INFO:teuthology.orchestra.run.smithi196.stdout:(73/150): protobuf-3.14.0-13.el9.x86_64.rpm 5.7 MB/s | 1.0 MB 00:00 2024-04-22T07:16:28.158 INFO:teuthology.orchestra.run.smithi037.stdout:(34/150): ceph-prometheus-alerts-19.0.0-3156.g8 281 kB/s | 16 kB 00:00 2024-04-22T07:16:28.216 INFO:teuthology.orchestra.run.smithi196.stdout:(74/150): python3-devel-3.9.18-3.el9.x86_64.rpm 3.2 MB/s | 244 kB 00:00 2024-04-22T07:16:28.259 INFO:teuthology.orchestra.run.smithi037.stdout:(35/150): ceph-volume-19.0.0-3156.g86f7587a.el9 2.7 MB/s | 273 kB 00:00 2024-04-22T07:16:28.334 INFO:teuthology.orchestra.run.smithi196.stdout:(75/150): postgresql-server-13.14-1.el9.x86_64. 13 MB/s | 5.8 MB 00:00 2024-04-22T07:16:28.359 INFO:teuthology.orchestra.run.smithi196.stdout:(76/150): python3-jinja2-2.11.3-5.el9.noarch.rp 1.7 MB/s | 248 kB 00:00 2024-04-22T07:16:28.400 INFO:teuthology.orchestra.run.smithi196.stdout:(77/150): python3-jsonpatch-1.21-16.el9.noarch. 383 kB/s | 26 kB 00:00 2024-04-22T07:16:28.426 INFO:teuthology.orchestra.run.smithi196.stdout:(78/150): python3-jsonpointer-2.0-4.el9.noarch. 286 kB/s | 19 kB 00:00 2024-04-22T07:16:28.434 INFO:teuthology.orchestra.run.smithi037.stdout:(36/150): cephadm-19.0.0-3156.g86f7587a.el9.noa 4.3 MB/s | 763 kB 00:00 2024-04-22T07:16:28.468 INFO:teuthology.orchestra.run.smithi196.stdout:(79/150): python3-markupsafe-1.1.1-12.el9.x86_6 838 kB/s | 35 kB 00:00 2024-04-22T07:16:28.492 INFO:teuthology.orchestra.run.smithi037.stdout:(37/150): cephfs-top-19.0.0-3156.g86f7587a.el9. 313 kB/s | 18 kB 00:00 2024-04-22T07:16:28.493 INFO:teuthology.orchestra.run.smithi196.stdout:(80/150): python3-mako-1.1.4-6.el9.noarch.rpm 1.8 MB/s | 172 kB 00:00 2024-04-22T07:16:28.594 INFO:teuthology.orchestra.run.smithi196.stdout:(81/150): python3-babel-2.9.1-2.el9.noarch.rpm 11 MB/s | 6.0 MB 00:00 2024-04-22T07:16:28.635 INFO:teuthology.orchestra.run.smithi196.stdout:(82/150): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.7 MB/s | 250 kB 00:00 2024-04-22T07:16:28.643 INFO:teuthology.orchestra.run.smithi037.stdout:(38/150): fuse-2.9.9-15.el9.x86_64.rpm 536 kB/s | 80 kB 00:00 2024-04-22T07:16:28.686 INFO:teuthology.orchestra.run.smithi196.stdout:(83/150): python3-oauthlib-3.1.1-5.el9.noarch.r 2.4 MB/s | 222 kB 00:00 2024-04-22T07:16:28.711 INFO:teuthology.orchestra.run.smithi196.stdout:(84/150): python3-packaging-20.9-5.el9.noarch.r 1.0 MB/s | 77 kB 00:00 2024-04-22T07:16:28.769 INFO:teuthology.orchestra.run.smithi196.stdout:(85/150): python3-prettytable-0.7.2-27.el9.noar 506 kB/s | 42 kB 00:00 2024-04-22T07:16:28.819 INFO:teuthology.orchestra.run.smithi196.stdout:(86/150): python3-protobuf-3.14.0-13.el9.noarch 2.4 MB/s | 269 kB 00:00 2024-04-22T07:16:28.843 INFO:teuthology.orchestra.run.smithi037.stdout:(39/150): ceph-mgr-diskprediction-local-19.0.0- 4.8 MB/s | 7.4 MB 00:01 2024-04-22T07:16:28.861 INFO:teuthology.orchestra.run.smithi196.stdout:(87/150): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.7 MB/s | 159 kB 00:00 2024-04-22T07:16:28.877 INFO:teuthology.orchestra.run.smithi037.stdout:(40/150): libgfortran-11.4.1-3.el9.x86_64.rpm 3.4 MB/s | 803 kB 00:00 2024-04-22T07:16:28.935 INFO:teuthology.orchestra.run.smithi037.stdout:(41/150): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.2 MB/s | 253 kB 00:00 2024-04-22T07:16:28.962 INFO:teuthology.orchestra.run.smithi196.stdout:(88/150): python3-numpy-1.20.1-5.el9.x86_64.rpm 10 MB/s | 5.1 MB 00:00 2024-04-22T07:16:28.987 INFO:teuthology.orchestra.run.smithi196.stdout:(89/150): python3-pytz-2021.1-5.el9.noarch.rpm 407 kB/s | 51 kB 00:00 2024-04-22T07:16:29.012 INFO:teuthology.orchestra.run.smithi196.stdout:(90/150): python3-pyasn1-modules-0.4.8-6.el9.no 1.4 MB/s | 279 kB 00:00 2024-04-22T07:16:29.035 INFO:teuthology.orchestra.run.smithi037.stdout:(42/150): python3-cryptography-36.0.1-4.el9.x86 12 MB/s | 1.2 MB 00:00 2024-04-22T07:16:29.037 INFO:teuthology.orchestra.run.smithi196.stdout:(91/150): python3-requests-oauthlib-1.3.0-12.el 711 kB/s | 54 kB 00:00 2024-04-22T07:16:29.062 INFO:teuthology.orchestra.run.smithi037.stdout:(43/150): libquadmath-11.4.1-3.el9.x86_64.rpm 899 kB/s | 195 kB 00:00 2024-04-22T07:16:29.088 INFO:teuthology.orchestra.run.smithi196.stdout:(92/150): python3-toml-0.10.2-6.el9.noarch.rpm 553 kB/s | 42 kB 00:00 2024-04-22T07:16:29.094 INFO:teuthology.orchestra.run.smithi037.stdout:(44/150): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 106 kB 00:00 2024-04-22T07:16:29.113 INFO:teuthology.orchestra.run.smithi196.stdout:(93/150): python3-wcwidth-0.2.5-8.el9.noarch.rp 585 kB/s | 44 kB 00:00 2024-04-22T07:16:29.120 INFO:teuthology.orchestra.run.smithi037.stdout:(45/150): python3-pycparser-2.20-6.el9.noarch.r 2.3 MB/s | 135 kB 00:00 2024-04-22T07:16:29.153 INFO:teuthology.orchestra.run.smithi037.stdout:(46/150): python3-requests-2.25.1-8.el9.noarch. 2.1 MB/s | 125 kB 00:00 2024-04-22T07:16:29.163 INFO:teuthology.orchestra.run.smithi196.stdout:(94/150): qatlib-service-24.02.0-1.el9.x86_64.r 721 kB/s | 36 kB 00:00 2024-04-22T07:16:29.179 INFO:teuthology.orchestra.run.smithi037.stdout:(47/150): python3-urllib3-1.26.5-5.el9.noarch.r 3.6 MB/s | 215 kB 00:00 2024-04-22T07:16:29.197 INFO:teuthology.orchestra.run.smithi196.stdout:(95/150): qatlib-24.02.0-1.el9.x86_64.rpm 2.0 MB/s | 221 kB 00:00 2024-04-22T07:16:29.255 INFO:teuthology.orchestra.run.smithi196.stdout:(96/150): qatzip-libs-1.2.0-1.el9.x86_64.rpm 515 kB/s | 47 kB 00:00 2024-04-22T07:16:29.339 INFO:teuthology.orchestra.run.smithi196.stdout:(97/150): socat-1.7.4.1-5.el9.x86_64.rpm 2.1 MB/s | 305 kB 00:00 2024-04-22T07:16:29.354 INFO:teuthology.orchestra.run.smithi037.stdout:(48/150): automake-1.16.2-8.el9.noarch.rpm 3.4 MB/s | 689 kB 00:00 2024-04-22T07:16:29.364 INFO:teuthology.orchestra.run.smithi196.stdout:(98/150): uuid-1.6.2-55.el9.x86_64.rpm 531 kB/s | 58 kB 00:00 2024-04-22T07:16:29.396 INFO:teuthology.orchestra.run.smithi037.stdout:(49/150): boost-program-options-1.75.0-8.el9.x8 2.5 MB/s | 107 kB 00:00 2024-04-22T07:16:29.430 INFO:teuthology.orchestra.run.smithi037.stdout:(50/150): bison-3.7.4-5.el9.x86_64.rpm 3.7 MB/s | 943 kB 00:00 2024-04-22T07:16:29.440 INFO:teuthology.orchestra.run.smithi196.stdout:(99/150): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 935 kB/s | 94 kB 00:00 2024-04-22T07:16:29.455 INFO:teuthology.orchestra.run.smithi037.stdout:(51/150): elfutils-libelf-devel-0.190-2.el9.x86 368 kB/s | 21 kB 00:00 2024-04-22T07:16:29.465 INFO:teuthology.orchestra.run.smithi196.stdout:(100/150): xmlstarlet-1.6.1-20.el9.x86_64.rpm 635 kB/s | 64 kB 00:00 2024-04-22T07:16:29.480 INFO:teuthology.orchestra.run.smithi037.stdout:(52/150): flex-2.6.4-9.el9.x86_64.rpm 6.1 MB/s | 313 kB 00:00 2024-04-22T07:16:29.505 INFO:teuthology.orchestra.run.smithi037.stdout:(53/150): flexiblas-3.0.4-8.el9.x86_64.rpm 652 kB/s | 33 kB 00:00 2024-04-22T07:16:29.515 INFO:teuthology.orchestra.run.smithi196.stdout:(101/150): zlib-devel-1.2.11-41.el9.x86_64.rpm 595 kB/s | 45 kB 00:00 2024-04-22T07:16:29.547 INFO:teuthology.orchestra.run.smithi037.stdout:(54/150): flexiblas-openblas-openmp-3.0.4-8.el9 439 kB/s | 18 kB 00:00 2024-04-22T07:16:29.589 INFO:teuthology.orchestra.run.smithi037.stdout:(55/150): libaio-devel-0.3.111-13.el9.x86_64.rp 268 kB/s | 11 kB 00:00 2024-04-22T07:16:29.607 INFO:teuthology.orchestra.run.smithi196.stdout:(102/150): lua-devel-5.4.4-4.el9.x86_64.rpm 157 kB/s | 22 kB 00:00 2024-04-22T07:16:29.640 INFO:teuthology.orchestra.run.smithi037.stdout:(56/150): flexiblas-netlib-3.0.4-8.el9.x86_64.r 19 MB/s | 3.0 MB 00:00 2024-04-22T07:16:29.665 INFO:teuthology.orchestra.run.smithi037.stdout:(57/150): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.1 MB/s | 160 kB 00:00 2024-04-22T07:16:29.690 INFO:teuthology.orchestra.run.smithi037.stdout:(58/150): librabbitmq-0.11.0-7.el9.x86_64.rpm 905 kB/s | 45 kB 00:00 2024-04-22T07:16:29.724 INFO:teuthology.orchestra.run.smithi037.stdout:(59/150): librdkafka-1.6.1-102.el9.x86_64.rpm 11 MB/s | 662 kB 00:00 2024-04-22T07:16:29.765 INFO:teuthology.orchestra.run.smithi037.stdout:(60/150): libtool-2.4.6-45.el9.x86_64.rpm 7.6 MB/s | 582 kB 00:00 2024-04-22T07:16:29.791 INFO:teuthology.orchestra.run.smithi037.stdout:(61/150): libuuid-devel-2.37.4-18.el9.x86_64.rp 381 kB/s | 25 kB 00:00 2024-04-22T07:16:29.799 INFO:teuthology.orchestra.run.smithi196.stdout:(103/150): protobuf-compiler-3.14.0-13.el9.x86_ 3.0 MB/s | 863 kB 00:00 2024-04-22T07:16:29.900 INFO:teuthology.orchestra.run.smithi037.stdout:(62/150): libzstd-devel-1.5.1-2.el9.x86_64.rpm 354 kB/s | 47 kB 00:00 2024-04-22T07:16:29.959 INFO:teuthology.orchestra.run.smithi037.stdout:(63/150): lttng-ust-2.12.0-6.el9.x86_64.rpm 1.7 MB/s | 292 kB 00:00 2024-04-22T07:16:29.984 INFO:teuthology.orchestra.run.smithi037.stdout:(64/150): lua-5.4.4-4.el9.x86_64.rpm 2.2 MB/s | 188 kB 00:00 2024-04-22T07:16:30.001 INFO:teuthology.orchestra.run.smithi037.stdout:(65/150): openblas-0.3.21-2.el9.x86_64.rpm 842 kB/s | 35 kB 00:00 2024-04-22T07:16:30.143 INFO:teuthology.orchestra.run.smithi037.stdout:(66/150): openblas-openmp-0.3.21-2.el9.x86_64.r 30 MB/s | 4.7 MB 00:00 2024-04-22T07:16:30.199 INFO:teuthology.orchestra.run.smithi196.stdout:(104/150): abseil-cpp-20211102.0-3.el9.x86_64.r 926 kB/s | 548 kB 00:00 2024-04-22T07:16:30.218 INFO:teuthology.orchestra.run.smithi037.stdout:(67/150): openssl-devel-3.0.7-27.el9.x86_64.rpm 19 MB/s | 4.1 MB 00:00 2024-04-22T07:16:30.260 INFO:teuthology.orchestra.run.smithi037.stdout:(68/150): postgresql-13.14-1.el9.x86_64.rpm 14 MB/s | 1.6 MB 00:00 2024-04-22T07:16:30.293 INFO:teuthology.orchestra.run.smithi037.stdout:(69/150): postgresql-contrib-13.14-1.el9.x86_64 12 MB/s | 911 kB 00:00 2024-04-22T07:16:30.319 INFO:teuthology.orchestra.run.smithi037.stdout:(70/150): postgresql-private-libs-13.14-1.el9.x 2.2 MB/s | 133 kB 00:00 2024-04-22T07:16:30.383 INFO:teuthology.orchestra.run.smithi196.stdout:(105/150): gperftools-libs-2.9.1-2.el9.x86_64.r 529 kB/s | 309 kB 00:00 2024-04-22T07:16:30.385 INFO:teuthology.orchestra.run.smithi037.stdout:(71/150): protobuf-3.14.0-13.el9.x86_64.rpm 15 MB/s | 1.0 MB 00:00 2024-04-22T07:16:30.467 INFO:teuthology.orchestra.run.smithi196.stdout:(106/150): grpc-data-1.46.7-10.el9.noarch.rpm 73 kB/s | 19 kB 00:00 2024-04-22T07:16:30.494 INFO:teuthology.orchestra.run.smithi037.stdout:(72/150): postgresql-server-13.14-1.el9.x86_64. 29 MB/s | 5.8 MB 00:00 2024-04-22T07:16:30.520 INFO:teuthology.orchestra.run.smithi037.stdout:(73/150): python3-attrs-20.3.0-7.el9.noarch.rpm 654 kB/s | 87 kB 00:00 2024-04-22T07:16:30.578 INFO:teuthology.orchestra.run.smithi037.stdout:(74/150): python3-devel-3.9.18-3.el9.x86_64.rpm 4.1 MB/s | 244 kB 00:00 2024-04-22T07:16:30.678 INFO:teuthology.orchestra.run.smithi037.stdout:(75/150): python3-babel-2.9.1-2.el9.noarch.rpm 32 MB/s | 6.0 MB 00:00 2024-04-22T07:16:30.695 INFO:teuthology.orchestra.run.smithi037.stdout:(76/150): python3-jinja2-2.11.3-5.el9.noarch.rp 2.1 MB/s | 248 kB 00:00 2024-04-22T07:16:30.721 INFO:teuthology.orchestra.run.smithi037.stdout:(77/150): python3-jsonpatch-1.21-16.el9.noarch. 611 kB/s | 26 kB 00:00 2024-04-22T07:16:30.733 INFO:teuthology.orchestra.run.smithi196.stdout:(107/150): libarrow-doc-9.0.0-10.el9.noarch.rpm 97 kB/s | 26 kB 00:00 2024-04-22T07:16:30.746 INFO:teuthology.orchestra.run.smithi037.stdout:(78/150): python3-jsonpointer-2.0-4.el9.noarch. 381 kB/s | 19 kB 00:00 2024-04-22T07:16:30.763 INFO:teuthology.orchestra.run.smithi037.stdout:(79/150): python3-mako-1.1.4-6.el9.noarch.rpm 4.0 MB/s | 172 kB 00:00 2024-04-22T07:16:30.788 INFO:teuthology.orchestra.run.smithi037.stdout:(80/150): python3-markupsafe-1.1.1-12.el9.x86_6 830 kB/s | 35 kB 00:00 2024-04-22T07:16:30.847 INFO:teuthology.orchestra.run.smithi037.stdout:(81/150): python3-numpy-f2py-1.20.1-5.el9.x86_6 4.2 MB/s | 250 kB 00:00 2024-04-22T07:16:30.922 INFO:teuthology.orchestra.run.smithi037.stdout:(82/150): python3-numpy-1.20.1-5.el9.x86_64.rpm 32 MB/s | 5.1 MB 00:00 2024-04-22T07:16:30.947 INFO:teuthology.orchestra.run.smithi037.stdout:(83/150): python3-oauthlib-3.1.1-5.el9.noarch.r 2.2 MB/s | 222 kB 00:00 2024-04-22T07:16:30.973 INFO:teuthology.orchestra.run.smithi037.stdout:(84/150): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-04-22T07:16:30.998 INFO:teuthology.orchestra.run.smithi037.stdout:(85/150): python3-prettytable-0.7.2-27.el9.noar 839 kB/s | 42 kB 00:00 2024-04-22T07:16:31.023 INFO:teuthology.orchestra.run.smithi037.stdout:(86/150): python3-protobuf-3.14.0-13.el9.noarch 5.2 MB/s | 269 kB 00:00 2024-04-22T07:16:31.049 INFO:teuthology.orchestra.run.smithi037.stdout:(87/150): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 159 kB 00:00 2024-04-22T07:16:31.074 INFO:teuthology.orchestra.run.smithi037.stdout:(88/150): python3-pyasn1-modules-0.4.8-6.el9.no 5.4 MB/s | 279 kB 00:00 2024-04-22T07:16:31.083 INFO:teuthology.orchestra.run.smithi196.stdout:(108/150): liboath-2.6.7-2.el9.x86_64.rpm 139 kB/s | 49 kB 00:00 2024-04-22T07:16:31.099 INFO:teuthology.orchestra.run.smithi037.stdout:(89/150): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-04-22T07:16:31.124 INFO:teuthology.orchestra.run.smithi037.stdout:(90/150): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-04-22T07:16:31.191 INFO:teuthology.orchestra.run.smithi037.stdout:(91/150): python3-toml-0.10.2-6.el9.noarch.rpm 625 kB/s | 42 kB 00:00 2024-04-22T07:16:31.242 INFO:teuthology.orchestra.run.smithi037.stdout:(92/150): python3-wcwidth-0.2.5-8.el9.noarch.rp 884 kB/s | 44 kB 00:00 2024-04-22T07:16:31.292 INFO:teuthology.orchestra.run.smithi037.stdout:(93/150): qatlib-24.02.0-1.el9.x86_64.rpm 4.3 MB/s | 221 kB 00:00 2024-04-22T07:16:31.342 INFO:teuthology.orchestra.run.smithi037.stdout:(94/150): qatlib-service-24.02.0-1.el9.x86_64.r 719 kB/s | 36 kB 00:00 2024-04-22T07:16:31.425 INFO:teuthology.orchestra.run.smithi196.stdout:(109/150): libunwind-1.6.2-1.el9.x86_64.rpm 197 kB/s | 67 kB 00:00 2024-04-22T07:16:31.510 INFO:teuthology.orchestra.run.smithi037.stdout:(95/150): python3-scipy-1.6.2-8.el9.x86_64.rpm 40 MB/s | 16 MB 00:00 2024-04-22T07:16:31.535 INFO:teuthology.orchestra.run.smithi037.stdout:(96/150): qatzip-libs-1.2.0-1.el9.x86_64.rpm 247 kB/s | 47 kB 00:00 2024-04-22T07:16:31.560 INFO:teuthology.orchestra.run.smithi037.stdout:(97/150): socat-1.7.4.1-5.el9.x86_64.rpm 5.9 MB/s | 305 kB 00:00 2024-04-22T07:16:31.586 INFO:teuthology.orchestra.run.smithi037.stdout:(98/150): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-04-22T07:16:31.602 INFO:teuthology.orchestra.run.smithi037.stdout:(99/150): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 2.2 MB/s | 94 kB 00:00 2024-04-22T07:16:31.628 INFO:teuthology.orchestra.run.smithi037.stdout:(100/150): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.5 MB/s | 64 kB 00:00 2024-04-22T07:16:31.651 INFO:teuthology.orchestra.run.smithi196.stdout:(110/150): libarrow-9.0.0-10.el9.x86_64.rpm 3.5 MB/s | 4.4 MB 00:01 2024-04-22T07:16:31.653 INFO:teuthology.orchestra.run.smithi037.stdout:(101/150): zlib-devel-1.2.11-41.el9.x86_64.rpm 890 kB/s | 45 kB 00:00 2024-04-22T07:16:31.851 INFO:teuthology.orchestra.run.smithi196.stdout:(111/150): luarocks-3.9.2-1.el9.noarch.rpm 355 kB/s | 151 kB 00:00 2024-04-22T07:16:32.020 INFO:teuthology.orchestra.run.smithi037.stdout:(102/150): lua-devel-5.4.4-4.el9.x86_64.rpm 57 kB/s | 22 kB 00:00 2024-04-22T07:16:32.170 INFO:teuthology.orchestra.run.smithi037.stdout:(103/150): abseil-cpp-20211102.0-3.el9.x86_64.r 3.6 MB/s | 548 kB 00:00 2024-04-22T07:16:32.212 INFO:teuthology.orchestra.run.smithi037.stdout:(104/150): protobuf-compiler-3.14.0-13.el9.x86_ 1.5 MB/s | 863 kB 00:00 2024-04-22T07:16:32.237 INFO:teuthology.orchestra.run.smithi037.stdout:(105/150): gperftools-libs-2.9.1-2.el9.x86_64.r 4.5 MB/s | 309 kB 00:00 2024-04-22T07:16:32.318 INFO:teuthology.orchestra.run.smithi196.stdout:(112/150): parquet-libs-9.0.0-10.el9.x86_64.rpm 1.2 MB/s | 838 kB 00:00 2024-04-22T07:16:32.371 INFO:teuthology.orchestra.run.smithi037.stdout:(106/150): grpc-data-1.46.7-10.el9.noarch.rpm 123 kB/s | 19 kB 00:00 2024-04-22T07:16:32.446 INFO:teuthology.orchestra.run.smithi037.stdout:(107/150): libarrow-9.0.0-10.el9.x86_64.rpm 21 MB/s | 4.4 MB 00:00 2024-04-22T07:16:32.451 INFO:teuthology.orchestra.run.smithi196.stdout:(113/150): python3-asyncssh-2.13.2-5.el9.noarch 913 kB/s | 548 kB 00:00 2024-04-22T07:16:32.471 INFO:teuthology.orchestra.run.smithi037.stdout:(108/150): libarrow-doc-9.0.0-10.el9.noarch.rpm 259 kB/s | 26 kB 00:00 2024-04-22T07:16:32.496 INFO:teuthology.orchestra.run.smithi037.stdout:(109/150): liboath-2.6.7-2.el9.x86_64.rpm 969 kB/s | 49 kB 00:00 2024-04-22T07:16:32.530 INFO:teuthology.orchestra.run.smithi037.stdout:(110/150): libunwind-1.6.2-1.el9.x86_64.rpm 1.1 MB/s | 67 kB 00:00 2024-04-22T07:16:32.556 INFO:teuthology.orchestra.run.smithi037.stdout:(111/150): luarocks-3.9.2-1.el9.noarch.rpm 2.5 MB/s | 151 kB 00:00 2024-04-22T07:16:32.606 INFO:teuthology.orchestra.run.smithi037.stdout:(112/150): python3-asyncssh-2.13.2-5.el9.noarch 11 MB/s | 548 kB 00:00 2024-04-22T07:16:32.648 INFO:teuthology.orchestra.run.smithi037.stdout:(113/150): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.0 MB/s | 43 kB 00:00 2024-04-22T07:16:32.693 INFO:teuthology.orchestra.run.smithi196.stdout:(114/150): python3-bcrypt-3.2.2-1.el9.x86_64.rp 116 kB/s | 43 kB 00:00 2024-04-22T07:16:32.698 INFO:teuthology.orchestra.run.smithi037.stdout:(114/150): parquet-libs-9.0.0-10.el9.x86_64.rpm 4.9 MB/s | 838 kB 00:00 2024-04-22T07:16:32.719 INFO:teuthology.orchestra.run.smithi196.stdout:(115/150): python3-cachetools-4.2.4-1.el9.noarc 120 kB/s | 32 kB 00:00 2024-04-22T07:16:32.723 INFO:teuthology.orchestra.run.smithi037.stdout:(115/150): python3-cachetools-4.2.4-1.el9.noarc 429 kB/s | 32 kB 00:00 2024-04-22T07:16:32.749 INFO:teuthology.orchestra.run.smithi037.stdout:(116/150): python3-certifi-2021.10.8-2.el9.noar 299 kB/s | 15 kB 00:00 2024-04-22T07:16:32.774 INFO:teuthology.orchestra.run.smithi037.stdout:(117/150): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2024-04-22T07:16:32.799 INFO:teuthology.orchestra.run.smithi037.stdout:(118/150): python3-cherrypy-18.6.1-2.el9.noarch 7.0 MB/s | 358 kB 00:00 2024-04-22T07:16:32.824 INFO:teuthology.orchestra.run.smithi037.stdout:(119/150): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.9 MB/s | 303 kB 00:00 2024-04-22T07:16:32.850 INFO:teuthology.orchestra.run.smithi037.stdout:(120/150): python3-colorama-0.4.4-12.el9.noarch 701 kB/s | 35 kB 00:00 2024-04-22T07:16:32.875 INFO:teuthology.orchestra.run.smithi037.stdout:(121/150): python3-google-auth-2.28.2-1.el9.noa 3.9 MB/s | 203 kB 00:00 2024-04-22T07:16:32.917 INFO:teuthology.orchestra.run.smithi037.stdout:(122/150): python3-grpcio-tools-1.46.7-10.el9.x 3.4 MB/s | 144 kB 00:00 2024-04-22T07:16:32.960 INFO:teuthology.orchestra.run.smithi196.stdout:(116/150): python3-certifi-2021.10.8-2.el9.noar 56 kB/s | 15 kB 00:00 2024-04-22T07:16:32.967 INFO:teuthology.orchestra.run.smithi037.stdout:(123/150): python3-grpcio-1.46.7-10.el9.x86_64. 17 MB/s | 2.0 MB 00:00 2024-04-22T07:16:32.992 INFO:teuthology.orchestra.run.smithi037.stdout:(124/150): python3-jaraco-8.2.1-3.el9.noarch.rp 142 kB/s | 11 kB 00:00 2024-04-22T07:16:33.018 INFO:teuthology.orchestra.run.smithi037.stdout:(125/150): python3-jaraco-classes-3.2.1-5.el9.n 352 kB/s | 18 kB 00:00 2024-04-22T07:16:33.043 INFO:teuthology.orchestra.run.smithi037.stdout:(126/150): python3-jaraco-collections-3.0.0-8.e 461 kB/s | 23 kB 00:00 2024-04-22T07:16:33.068 INFO:teuthology.orchestra.run.smithi037.stdout:(127/150): python3-jaraco-functools-3.5.0-2.el9 388 kB/s | 19 kB 00:00 2024-04-22T07:16:33.094 INFO:teuthology.orchestra.run.smithi037.stdout:(128/150): python3-jaraco-text-3.2.0-6.el9.noar 392 kB/s | 20 kB 00:00 2024-04-22T07:16:33.135 INFO:teuthology.orchestra.run.smithi037.stdout:(129/150): python3-kubernetes-26.1.0-2.el9.noar 15 MB/s | 1.0 MB 00:00 2024-04-22T07:16:33.161 INFO:teuthology.orchestra.run.smithi037.stdout:(130/150): python3-logutils-0.3.5-21.el9.noarch 694 kB/s | 46 kB 00:00 2024-04-22T07:16:33.186 INFO:teuthology.orchestra.run.smithi037.stdout:(131/150): python3-more-itertools-8.12.0-2.el9. 1.5 MB/s | 79 kB 00:00 2024-04-22T07:16:33.212 INFO:teuthology.orchestra.run.smithi037.stdout:(132/150): python3-natsort-7.1.1-5.el9.noarch.r 1.1 MB/s | 58 kB 00:00 2024-04-22T07:16:33.219 INFO:teuthology.orchestra.run.smithi196.stdout:(117/150): python3-cheroot-8.6.0-4.el9.noarch.r 343 kB/s | 172 kB 00:00 2024-04-22T07:16:33.237 INFO:teuthology.orchestra.run.smithi037.stdout:(133/150): python3-pecan-1.4.2-3.el9.noarch.rpm 5.3 MB/s | 272 kB 00:00 2024-04-22T07:16:33.262 INFO:teuthology.orchestra.run.smithi037.stdout:(134/150): python3-portend-3.1.0-2.el9.noarch.r 328 kB/s | 16 kB 00:00 2024-04-22T07:16:33.287 INFO:teuthology.orchestra.run.smithi037.stdout:(135/150): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.8 MB/s | 90 kB 00:00 2024-04-22T07:16:33.312 INFO:teuthology.orchestra.run.smithi037.stdout:(136/150): python3-pyperclip-1.8.2-2.el9.noarch 564 kB/s | 28 kB 00:00 2024-04-22T07:16:33.338 INFO:teuthology.orchestra.run.smithi037.stdout:(137/150): python3-repoze-lru-0.7-16.el9.noarch 612 kB/s | 31 kB 00:00 2024-04-22T07:16:33.366 INFO:teuthology.orchestra.run.smithi037.stdout:(138/150): python3-routes-2.5.1-5.el9.noarch.rp 3.7 MB/s | 188 kB 00:00 2024-04-22T07:16:33.388 INFO:teuthology.orchestra.run.smithi037.stdout:(139/150): python3-rsa-4.9-2.el9.noarch.rpm 1.2 MB/s | 59 kB 00:00 2024-04-22T07:16:33.414 INFO:teuthology.orchestra.run.smithi037.stdout:(140/150): python3-tempora-5.0.0-2.el9.noarch.r 712 kB/s | 36 kB 00:00 2024-04-22T07:16:33.439 INFO:teuthology.orchestra.run.smithi037.stdout:(141/150): python3-typing-extensions-4.4.0-2.el 1.0 MB/s | 51 kB 00:00 2024-04-22T07:16:33.464 INFO:teuthology.orchestra.run.smithi037.stdout:(142/150): python3-webob-1.8.7-6.el9.noarch.rpm 4.5 MB/s | 230 kB 00:00 2024-04-22T07:16:33.489 INFO:teuthology.orchestra.run.smithi037.stdout:(143/150): python3-websocket-client-1.2.3-2.el9 1.8 MB/s | 90 kB 00:00 2024-04-22T07:16:33.515 INFO:teuthology.orchestra.run.smithi037.stdout:(144/150): python3-werkzeug-2.0.3-3.el9.1.noarc 8.3 MB/s | 427 kB 00:00 2024-04-22T07:16:33.540 INFO:teuthology.orchestra.run.smithi037.stdout:(145/150): python3-zc-lockfile-2.0-10.el9.noarc 399 kB/s | 20 kB 00:00 2024-04-22T07:16:33.552 INFO:teuthology.orchestra.run.smithi196.stdout:(118/150): python3-cherrypy-18.6.1-2.el9.noarch 606 kB/s | 358 kB 00:00 2024-04-22T07:16:33.565 INFO:teuthology.orchestra.run.smithi037.stdout:(146/150): re2-20211101-3.el9.x86_64.rpm 3.7 MB/s | 192 kB 00:00 2024-04-22T07:16:33.607 INFO:teuthology.orchestra.run.smithi037.stdout:(147/150): thrift-0.15.0-2.el9.x86_64.rpm 24 MB/s | 1.6 MB 00:00 2024-04-22T07:16:33.803 INFO:teuthology.orchestra.run.smithi196.stdout:(119/150): python3-cmd2-2.4.2-2.el9.noarch.rpm 520 kB/s | 303 kB 00:00 2024-04-22T07:16:33.828 INFO:teuthology.orchestra.run.smithi196.stdout:(120/150): python3-colorama-0.4.4-12.el9.noarch 128 kB/s | 35 kB 00:00 2024-04-22T07:16:34.032 INFO:teuthology.orchestra.run.smithi037.stdout:(148/150): ceph-test-19.0.0-3156.g86f7587a.el9. 5.1 MB/s | 49 MB 00:09 2024-04-22T07:16:34.303 INFO:teuthology.orchestra.run.smithi196.stdout:(121/150): python3-google-auth-2.28.2-1.el9.noa 405 kB/s | 203 kB 00:00 2024-04-22T07:16:34.474 INFO:teuthology.orchestra.run.smithi037.stdout:(149/150): librados2-19.0.0-3156.g86f7587a.el9. 3.7 MB/s | 3.4 MB 00:00 2024-04-22T07:16:34.524 INFO:teuthology.orchestra.run.smithi037.stdout:(150/150): librbd1-19.0.0-3156.g86f7587a.el9.x8 3.4 MB/s | 3.1 MB 00:00 2024-04-22T07:16:34.528 INFO:teuthology.orchestra.run.smithi037.stdout:-------------------------------------------------------------------------------- 2024-04-22T07:16:34.528 INFO:teuthology.orchestra.run.smithi037.stdout:Total 9.5 MB/s | 218 MB 00:22 2024-04-22T07:16:34.670 INFO:teuthology.orchestra.run.smithi196.stdout:(122/150): python3-grpcio-1.46.7-10.el9.x86_64. 2.4 MB/s | 2.0 MB 00:00 2024-04-22T07:16:34.728 INFO:teuthology.orchestra.run.smithi196.stdout:(123/150): python3-grpcio-tools-1.46.7-10.el9.x 340 kB/s | 144 kB 00:00 2024-04-22T07:16:34.845 INFO:teuthology.orchestra.run.smithi196.stdout:(124/150): python3-jaraco-8.2.1-3.el9.noarch.rp 61 kB/s | 11 kB 00:00 2024-04-22T07:16:34.987 INFO:teuthology.orchestra.run.smithi196.stdout:(125/150): python3-jaraco-classes-3.2.1-5.el9.n 68 kB/s | 18 kB 00:00 2024-04-22T07:16:35.112 INFO:teuthology.orchestra.run.smithi196.stdout:(126/150): python3-jaraco-collections-3.0.0-8.e 87 kB/s | 23 kB 00:00 2024-04-22T07:16:35.255 INFO:teuthology.orchestra.run.smithi196.stdout:(127/150): python3-jaraco-functools-3.5.0-2.el9 73 kB/s | 19 kB 00:00 2024-04-22T07:16:35.380 INFO:teuthology.orchestra.run.smithi196.stdout:(128/150): python3-jaraco-text-3.2.0-6.el9.noar 74 kB/s | 20 kB 00:00 2024-04-22T07:16:35.625 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction check 2024-04-22T07:16:35.767 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction check succeeded. 2024-04-22T07:16:35.767 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction test 2024-04-22T07:16:35.789 INFO:teuthology.orchestra.run.smithi196.stdout:(129/150): python3-scipy-1.6.2-8.el9.x86_64.rpm 2.4 MB/s | 16 MB 00:06 2024-04-22T07:16:35.814 INFO:teuthology.orchestra.run.smithi196.stdout:(130/150): python3-logutils-0.3.5-21.el9.noarch 107 kB/s | 46 kB 00:00 2024-04-22T07:16:36.139 INFO:teuthology.orchestra.run.smithi196.stdout:(131/150): python3-more-itertools-8.12.0-2.el9. 225 kB/s | 79 kB 00:00 2024-04-22T07:16:36.164 INFO:teuthology.orchestra.run.smithi196.stdout:(132/150): python3-natsort-7.1.1-5.el9.noarch.r 165 kB/s | 58 kB 00:00 2024-04-22T07:16:36.214 INFO:teuthology.orchestra.run.smithi196.stdout:(133/150): python3-kubernetes-26.1.0-2.el9.noar 1.1 MB/s | 1.0 MB 00:00 2024-04-22T07:16:36.423 INFO:teuthology.orchestra.run.smithi196.stdout:(134/150): python3-portend-3.1.0-2.el9.noarch.r 63 kB/s | 16 kB 00:00 2024-04-22T07:16:36.573 INFO:teuthology.orchestra.run.smithi196.stdout:(135/150): python3-pyOpenSSL-21.0.0-1.el9.noarc 251 kB/s | 90 kB 00:00 2024-04-22T07:16:36.657 INFO:teuthology.orchestra.run.smithi196.stdout:(136/150): python3-pecan-1.4.2-3.el9.noarch.rpm 526 kB/s | 272 kB 00:00 2024-04-22T07:16:36.690 INFO:teuthology.orchestra.run.smithi196.stdout:(137/150): python3-pyperclip-1.8.2-2.el9.noarch 106 kB/s | 28 kB 00:00 2024-04-22T07:16:36.841 INFO:teuthology.orchestra.run.smithi196.stdout:(138/150): python3-repoze-lru-0.7-16.el9.noarch 115 kB/s | 31 kB 00:00 2024-04-22T07:16:37.041 INFO:teuthology.orchestra.run.smithi196.stdout:(139/150): python3-rsa-4.9-2.el9.noarch.rpm 169 kB/s | 59 kB 00:00 2024-04-22T07:16:37.083 INFO:teuthology.orchestra.run.smithi196.stdout:(140/150): python3-routes-2.5.1-5.el9.noarch.rp 443 kB/s | 188 kB 00:00 2024-04-22T07:16:37.100 INFO:teuthology.orchestra.run.smithi196.stdout:(141/150): python3-tempora-5.0.0-2.el9.noarch.r 138 kB/s | 36 kB 00:00 2024-04-22T07:16:37.383 INFO:teuthology.orchestra.run.smithi196.stdout:(142/150): python3-typing-extensions-4.4.0-2.el 149 kB/s | 51 kB 00:00 2024-04-22T07:16:37.442 INFO:teuthology.orchestra.run.smithi196.stdout:(143/150): python3-websocket-client-1.2.3-2.el9 262 kB/s | 90 kB 00:00 2024-04-22T07:16:37.592 INFO:teuthology.orchestra.run.smithi196.stdout:(144/150): python3-webob-1.8.7-6.el9.noarch.rpm 451 kB/s | 230 kB 00:00 2024-04-22T07:16:37.598 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction test succeeded. 2024-04-22T07:16:37.598 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction 2024-04-22T07:16:37.701 INFO:teuthology.orchestra.run.smithi196.stdout:(145/150): python3-zc-lockfile-2.0-10.el9.noarc 77 kB/s | 20 kB 00:00 2024-04-22T07:16:37.976 INFO:teuthology.orchestra.run.smithi196.stdout:(146/150): python3-werkzeug-2.0.3-3.el9.1.noarc 721 kB/s | 427 kB 00:00 2024-04-22T07:16:38.101 INFO:teuthology.orchestra.run.smithi196.stdout:(147/150): re2-20211101-3.el9.x86_64.rpm 377 kB/s | 192 kB 00:00 2024-04-22T07:16:38.460 INFO:teuthology.orchestra.run.smithi196.stdout:(148/150): librados2-19.0.0-3156.g86f7587a.el9. 7.0 MB/s | 3.4 MB 00:00 2024-04-22T07:16:38.510 INFO:teuthology.orchestra.run.smithi196.stdout:(149/150): librbd1-19.0.0-3156.g86f7587a.el9.x8 7.7 MB/s | 3.1 MB 00:00 2024-04-22T07:16:38.552 INFO:teuthology.orchestra.run.smithi196.stdout:(150/150): thrift-0.15.0-2.el9.x86_64.rpm 1.9 MB/s | 1.6 MB 00:00 2024-04-22T07:16:38.556 INFO:teuthology.orchestra.run.smithi196.stdout:-------------------------------------------------------------------------------- 2024-04-22T07:16:38.556 INFO:teuthology.orchestra.run.smithi196.stdout:Total 8.1 MB/s | 218 MB 00:26 2024-04-22T07:16:39.625 INFO:teuthology.orchestra.run.smithi196.stdout:Running transaction check 2024-04-22T07:16:39.749 INFO:teuthology.orchestra.run.smithi196.stdout:Transaction check succeeded. 2024-04-22T07:16:39.749 INFO:teuthology.orchestra.run.smithi196.stdout:Running transaction test 2024-04-22T07:16:41.468 INFO:teuthology.orchestra.run.smithi196.stdout:Transaction test succeeded. 2024-04-22T07:16:41.469 INFO:teuthology.orchestra.run.smithi196.stdout:Running transaction 2024-04-22T07:16:43.647 INFO:teuthology.orchestra.run.smithi037.stdout: Preparing : 1/1 2024-04-22T07:16:43.770 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : thrift-0.15.0-2.el9.x86_64 1/152 2024-04-22T07:16:43.920 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 2/152 2024-04-22T07:16:43.966 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 3/152 2024-04-22T07:16:44.309 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 4/152 2024-04-22T07:16:44.412 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : librados2-2:19.0.0-3156.g86f7587a.el9.x86_64 5/152 2024-04-22T07:16:44.537 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: librados2-2:19.0.0-3156.g86f7587a.el9.x86_64 5/152 2024-04-22T07:16:44.563 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libcephfs2-2:19.0.0-3156.g86f7587a.el9.x86_64 6/152 2024-04-22T07:16:44.756 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: libcephfs2-2:19.0.0-3156.g86f7587a.el9.x86_64 6/152 2024-04-22T07:16:44.797 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-rados-2:19.0.0-3156.g86f7587a.el9.x86_64 7/152 2024-04-22T07:16:44.825 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 8/152 2024-04-22T07:16:44.851 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 9/152 2024-04-22T07:16:45.013 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 10/152 2024-04-22T07:16:45.065 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : postgresql-13.14-1.el9.x86_64 11/152 2024-04-22T07:16:45.093 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libcephsqlite-2:19.0.0-3156.g86f7587a.el9.x86_64 12/152 2024-04-22T07:16:45.199 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3156.g86f7587a.el9.x86_64 12/152 2024-04-22T07:16:45.227 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libradosstriper1-2:19.0.0-3156.g86f7587a.el9.x86 13/152 2024-04-22T07:16:45.290 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3156.g86f7587a.el9.x86 13/152 2024-04-22T07:16:45.311 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 14/152 2024-04-22T07:16:45.335 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 14/152 2024-04-22T07:16:45.555 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 15/152 2024-04-22T07:16:45.586 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 15/152 2024-04-22T07:16:45.697 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : re2-1:20211101-3.el9.x86_64 16/152 2024-04-22T07:16:45.798 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 17/152 2024-04-22T07:16:45.835 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 18/152 2024-04-22T07:16:45.996 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : liboath-2.6.7-2.el9.x86_64 19/152 2024-04-22T07:16:46.073 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 20/152 2024-04-22T07:16:46.112 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 21/152 2024-04-22T07:16:46.156 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 22/152 2024-04-22T07:16:46.197 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 23/152 2024-04-22T07:16:46.223 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : lua-5.4.4-4.el9.x86_64 24/152 2024-04-22T07:16:46.297 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 25/152 2024-04-22T07:16:46.348 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 26/152 2024-04-22T07:16:46.376 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 27/152 2024-04-22T07:16:46.420 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 28/152 2024-04-22T07:16:46.500 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 29/152 2024-04-22T07:16:46.531 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-ceph-common-2:19.0.0-3156.g86f7587a.el9. 30/152 2024-04-22T07:16:46.574 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-ceph-argparse-2:19.0.0-3156.g86f7587a.el 31/152 2024-04-22T07:16:46.603 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-cephfs-2:19.0.0-3156.g86f7587a.el9.x86_6 32/152 2024-04-22T07:16:46.679 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 33/152 2024-04-22T07:16:46.735 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : luarocks-3.9.2-1.el9.noarch 34/152 2024-04-22T07:16:46.814 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 35/152 2024-04-22T07:16:46.961 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 36/152 2024-04-22T07:16:47.015 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 37/152 2024-04-22T07:16:47.255 INFO:teuthology.orchestra.run.smithi196.stdout: Preparing : 1/1 2024-04-22T07:16:47.337 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : thrift-0.15.0-2.el9.x86_64 1/152 2024-04-22T07:16:47.362 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 2/152 2024-04-22T07:16:47.415 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 3/152 2024-04-22T07:16:47.585 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-rsa-4.9-2.el9.noarch 38/152 2024-04-22T07:16:47.669 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 39/152 2024-04-22T07:16:47.703 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 40/152 2024-04-22T07:16:47.745 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 4/152 2024-04-22T07:16:47.745 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 41/152 2024-04-22T07:16:47.784 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : librados-devel-2:19.0.0-3156.g86f7587a.el9.x86_6 42/152 2024-04-22T07:16:47.817 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 43/152 2024-04-22T07:16:47.855 INFO:teuthology.orchestra.run.smithi196.stdout: Upgrading : librados2-2:19.0.0-3156.g86f7587a.el9.x86_64 5/152 2024-04-22T07:16:47.874 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 44/152 2024-04-22T07:16:47.950 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 45/152 2024-04-22T07:16:47.975 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: librados2-2:19.0.0-3156.g86f7587a.el9.x86_64 5/152 2024-04-22T07:16:47.998 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : libcephfs2-2:19.0.0-3156.g86f7587a.el9.x86_64 6/152 2024-04-22T07:16:48.089 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: libcephfs2-2:19.0.0-3156.g86f7587a.el9.x86_64 6/152 2024-04-22T07:16:48.118 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 46/152 2024-04-22T07:16:48.131 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-rados-2:19.0.0-3156.g86f7587a.el9.x86_64 7/152 2024-04-22T07:16:48.154 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 47/152 2024-04-22T07:16:48.160 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 8/152 2024-04-22T07:16:48.186 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 9/152 2024-04-22T07:16:48.202 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 48/152 2024-04-22T07:16:48.237 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 49/152 2024-04-22T07:16:48.281 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 50/152 2024-04-22T07:16:48.331 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 51/152 2024-04-22T07:16:48.338 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 10/152 2024-04-22T07:16:48.400 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : postgresql-13.14-1.el9.x86_64 11/152 2024-04-22T07:16:48.427 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : libcephsqlite-2:19.0.0-3156.g86f7587a.el9.x86_64 12/152 2024-04-22T07:16:48.479 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 52/152 2024-04-22T07:16:48.520 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 53/152 2024-04-22T07:16:48.530 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3156.g86f7587a.el9.x86_64 12/152 2024-04-22T07:16:48.550 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 54/152 2024-04-22T07:16:48.554 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : libradosstriper1-2:19.0.0-3156.g86f7587a.el9.x86 13/152 2024-04-22T07:16:48.591 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 55/152 2024-04-22T07:16:48.608 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3156.g86f7587a.el9.x86 13/152 2024-04-22T07:16:48.629 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 14/152 2024-04-22T07:16:48.653 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 14/152 2024-04-22T07:16:48.693 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 56/152 2024-04-22T07:16:48.732 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-google-auth-1:2.28.2-1.el9.noarch 57/152 2024-04-22T07:16:48.772 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 58/152 2024-04-22T07:16:48.797 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 59/152 2024-04-22T07:16:48.822 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 60/152 2024-04-22T07:16:48.846 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 15/152 2024-04-22T07:16:48.879 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 15/152 2024-04-22T07:16:48.902 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 61/152 2024-04-22T07:16:48.986 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : re2-1:20211101-3.el9.x86_64 16/152 2024-04-22T07:16:49.040 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 62/152 2024-04-22T07:16:49.074 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 17/152 2024-04-22T07:16:49.120 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 18/152 2024-04-22T07:16:49.155 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 63/152 2024-04-22T07:16:49.155 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : liboath-2.6.7-2.el9.x86_64 19/152 2024-04-22T07:16:49.183 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 64/152 2024-04-22T07:16:49.217 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 65/152 2024-04-22T07:16:49.220 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 20/152 2024-04-22T07:16:49.254 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 21/152 2024-04-22T07:16:49.261 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : uuid-1.6.2-55.el9.x86_64 66/152 2024-04-22T07:16:49.297 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 22/152 2024-04-22T07:16:49.330 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 23/152 2024-04-22T07:16:49.333 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 67/152 2024-04-22T07:16:49.358 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : lua-5.4.4-4.el9.x86_64 24/152 2024-04-22T07:16:49.372 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 68/152 2024-04-22T07:16:49.402 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 69/152 2024-04-22T07:16:49.427 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 25/152 2024-04-22T07:16:49.436 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 70/152 2024-04-22T07:16:49.469 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 71/152 2024-04-22T07:16:49.489 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 26/152 2024-04-22T07:16:49.511 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 72/152 2024-04-22T07:16:49.519 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 27/152 2024-04-22T07:16:49.545 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 73/152 2024-04-22T07:16:49.554 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 28/152 2024-04-22T07:16:49.632 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 29/152 2024-04-22T07:16:49.637 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 74/152 2024-04-22T07:16:49.665 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-ceph-common-2:19.0.0-3156.g86f7587a.el9. 30/152 2024-04-22T07:16:49.685 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 75/152 2024-04-22T07:16:49.708 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-ceph-argparse-2:19.0.0-3156.g86f7587a.el 31/152 2024-04-22T07:16:49.715 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 76/152 2024-04-22T07:16:49.737 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-cephfs-2:19.0.0-3156.g86f7587a.el9.x86_6 32/152 2024-04-22T07:16:49.764 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 77/152 2024-04-22T07:16:49.808 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 33/152 2024-04-22T07:16:49.852 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : luarocks-3.9.2-1.el9.noarch 34/152 2024-04-22T07:16:49.876 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-packaging-20.9-5.el9.noarch 78/152 2024-04-22T07:16:49.927 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 79/152 2024-04-22T07:16:49.927 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 35/152 2024-04-22T07:16:50.062 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 36/152 2024-04-22T07:16:50.113 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 37/152 2024-04-22T07:16:50.648 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-rsa-4.9-2.el9.noarch 38/152 2024-04-22T07:16:50.720 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 80/152 2024-04-22T07:16:50.733 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 39/152 2024-04-22T07:16:50.762 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 40/152 2024-04-22T07:16:50.772 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 81/152 2024-04-22T07:16:50.805 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 41/152 2024-04-22T07:16:50.805 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 82/152 2024-04-22T07:16:50.843 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : librados-devel-2:19.0.0-3156.g86f7587a.el9.x86_6 42/152 2024-04-22T07:16:50.875 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 43/152 2024-04-22T07:16:50.912 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 83/152 2024-04-22T07:16:50.931 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 44/152 2024-04-22T07:16:50.965 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 84/152 2024-04-22T07:16:51.004 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 45/152 2024-04-22T07:16:51.035 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 46/152 2024-04-22T07:16:51.057 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 85/152 2024-04-22T07:16:51.071 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 47/152 2024-04-22T07:16:51.110 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 48/152 2024-04-22T07:16:51.132 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 86/152 2024-04-22T07:16:51.146 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 49/152 2024-04-22T07:16:51.189 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 50/152 2024-04-22T07:16:51.231 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 51/152 2024-04-22T07:16:51.309 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : openblas-0.3.21-2.el9.x86_64 87/152 2024-04-22T07:16:51.338 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 88/152 2024-04-22T07:16:51.369 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 52/152 2024-04-22T07:16:51.418 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 89/152 2024-04-22T07:16:51.420 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 53/152 2024-04-22T07:16:51.450 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 54/152 2024-04-22T07:16:51.500 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 55/152 2024-04-22T07:16:51.595 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 56/152 2024-04-22T07:16:51.633 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-google-auth-1:2.28.2-1.el9.noarch 57/152 2024-04-22T07:16:51.682 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 58/152 2024-04-22T07:16:51.707 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 59/152 2024-04-22T07:16:51.732 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 60/152 2024-04-22T07:16:51.807 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 61/152 2024-04-22T07:16:51.935 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 62/152 2024-04-22T07:16:51.972 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 63/152 2024-04-22T07:16:52.000 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 64/152 2024-04-22T07:16:52.034 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 65/152 2024-04-22T07:16:52.078 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : uuid-1.6.2-55.el9.x86_64 66/152 2024-04-22T07:16:52.116 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 67/152 2024-04-22T07:16:52.125 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 90/152 2024-04-22T07:16:52.148 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 68/152 2024-04-22T07:16:52.178 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 69/152 2024-04-22T07:16:52.212 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 70/152 2024-04-22T07:16:52.246 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 71/152 2024-04-22T07:16:52.251 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 91/152 2024-04-22T07:16:52.287 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 72/152 2024-04-22T07:16:52.321 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 73/152 2024-04-22T07:16:52.409 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 74/152 2024-04-22T07:16:52.452 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 75/152 2024-04-22T07:16:52.483 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 76/152 2024-04-22T07:16:52.530 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 77/152 2024-04-22T07:16:52.629 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-packaging-20.9-5.el9.noarch 78/152 2024-04-22T07:16:52.685 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 79/152 2024-04-22T07:16:53.421 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 80/152 2024-04-22T07:16:53.473 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 81/152 2024-04-22T07:16:53.507 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 82/152 2024-04-22T07:16:53.608 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 83/152 2024-04-22T07:16:53.618 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 92/152 2024-04-22T07:16:53.665 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 84/152 2024-04-22T07:16:53.692 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 93/152 2024-04-22T07:16:53.720 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 94/152 2024-04-22T07:16:53.753 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 85/152 2024-04-22T07:16:53.753 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 95/152 2024-04-22T07:16:53.800 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 86/152 2024-04-22T07:16:53.976 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : openblas-0.3.21-2.el9.x86_64 87/152 2024-04-22T07:16:54.014 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 88/152 2024-04-22T07:16:54.082 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 96/152 2024-04-22T07:16:54.092 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 89/152 2024-04-22T07:16:54.124 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : librbd1-2:19.0.0-3156.g86f7587a.el9.x86_64 97/152 2024-04-22T07:16:54.216 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: librbd1-2:19.0.0-3156.g86f7587a.el9.x86_64 97/152 2024-04-22T07:16:54.246 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-rbd-2:19.0.0-3156.g86f7587a.el9.x86_64 98/152 2024-04-22T07:16:54.282 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 99/152 2024-04-22T07:16:54.748 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 90/152 2024-04-22T07:16:54.788 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 100/152 2024-04-22T07:16:54.827 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : librgw2-2:19.0.0-3156.g86f7587a.el9.x86_64 101/152 2024-04-22T07:16:54.873 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 91/152 2024-04-22T07:16:54.899 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: librgw2-2:19.0.0-3156.g86f7587a.el9.x86_64 101/152 2024-04-22T07:16:54.920 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-rgw-2:19.0.0-3156.g86f7587a.el9.x86_64 102/152 2024-04-22T07:16:56.119 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 92/152 2024-04-22T07:16:56.193 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 93/152 2024-04-22T07:16:56.220 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 94/152 2024-04-22T07:16:56.245 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 95/152 2024-04-22T07:16:56.558 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 96/152 2024-04-22T07:16:56.600 INFO:teuthology.orchestra.run.smithi196.stdout: Upgrading : librbd1-2:19.0.0-3156.g86f7587a.el9.x86_64 97/152 2024-04-22T07:16:56.674 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: librbd1-2:19.0.0-3156.g86f7587a.el9.x86_64 97/152 2024-04-22T07:16:56.705 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-rbd-2:19.0.0-3156.g86f7587a.el9.x86_64 98/152 2024-04-22T07:16:56.741 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 99/152 2024-04-22T07:16:57.222 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 100/152 2024-04-22T07:16:57.244 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : librgw2-2:19.0.0-3156.g86f7587a.el9.x86_64 101/152 2024-04-22T07:16:57.306 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-common-2:19.0.0-3156.g86f7587a.el9.x86_64 103/152 2024-04-22T07:16:57.308 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: librgw2-2:19.0.0-3156.g86f7587a.el9.x86_64 101/152 2024-04-22T07:16:57.338 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-rgw-2:19.0.0-3156.g86f7587a.el9.x86_64 102/152 2024-04-22T07:16:57.342 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-common-2:19.0.0-3156.g86f7587a.el9.x86_64 103/152 2024-04-22T07:16:57.916 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-common-2:19.0.0-3156.g86f7587a.el9.x86_64 103/152 2024-04-22T07:16:57.962 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-base-2:19.0.0-3156.g86f7587a.el9.x86_64 104/152 2024-04-22T07:16:58.054 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-base-2:19.0.0-3156.g86f7587a.el9.x86_64 104/152 2024-04-22T07:16:58.054 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-22T07:16:58.054 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-22T07:16:58.054 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-22T07:16:58.088 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-selinux-2:19.0.0-3156.g86f7587a.el9.x86_64 105/152 2024-04-22T07:16:59.587 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: ceph-common-2:19.0.0-3156.g86f7587a.el9.x86_64 103/152 2024-04-22T07:16:59.625 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-common-2:19.0.0-3156.g86f7587a.el9.x86_64 103/152 2024-04-22T07:17:00.167 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: ceph-common-2:19.0.0-3156.g86f7587a.el9.x86_64 103/152 2024-04-22T07:17:00.204 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-base-2:19.0.0-3156.g86f7587a.el9.x86_64 104/152 2024-04-22T07:17:00.298 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: ceph-base-2:19.0.0-3156.g86f7587a.el9.x86_64 104/152 2024-04-22T07:17:00.298 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-22T07:17:00.298 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-22T07:17:00.298 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-04-22T07:17:00.330 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-selinux-2:19.0.0-3156.g86f7587a.el9.x86_64 105/152 2024-04-22T07:17:09.929 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3156.g86f7587a.el9.x86_64 105/152 2024-04-22T07:17:09.929 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /sys 2024-04-22T07:17:09.929 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /proc 2024-04-22T07:17:09.929 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /mnt 2024-04-22T07:17:09.929 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /var/tmp 2024-04-22T07:17:09.929 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /home 2024-04-22T07:17:09.930 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /root 2024-04-22T07:17:09.930 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /tmp 2024-04-22T07:17:09.930 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-22T07:17:10.117 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-volume-2:19.0.0-3156.g86f7587a.el9.noarch 106/152 2024-04-22T07:17:10.134 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-volume-2:19.0.0-3156.g86f7587a.el9.noarch 106/152 2024-04-22T07:17:10.134 INFO:teuthology.orchestra.run.smithi037.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-22T07:17:10.134 INFO:teuthology.orchestra.run.smithi037.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-22T07:17:10.134 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-22T07:17:11.662 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-osd-2:19.0.0-3156.g86f7587a.el9.x86_64 107/152 2024-04-22T07:17:11.679 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3156.g86f7587a.el9.x86_64 105/152 2024-04-22T07:17:11.679 INFO:teuthology.orchestra.run.smithi196.stdout:skipping the directory /sys 2024-04-22T07:17:11.679 INFO:teuthology.orchestra.run.smithi196.stdout:skipping the directory /proc 2024-04-22T07:17:11.680 INFO:teuthology.orchestra.run.smithi196.stdout:skipping the directory /mnt 2024-04-22T07:17:11.680 INFO:teuthology.orchestra.run.smithi196.stdout:skipping the directory /var/tmp 2024-04-22T07:17:11.680 INFO:teuthology.orchestra.run.smithi196.stdout:skipping the directory /home 2024-04-22T07:17:11.680 INFO:teuthology.orchestra.run.smithi196.stdout:skipping the directory /root 2024-04-22T07:17:11.680 INFO:teuthology.orchestra.run.smithi196.stdout:skipping the directory /tmp 2024-04-22T07:17:11.680 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-04-22T07:17:11.689 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-osd-2:19.0.0-3156.g86f7587a.el9.x86_64 107/152 2024-04-22T07:17:11.689 INFO:teuthology.orchestra.run.smithi037.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-22T07:17:11.690 INFO:teuthology.orchestra.run.smithi037.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-22T07:17:11.690 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-22T07:17:11.690 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-22T07:17:11.690 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-22T07:17:11.857 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-volume-2:19.0.0-3156.g86f7587a.el9.noarch 106/152 2024-04-22T07:17:11.874 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: ceph-volume-2:19.0.0-3156.g86f7587a.el9.noarch 106/152 2024-04-22T07:17:11.874 INFO:teuthology.orchestra.run.smithi196.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-22T07:17:11.874 INFO:teuthology.orchestra.run.smithi196.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-22T07:17:11.874 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-04-22T07:17:11.930 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mds-2:19.0.0-3156.g86f7587a.el9.x86_64 108/152 2024-04-22T07:17:11.954 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mds-2:19.0.0-3156.g86f7587a.el9.x86_64 108/152 2024-04-22T07:17:11.954 INFO:teuthology.orchestra.run.smithi037.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-22T07:17:11.954 INFO:teuthology.orchestra.run.smithi037.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-22T07:17:11.954 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-22T07:17:11.954 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-22T07:17:11.954 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-22T07:17:12.422 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mon-2:19.0.0-3156.g86f7587a.el9.x86_64 109/152 2024-04-22T07:17:12.446 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mon-2:19.0.0-3156.g86f7587a.el9.x86_64 109/152 2024-04-22T07:17:12.446 INFO:teuthology.orchestra.run.smithi037.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-22T07:17:12.446 INFO:teuthology.orchestra.run.smithi037.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-22T07:17:12.447 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-22T07:17:12.447 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-22T07:17:12.447 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-22T07:17:12.562 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : automake-1.16.2-8.el9.noarch 110/152 2024-04-22T07:17:12.620 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-ply-3.11-14.el9.noarch 111/152 2024-04-22T07:17:12.683 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 112/152 2024-04-22T07:17:12.883 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 113/152 2024-04-22T07:17:12.924 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 114/152 2024-04-22T07:17:13.006 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 115/152 2024-04-22T07:17:13.104 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 116/152 2024-04-22T07:17:13.246 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 117/152 2024-04-22T07:17:13.290 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 118/152 2024-04-22T07:17:13.322 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 119/152 2024-04-22T07:17:13.349 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : fuse-2.9.9-15.el9.x86_64 120/152 2024-04-22T07:17:13.352 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-osd-2:19.0.0-3156.g86f7587a.el9.x86_64 107/152 2024-04-22T07:17:13.377 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: ceph-osd-2:19.0.0-3156.g86f7587a.el9.x86_64 107/152 2024-04-22T07:17:13.377 INFO:teuthology.orchestra.run.smithi196.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-22T07:17:13.377 INFO:teuthology.orchestra.run.smithi196.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-22T07:17:13.377 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-22T07:17:13.377 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-22T07:17:13.377 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-04-22T07:17:13.603 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-mds-2:19.0.0-3156.g86f7587a.el9.x86_64 108/152 2024-04-22T07:17:13.625 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: ceph-mds-2:19.0.0-3156.g86f7587a.el9.x86_64 108/152 2024-04-22T07:17:13.625 INFO:teuthology.orchestra.run.smithi196.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-22T07:17:13.626 INFO:teuthology.orchestra.run.smithi196.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-22T07:17:13.626 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-22T07:17:13.626 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-22T07:17:13.626 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-04-22T07:17:13.830 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: cephadm-2:19.0.0-3156.g86f7587a.el9.noarch 121/152 2024-04-22T07:17:13.856 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : cephadm-2:19.0.0-3156.g86f7587a.el9.noarch 121/152 2024-04-22T07:17:13.890 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3156.g86f7587a.e 122/152 2024-04-22T07:17:13.955 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3156.g86f7587a. 123/152 2024-04-22T07:17:13.979 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3156.g86f7587a.el9.noa 124/152 2024-04-22T07:17:14.070 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-mon-2:19.0.0-3156.g86f7587a.el9.x86_64 109/152 2024-04-22T07:17:14.093 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: ceph-mon-2:19.0.0-3156.g86f7587a.el9.x86_64 109/152 2024-04-22T07:17:14.093 INFO:teuthology.orchestra.run.smithi196.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-22T07:17:14.093 INFO:teuthology.orchestra.run.smithi196.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-22T07:17:14.093 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-22T07:17:14.093 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-22T07:17:14.093 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-04-22T07:17:14.191 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : automake-1.16.2-8.el9.noarch 110/152 2024-04-22T07:17:14.239 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-ply-3.11-14.el9.noarch 111/152 2024-04-22T07:17:14.303 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 112/152 2024-04-22T07:17:14.496 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 113/152 2024-04-22T07:17:14.545 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 114/152 2024-04-22T07:17:14.623 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 115/152 2024-04-22T07:17:14.744 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 116/152 2024-04-22T07:17:14.885 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 117/152 2024-04-22T07:17:14.929 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 118/152 2024-04-22T07:17:14.960 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 119/152 2024-04-22T07:17:14.988 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : fuse-2.9.9-15.el9.x86_64 120/152 2024-04-22T07:17:15.077 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3156.g86f7587a.el9.noa 124/152 2024-04-22T07:17:15.114 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3156.g86f7587a.el9.n 125/152 2024-04-22T07:17:15.374 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: cephadm-2:19.0.0-3156.g86f7587a.el9.noarch 121/152 2024-04-22T07:17:15.403 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : cephadm-2:19.0.0-3156.g86f7587a.el9.noarch 121/152 2024-04-22T07:17:15.435 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3156.g86f7587a.e 122/152 2024-04-22T07:17:15.498 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3156.g86f7587a. 123/152 2024-04-22T07:17:15.526 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3156.g86f7587a.el9.noa 124/152 2024-04-22T07:17:16.131 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3156.g86f7587a.el9.n 125/152 2024-04-22T07:17:16.175 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3156.g86f 126/152 2024-04-22T07:17:16.283 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3156.g86f 126/152 2024-04-22T07:17:16.452 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3156.g86f7587a.el 127/152 2024-04-22T07:17:16.484 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mgr-2:19.0.0-3156.g86f7587a.el9.x86_64 128/152 2024-04-22T07:17:16.508 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3156.g86f7587a.el9.x86_64 128/152 2024-04-22T07:17:16.508 INFO:teuthology.orchestra.run.smithi037.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-22T07:17:16.508 INFO:teuthology.orchestra.run.smithi037.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-22T07:17:16.508 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-22T07:17:16.508 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-22T07:17:16.508 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-22T07:17:16.559 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mgr-rook-2:19.0.0-3156.g86f7587a.el9.noarch 129/152 2024-04-22T07:17:16.560 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3156.g86f7587a.el9.noa 124/152 2024-04-22T07:17:16.571 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3156.g86f7587a.el9.noarch 129/152 2024-04-22T07:17:16.595 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3156.g86f7587a.el9.n 125/152 2024-04-22T07:17:16.672 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-2:19.0.0-3156.g86f7587a.el9.x86_64 130/152 2024-04-22T07:17:16.726 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-fuse-2:19.0.0-3156.g86f7587a.el9.x86_64 131/152 2024-04-22T07:17:17.559 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3156.g86f7587a.el9.n 125/152 2024-04-22T07:17:17.587 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3156.g86f 126/152 2024-04-22T07:17:17.689 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3156.g86f 126/152 2024-04-22T07:17:17.700 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libtool-2.4.6-45.el9.x86_64 132/152 2024-04-22T07:17:17.737 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-radosgw-2:19.0.0-3156.g86f7587a.el9.x86_64 133/152 2024-04-22T07:17:17.761 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3156.g86f7587a.el9.x86_64 133/152 2024-04-22T07:17:17.761 INFO:teuthology.orchestra.run.smithi037.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-22T07:17:17.761 INFO:teuthology.orchestra.run.smithi037.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-22T07:17:17.761 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-22T07:17:17.761 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-22T07:17:17.761 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-22T07:17:17.804 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3156.g86f75 134/152 2024-04-22T07:17:17.827 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3156.g86f75 134/152 2024-04-22T07:17:17.827 INFO:teuthology.orchestra.run.smithi037.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-22T07:17:17.827 INFO:teuthology.orchestra.run.smithi037.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-22T07:17:17.828 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-22T07:17:17.858 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3156.g86f7587a.el 127/152 2024-04-22T07:17:17.880 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : cephfs-mirror-2:19.0.0-3156.g86f7587a.el9.x86_64 135/152 2024-04-22T07:17:17.888 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-mgr-2:19.0.0-3156.g86f7587a.el9.x86_64 128/152 2024-04-22T07:17:17.904 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-3156.g86f7587a.el9.x86_64 135/152 2024-04-22T07:17:17.904 INFO:teuthology.orchestra.run.smithi037.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-22T07:17:17.904 INFO:teuthology.orchestra.run.smithi037.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-04-22T07:17:17.904 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-22T07:17:17.904 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-22T07:17:17.905 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-22T07:17:17.912 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3156.g86f7587a.el9.x86_64 128/152 2024-04-22T07:17:17.912 INFO:teuthology.orchestra.run.smithi196.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-22T07:17:17.912 INFO:teuthology.orchestra.run.smithi196.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-22T07:17:17.912 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-22T07:17:17.912 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-22T07:17:17.912 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-04-22T07:17:17.956 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-mgr-rook-2:19.0.0-3156.g86f7587a.el9.noarch 129/152 2024-04-22T07:17:17.967 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3156.g86f7587a.el9.noarch 129/152 2024-04-22T07:17:18.065 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-2:19.0.0-3156.g86f7587a.el9.x86_64 130/152 2024-04-22T07:17:18.129 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-fuse-2:19.0.0-3156.g86f7587a.el9.x86_64 131/152 2024-04-22T07:17:18.222 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : rbd-mirror-2:19.0.0-3156.g86f7587a.el9.x86_64 136/152 2024-04-22T07:17:18.246 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3156.g86f7587a.el9.x86_64 136/152 2024-04-22T07:17:18.247 INFO:teuthology.orchestra.run.smithi037.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-22T07:17:18.247 INFO:teuthology.orchestra.run.smithi037.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-22T07:17:18.247 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-22T07:17:18.247 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-22T07:17:18.247 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-22T07:17:19.056 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : libtool-2.4.6-45.el9.x86_64 132/152 2024-04-22T07:17:19.083 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-radosgw-2:19.0.0-3156.g86f7587a.el9.x86_64 133/152 2024-04-22T07:17:19.106 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3156.g86f7587a.el9.x86_64 133/152 2024-04-22T07:17:19.106 INFO:teuthology.orchestra.run.smithi196.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-22T07:17:19.106 INFO:teuthology.orchestra.run.smithi196.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-22T07:17:19.106 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-22T07:17:19.107 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-22T07:17:19.107 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-04-22T07:17:19.151 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3156.g86f75 134/152 2024-04-22T07:17:19.173 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3156.g86f75 134/152 2024-04-22T07:17:19.173 INFO:teuthology.orchestra.run.smithi196.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-22T07:17:19.173 INFO:teuthology.orchestra.run.smithi196.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-22T07:17:19.173 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-04-22T07:17:19.226 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : cephfs-mirror-2:19.0.0-3156.g86f7587a.el9.x86_64 135/152 2024-04-22T07:17:19.249 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-3156.g86f7587a.el9.x86_64 135/152 2024-04-22T07:17:19.249 INFO:teuthology.orchestra.run.smithi196.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-22T07:17:19.249 INFO:teuthology.orchestra.run.smithi196.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-04-22T07:17:19.249 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-22T07:17:19.249 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-22T07:17:19.249 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-04-22T07:17:19.561 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : rbd-mirror-2:19.0.0-3156.g86f7587a.el9.x86_64 136/152 2024-04-22T07:17:19.584 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3156.g86f7587a.el9.x86_64 136/152 2024-04-22T07:17:19.584 INFO:teuthology.orchestra.run.smithi196.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-22T07:17:19.584 INFO:teuthology.orchestra.run.smithi196.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-22T07:17:19.584 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-22T07:17:19.584 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-22T07:17:19.584 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-04-22T07:17:23.101 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-test-2:19.0.0-3156.g86f7587a.el9.x86_64 137/152 2024-04-22T07:17:23.142 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : rbd-fuse-2:19.0.0-3156.g86f7587a.el9.x86_64 138/152 2024-04-22T07:17:23.183 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : rbd-nbd-2:19.0.0-3156.g86f7587a.el9.x86_64 139/152 2024-04-22T07:17:23.215 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 140/152 2024-04-22T07:17:23.242 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 141/152 2024-04-22T07:17:23.428 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : cephfs-shell-2:19.0.0-3156.g86f7587a.el9.x86_64 142/152 2024-04-22T07:17:23.472 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 143/152 2024-04-22T07:17:23.501 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libcephfs-devel-2:19.0.0-3156.g86f7587a.el9.x86_ 144/152 2024-04-22T07:17:24.120 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 145/152 2024-04-22T07:17:24.165 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 145/152 2024-04-22T07:17:24.186 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 145/152 2024-04-22T07:17:24.222 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-test-2:19.0.0-3156.g86f7587a.el9.x86_64 137/152 2024-04-22T07:17:24.263 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : rbd-fuse-2:19.0.0-3156.g86f7587a.el9.x86_64 138/152 2024-04-22T07:17:24.304 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : rbd-nbd-2:19.0.0-3156.g86f7587a.el9.x86_64 139/152 2024-04-22T07:17:24.336 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 140/152 2024-04-22T07:17:24.363 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 141/152 2024-04-22T07:17:24.544 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : cephfs-shell-2:19.0.0-3156.g86f7587a.el9.x86_64 142/152 2024-04-22T07:17:24.601 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 143/152 2024-04-22T07:17:24.631 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : libcephfs-devel-2:19.0.0-3156.g86f7587a.el9.x86_ 144/152 2024-04-22T07:17:25.040 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : cephfs-top-2:19.0.0-3156.g86f7587a.el9.noarch 146/152 2024-04-22T07:17:25.128 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : openssl-devel-1:3.0.7-27.el9.x86_64 147/152 2024-04-22T07:17:25.170 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 148/152 2024-04-22T07:17:25.252 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 145/152 2024-04-22T07:17:25.254 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : flex-2.6.4-9.el9.x86_64 149/152 2024-04-22T07:17:25.295 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 145/152 2024-04-22T07:17:25.299 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : bison-3.7.4-5.el9.x86_64 150/152 2024-04-22T07:17:25.299 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 151/152 2024-04-22T07:17:25.315 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 145/152 2024-04-22T07:17:25.383 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 151/152 2024-04-22T07:17:25.383 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 152/152 2024-04-22T07:17:26.088 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : cephfs-top-2:19.0.0-3156.g86f7587a.el9.noarch 146/152 2024-04-22T07:17:26.182 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : openssl-devel-1:3.0.7-27.el9.x86_64 147/152 2024-04-22T07:17:26.223 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 148/152 2024-04-22T07:17:26.303 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : flex-2.6.4-9.el9.x86_64 149/152 2024-04-22T07:17:26.336 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : bison-3.7.4-5.el9.x86_64 150/152 2024-04-22T07:17:26.336 INFO:teuthology.orchestra.run.smithi196.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 151/152 2024-04-22T07:17:26.414 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 151/152 2024-04-22T07:17:26.414 INFO:teuthology.orchestra.run.smithi196.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 152/152 2024-04-22T07:17:31.217 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 152/152 2024-04-22T07:17:31.217 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-2:19.0.0-3156.g86f7587a.el9.x86_64 1/152 2024-04-22T07:17:31.217 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-base-2:19.0.0-3156.g86f7587a.el9.x86_64 2/152 2024-04-22T07:17:31.218 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-common-2:19.0.0-3156.g86f7587a.el9.x86_64 3/152 2024-04-22T07:17:31.218 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-fuse-2:19.0.0-3156.g86f7587a.el9.x86_64 4/152 2024-04-22T07:17:31.218 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3156.g86f75 5/152 2024-04-22T07:17:31.218 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mds-2:19.0.0-3156.g86f7587a.el9.x86_64 6/152 2024-04-22T07:17:31.218 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mgr-2:19.0.0-3156.g86f7587a.el9.x86_64 7/152 2024-04-22T07:17:31.218 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mon-2:19.0.0-3156.g86f7587a.el9.x86_64 8/152 2024-04-22T07:17:31.218 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-osd-2:19.0.0-3156.g86f7587a.el9.x86_64 9/152 2024-04-22T07:17:31.218 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-radosgw-2:19.0.0-3156.g86f7587a.el9.x86_64 10/152 2024-04-22T07:17:31.218 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-selinux-2:19.0.0-3156.g86f7587a.el9.x86_64 11/152 2024-04-22T07:17:31.218 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-test-2:19.0.0-3156.g86f7587a.el9.x86_64 12/152 2024-04-22T07:17:31.218 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : cephfs-mirror-2:19.0.0-3156.g86f7587a.el9.x86_64 13/152 2024-04-22T07:17:31.218 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : cephfs-shell-2:19.0.0-3156.g86f7587a.el9.x86_64 14/152 2024-04-22T07:17:31.219 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libcephfs-devel-2:19.0.0-3156.g86f7587a.el9.x86_ 15/152 2024-04-22T07:17:31.219 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libcephfs2-2:19.0.0-3156.g86f7587a.el9.x86_64 16/152 2024-04-22T07:17:31.219 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libcephsqlite-2:19.0.0-3156.g86f7587a.el9.x86_64 17/152 2024-04-22T07:17:31.219 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librados-devel-2:19.0.0-3156.g86f7587a.el9.x86_6 18/152 2024-04-22T07:17:31.219 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libradosstriper1-2:19.0.0-3156.g86f7587a.el9.x86 19/152 2024-04-22T07:17:31.219 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librgw2-2:19.0.0-3156.g86f7587a.el9.x86_64 20/152 2024-04-22T07:17:31.219 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3156.g86f7587a.el 21/152 2024-04-22T07:17:31.219 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-ceph-common-2:19.0.0-3156.g86f7587a.el9. 22/152 2024-04-22T07:17:31.219 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-cephfs-2:19.0.0-3156.g86f7587a.el9.x86_6 23/152 2024-04-22T07:17:31.219 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-rados-2:19.0.0-3156.g86f7587a.el9.x86_64 24/152 2024-04-22T07:17:31.219 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-rbd-2:19.0.0-3156.g86f7587a.el9.x86_64 25/152 2024-04-22T07:17:31.219 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-rgw-2:19.0.0-3156.g86f7587a.el9.x86_64 26/152 2024-04-22T07:17:31.219 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : rbd-fuse-2:19.0.0-3156.g86f7587a.el9.x86_64 27/152 2024-04-22T07:17:31.220 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : rbd-mirror-2:19.0.0-3156.g86f7587a.el9.x86_64 28/152 2024-04-22T07:17:31.220 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : rbd-nbd-2:19.0.0-3156.g86f7587a.el9.x86_64 29/152 2024-04-22T07:17:31.230 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3156.g86f7587a. 30/152 2024-04-22T07:17:31.231 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3156.g86f7587a.el9.noa 31/152 2024-04-22T07:17:31.231 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3156.g86f7587a.el9.n 32/152 2024-04-22T07:17:31.231 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3156.g86f 33/152 2024-04-22T07:17:31.231 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3156.g86f7587a.el 34/152 2024-04-22T07:17:31.231 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3156.g86f7587a.el9.noarch 35/152 2024-04-22T07:17:31.231 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3156.g86f7587a.e 36/152 2024-04-22T07:17:31.231 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-volume-2:19.0.0-3156.g86f7587a.el9.noarch 37/152 2024-04-22T07:17:31.231 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : cephadm-2:19.0.0-3156.g86f7587a.el9.noarch 38/152 2024-04-22T07:17:31.231 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : cephfs-top-2:19.0.0-3156.g86f7587a.el9.noarch 39/152 2024-04-22T07:17:31.231 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/152 2024-04-22T07:17:31.231 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/152 2024-04-22T07:17:31.231 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/152 2024-04-22T07:17:31.231 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/152 2024-04-22T07:17:31.232 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/152 2024-04-22T07:17:31.232 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/152 2024-04-22T07:17:31.232 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/152 2024-04-22T07:17:31.232 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/152 2024-04-22T07:17:31.232 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/152 2024-04-22T07:17:31.232 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/152 2024-04-22T07:17:31.232 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/152 2024-04-22T07:17:31.232 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/152 2024-04-22T07:17:31.232 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 52/152 2024-04-22T07:17:31.232 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/152 2024-04-22T07:17:31.232 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/152 2024-04-22T07:17:31.232 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/152 2024-04-22T07:17:31.232 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/152 2024-04-22T07:17:31.233 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/152 2024-04-22T07:17:31.233 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/152 2024-04-22T07:17:31.233 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/152 2024-04-22T07:17:31.233 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/152 2024-04-22T07:17:31.233 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/152 2024-04-22T07:17:31.233 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/152 2024-04-22T07:17:31.233 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/152 2024-04-22T07:17:31.233 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/152 2024-04-22T07:17:31.233 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/152 2024-04-22T07:17:31.233 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/152 2024-04-22T07:17:31.233 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/152 2024-04-22T07:17:31.233 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : openssl-devel-1:3.0.7-27.el9.x86_64 68/152 2024-04-22T07:17:31.233 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/152 2024-04-22T07:17:31.233 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/152 2024-04-22T07:17:31.234 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/152 2024-04-22T07:17:31.234 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/152 2024-04-22T07:17:31.234 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/152 2024-04-22T07:17:31.234 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/152 2024-04-22T07:17:31.234 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/152 2024-04-22T07:17:31.234 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 76/152 2024-04-22T07:17:31.234 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 77/152 2024-04-22T07:17:31.234 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 78/152 2024-04-22T07:17:31.234 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 79/152 2024-04-22T07:17:31.234 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 80/152 2024-04-22T07:17:31.234 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 81/152 2024-04-22T07:17:31.234 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 82/152 2024-04-22T07:17:31.234 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/152 2024-04-22T07:17:31.235 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 84/152 2024-04-22T07:17:31.235 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 85/152 2024-04-22T07:17:31.235 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/152 2024-04-22T07:17:31.235 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 87/152 2024-04-22T07:17:31.235 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 88/152 2024-04-22T07:17:31.235 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 89/152 2024-04-22T07:17:31.235 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 90/152 2024-04-22T07:17:31.235 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/152 2024-04-22T07:17:31.235 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 92/152 2024-04-22T07:17:31.235 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 93/152 2024-04-22T07:17:31.235 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 94/152 2024-04-22T07:17:31.235 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 95/152 2024-04-22T07:17:31.235 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 96/152 2024-04-22T07:17:31.236 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 97/152 2024-04-22T07:17:31.236 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 98/152 2024-04-22T07:17:31.236 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 99/152 2024-04-22T07:17:31.236 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 100/152 2024-04-22T07:17:31.236 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 101/152 2024-04-22T07:17:31.236 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 102/152 2024-04-22T07:17:31.236 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 103/152 2024-04-22T07:17:31.236 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 104/152 2024-04-22T07:17:31.236 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 105/152 2024-04-22T07:17:31.236 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 106/152 2024-04-22T07:17:31.236 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 107/152 2024-04-22T07:17:31.236 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 108/152 2024-04-22T07:17:31.236 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 109/152 2024-04-22T07:17:31.236 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 110/152 2024-04-22T07:17:31.237 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 111/152 2024-04-22T07:17:31.237 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 112/152 2024-04-22T07:17:31.237 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 113/152 2024-04-22T07:17:31.237 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 114/152 2024-04-22T07:17:31.237 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 115/152 2024-04-22T07:17:31.237 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 116/152 2024-04-22T07:17:31.237 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 117/152 2024-04-22T07:17:31.237 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 118/152 2024-04-22T07:17:31.237 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 119/152 2024-04-22T07:17:31.237 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 120/152 2024-04-22T07:17:31.237 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 121/152 2024-04-22T07:17:31.237 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-google-auth-1:2.28.2-1.el9.noarch 122/152 2024-04-22T07:17:31.237 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/152 2024-04-22T07:17:31.237 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/152 2024-04-22T07:17:31.237 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/152 2024-04-22T07:17:31.238 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/152 2024-04-22T07:17:31.238 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/152 2024-04-22T07:17:31.238 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/152 2024-04-22T07:17:31.238 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/152 2024-04-22T07:17:31.238 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/152 2024-04-22T07:17:31.238 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/152 2024-04-22T07:17:31.238 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/152 2024-04-22T07:17:31.238 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/152 2024-04-22T07:17:31.238 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/152 2024-04-22T07:17:31.238 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/152 2024-04-22T07:17:31.238 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/152 2024-04-22T07:17:31.238 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/152 2024-04-22T07:17:31.238 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/152 2024-04-22T07:17:31.239 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/152 2024-04-22T07:17:31.239 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/152 2024-04-22T07:17:31.239 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/152 2024-04-22T07:17:31.239 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/152 2024-04-22T07:17:31.239 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/152 2024-04-22T07:17:31.239 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/152 2024-04-22T07:17:31.239 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/152 2024-04-22T07:17:31.239 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/152 2024-04-22T07:17:31.239 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/152 2024-04-22T07:17:31.239 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/152 2024-04-22T07:17:31.239 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librados2-2:19.0.0-3156.g86f7587a.el9.x86_64 149/152 2024-04-22T07:17:31.239 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/152 2024-04-22T07:17:31.239 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librbd1-2:19.0.0-3156.g86f7587a.el9.x86_64 151/152 2024-04-22T07:17:32.314 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 152/152 2024-04-22T07:17:32.315 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-2:19.0.0-3156.g86f7587a.el9.x86_64 1/152 2024-04-22T07:17:32.315 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-base-2:19.0.0-3156.g86f7587a.el9.x86_64 2/152 2024-04-22T07:17:32.315 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-common-2:19.0.0-3156.g86f7587a.el9.x86_64 3/152 2024-04-22T07:17:32.315 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-fuse-2:19.0.0-3156.g86f7587a.el9.x86_64 4/152 2024-04-22T07:17:32.315 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3156.g86f75 5/152 2024-04-22T07:17:32.315 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-mds-2:19.0.0-3156.g86f7587a.el9.x86_64 6/152 2024-04-22T07:17:32.315 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-mgr-2:19.0.0-3156.g86f7587a.el9.x86_64 7/152 2024-04-22T07:17:32.315 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-mon-2:19.0.0-3156.g86f7587a.el9.x86_64 8/152 2024-04-22T07:17:32.315 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-osd-2:19.0.0-3156.g86f7587a.el9.x86_64 9/152 2024-04-22T07:17:32.315 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-radosgw-2:19.0.0-3156.g86f7587a.el9.x86_64 10/152 2024-04-22T07:17:32.315 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-selinux-2:19.0.0-3156.g86f7587a.el9.x86_64 11/152 2024-04-22T07:17:32.316 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-test-2:19.0.0-3156.g86f7587a.el9.x86_64 12/152 2024-04-22T07:17:32.316 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : cephfs-mirror-2:19.0.0-3156.g86f7587a.el9.x86_64 13/152 2024-04-22T07:17:32.316 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : cephfs-shell-2:19.0.0-3156.g86f7587a.el9.x86_64 14/152 2024-04-22T07:17:32.316 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : libcephfs-devel-2:19.0.0-3156.g86f7587a.el9.x86_ 15/152 2024-04-22T07:17:32.316 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : libcephfs2-2:19.0.0-3156.g86f7587a.el9.x86_64 16/152 2024-04-22T07:17:32.316 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : libcephsqlite-2:19.0.0-3156.g86f7587a.el9.x86_64 17/152 2024-04-22T07:17:32.316 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : librados-devel-2:19.0.0-3156.g86f7587a.el9.x86_6 18/152 2024-04-22T07:17:32.316 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : libradosstriper1-2:19.0.0-3156.g86f7587a.el9.x86 19/152 2024-04-22T07:17:32.316 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : librgw2-2:19.0.0-3156.g86f7587a.el9.x86_64 20/152 2024-04-22T07:17:32.316 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3156.g86f7587a.el 21/152 2024-04-22T07:17:32.316 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-ceph-common-2:19.0.0-3156.g86f7587a.el9. 22/152 2024-04-22T07:17:32.317 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-cephfs-2:19.0.0-3156.g86f7587a.el9.x86_6 23/152 2024-04-22T07:17:32.317 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-rados-2:19.0.0-3156.g86f7587a.el9.x86_64 24/152 2024-04-22T07:17:32.317 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-rbd-2:19.0.0-3156.g86f7587a.el9.x86_64 25/152 2024-04-22T07:17:32.317 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-rgw-2:19.0.0-3156.g86f7587a.el9.x86_64 26/152 2024-04-22T07:17:32.317 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : rbd-fuse-2:19.0.0-3156.g86f7587a.el9.x86_64 27/152 2024-04-22T07:17:32.317 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : rbd-mirror-2:19.0.0-3156.g86f7587a.el9.x86_64 28/152 2024-04-22T07:17:32.317 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : rbd-nbd-2:19.0.0-3156.g86f7587a.el9.x86_64 29/152 2024-04-22T07:17:32.317 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3156.g86f7587a. 30/152 2024-04-22T07:17:32.317 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3156.g86f7587a.el9.noa 31/152 2024-04-22T07:17:32.317 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3156.g86f7587a.el9.n 32/152 2024-04-22T07:17:32.317 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3156.g86f 33/152 2024-04-22T07:17:32.317 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3156.g86f7587a.el 34/152 2024-04-22T07:17:32.317 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3156.g86f7587a.el9.noarch 35/152 2024-04-22T07:17:32.318 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3156.g86f7587a.e 36/152 2024-04-22T07:17:32.318 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-volume-2:19.0.0-3156.g86f7587a.el9.noarch 37/152 2024-04-22T07:17:32.318 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : cephadm-2:19.0.0-3156.g86f7587a.el9.noarch 38/152 2024-04-22T07:17:32.318 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : cephfs-top-2:19.0.0-3156.g86f7587a.el9.noarch 39/152 2024-04-22T07:17:32.318 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/152 2024-04-22T07:17:32.318 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/152 2024-04-22T07:17:32.318 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/152 2024-04-22T07:17:32.318 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/152 2024-04-22T07:17:32.318 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/152 2024-04-22T07:17:32.318 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/152 2024-04-22T07:17:32.318 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/152 2024-04-22T07:17:32.318 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/152 2024-04-22T07:17:32.319 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/152 2024-04-22T07:17:32.319 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/152 2024-04-22T07:17:32.319 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/152 2024-04-22T07:17:32.319 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/152 2024-04-22T07:17:32.319 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 52/152 2024-04-22T07:17:32.319 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/152 2024-04-22T07:17:32.319 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/152 2024-04-22T07:17:32.319 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/152 2024-04-22T07:17:32.319 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/152 2024-04-22T07:17:32.319 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/152 2024-04-22T07:17:32.319 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/152 2024-04-22T07:17:32.319 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/152 2024-04-22T07:17:32.319 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/152 2024-04-22T07:17:32.319 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/152 2024-04-22T07:17:32.320 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/152 2024-04-22T07:17:32.320 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/152 2024-04-22T07:17:32.320 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/152 2024-04-22T07:17:32.320 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/152 2024-04-22T07:17:32.320 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/152 2024-04-22T07:17:32.320 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/152 2024-04-22T07:17:32.320 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : openssl-devel-1:3.0.7-27.el9.x86_64 68/152 2024-04-22T07:17:32.320 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/152 2024-04-22T07:17:32.320 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/152 2024-04-22T07:17:32.320 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/152 2024-04-22T07:17:32.320 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/152 2024-04-22T07:17:32.320 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/152 2024-04-22T07:17:32.320 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/152 2024-04-22T07:17:32.320 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/152 2024-04-22T07:17:32.320 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 76/152 2024-04-22T07:17:32.321 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 77/152 2024-04-22T07:17:32.321 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 78/152 2024-04-22T07:17:32.321 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 79/152 2024-04-22T07:17:32.321 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 80/152 2024-04-22T07:17:32.321 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 81/152 2024-04-22T07:17:32.321 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 82/152 2024-04-22T07:17:32.321 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/152 2024-04-22T07:17:32.321 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 84/152 2024-04-22T07:17:32.321 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 85/152 2024-04-22T07:17:32.321 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/152 2024-04-22T07:17:32.321 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 87/152 2024-04-22T07:17:32.321 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 88/152 2024-04-22T07:17:32.321 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 89/152 2024-04-22T07:17:32.321 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 90/152 2024-04-22T07:17:32.322 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/152 2024-04-22T07:17:32.322 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 92/152 2024-04-22T07:17:32.322 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 93/152 2024-04-22T07:17:32.322 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 94/152 2024-04-22T07:17:32.322 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 95/152 2024-04-22T07:17:32.322 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 96/152 2024-04-22T07:17:32.322 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 97/152 2024-04-22T07:17:32.322 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 98/152 2024-04-22T07:17:32.322 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 99/152 2024-04-22T07:17:32.322 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 100/152 2024-04-22T07:17:32.322 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 101/152 2024-04-22T07:17:32.322 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 102/152 2024-04-22T07:17:32.322 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 103/152 2024-04-22T07:17:32.323 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 104/152 2024-04-22T07:17:32.323 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 105/152 2024-04-22T07:17:32.323 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 106/152 2024-04-22T07:17:32.323 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 107/152 2024-04-22T07:17:32.323 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 108/152 2024-04-22T07:17:32.323 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 109/152 2024-04-22T07:17:32.323 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 110/152 2024-04-22T07:17:32.323 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 111/152 2024-04-22T07:17:32.323 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 112/152 2024-04-22T07:17:32.324 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 113/152 2024-04-22T07:17:32.324 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 114/152 2024-04-22T07:17:32.324 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 115/152 2024-04-22T07:17:32.324 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 116/152 2024-04-22T07:17:32.324 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 117/152 2024-04-22T07:17:32.324 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 118/152 2024-04-22T07:17:32.324 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 119/152 2024-04-22T07:17:32.324 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 120/152 2024-04-22T07:17:32.324 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 121/152 2024-04-22T07:17:32.324 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-google-auth-1:2.28.2-1.el9.noarch 122/152 2024-04-22T07:17:32.324 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/152 2024-04-22T07:17:32.324 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/152 2024-04-22T07:17:32.325 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/152 2024-04-22T07:17:32.325 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/152 2024-04-22T07:17:32.325 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/152 2024-04-22T07:17:32.325 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/152 2024-04-22T07:17:32.325 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/152 2024-04-22T07:17:32.325 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/152 2024-04-22T07:17:32.325 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/152 2024-04-22T07:17:32.325 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/152 2024-04-22T07:17:32.325 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/152 2024-04-22T07:17:32.325 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/152 2024-04-22T07:17:32.325 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/152 2024-04-22T07:17:32.325 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/152 2024-04-22T07:17:32.325 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/152 2024-04-22T07:17:32.325 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/152 2024-04-22T07:17:32.326 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/152 2024-04-22T07:17:32.326 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/152 2024-04-22T07:17:32.326 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/152 2024-04-22T07:17:32.326 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/152 2024-04-22T07:17:32.326 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/152 2024-04-22T07:17:32.326 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/152 2024-04-22T07:17:32.326 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/152 2024-04-22T07:17:32.326 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/152 2024-04-22T07:17:32.326 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/152 2024-04-22T07:17:32.326 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/152 2024-04-22T07:17:32.326 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : librados2-2:19.0.0-3156.g86f7587a.el9.x86_64 149/152 2024-04-22T07:17:32.326 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/152 2024-04-22T07:17:32.326 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : librbd1-2:19.0.0-3156.g86f7587a.el9.x86_64 151/152 2024-04-22T07:17:33.280 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/152 2024-04-22T07:17:33.280 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-22T07:17:33.280 INFO:teuthology.orchestra.run.smithi037.stdout:Upgraded: 2024-04-22T07:17:33.280 INFO:teuthology.orchestra.run.smithi037.stdout: librados2-2:19.0.0-3156.g86f7587a.el9.x86_64 2024-04-22T07:17:33.280 INFO:teuthology.orchestra.run.smithi037.stdout: librbd1-2:19.0.0-3156.g86f7587a.el9.x86_64 2024-04-22T07:17:33.280 INFO:teuthology.orchestra.run.smithi037.stdout:Installed: 2024-04-22T07:17:33.280 INFO:teuthology.orchestra.run.smithi037.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-04-22T07:17:33.280 INFO:teuthology.orchestra.run.smithi037.stdout: automake-1.16.2-8.el9.noarch 2024-04-22T07:17:33.280 INFO:teuthology.orchestra.run.smithi037.stdout: bison-3.7.4-5.el9.x86_64 2024-04-22T07:17:33.280 INFO:teuthology.orchestra.run.smithi037.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-22T07:17:33.281 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-2:19.0.0-3156.g86f7587a.el9.x86_64 2024-04-22T07:17:33.281 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-base-2:19.0.0-3156.g86f7587a.el9.x86_64 2024-04-22T07:17:33.281 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-common-2:19.0.0-3156.g86f7587a.el9.x86_64 2024-04-22T07:17:33.281 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-fuse-2:19.0.0-3156.g86f7587a.el9.x86_64 2024-04-22T07:17:33.281 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-grafana-dashboards-2:19.0.0-3156.g86f7587a.el9.noarch 2024-04-22T07:17:33.281 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-immutable-object-cache-2:19.0.0-3156.g86f7587a.el9.x86_64 2024-04-22T07:17:33.281 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mds-2:19.0.0-3156.g86f7587a.el9.x86_64 2024-04-22T07:17:33.281 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-2:19.0.0-3156.g86f7587a.el9.x86_64 2024-04-22T07:17:33.281 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-cephadm-2:19.0.0-3156.g86f7587a.el9.noarch 2024-04-22T07:17:33.281 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-dashboard-2:19.0.0-3156.g86f7587a.el9.noarch 2024-04-22T07:17:33.281 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3156.g86f7587a.el9.noarch 2024-04-22T07:17:33.281 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-modules-core-2:19.0.0-3156.g86f7587a.el9.noarch 2024-04-22T07:17:33.282 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-rook-2:19.0.0-3156.g86f7587a.el9.noarch 2024-04-22T07:17:33.282 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mon-2:19.0.0-3156.g86f7587a.el9.x86_64 2024-04-22T07:17:33.282 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-osd-2:19.0.0-3156.g86f7587a.el9.x86_64 2024-04-22T07:17:33.282 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-prometheus-alerts-2:19.0.0-3156.g86f7587a.el9.noarch 2024-04-22T07:17:33.282 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-radosgw-2:19.0.0-3156.g86f7587a.el9.x86_64 2024-04-22T07:17:33.282 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-selinux-2:19.0.0-3156.g86f7587a.el9.x86_64 2024-04-22T07:17:33.282 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-test-2:19.0.0-3156.g86f7587a.el9.x86_64 2024-04-22T07:17:33.282 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-volume-2:19.0.0-3156.g86f7587a.el9.noarch 2024-04-22T07:17:33.282 INFO:teuthology.orchestra.run.smithi037.stdout: cephadm-2:19.0.0-3156.g86f7587a.el9.noarch 2024-04-22T07:17:33.282 INFO:teuthology.orchestra.run.smithi037.stdout: cephfs-mirror-2:19.0.0-3156.g86f7587a.el9.x86_64 2024-04-22T07:17:33.282 INFO:teuthology.orchestra.run.smithi037.stdout: cephfs-shell-2:19.0.0-3156.g86f7587a.el9.x86_64 2024-04-22T07:17:33.282 INFO:teuthology.orchestra.run.smithi037.stdout: cephfs-top-2:19.0.0-3156.g86f7587a.el9.noarch 2024-04-22T07:17:33.282 INFO:teuthology.orchestra.run.smithi037.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-04-22T07:17:33.283 INFO:teuthology.orchestra.run.smithi037.stdout: flex-2.6.4-9.el9.x86_64 2024-04-22T07:17:33.283 INFO:teuthology.orchestra.run.smithi037.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-22T07:17:33.283 INFO:teuthology.orchestra.run.smithi037.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-22T07:17:33.283 INFO:teuthology.orchestra.run.smithi037.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-22T07:17:33.283 INFO:teuthology.orchestra.run.smithi037.stdout: fuse-2.9.9-15.el9.x86_64 2024-04-22T07:17:33.283 INFO:teuthology.orchestra.run.smithi037.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-22T07:17:33.283 INFO:teuthology.orchestra.run.smithi037.stdout: grpc-data-1.46.7-10.el9.noarch 2024-04-22T07:17:33.283 INFO:teuthology.orchestra.run.smithi037.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-04-22T07:17:33.283 INFO:teuthology.orchestra.run.smithi037.stdout: libarrow-9.0.0-10.el9.x86_64 2024-04-22T07:17:33.283 INFO:teuthology.orchestra.run.smithi037.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-04-22T07:17:33.283 INFO:teuthology.orchestra.run.smithi037.stdout: libcephfs-devel-2:19.0.0-3156.g86f7587a.el9.x86_64 2024-04-22T07:17:33.283 INFO:teuthology.orchestra.run.smithi037.stdout: libcephfs2-2:19.0.0-3156.g86f7587a.el9.x86_64 2024-04-22T07:17:33.283 INFO:teuthology.orchestra.run.smithi037.stdout: libcephsqlite-2:19.0.0-3156.g86f7587a.el9.x86_64 2024-04-22T07:17:33.284 INFO:teuthology.orchestra.run.smithi037.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-22T07:17:33.284 INFO:teuthology.orchestra.run.smithi037.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-22T07:17:33.284 INFO:teuthology.orchestra.run.smithi037.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-22T07:17:33.284 INFO:teuthology.orchestra.run.smithi037.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-22T07:17:33.284 INFO:teuthology.orchestra.run.smithi037.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-22T07:17:33.284 INFO:teuthology.orchestra.run.smithi037.stdout: librados-devel-2:19.0.0-3156.g86f7587a.el9.x86_64 2024-04-22T07:17:33.284 INFO:teuthology.orchestra.run.smithi037.stdout: libradosstriper1-2:19.0.0-3156.g86f7587a.el9.x86_64 2024-04-22T07:17:33.284 INFO:teuthology.orchestra.run.smithi037.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-22T07:17:33.284 INFO:teuthology.orchestra.run.smithi037.stdout: librgw2-2:19.0.0-3156.g86f7587a.el9.x86_64 2024-04-22T07:17:33.284 INFO:teuthology.orchestra.run.smithi037.stdout: libtool-2.4.6-45.el9.x86_64 2024-04-22T07:17:33.284 INFO:teuthology.orchestra.run.smithi037.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-22T07:17:33.284 INFO:teuthology.orchestra.run.smithi037.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-04-22T07:17:33.284 INFO:teuthology.orchestra.run.smithi037.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-04-22T07:17:33.284 INFO:teuthology.orchestra.run.smithi037.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-22T07:17:33.285 INFO:teuthology.orchestra.run.smithi037.stdout: lua-5.4.4-4.el9.x86_64 2024-04-22T07:17:33.285 INFO:teuthology.orchestra.run.smithi037.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-04-22T07:17:33.285 INFO:teuthology.orchestra.run.smithi037.stdout: luarocks-3.9.2-1.el9.noarch 2024-04-22T07:17:33.285 INFO:teuthology.orchestra.run.smithi037.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-22T07:17:33.285 INFO:teuthology.orchestra.run.smithi037.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-22T07:17:33.285 INFO:teuthology.orchestra.run.smithi037.stdout: openssl-devel-1:3.0.7-27.el9.x86_64 2024-04-22T07:17:33.285 INFO:teuthology.orchestra.run.smithi037.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-04-22T07:17:33.285 INFO:teuthology.orchestra.run.smithi037.stdout: postgresql-13.14-1.el9.x86_64 2024-04-22T07:17:33.285 INFO:teuthology.orchestra.run.smithi037.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-04-22T07:17:33.285 INFO:teuthology.orchestra.run.smithi037.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-04-22T07:17:33.285 INFO:teuthology.orchestra.run.smithi037.stdout: postgresql-server-13.14-1.el9.x86_64 2024-04-22T07:17:33.285 INFO:teuthology.orchestra.run.smithi037.stdout: protobuf-3.14.0-13.el9.x86_64 2024-04-22T07:17:33.285 INFO:teuthology.orchestra.run.smithi037.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-04-22T07:17:33.285 INFO:teuthology.orchestra.run.smithi037.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-22T07:17:33.286 INFO:teuthology.orchestra.run.smithi037.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-04-22T07:17:33.286 INFO:teuthology.orchestra.run.smithi037.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-22T07:17:33.286 INFO:teuthology.orchestra.run.smithi037.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-22T07:17:33.286 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-22T07:17:33.286 INFO:teuthology.orchestra.run.smithi037.stdout: python3-ceph-argparse-2:19.0.0-3156.g86f7587a.el9.x86_64 2024-04-22T07:17:33.286 INFO:teuthology.orchestra.run.smithi037.stdout: python3-ceph-common-2:19.0.0-3156.g86f7587a.el9.x86_64 2024-04-22T07:17:33.286 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cephfs-2:19.0.0-3156.g86f7587a.el9.x86_64 2024-04-22T07:17:33.286 INFO:teuthology.orchestra.run.smithi037.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-22T07:17:33.286 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-22T07:17:33.286 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-22T07:17:33.286 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-22T07:17:33.286 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-04-22T07:17:33.286 INFO:teuthology.orchestra.run.smithi037.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-04-22T07:17:33.287 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-22T07:17:33.287 INFO:teuthology.orchestra.run.smithi037.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-04-22T07:17:33.287 INFO:teuthology.orchestra.run.smithi037.stdout: python3-google-auth-1:2.28.2-1.el9.noarch 2024-04-22T07:17:33.287 INFO:teuthology.orchestra.run.smithi037.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-04-22T07:17:33.287 INFO:teuthology.orchestra.run.smithi037.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-04-22T07:17:33.287 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-22T07:17:33.287 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-22T07:17:33.287 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-22T07:17:33.287 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-22T07:17:33.287 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-22T07:17:33.287 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-22T07:17:33.287 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-22T07:17:33.287 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-22T07:17:33.287 INFO:teuthology.orchestra.run.smithi037.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-22T07:17:33.288 INFO:teuthology.orchestra.run.smithi037.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-22T07:17:33.288 INFO:teuthology.orchestra.run.smithi037.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-22T07:17:33.288 INFO:teuthology.orchestra.run.smithi037.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-22T07:17:33.288 INFO:teuthology.orchestra.run.smithi037.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-22T07:17:33.288 INFO:teuthology.orchestra.run.smithi037.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-22T07:17:33.288 INFO:teuthology.orchestra.run.smithi037.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-22T07:17:33.288 INFO:teuthology.orchestra.run.smithi037.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-22T07:17:33.288 INFO:teuthology.orchestra.run.smithi037.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-22T07:17:33.288 INFO:teuthology.orchestra.run.smithi037.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-22T07:17:33.288 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-22T07:17:33.288 INFO:teuthology.orchestra.run.smithi037.stdout: python3-ply-3.11-14.el9.noarch 2024-04-22T07:17:33.288 INFO:teuthology.orchestra.run.smithi037.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-22T07:17:33.288 INFO:teuthology.orchestra.run.smithi037.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-22T07:17:33.288 INFO:teuthology.orchestra.run.smithi037.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-04-22T07:17:33.289 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-22T07:17:33.289 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-22T07:17:33.289 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-22T07:17:33.289 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-22T07:17:33.289 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-04-22T07:17:33.289 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-22T07:17:33.289 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rados-2:19.0.0-3156.g86f7587a.el9.x86_64 2024-04-22T07:17:33.289 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rbd-2:19.0.0-3156.g86f7587a.el9.x86_64 2024-04-22T07:17:33.289 INFO:teuthology.orchestra.run.smithi037.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-22T07:17:33.289 INFO:teuthology.orchestra.run.smithi037.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-22T07:17:33.289 INFO:teuthology.orchestra.run.smithi037.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-22T07:17:33.289 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rgw-2:19.0.0-3156.g86f7587a.el9.x86_64 2024-04-22T07:17:33.289 INFO:teuthology.orchestra.run.smithi037.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-22T07:17:33.289 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-22T07:17:33.290 INFO:teuthology.orchestra.run.smithi037.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-22T07:17:33.290 INFO:teuthology.orchestra.run.smithi037.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-22T07:17:33.290 INFO:teuthology.orchestra.run.smithi037.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-22T07:17:33.290 INFO:teuthology.orchestra.run.smithi037.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-22T07:17:33.290 INFO:teuthology.orchestra.run.smithi037.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-22T07:17:33.290 INFO:teuthology.orchestra.run.smithi037.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-04-22T07:17:33.290 INFO:teuthology.orchestra.run.smithi037.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-22T07:17:33.290 INFO:teuthology.orchestra.run.smithi037.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-22T07:17:33.290 INFO:teuthology.orchestra.run.smithi037.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-22T07:17:33.290 INFO:teuthology.orchestra.run.smithi037.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-22T07:17:33.290 INFO:teuthology.orchestra.run.smithi037.stdout: qatlib-24.02.0-1.el9.x86_64 2024-04-22T07:17:33.290 INFO:teuthology.orchestra.run.smithi037.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-04-22T07:17:33.290 INFO:teuthology.orchestra.run.smithi037.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-04-22T07:17:33.291 INFO:teuthology.orchestra.run.smithi037.stdout: rbd-fuse-2:19.0.0-3156.g86f7587a.el9.x86_64 2024-04-22T07:17:33.291 INFO:teuthology.orchestra.run.smithi037.stdout: rbd-mirror-2:19.0.0-3156.g86f7587a.el9.x86_64 2024-04-22T07:17:33.291 INFO:teuthology.orchestra.run.smithi037.stdout: rbd-nbd-2:19.0.0-3156.g86f7587a.el9.x86_64 2024-04-22T07:17:33.291 INFO:teuthology.orchestra.run.smithi037.stdout: re2-1:20211101-3.el9.x86_64 2024-04-22T07:17:33.291 INFO:teuthology.orchestra.run.smithi037.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-22T07:17:33.291 INFO:teuthology.orchestra.run.smithi037.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-22T07:17:33.291 INFO:teuthology.orchestra.run.smithi037.stdout: uuid-1.6.2-55.el9.x86_64 2024-04-22T07:17:33.291 INFO:teuthology.orchestra.run.smithi037.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-04-22T07:17:33.291 INFO:teuthology.orchestra.run.smithi037.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-22T07:17:33.291 INFO:teuthology.orchestra.run.smithi037.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-04-22T07:17:33.291 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-22T07:17:33.292 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2024-04-22T07:17:33.623 DEBUG:teuthology.parallel:result is None 2024-04-22T07:17:34.396 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/152 2024-04-22T07:17:34.397 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-04-22T07:17:34.397 INFO:teuthology.orchestra.run.smithi196.stdout:Upgraded: 2024-04-22T07:17:34.397 INFO:teuthology.orchestra.run.smithi196.stdout: librados2-2:19.0.0-3156.g86f7587a.el9.x86_64 2024-04-22T07:17:34.397 INFO:teuthology.orchestra.run.smithi196.stdout: librbd1-2:19.0.0-3156.g86f7587a.el9.x86_64 2024-04-22T07:17:34.397 INFO:teuthology.orchestra.run.smithi196.stdout:Installed: 2024-04-22T07:17:34.397 INFO:teuthology.orchestra.run.smithi196.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-04-22T07:17:34.397 INFO:teuthology.orchestra.run.smithi196.stdout: automake-1.16.2-8.el9.noarch 2024-04-22T07:17:34.397 INFO:teuthology.orchestra.run.smithi196.stdout: bison-3.7.4-5.el9.x86_64 2024-04-22T07:17:34.397 INFO:teuthology.orchestra.run.smithi196.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-22T07:17:34.397 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-2:19.0.0-3156.g86f7587a.el9.x86_64 2024-04-22T07:17:34.398 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-base-2:19.0.0-3156.g86f7587a.el9.x86_64 2024-04-22T07:17:34.398 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-common-2:19.0.0-3156.g86f7587a.el9.x86_64 2024-04-22T07:17:34.398 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-fuse-2:19.0.0-3156.g86f7587a.el9.x86_64 2024-04-22T07:17:34.398 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-grafana-dashboards-2:19.0.0-3156.g86f7587a.el9.noarch 2024-04-22T07:17:34.398 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-immutable-object-cache-2:19.0.0-3156.g86f7587a.el9.x86_64 2024-04-22T07:17:34.398 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mds-2:19.0.0-3156.g86f7587a.el9.x86_64 2024-04-22T07:17:34.398 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mgr-2:19.0.0-3156.g86f7587a.el9.x86_64 2024-04-22T07:17:34.398 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mgr-cephadm-2:19.0.0-3156.g86f7587a.el9.noarch 2024-04-22T07:17:34.398 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mgr-dashboard-2:19.0.0-3156.g86f7587a.el9.noarch 2024-04-22T07:17:34.398 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3156.g86f7587a.el9.noarch 2024-04-22T07:17:34.398 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mgr-modules-core-2:19.0.0-3156.g86f7587a.el9.noarch 2024-04-22T07:17:34.398 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mgr-rook-2:19.0.0-3156.g86f7587a.el9.noarch 2024-04-22T07:17:34.399 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mon-2:19.0.0-3156.g86f7587a.el9.x86_64 2024-04-22T07:17:34.399 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-osd-2:19.0.0-3156.g86f7587a.el9.x86_64 2024-04-22T07:17:34.399 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-prometheus-alerts-2:19.0.0-3156.g86f7587a.el9.noarch 2024-04-22T07:17:34.399 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-radosgw-2:19.0.0-3156.g86f7587a.el9.x86_64 2024-04-22T07:17:34.399 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-selinux-2:19.0.0-3156.g86f7587a.el9.x86_64 2024-04-22T07:17:34.399 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-test-2:19.0.0-3156.g86f7587a.el9.x86_64 2024-04-22T07:17:34.399 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-volume-2:19.0.0-3156.g86f7587a.el9.noarch 2024-04-22T07:17:34.399 INFO:teuthology.orchestra.run.smithi196.stdout: cephadm-2:19.0.0-3156.g86f7587a.el9.noarch 2024-04-22T07:17:34.399 INFO:teuthology.orchestra.run.smithi196.stdout: cephfs-mirror-2:19.0.0-3156.g86f7587a.el9.x86_64 2024-04-22T07:17:34.399 INFO:teuthology.orchestra.run.smithi196.stdout: cephfs-shell-2:19.0.0-3156.g86f7587a.el9.x86_64 2024-04-22T07:17:34.399 INFO:teuthology.orchestra.run.smithi196.stdout: cephfs-top-2:19.0.0-3156.g86f7587a.el9.noarch 2024-04-22T07:17:34.399 INFO:teuthology.orchestra.run.smithi196.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-04-22T07:17:34.399 INFO:teuthology.orchestra.run.smithi196.stdout: flex-2.6.4-9.el9.x86_64 2024-04-22T07:17:34.400 INFO:teuthology.orchestra.run.smithi196.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-22T07:17:34.400 INFO:teuthology.orchestra.run.smithi196.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-22T07:17:34.400 INFO:teuthology.orchestra.run.smithi196.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-22T07:17:34.400 INFO:teuthology.orchestra.run.smithi196.stdout: fuse-2.9.9-15.el9.x86_64 2024-04-22T07:17:34.400 INFO:teuthology.orchestra.run.smithi196.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-22T07:17:34.400 INFO:teuthology.orchestra.run.smithi196.stdout: grpc-data-1.46.7-10.el9.noarch 2024-04-22T07:17:34.400 INFO:teuthology.orchestra.run.smithi196.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-04-22T07:17:34.400 INFO:teuthology.orchestra.run.smithi196.stdout: libarrow-9.0.0-10.el9.x86_64 2024-04-22T07:17:34.400 INFO:teuthology.orchestra.run.smithi196.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-04-22T07:17:34.400 INFO:teuthology.orchestra.run.smithi196.stdout: libcephfs-devel-2:19.0.0-3156.g86f7587a.el9.x86_64 2024-04-22T07:17:34.400 INFO:teuthology.orchestra.run.smithi196.stdout: libcephfs2-2:19.0.0-3156.g86f7587a.el9.x86_64 2024-04-22T07:17:34.400 INFO:teuthology.orchestra.run.smithi196.stdout: libcephsqlite-2:19.0.0-3156.g86f7587a.el9.x86_64 2024-04-22T07:17:34.400 INFO:teuthology.orchestra.run.smithi196.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-22T07:17:34.401 INFO:teuthology.orchestra.run.smithi196.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-22T07:17:34.401 INFO:teuthology.orchestra.run.smithi196.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-22T07:17:34.401 INFO:teuthology.orchestra.run.smithi196.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-22T07:17:34.401 INFO:teuthology.orchestra.run.smithi196.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-22T07:17:34.401 INFO:teuthology.orchestra.run.smithi196.stdout: librados-devel-2:19.0.0-3156.g86f7587a.el9.x86_64 2024-04-22T07:17:34.401 INFO:teuthology.orchestra.run.smithi196.stdout: libradosstriper1-2:19.0.0-3156.g86f7587a.el9.x86_64 2024-04-22T07:17:34.401 INFO:teuthology.orchestra.run.smithi196.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-22T07:17:34.401 INFO:teuthology.orchestra.run.smithi196.stdout: librgw2-2:19.0.0-3156.g86f7587a.el9.x86_64 2024-04-22T07:17:34.401 INFO:teuthology.orchestra.run.smithi196.stdout: libtool-2.4.6-45.el9.x86_64 2024-04-22T07:17:34.401 INFO:teuthology.orchestra.run.smithi196.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-22T07:17:34.401 INFO:teuthology.orchestra.run.smithi196.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-04-22T07:17:34.401 INFO:teuthology.orchestra.run.smithi196.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-04-22T07:17:34.401 INFO:teuthology.orchestra.run.smithi196.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-22T07:17:34.402 INFO:teuthology.orchestra.run.smithi196.stdout: lua-5.4.4-4.el9.x86_64 2024-04-22T07:17:34.402 INFO:teuthology.orchestra.run.smithi196.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-04-22T07:17:34.402 INFO:teuthology.orchestra.run.smithi196.stdout: luarocks-3.9.2-1.el9.noarch 2024-04-22T07:17:34.402 INFO:teuthology.orchestra.run.smithi196.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-22T07:17:34.402 INFO:teuthology.orchestra.run.smithi196.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-22T07:17:34.402 INFO:teuthology.orchestra.run.smithi196.stdout: openssl-devel-1:3.0.7-27.el9.x86_64 2024-04-22T07:17:34.402 INFO:teuthology.orchestra.run.smithi196.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-04-22T07:17:34.402 INFO:teuthology.orchestra.run.smithi196.stdout: postgresql-13.14-1.el9.x86_64 2024-04-22T07:17:34.403 INFO:teuthology.orchestra.run.smithi196.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-04-22T07:17:34.403 INFO:teuthology.orchestra.run.smithi196.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-04-22T07:17:34.403 INFO:teuthology.orchestra.run.smithi196.stdout: postgresql-server-13.14-1.el9.x86_64 2024-04-22T07:17:34.403 INFO:teuthology.orchestra.run.smithi196.stdout: protobuf-3.14.0-13.el9.x86_64 2024-04-22T07:17:34.403 INFO:teuthology.orchestra.run.smithi196.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-04-22T07:17:34.403 INFO:teuthology.orchestra.run.smithi196.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-22T07:17:34.403 INFO:teuthology.orchestra.run.smithi196.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-04-22T07:17:34.403 INFO:teuthology.orchestra.run.smithi196.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-22T07:17:34.403 INFO:teuthology.orchestra.run.smithi196.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-22T07:17:34.403 INFO:teuthology.orchestra.run.smithi196.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-22T07:17:34.403 INFO:teuthology.orchestra.run.smithi196.stdout: python3-ceph-argparse-2:19.0.0-3156.g86f7587a.el9.x86_64 2024-04-22T07:17:34.403 INFO:teuthology.orchestra.run.smithi196.stdout: python3-ceph-common-2:19.0.0-3156.g86f7587a.el9.x86_64 2024-04-22T07:17:34.403 INFO:teuthology.orchestra.run.smithi196.stdout: python3-cephfs-2:19.0.0-3156.g86f7587a.el9.x86_64 2024-04-22T07:17:34.404 INFO:teuthology.orchestra.run.smithi196.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-22T07:17:34.404 INFO:teuthology.orchestra.run.smithi196.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-22T07:17:34.404 INFO:teuthology.orchestra.run.smithi196.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-22T07:17:34.404 INFO:teuthology.orchestra.run.smithi196.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-22T07:17:34.404 INFO:teuthology.orchestra.run.smithi196.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-04-22T07:17:34.404 INFO:teuthology.orchestra.run.smithi196.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-04-22T07:17:34.404 INFO:teuthology.orchestra.run.smithi196.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-22T07:17:34.404 INFO:teuthology.orchestra.run.smithi196.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-04-22T07:17:34.404 INFO:teuthology.orchestra.run.smithi196.stdout: python3-google-auth-1:2.28.2-1.el9.noarch 2024-04-22T07:17:34.404 INFO:teuthology.orchestra.run.smithi196.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-04-22T07:17:34.404 INFO:teuthology.orchestra.run.smithi196.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-04-22T07:17:34.404 INFO:teuthology.orchestra.run.smithi196.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-22T07:17:34.404 INFO:teuthology.orchestra.run.smithi196.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-22T07:17:34.405 INFO:teuthology.orchestra.run.smithi196.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-22T07:17:34.405 INFO:teuthology.orchestra.run.smithi196.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-22T07:17:34.405 INFO:teuthology.orchestra.run.smithi196.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-22T07:17:34.405 INFO:teuthology.orchestra.run.smithi196.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-22T07:17:34.405 INFO:teuthology.orchestra.run.smithi196.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-22T07:17:34.405 INFO:teuthology.orchestra.run.smithi196.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-22T07:17:34.405 INFO:teuthology.orchestra.run.smithi196.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-22T07:17:34.405 INFO:teuthology.orchestra.run.smithi196.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-22T07:17:34.405 INFO:teuthology.orchestra.run.smithi196.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-22T07:17:34.405 INFO:teuthology.orchestra.run.smithi196.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-22T07:17:34.405 INFO:teuthology.orchestra.run.smithi196.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-22T07:17:34.405 INFO:teuthology.orchestra.run.smithi196.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-22T07:17:34.405 INFO:teuthology.orchestra.run.smithi196.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-22T07:17:34.405 INFO:teuthology.orchestra.run.smithi196.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-22T07:17:34.406 INFO:teuthology.orchestra.run.smithi196.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-22T07:17:34.406 INFO:teuthology.orchestra.run.smithi196.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-22T07:17:34.406 INFO:teuthology.orchestra.run.smithi196.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-22T07:17:34.406 INFO:teuthology.orchestra.run.smithi196.stdout: python3-ply-3.11-14.el9.noarch 2024-04-22T07:17:34.406 INFO:teuthology.orchestra.run.smithi196.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-22T07:17:34.406 INFO:teuthology.orchestra.run.smithi196.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-22T07:17:34.406 INFO:teuthology.orchestra.run.smithi196.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-04-22T07:17:34.406 INFO:teuthology.orchestra.run.smithi196.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-22T07:17:34.406 INFO:teuthology.orchestra.run.smithi196.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-22T07:17:34.406 INFO:teuthology.orchestra.run.smithi196.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-22T07:17:34.406 INFO:teuthology.orchestra.run.smithi196.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-22T07:17:34.406 INFO:teuthology.orchestra.run.smithi196.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-04-22T07:17:34.407 INFO:teuthology.orchestra.run.smithi196.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-22T07:17:34.407 INFO:teuthology.orchestra.run.smithi196.stdout: python3-rados-2:19.0.0-3156.g86f7587a.el9.x86_64 2024-04-22T07:17:34.407 INFO:teuthology.orchestra.run.smithi196.stdout: python3-rbd-2:19.0.0-3156.g86f7587a.el9.x86_64 2024-04-22T07:17:34.407 INFO:teuthology.orchestra.run.smithi196.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-22T07:17:34.407 INFO:teuthology.orchestra.run.smithi196.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-22T07:17:34.407 INFO:teuthology.orchestra.run.smithi196.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-22T07:17:34.407 INFO:teuthology.orchestra.run.smithi196.stdout: python3-rgw-2:19.0.0-3156.g86f7587a.el9.x86_64 2024-04-22T07:17:34.407 INFO:teuthology.orchestra.run.smithi196.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-22T07:17:34.407 INFO:teuthology.orchestra.run.smithi196.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-22T07:17:34.407 INFO:teuthology.orchestra.run.smithi196.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-22T07:17:34.407 INFO:teuthology.orchestra.run.smithi196.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-22T07:17:34.407 INFO:teuthology.orchestra.run.smithi196.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-22T07:17:34.407 INFO:teuthology.orchestra.run.smithi196.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-22T07:17:34.407 INFO:teuthology.orchestra.run.smithi196.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-22T07:17:34.408 INFO:teuthology.orchestra.run.smithi196.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-04-22T07:17:34.408 INFO:teuthology.orchestra.run.smithi196.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-22T07:17:34.408 INFO:teuthology.orchestra.run.smithi196.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-22T07:17:34.408 INFO:teuthology.orchestra.run.smithi196.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-22T07:17:34.408 INFO:teuthology.orchestra.run.smithi196.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-22T07:17:34.408 INFO:teuthology.orchestra.run.smithi196.stdout: qatlib-24.02.0-1.el9.x86_64 2024-04-22T07:17:34.408 INFO:teuthology.orchestra.run.smithi196.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-04-22T07:17:34.408 INFO:teuthology.orchestra.run.smithi196.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-04-22T07:17:34.408 INFO:teuthology.orchestra.run.smithi196.stdout: rbd-fuse-2:19.0.0-3156.g86f7587a.el9.x86_64 2024-04-22T07:17:34.408 INFO:teuthology.orchestra.run.smithi196.stdout: rbd-mirror-2:19.0.0-3156.g86f7587a.el9.x86_64 2024-04-22T07:17:34.408 INFO:teuthology.orchestra.run.smithi196.stdout: rbd-nbd-2:19.0.0-3156.g86f7587a.el9.x86_64 2024-04-22T07:17:34.408 INFO:teuthology.orchestra.run.smithi196.stdout: re2-1:20211101-3.el9.x86_64 2024-04-22T07:17:34.408 INFO:teuthology.orchestra.run.smithi196.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-22T07:17:34.409 INFO:teuthology.orchestra.run.smithi196.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-22T07:17:34.409 INFO:teuthology.orchestra.run.smithi196.stdout: uuid-1.6.2-55.el9.x86_64 2024-04-22T07:17:34.409 INFO:teuthology.orchestra.run.smithi196.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-04-22T07:17:34.409 INFO:teuthology.orchestra.run.smithi196.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-22T07:17:34.409 INFO:teuthology.orchestra.run.smithi196.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-04-22T07:17:34.409 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-04-22T07:17:34.409 INFO:teuthology.orchestra.run.smithi196.stdout:Complete! 2024-04-22T07:17:34.771 DEBUG:teuthology.parallel:result is None 2024-04-22T07:17:34.772 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=86f7587a5a09af35f0895e1a2d08527638fae697 2024-04-22T07:17:35.017 DEBUG:teuthology.orchestra.run.smithi037:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-22T07:17:35.039 INFO:teuthology.orchestra.run.smithi037.stdout:19.0.0-3156.g86f7587a.el9 2024-04-22T07:17:35.040 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3156.g86f7587a.el9 2024-04-22T07:17:35.040 INFO:teuthology.task.install:The correct ceph version 19.0.0-3156.g86f7587a is installed. 2024-04-22T07:17:35.042 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=86f7587a5a09af35f0895e1a2d08527638fae697 2024-04-22T07:17:35.199 DEBUG:teuthology.orchestra.run.smithi196:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-22T07:17:35.220 INFO:teuthology.orchestra.run.smithi196.stdout:19.0.0-3156.g86f7587a.el9 2024-04-22T07:17:35.221 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3156.g86f7587a.el9 2024-04-22T07:17:35.221 INFO:teuthology.task.install:The correct ceph version 19.0.0-3156.g86f7587a is installed. 2024-04-22T07:17:35.223 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-04-22T07:17:35.223 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-04-22T07:17:35.223 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-22T07:17:35.249 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-04-22T07:17:35.249 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-22T07:17:35.286 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-04-22T07:17:35.286 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-04-22T07:17:35.286 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/usr/bin/daemon-helper 2024-04-22T07:17:35.314 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-22T07:17:35.377 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-04-22T07:17:35.377 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd of=/usr/bin/daemon-helper 2024-04-22T07:17:35.400 DEBUG:teuthology.orchestra.run.smithi196:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-22T07:17:35.466 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-04-22T07:17:35.466 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-04-22T07:17:35.466 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-22T07:17:35.490 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-22T07:17:35.555 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-04-22T07:17:35.555 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-22T07:17:35.578 DEBUG:teuthology.orchestra.run.smithi196:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-22T07:17:35.642 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-04-22T07:17:35.643 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-04-22T07:17:35.643 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/usr/bin/stdin-killer 2024-04-22T07:17:35.667 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-22T07:17:35.731 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-04-22T07:17:35.731 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd of=/usr/bin/stdin-killer 2024-04-22T07:17:35.755 DEBUG:teuthology.orchestra.run.smithi196:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-22T07:17:35.820 INFO:teuthology.run_tasks:Running task ceph... 2024-04-22T07:17:35.909 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-04-22T07:17:35.909 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 777 /var/log/ceph 2024-04-22T07:17:35.912 DEBUG:teuthology.orchestra.run.smithi196:> sudo chmod 777 /var/log/ceph 2024-04-22T07:17:35.935 INFO:tasks.ceph:Disabling ceph logrotate... 2024-04-22T07:17:35.935 DEBUG:teuthology.orchestra.run.smithi037:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-22T07:17:35.977 DEBUG:teuthology.orchestra.run.smithi196:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-22T07:17:36.000 INFO:tasks.ceph:Creating extra log directories... 2024-04-22T07:17:36.001 DEBUG:teuthology.orchestra.run.smithi037:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-22T07:17:36.042 DEBUG:teuthology.orchestra.run.smithi196:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-22T07:17:36.071 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-04-22T07:17:36.071 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-04-22T07:17:36.071 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-04-22T07:17:36.071 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-04-22T07:17:36.071 DEBUG:teuthology.orchestra.run.smithi037:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-04-22T07:17:36.119 DEBUG:teuthology.orchestra.run.smithi037:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-04-22T07:17:36.238 DEBUG:teuthology.orchestra.run.smithi037:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-04-22T07:17:36.270 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-04-22T07:17:36.270 DEBUG:teuthology.orchestra.run.smithi196:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-04-22T07:17:36.286 DEBUG:teuthology.orchestra.run.smithi196:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-04-22T07:17:36.398 DEBUG:teuthology.orchestra.run.smithi196:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-04-22T07:17:36.438 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-04-22T07:17:36.438 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds oft prefetch dirfrags': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_dir_prefetch': True, 'mds_sleep_rank_change': 5000000.0, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-04-22T07:17:36.439 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/leonidus-2024-04-22_05:52:53-fs-wip-lusov-quiescer-distro-default-smithi/7668166', 'branch': 'wip-lusov-quiescer', 'description': 'fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-bitmap overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down pg_health prefetch_dirfrags/no prefetch_dirfrags/yes prefetch_entire_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/1 tasks/{1-thrash/with-quiesce 2-workunit/suites/iozone}}', 'email': None, 'first_in_suite': False, 'job_id': '7668166', 'kernel': {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'leonidus-2024-04-22_05:52:53-fs-wip-lusov-quiescer-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-lusov-quiescer'}, 'ceph': {'cephfs': {'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds oft prefetch dirfrags': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_dir_prefetch': True, 'mds_sleep_rank_change': 5000000.0, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum'], 'sha1': '86f7587a5a09af35f0895e1a2d08527638fae697'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '86f7587a5a09af35f0895e1a2d08527638fae697'}}, 'kclient': {'syntax': 'v2'}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-lusov-quiescer', 'sha1': '86f7587a5a09af35f0895e1a2d08527638fae697'}}, 'owner': 'scheduled_leonidus@teuthology', 'priority': 70, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7']], 'seed': 4362, 'sha1': '86f7587a5a09af35f0895e1a2d08527638fae697', 'sleep_before_teardown': 0, 'subset': '222/111111', 'suite': 'fs', 'suite_branch': 'wip-lusov-quiescer', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_86f7587a5a09af35f0895e1a2d08527638fae697/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '86f7587a5a09af35f0895e1a2d08527638fae697', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi037.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBWX1+yrY/C9HKkCV1N2hQSWVXCqNwEoWp5HEc28YuKOKCUMOyzaQNKguQJ/YACbZAQdlBYARX+PeTM8vBxlWQM=', 'smithi196.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNRFdyFezLuHDXiUeiaFik5w/mcSetLHXTxUVX2NGSAKuMHAjbJ3NA1zEdV0xEO6g25VnL3c/ftyVR34YM1BQYY='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '86f7587a5a09af35f0895e1a2d08527638fae697'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds oft prefetch dirfrags': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_dir_prefetch': True, 'mds_sleep_rank_change': 5000000.0, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum'], 'sha1': '86f7587a5a09af35f0895e1a2d08527638fae697', 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'kclient': None}, {'quiescer': None}, {'workunit': {'clients': {'all': ['suites/iozone.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17', 'timestamp': '2024-04-22_05:52:53', 'tube': 'smithi', 'user': 'leonidus', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-04-22T07:17:36.439 DEBUG:teuthology.orchestra.run.smithi037:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-22T07:17:36.442 DEBUG:teuthology.orchestra.run.smithi196:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-22T07:17:36.487 DEBUG:teuthology.orchestra.run.smithi037:> sudo install -d -m0777 -- /var/run/ceph 2024-04-22T07:17:36.496 DEBUG:teuthology.orchestra.run.smithi196:> sudo install -d -m0777 -- /var/run/ceph 2024-04-22T07:17:36.551 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-04-22T07:17:36.551 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/scratch_devs of=/dev/stdout 2024-04-22T07:17:36.574 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-22T07:17:36.574 DEBUG:teuthology.orchestra.run.smithi037:> stat /dev/vg_nvme/lv_1 2024-04-22T07:17:36.629 INFO:teuthology.orchestra.run.smithi037.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-22T07:17:36.629 INFO:teuthology.orchestra.run.smithi037.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-22T07:17:36.629 INFO:teuthology.orchestra.run.smithi037.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-04-22T07:17:36.629 INFO:teuthology.orchestra.run.smithi037.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-22T07:17:36.630 INFO:teuthology.orchestra.run.smithi037.stdout:Context: system_u:object_r:device_t:s0 2024-04-22T07:17:36.630 INFO:teuthology.orchestra.run.smithi037.stdout:Access: 2024-04-22 07:17:25.886372835 +0000 2024-04-22T07:17:36.630 INFO:teuthology.orchestra.run.smithi037.stdout:Modify: 2024-04-22 07:15:13.832427259 +0000 2024-04-22T07:17:36.630 INFO:teuthology.orchestra.run.smithi037.stdout:Change: 2024-04-22 07:15:13.832427259 +0000 2024-04-22T07:17:36.630 INFO:teuthology.orchestra.run.smithi037.stdout: Birth: 2024-04-22 07:15:13.832427259 +0000 2024-04-22T07:17:36.630 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-22T07:17:36.692 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records in 2024-04-22T07:17:36.692 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records out 2024-04-22T07:17:36.692 INFO:teuthology.orchestra.run.smithi037.stderr:512 bytes copied, 0.000260474 s, 2.0 MB/s 2024-04-22T07:17:36.694 DEBUG:teuthology.orchestra.run.smithi037:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-22T07:17:36.750 DEBUG:teuthology.orchestra.run.smithi037:> stat /dev/vg_nvme/lv_2 2024-04-22T07:17:36.806 INFO:teuthology.orchestra.run.smithi037.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-22T07:17:36.806 INFO:teuthology.orchestra.run.smithi037.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-22T07:17:36.806 INFO:teuthology.orchestra.run.smithi037.stdout:Device: 5h/5d Inode: 683 Links: 1 2024-04-22T07:17:36.806 INFO:teuthology.orchestra.run.smithi037.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-22T07:17:36.806 INFO:teuthology.orchestra.run.smithi037.stdout:Context: system_u:object_r:device_t:s0 2024-04-22T07:17:36.806 INFO:teuthology.orchestra.run.smithi037.stdout:Access: 2024-04-22 07:17:25.886372835 +0000 2024-04-22T07:17:36.806 INFO:teuthology.orchestra.run.smithi037.stdout:Modify: 2024-04-22 07:15:14.183422416 +0000 2024-04-22T07:17:36.806 INFO:teuthology.orchestra.run.smithi037.stdout:Change: 2024-04-22 07:15:14.183422416 +0000 2024-04-22T07:17:36.806 INFO:teuthology.orchestra.run.smithi037.stdout: Birth: 2024-04-22 07:15:14.183422416 +0000 2024-04-22T07:17:36.807 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-22T07:17:36.868 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records in 2024-04-22T07:17:36.869 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records out 2024-04-22T07:17:36.869 INFO:teuthology.orchestra.run.smithi037.stderr:512 bytes copied, 0.000195068 s, 2.6 MB/s 2024-04-22T07:17:36.870 DEBUG:teuthology.orchestra.run.smithi037:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-22T07:17:36.926 DEBUG:teuthology.orchestra.run.smithi037:> stat /dev/vg_nvme/lv_3 2024-04-22T07:17:36.982 INFO:teuthology.orchestra.run.smithi037.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-22T07:17:36.982 INFO:teuthology.orchestra.run.smithi037.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-22T07:17:36.982 INFO:teuthology.orchestra.run.smithi037.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-04-22T07:17:36.982 INFO:teuthology.orchestra.run.smithi037.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-22T07:17:36.982 INFO:teuthology.orchestra.run.smithi037.stdout:Context: system_u:object_r:device_t:s0 2024-04-22T07:17:36.982 INFO:teuthology.orchestra.run.smithi037.stdout:Access: 2024-04-22 07:17:25.886372835 +0000 2024-04-22T07:17:36.982 INFO:teuthology.orchestra.run.smithi037.stdout:Modify: 2024-04-22 07:15:14.535417559 +0000 2024-04-22T07:17:36.983 INFO:teuthology.orchestra.run.smithi037.stdout:Change: 2024-04-22 07:15:14.535417559 +0000 2024-04-22T07:17:36.983 INFO:teuthology.orchestra.run.smithi037.stdout: Birth: 2024-04-22 07:15:14.535417559 +0000 2024-04-22T07:17:36.983 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-22T07:17:37.045 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records in 2024-04-22T07:17:37.045 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records out 2024-04-22T07:17:37.045 INFO:teuthology.orchestra.run.smithi037.stderr:512 bytes copied, 0.000191125 s, 2.7 MB/s 2024-04-22T07:17:37.047 DEBUG:teuthology.orchestra.run.smithi037:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-22T07:17:37.102 DEBUG:teuthology.orchestra.run.smithi037:> stat /dev/vg_nvme/lv_4 2024-04-22T07:17:37.158 INFO:teuthology.orchestra.run.smithi037.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-22T07:17:37.158 INFO:teuthology.orchestra.run.smithi037.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-22T07:17:37.158 INFO:teuthology.orchestra.run.smithi037.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-04-22T07:17:37.158 INFO:teuthology.orchestra.run.smithi037.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-22T07:17:37.158 INFO:teuthology.orchestra.run.smithi037.stdout:Context: system_u:object_r:device_t:s0 2024-04-22T07:17:37.158 INFO:teuthology.orchestra.run.smithi037.stdout:Access: 2024-04-22 07:17:25.887372821 +0000 2024-04-22T07:17:37.158 INFO:teuthology.orchestra.run.smithi037.stdout:Modify: 2024-04-22 07:15:14.877412840 +0000 2024-04-22T07:17:37.158 INFO:teuthology.orchestra.run.smithi037.stdout:Change: 2024-04-22 07:15:14.877412840 +0000 2024-04-22T07:17:37.158 INFO:teuthology.orchestra.run.smithi037.stdout: Birth: 2024-04-22 07:15:14.877412840 +0000 2024-04-22T07:17:37.159 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-22T07:17:37.221 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records in 2024-04-22T07:17:37.221 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records out 2024-04-22T07:17:37.221 INFO:teuthology.orchestra.run.smithi037.stderr:512 bytes copied, 0.000206888 s, 2.5 MB/s 2024-04-22T07:17:37.222 DEBUG:teuthology.orchestra.run.smithi037:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-22T07:17:37.278 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-22T07:17:37.279 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-04-22T07:17:37.279 DEBUG:teuthology.orchestra.run.smithi196:> dd if=/scratch_devs of=/dev/stdout 2024-04-22T07:17:37.295 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-22T07:17:37.295 DEBUG:teuthology.orchestra.run.smithi196:> stat /dev/vg_nvme/lv_1 2024-04-22T07:17:37.351 INFO:teuthology.orchestra.run.smithi196.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-22T07:17:37.351 INFO:teuthology.orchestra.run.smithi196.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-22T07:17:37.351 INFO:teuthology.orchestra.run.smithi196.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-04-22T07:17:37.351 INFO:teuthology.orchestra.run.smithi196.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-22T07:17:37.351 INFO:teuthology.orchestra.run.smithi196.stdout:Context: system_u:object_r:device_t:s0 2024-04-22T07:17:37.351 INFO:teuthology.orchestra.run.smithi196.stdout:Access: 2024-04-22 07:17:26.935540490 +0000 2024-04-22T07:17:37.351 INFO:teuthology.orchestra.run.smithi196.stdout:Modify: 2024-04-22 07:15:29.192156968 +0000 2024-04-22T07:17:37.351 INFO:teuthology.orchestra.run.smithi196.stdout:Change: 2024-04-22 07:15:29.192156968 +0000 2024-04-22T07:17:37.351 INFO:teuthology.orchestra.run.smithi196.stdout: Birth: 2024-04-22 07:15:29.192156968 +0000 2024-04-22T07:17:37.352 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-22T07:17:37.415 INFO:teuthology.orchestra.run.smithi196.stderr:1+0 records in 2024-04-22T07:17:37.415 INFO:teuthology.orchestra.run.smithi196.stderr:1+0 records out 2024-04-22T07:17:37.415 INFO:teuthology.orchestra.run.smithi196.stderr:512 bytes copied, 0.000296543 s, 1.7 MB/s 2024-04-22T07:17:37.416 DEBUG:teuthology.orchestra.run.smithi196:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-22T07:17:37.472 DEBUG:teuthology.orchestra.run.smithi196:> stat /dev/vg_nvme/lv_2 2024-04-22T07:17:37.527 INFO:teuthology.orchestra.run.smithi196.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-22T07:17:37.527 INFO:teuthology.orchestra.run.smithi196.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-22T07:17:37.527 INFO:teuthology.orchestra.run.smithi196.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-04-22T07:17:37.527 INFO:teuthology.orchestra.run.smithi196.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-22T07:17:37.527 INFO:teuthology.orchestra.run.smithi196.stdout:Context: system_u:object_r:device_t:s0 2024-04-22T07:17:37.527 INFO:teuthology.orchestra.run.smithi196.stdout:Access: 2024-04-22 07:17:26.935540490 +0000 2024-04-22T07:17:37.527 INFO:teuthology.orchestra.run.smithi196.stdout:Modify: 2024-04-22 07:15:29.542149161 +0000 2024-04-22T07:17:37.528 INFO:teuthology.orchestra.run.smithi196.stdout:Change: 2024-04-22 07:15:29.542149161 +0000 2024-04-22T07:17:37.528 INFO:teuthology.orchestra.run.smithi196.stdout: Birth: 2024-04-22 07:15:29.542149161 +0000 2024-04-22T07:17:37.528 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-22T07:17:37.590 INFO:teuthology.orchestra.run.smithi196.stderr:1+0 records in 2024-04-22T07:17:37.590 INFO:teuthology.orchestra.run.smithi196.stderr:1+0 records out 2024-04-22T07:17:37.590 INFO:teuthology.orchestra.run.smithi196.stderr:512 bytes copied, 0.000201444 s, 2.5 MB/s 2024-04-22T07:17:37.591 DEBUG:teuthology.orchestra.run.smithi196:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-22T07:17:37.647 DEBUG:teuthology.orchestra.run.smithi196:> stat /dev/vg_nvme/lv_3 2024-04-22T07:17:37.702 INFO:teuthology.orchestra.run.smithi196.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-22T07:17:37.702 INFO:teuthology.orchestra.run.smithi196.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-22T07:17:37.702 INFO:teuthology.orchestra.run.smithi196.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-04-22T07:17:37.702 INFO:teuthology.orchestra.run.smithi196.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-22T07:17:37.703 INFO:teuthology.orchestra.run.smithi196.stdout:Context: system_u:object_r:device_t:s0 2024-04-22T07:17:37.703 INFO:teuthology.orchestra.run.smithi196.stdout:Access: 2024-04-22 07:17:26.936540467 +0000 2024-04-22T07:17:37.703 INFO:teuthology.orchestra.run.smithi196.stdout:Modify: 2024-04-22 07:15:29.891141376 +0000 2024-04-22T07:17:37.703 INFO:teuthology.orchestra.run.smithi196.stdout:Change: 2024-04-22 07:15:29.891141376 +0000 2024-04-22T07:17:37.703 INFO:teuthology.orchestra.run.smithi196.stdout: Birth: 2024-04-22 07:15:29.891141376 +0000 2024-04-22T07:17:37.703 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-22T07:17:37.765 INFO:teuthology.orchestra.run.smithi196.stderr:1+0 records in 2024-04-22T07:17:37.765 INFO:teuthology.orchestra.run.smithi196.stderr:1+0 records out 2024-04-22T07:17:37.765 INFO:teuthology.orchestra.run.smithi196.stderr:512 bytes copied, 0.000212285 s, 2.4 MB/s 2024-04-22T07:17:37.766 DEBUG:teuthology.orchestra.run.smithi196:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-22T07:17:37.822 DEBUG:teuthology.orchestra.run.smithi196:> stat /dev/vg_nvme/lv_4 2024-04-22T07:17:37.877 INFO:teuthology.orchestra.run.smithi196.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-22T07:17:37.877 INFO:teuthology.orchestra.run.smithi196.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-22T07:17:37.877 INFO:teuthology.orchestra.run.smithi196.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-04-22T07:17:37.877 INFO:teuthology.orchestra.run.smithi196.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-22T07:17:37.877 INFO:teuthology.orchestra.run.smithi196.stdout:Context: system_u:object_r:device_t:s0 2024-04-22T07:17:37.877 INFO:teuthology.orchestra.run.smithi196.stdout:Access: 2024-04-22 07:17:26.936540467 +0000 2024-04-22T07:17:37.877 INFO:teuthology.orchestra.run.smithi196.stdout:Modify: 2024-04-22 07:15:30.255133257 +0000 2024-04-22T07:17:37.877 INFO:teuthology.orchestra.run.smithi196.stdout:Change: 2024-04-22 07:15:30.255133257 +0000 2024-04-22T07:17:37.878 INFO:teuthology.orchestra.run.smithi196.stdout: Birth: 2024-04-22 07:15:30.255133257 +0000 2024-04-22T07:17:37.878 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-22T07:17:37.939 INFO:teuthology.orchestra.run.smithi196.stderr:1+0 records in 2024-04-22T07:17:37.939 INFO:teuthology.orchestra.run.smithi196.stderr:1+0 records out 2024-04-22T07:17:37.939 INFO:teuthology.orchestra.run.smithi196.stderr:512 bytes copied, 0.000183302 s, 2.8 MB/s 2024-04-22T07:17:37.940 DEBUG:teuthology.orchestra.run.smithi196:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-22T07:17:37.995 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-22T07:17:37.995 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi037.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi196.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-22T07:17:37.995 INFO:tasks.ceph:Generating config... 2024-04-22T07:17:37.997 INFO:tasks.ceph:[client] client mount timeout = 600 2024-04-22T07:17:37.997 INFO:tasks.ceph:[client] client_shutdown_timeout = 120 2024-04-22T07:17:37.997 INFO:tasks.ceph:[client] debug client = 20 2024-04-22T07:17:37.997 INFO:tasks.ceph:[client] debug ms = 1 2024-04-22T07:17:37.997 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-04-22T07:17:37.997 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-04-22T07:17:37.997 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-04-22T07:17:37.997 INFO:tasks.ceph:[mds] debug mds = 20 2024-04-22T07:17:37.998 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-04-22T07:17:37.998 INFO:tasks.ceph:[mds] debug ms = 1 2024-04-22T07:17:37.998 INFO:tasks.ceph:[mds] mds bal fragment size max = 10000 2024-04-22T07:17:37.998 INFO:tasks.ceph:[mds] mds bal merge size = 5 2024-04-22T07:17:37.998 INFO:tasks.ceph:[mds] mds bal split bits = 3 2024-04-22T07:17:37.998 INFO:tasks.ceph:[mds] mds bal split size = 100 2024-04-22T07:17:37.998 INFO:tasks.ceph:[mds] mds debug frag = True 2024-04-22T07:17:37.998 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-04-22T07:17:37.998 INFO:tasks.ceph:[mds] mds oft prefetch dirfrags = True 2024-04-22T07:17:37.998 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-04-22T07:17:37.999 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-04-22T07:17:37.999 INFO:tasks.ceph:[mds] mds_dir_prefetch = True 2024-04-22T07:17:37.999 INFO:tasks.ceph:[mds] mds_sleep_rank_change = 5000000.0 2024-04-22T07:17:37.999 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-04-22T07:17:37.999 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-04-22T07:17:37.999 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-04-22T07:17:37.999 INFO:tasks.ceph:[mgr] debug client = 20 2024-04-22T07:17:37.999 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-04-22T07:17:37.999 INFO:tasks.ceph:[mgr] debug ms = 1 2024-04-22T07:17:37.999 INFO:tasks.ceph:[mon] debug mon = 20 2024-04-22T07:17:37.999 INFO:tasks.ceph:[mon] debug ms = 1 2024-04-22T07:17:38.000 INFO:tasks.ceph:[mon] debug paxos = 20 2024-04-22T07:17:38.000 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-04-22T07:17:38.000 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-04-22T07:17:38.000 INFO:tasks.ceph:[osd] bdev async discard = True 2024-04-22T07:17:38.000 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-04-22T07:17:38.000 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-04-22T07:17:38.000 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-04-22T07:17:38.000 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-04-22T07:17:38.000 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-04-22T07:17:38.000 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-04-22T07:17:38.000 INFO:tasks.ceph:[osd] debug ms = 1 2024-04-22T07:17:38.000 INFO:tasks.ceph:[osd] debug osd = 20 2024-04-22T07:17:38.000 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-04-22T07:17:38.000 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-04-22T07:17:38.000 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-04-22T07:17:38.001 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-04-22T07:17:38.001 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2024-04-22T07:17:38.001 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-04-22T07:17:38.001 INFO:tasks.ceph:[osd] osd max markdown count = 1000 2024-04-22T07:17:38.001 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-04-22T07:17:38.001 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-04-22T07:17:38.001 INFO:tasks.ceph:Setting up mon.a... 2024-04-22T07:17:38.001 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-04-22T07:17:38.058 INFO:teuthology.orchestra.run.smithi037.stdout:creating /etc/ceph/ceph.keyring 2024-04-22T07:17:38.061 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-04-22T07:17:38.106 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-22T07:17:38.131 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.37'), ('mon.b', '172.21.15.196'), ('mon.c', '[v2:172.21.15.196:3301,v1:172.21.15.196:6790]')] 2024-04-22T07:17:38.132 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.37,172.21.15.196,[v2:172.21.15.196:3301,v1:172.21.15.196:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.e': {}, 'mds.b': {}, 'mds.d': {}, 'mds.f': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds oft prefetch dirfrags': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_dir_prefetch': True, 'mds_sleep_rank_change': 5000000.0, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-04-22T07:17:38.133 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-04-22T07:17:38.133 DEBUG:teuthology.orchestra.run.smithi037:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-04-22T07:17:38.187 DEBUG:teuthology.orchestra.run.smithi037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.37 --add b 172.21.15.196 --addv c '[v2:172.21.15.196:3301,v1:172.21.15.196:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-04-22T07:17:38.274 INFO:teuthology.orchestra.run.smithi037.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-04-22T07:17:38.274 INFO:teuthology.orchestra.run.smithi037.stdout:monmaptool: generated fsid 10d90a41-52d3-4e09-8022-c8ac67897ad1 2024-04-22T07:17:38.275 INFO:teuthology.orchestra.run.smithi037.stdout:setting min_mon_release = quincy 2024-04-22T07:17:38.275 INFO:teuthology.orchestra.run.smithi037.stdout:epoch 0 2024-04-22T07:17:38.275 INFO:teuthology.orchestra.run.smithi037.stdout:fsid 10d90a41-52d3-4e09-8022-c8ac67897ad1 2024-04-22T07:17:38.275 INFO:teuthology.orchestra.run.smithi037.stdout:last_changed 2024-04-22T07:17:38.277717+0000 2024-04-22T07:17:38.275 INFO:teuthology.orchestra.run.smithi037.stdout:created 2024-04-22T07:17:38.277717+0000 2024-04-22T07:17:38.275 INFO:teuthology.orchestra.run.smithi037.stdout:min_mon_release 17 (quincy) 2024-04-22T07:17:38.275 INFO:teuthology.orchestra.run.smithi037.stdout:election_strategy: 1 2024-04-22T07:17:38.275 INFO:teuthology.orchestra.run.smithi037.stdout:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-04-22T07:17:38.275 INFO:teuthology.orchestra.run.smithi037.stdout:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-04-22T07:17:38.275 INFO:teuthology.orchestra.run.smithi037.stdout:2: [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] mon.c 2024-04-22T07:17:38.275 INFO:teuthology.orchestra.run.smithi037.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-04-22T07:17:38.276 DEBUG:teuthology.orchestra.run.smithi037:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-04-22T07:17:38.291 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 10d90a41-52d3-4e09-8022-c8ac67897ad1... 2024-04-22T07:17:38.292 DEBUG:teuthology.orchestra.run.smithi037:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-22T07:17:38.334 DEBUG:teuthology.orchestra.run.smithi196:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-22T07:17:38.373 INFO:teuthology.orchestra.run.smithi037.stdout:[global] 2024-04-22T07:17:38.373 INFO:teuthology.orchestra.run.smithi037.stdout: chdir = "" 2024-04-22T07:17:38.373 INFO:teuthology.orchestra.run.smithi037.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-22T07:17:38.374 INFO:teuthology.orchestra.run.smithi037.stdout: auth supported = cephx 2024-04-22T07:17:38.374 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-22T07:17:38.374 INFO:teuthology.orchestra.run.smithi037.stdout: filestore xattr use omap = true 2024-04-22T07:17:38.374 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-22T07:17:38.374 INFO:teuthology.orchestra.run.smithi037.stdout: mon clock drift allowed = 1.000 2024-04-22T07:17:38.374 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-22T07:17:38.374 INFO:teuthology.orchestra.run.smithi037.stdout: osd crush chooseleaf type = 0 2024-04-22T07:17:38.374 INFO:teuthology.orchestra.run.smithi037.stdout: auth debug = true 2024-04-22T07:17:38.374 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-22T07:17:38.374 INFO:teuthology.orchestra.run.smithi037.stdout: ms die on old message = true 2024-04-22T07:17:38.374 INFO:teuthology.orchestra.run.smithi037.stdout: ms die on bug = true 2024-04-22T07:17:38.374 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-22T07:17:38.374 INFO:teuthology.orchestra.run.smithi037.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-22T07:17:38.375 INFO:teuthology.orchestra.run.smithi037.stdout: mon pg warn max object skew = 0 2024-04-22T07:17:38.375 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-22T07:17:38.375 INFO:teuthology.orchestra.run.smithi037.stdout: # disable pg_autoscaler by default for new pools 2024-04-22T07:17:38.375 INFO:teuthology.orchestra.run.smithi037.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-22T07:17:38.375 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-22T07:17:38.375 INFO:teuthology.orchestra.run.smithi037.stdout: osd pool default size = 2 2024-04-22T07:17:38.375 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-22T07:17:38.375 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd allow primary affinity = true 2024-04-22T07:17:38.375 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd allow pg remap = true 2024-04-22T07:17:38.375 INFO:teuthology.orchestra.run.smithi037.stdout: mon warn on legacy crush tunables = false 2024-04-22T07:17:38.375 INFO:teuthology.orchestra.run.smithi037.stdout: mon warn on crush straw calc version zero = false 2024-04-22T07:17:38.375 INFO:teuthology.orchestra.run.smithi037.stdout: mon warn on no sortbitwise = false 2024-04-22T07:17:38.375 INFO:teuthology.orchestra.run.smithi037.stdout: mon warn on osd down out interval zero = false 2024-04-22T07:17:38.375 INFO:teuthology.orchestra.run.smithi037.stdout: mon warn on too few osds = false 2024-04-22T07:17:38.376 INFO:teuthology.orchestra.run.smithi037.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-22T07:17:38.376 INFO:teuthology.orchestra.run.smithi037.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-22T07:17:38.376 INFO:teuthology.orchestra.run.smithi037.stdout: mon_allow_pool_size_one = true 2024-04-22T07:17:38.376 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-22T07:17:38.376 INFO:teuthology.orchestra.run.smithi037.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-22T07:17:38.376 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-22T07:17:38.376 INFO:teuthology.orchestra.run.smithi037.stdout: osd default data pool replay window = 5 2024-04-22T07:17:38.376 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-22T07:17:38.376 INFO:teuthology.orchestra.run.smithi037.stdout: mon allow pool delete = true 2024-04-22T07:17:38.376 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-22T07:17:38.376 INFO:teuthology.orchestra.run.smithi037.stdout: mon cluster log file level = debug 2024-04-22T07:17:38.376 INFO:teuthology.orchestra.run.smithi037.stdout: debug asserts on shutdown = true 2024-04-22T07:17:38.376 INFO:teuthology.orchestra.run.smithi037.stdout: mon health detail to clog = false 2024-04-22T07:17:38.376 INFO:teuthology.orchestra.run.smithi037.stdout: mon host = "172.21.15.37,172.21.15.196,[v2:172.21.15.196:3301,v1:172.21.15.196:6790]" 2024-04-22T07:17:38.377 INFO:teuthology.orchestra.run.smithi037.stdout: ms die on skipped message = False 2024-04-22T07:17:38.377 INFO:teuthology.orchestra.run.smithi037.stdout: fsid = 10d90a41-52d3-4e09-8022-c8ac67897ad1 2024-04-22T07:17:38.377 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-22T07:17:38.377 INFO:teuthology.orchestra.run.smithi037.stdout:[osd] 2024-04-22T07:17:38.377 INFO:teuthology.orchestra.run.smithi037.stdout: osd journal size = 100 2024-04-22T07:17:38.377 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-22T07:17:38.377 INFO:teuthology.orchestra.run.smithi037.stdout: osd scrub load threshold = 5.0 2024-04-22T07:17:38.377 INFO:teuthology.orchestra.run.smithi037.stdout: osd scrub max interval = 600 2024-04-22T07:17:38.377 INFO:teuthology.orchestra.run.smithi037.stdout: osd mclock profile = high_recovery_ops 2024-04-22T07:17:38.377 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-22T07:17:38.377 INFO:teuthology.orchestra.run.smithi037.stdout: osd recover clone overlap = true 2024-04-22T07:17:38.377 INFO:teuthology.orchestra.run.smithi037.stdout: osd recovery max chunk = 1048576 2024-04-22T07:17:38.377 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-22T07:17:38.377 INFO:teuthology.orchestra.run.smithi037.stdout: osd debug shutdown = true 2024-04-22T07:17:38.378 INFO:teuthology.orchestra.run.smithi037.stdout: osd debug op order = true 2024-04-22T07:17:38.378 INFO:teuthology.orchestra.run.smithi037.stdout: osd debug verify stray on activate = true 2024-04-22T07:17:38.378 INFO:teuthology.orchestra.run.smithi037.stdout: osd debug trim objects = true 2024-04-22T07:17:38.378 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-22T07:17:38.378 INFO:teuthology.orchestra.run.smithi037.stdout: osd open classes on start = true 2024-04-22T07:17:38.378 INFO:teuthology.orchestra.run.smithi037.stdout: osd debug pg log writeout = true 2024-04-22T07:17:38.378 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-22T07:17:38.378 INFO:teuthology.orchestra.run.smithi037.stdout: osd deep scrub update digest min age = 30 2024-04-22T07:17:38.378 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-22T07:17:38.378 INFO:teuthology.orchestra.run.smithi037.stdout: osd map max advance = 10 2024-04-22T07:17:38.378 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-22T07:17:38.378 INFO:teuthology.orchestra.run.smithi037.stdout: journal zero on create = true 2024-04-22T07:17:38.378 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-22T07:17:38.378 INFO:teuthology.orchestra.run.smithi037.stdout: filestore ondisk finisher threads = 3 2024-04-22T07:17:38.379 INFO:teuthology.orchestra.run.smithi037.stdout: filestore apply finisher threads = 3 2024-04-22T07:17:38.379 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-22T07:17:38.379 INFO:teuthology.orchestra.run.smithi037.stdout: bdev debug aio = true 2024-04-22T07:17:38.379 INFO:teuthology.orchestra.run.smithi037.stdout: osd debug misdirected ops = true 2024-04-22T07:17:38.379 INFO:teuthology.orchestra.run.smithi037.stdout: bdev async discard = True 2024-04-22T07:17:38.379 INFO:teuthology.orchestra.run.smithi037.stdout: bdev enable discard = True 2024-04-22T07:17:38.379 INFO:teuthology.orchestra.run.smithi037.stdout: bluestore allocator = bitmap 2024-04-22T07:17:38.379 INFO:teuthology.orchestra.run.smithi037.stdout: bluestore block size = 96636764160 2024-04-22T07:17:38.379 INFO:teuthology.orchestra.run.smithi037.stdout: bluestore fsck on mount = True 2024-04-22T07:17:38.379 INFO:teuthology.orchestra.run.smithi037.stdout: debug bluefs = 1/20 2024-04-22T07:17:38.379 INFO:teuthology.orchestra.run.smithi037.stdout: debug bluestore = 1/20 2024-04-22T07:17:38.379 INFO:teuthology.orchestra.run.smithi037.stdout: debug ms = 1 2024-04-22T07:17:38.379 INFO:teuthology.orchestra.run.smithi037.stdout: debug osd = 20 2024-04-22T07:17:38.379 INFO:teuthology.orchestra.run.smithi037.stdout: debug rocksdb = 4/10 2024-04-22T07:17:38.380 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd backfillfull_ratio = 0.85 2024-04-22T07:17:38.380 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd full ratio = 0.9 2024-04-22T07:17:38.380 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd nearfull ratio = 0.8 2024-04-22T07:17:38.380 INFO:teuthology.orchestra.run.smithi037.stdout: osd blocked scrub grace period = 3600 2024-04-22T07:17:38.380 INFO:teuthology.orchestra.run.smithi037.stdout: osd failsafe full ratio = 0.95 2024-04-22T07:17:38.380 INFO:teuthology.orchestra.run.smithi037.stdout: osd max markdown count = 1000 2024-04-22T07:17:38.380 INFO:teuthology.orchestra.run.smithi037.stdout: osd objectstore = bluestore 2024-04-22T07:17:38.380 INFO:teuthology.orchestra.run.smithi037.stdout: osd op complaint time = 180 2024-04-22T07:17:38.380 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-22T07:17:38.380 INFO:teuthology.orchestra.run.smithi037.stdout:[mgr] 2024-04-22T07:17:38.380 INFO:teuthology.orchestra.run.smithi037.stdout: debug ms = 1 2024-04-22T07:17:38.380 INFO:teuthology.orchestra.run.smithi037.stdout: debug mgr = 20 2024-04-22T07:17:38.380 INFO:teuthology.orchestra.run.smithi037.stdout: debug mon = 20 2024-04-22T07:17:38.380 INFO:teuthology.orchestra.run.smithi037.stdout: debug auth = 20 2024-04-22T07:17:38.380 INFO:teuthology.orchestra.run.smithi037.stdout: mon reweight min pgs per osd = 4 2024-04-22T07:17:38.381 INFO:teuthology.orchestra.run.smithi037.stdout: mon reweight min bytes per osd = 10 2024-04-22T07:17:38.381 INFO:teuthology.orchestra.run.smithi037.stdout: mgr/telemetry/nag = false 2024-04-22T07:17:38.381 INFO:teuthology.orchestra.run.smithi037.stdout: debug client = 20 2024-04-22T07:17:38.381 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-22T07:17:38.381 INFO:teuthology.orchestra.run.smithi037.stdout:[mon] 2024-04-22T07:17:38.381 INFO:teuthology.orchestra.run.smithi037.stdout: debug ms = 1 2024-04-22T07:17:38.381 INFO:teuthology.orchestra.run.smithi037.stdout: debug mon = 20 2024-04-22T07:17:38.381 INFO:teuthology.orchestra.run.smithi037.stdout: debug paxos = 20 2024-04-22T07:17:38.381 INFO:teuthology.orchestra.run.smithi037.stdout: debug auth = 20 2024-04-22T07:17:38.381 INFO:teuthology.orchestra.run.smithi037.stdout: mon data avail warn = 5 2024-04-22T07:17:38.381 INFO:teuthology.orchestra.run.smithi037.stdout: mon mgr mkfs grace = 240 2024-04-22T07:17:38.381 INFO:teuthology.orchestra.run.smithi037.stdout: mon reweight min pgs per osd = 4 2024-04-22T07:17:38.381 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd reporter subtree level = osd 2024-04-22T07:17:38.381 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd prime pg temp = true 2024-04-22T07:17:38.382 INFO:teuthology.orchestra.run.smithi037.stdout: mon reweight min bytes per osd = 10 2024-04-22T07:17:38.382 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-22T07:17:38.382 INFO:teuthology.orchestra.run.smithi037.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-22T07:17:38.382 INFO:teuthology.orchestra.run.smithi037.stdout: auth mon ticket ttl = 660 # 11m 2024-04-22T07:17:38.382 INFO:teuthology.orchestra.run.smithi037.stdout: auth service ticket ttl = 240 # 4m 2024-04-22T07:17:38.382 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-22T07:17:38.382 INFO:teuthology.orchestra.run.smithi037.stdout: # don't complain about insecure global_id in the test suite 2024-04-22T07:17:38.382 INFO:teuthology.orchestra.run.smithi037.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-22T07:17:38.382 INFO:teuthology.orchestra.run.smithi037.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-22T07:17:38.382 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-22T07:17:38.382 INFO:teuthology.orchestra.run.smithi037.stdout: # 1m isn't quite enough 2024-04-22T07:17:38.382 INFO:teuthology.orchestra.run.smithi037.stdout: mon_down_mkfs_grace = 2m 2024-04-22T07:17:38.382 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-22T07:17:38.383 INFO:teuthology.orchestra.run.smithi037.stdout: mon_warn_on_filestore_osds = false 2024-04-22T07:17:38.383 INFO:teuthology.orchestra.run.smithi037.stdout: mon down mkfs grace = 300 2024-04-22T07:17:38.383 INFO:teuthology.orchestra.run.smithi037.stdout: mon op complaint time = 120 2024-04-22T07:17:38.383 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-22T07:17:38.383 INFO:teuthology.orchestra.run.smithi037.stdout:[client] 2024-04-22T07:17:38.383 INFO:teuthology.orchestra.run.smithi037.stdout: rgw cache enabled = true 2024-04-22T07:17:38.383 INFO:teuthology.orchestra.run.smithi037.stdout: rgw enable ops log = true 2024-04-22T07:17:38.383 INFO:teuthology.orchestra.run.smithi037.stdout: rgw enable usage log = true 2024-04-22T07:17:38.383 INFO:teuthology.orchestra.run.smithi037.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-22T07:17:38.383 INFO:teuthology.orchestra.run.smithi037.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-22T07:17:38.383 INFO:teuthology.orchestra.run.smithi037.stdout: client mount timeout = 600 2024-04-22T07:17:38.383 INFO:teuthology.orchestra.run.smithi037.stdout: client_shutdown_timeout = 120 2024-04-22T07:17:38.383 INFO:teuthology.orchestra.run.smithi037.stdout: debug client = 20 2024-04-22T07:17:38.383 INFO:teuthology.orchestra.run.smithi037.stdout: debug ms = 1 2024-04-22T07:17:38.384 INFO:teuthology.orchestra.run.smithi037.stdout: rados mon op timeout = 900 2024-04-22T07:17:38.384 INFO:teuthology.orchestra.run.smithi037.stdout: rados osd op timeout = 900 2024-04-22T07:17:38.384 INFO:teuthology.orchestra.run.smithi037.stdout:[mon.a] 2024-04-22T07:17:38.384 INFO:teuthology.orchestra.run.smithi037.stdout:[mon.b] 2024-04-22T07:17:38.384 INFO:teuthology.orchestra.run.smithi037.stdout:[mon.c] 2024-04-22T07:17:38.384 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.a] 2024-04-22T07:17:38.384 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.c] 2024-04-22T07:17:38.384 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.e] 2024-04-22T07:17:38.384 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.b] 2024-04-22T07:17:38.384 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.d] 2024-04-22T07:17:38.384 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.f] 2024-04-22T07:17:38.384 INFO:teuthology.orchestra.run.smithi037.stdout:[mds] 2024-04-22T07:17:38.384 INFO:teuthology.orchestra.run.smithi037.stdout: debug mds = 20 2024-04-22T07:17:38.384 INFO:teuthology.orchestra.run.smithi037.stdout: debug mds balancer = 20 2024-04-22T07:17:38.385 INFO:teuthology.orchestra.run.smithi037.stdout: debug ms = 1 2024-04-22T07:17:38.385 INFO:teuthology.orchestra.run.smithi037.stdout: mds bal fragment size max = 10000 2024-04-22T07:17:38.385 INFO:teuthology.orchestra.run.smithi037.stdout: mds bal merge size = 5 2024-04-22T07:17:38.385 INFO:teuthology.orchestra.run.smithi037.stdout: mds bal split bits = 3 2024-04-22T07:17:38.385 INFO:teuthology.orchestra.run.smithi037.stdout: mds bal split size = 100 2024-04-22T07:17:38.385 INFO:teuthology.orchestra.run.smithi037.stdout: mds debug frag = True 2024-04-22T07:17:38.385 INFO:teuthology.orchestra.run.smithi037.stdout: mds debug scatterstat = True 2024-04-22T07:17:38.385 INFO:teuthology.orchestra.run.smithi037.stdout: mds oft prefetch dirfrags = True 2024-04-22T07:17:38.385 INFO:teuthology.orchestra.run.smithi037.stdout: mds op complaint time = 180 2024-04-22T07:17:38.385 INFO:teuthology.orchestra.run.smithi037.stdout: mds verify scatter = True 2024-04-22T07:17:38.385 INFO:teuthology.orchestra.run.smithi037.stdout: mds_dir_prefetch = True 2024-04-22T07:17:38.385 INFO:teuthology.orchestra.run.smithi037.stdout: mds_sleep_rank_change = 5000000.0 2024-04-22T07:17:38.385 INFO:teuthology.orchestra.run.smithi037.stdout: osd op complaint time = 180 2024-04-22T07:17:38.385 INFO:teuthology.orchestra.run.smithi037.stdout: rados mon op timeout = 900 2024-04-22T07:17:38.385 INFO:teuthology.orchestra.run.smithi037.stdout: rados osd op timeout = 900 2024-04-22T07:17:38.387 INFO:teuthology.orchestra.run.smithi196.stdout:[global] 2024-04-22T07:17:38.387 INFO:teuthology.orchestra.run.smithi196.stdout: chdir = "" 2024-04-22T07:17:38.387 INFO:teuthology.orchestra.run.smithi196.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-22T07:17:38.387 INFO:teuthology.orchestra.run.smithi196.stdout: auth supported = cephx 2024-04-22T07:17:38.387 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-04-22T07:17:38.387 INFO:teuthology.orchestra.run.smithi196.stdout: filestore xattr use omap = true 2024-04-22T07:17:38.387 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-04-22T07:17:38.387 INFO:teuthology.orchestra.run.smithi196.stdout: mon clock drift allowed = 1.000 2024-04-22T07:17:38.388 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-04-22T07:17:38.388 INFO:teuthology.orchestra.run.smithi196.stdout: osd crush chooseleaf type = 0 2024-04-22T07:17:38.388 INFO:teuthology.orchestra.run.smithi196.stdout: auth debug = true 2024-04-22T07:17:38.388 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-04-22T07:17:38.388 INFO:teuthology.orchestra.run.smithi196.stdout: ms die on old message = true 2024-04-22T07:17:38.388 INFO:teuthology.orchestra.run.smithi196.stdout: ms die on bug = true 2024-04-22T07:17:38.388 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-04-22T07:17:38.388 INFO:teuthology.orchestra.run.smithi196.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-22T07:17:38.388 INFO:teuthology.orchestra.run.smithi196.stdout: mon pg warn max object skew = 0 2024-04-22T07:17:38.388 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-04-22T07:17:38.388 INFO:teuthology.orchestra.run.smithi196.stdout: # disable pg_autoscaler by default for new pools 2024-04-22T07:17:38.388 INFO:teuthology.orchestra.run.smithi196.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-22T07:17:38.388 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-04-22T07:17:38.388 INFO:teuthology.orchestra.run.smithi196.stdout: osd pool default size = 2 2024-04-22T07:17:38.389 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-04-22T07:17:38.389 INFO:teuthology.orchestra.run.smithi196.stdout: mon osd allow primary affinity = true 2024-04-22T07:17:38.389 INFO:teuthology.orchestra.run.smithi196.stdout: mon osd allow pg remap = true 2024-04-22T07:17:38.389 INFO:teuthology.orchestra.run.smithi196.stdout: mon warn on legacy crush tunables = false 2024-04-22T07:17:38.389 INFO:teuthology.orchestra.run.smithi196.stdout: mon warn on crush straw calc version zero = false 2024-04-22T07:17:38.389 INFO:teuthology.orchestra.run.smithi196.stdout: mon warn on no sortbitwise = false 2024-04-22T07:17:38.389 INFO:teuthology.orchestra.run.smithi196.stdout: mon warn on osd down out interval zero = false 2024-04-22T07:17:38.389 INFO:teuthology.orchestra.run.smithi196.stdout: mon warn on too few osds = false 2024-04-22T07:17:38.389 INFO:teuthology.orchestra.run.smithi196.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-22T07:17:38.389 INFO:teuthology.orchestra.run.smithi196.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-22T07:17:38.389 INFO:teuthology.orchestra.run.smithi196.stdout: mon_allow_pool_size_one = true 2024-04-22T07:17:38.389 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-04-22T07:17:38.389 INFO:teuthology.orchestra.run.smithi196.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-22T07:17:38.389 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-04-22T07:17:38.390 INFO:teuthology.orchestra.run.smithi196.stdout: osd default data pool replay window = 5 2024-04-22T07:17:38.390 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-04-22T07:17:38.390 INFO:teuthology.orchestra.run.smithi196.stdout: mon allow pool delete = true 2024-04-22T07:17:38.390 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-04-22T07:17:38.390 INFO:teuthology.orchestra.run.smithi196.stdout: mon cluster log file level = debug 2024-04-22T07:17:38.390 INFO:teuthology.orchestra.run.smithi196.stdout: debug asserts on shutdown = true 2024-04-22T07:17:38.390 INFO:teuthology.orchestra.run.smithi196.stdout: mon health detail to clog = false 2024-04-22T07:17:38.390 INFO:teuthology.orchestra.run.smithi196.stdout: mon host = "172.21.15.37,172.21.15.196,[v2:172.21.15.196:3301,v1:172.21.15.196:6790]" 2024-04-22T07:17:38.390 INFO:teuthology.orchestra.run.smithi196.stdout: ms die on skipped message = False 2024-04-22T07:17:38.390 INFO:teuthology.orchestra.run.smithi196.stdout: fsid = 10d90a41-52d3-4e09-8022-c8ac67897ad1 2024-04-22T07:17:38.390 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-04-22T07:17:38.390 INFO:teuthology.orchestra.run.smithi196.stdout:[osd] 2024-04-22T07:17:38.390 INFO:teuthology.orchestra.run.smithi196.stdout: osd journal size = 100 2024-04-22T07:17:38.391 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-04-22T07:17:38.391 INFO:teuthology.orchestra.run.smithi196.stdout: osd scrub load threshold = 5.0 2024-04-22T07:17:38.391 INFO:teuthology.orchestra.run.smithi196.stdout: osd scrub max interval = 600 2024-04-22T07:17:38.391 INFO:teuthology.orchestra.run.smithi196.stdout: osd mclock profile = high_recovery_ops 2024-04-22T07:17:38.391 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-04-22T07:17:38.391 INFO:teuthology.orchestra.run.smithi196.stdout: osd recover clone overlap = true 2024-04-22T07:17:38.391 INFO:teuthology.orchestra.run.smithi196.stdout: osd recovery max chunk = 1048576 2024-04-22T07:17:38.391 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-04-22T07:17:38.391 INFO:teuthology.orchestra.run.smithi196.stdout: osd debug shutdown = true 2024-04-22T07:17:38.391 INFO:teuthology.orchestra.run.smithi196.stdout: osd debug op order = true 2024-04-22T07:17:38.391 INFO:teuthology.orchestra.run.smithi196.stdout: osd debug verify stray on activate = true 2024-04-22T07:17:38.391 INFO:teuthology.orchestra.run.smithi196.stdout: osd debug trim objects = true 2024-04-22T07:17:38.391 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-04-22T07:17:38.391 INFO:teuthology.orchestra.run.smithi196.stdout: osd open classes on start = true 2024-04-22T07:17:38.392 INFO:teuthology.orchestra.run.smithi196.stdout: osd debug pg log writeout = true 2024-04-22T07:17:38.392 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-04-22T07:17:38.392 INFO:teuthology.orchestra.run.smithi196.stdout: osd deep scrub update digest min age = 30 2024-04-22T07:17:38.392 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-04-22T07:17:38.392 INFO:teuthology.orchestra.run.smithi196.stdout: osd map max advance = 10 2024-04-22T07:17:38.392 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-04-22T07:17:38.392 INFO:teuthology.orchestra.run.smithi196.stdout: journal zero on create = true 2024-04-22T07:17:38.392 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-04-22T07:17:38.392 INFO:teuthology.orchestra.run.smithi196.stdout: filestore ondisk finisher threads = 3 2024-04-22T07:17:38.392 INFO:teuthology.orchestra.run.smithi196.stdout: filestore apply finisher threads = 3 2024-04-22T07:17:38.392 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-04-22T07:17:38.392 INFO:teuthology.orchestra.run.smithi196.stdout: bdev debug aio = true 2024-04-22T07:17:38.392 INFO:teuthology.orchestra.run.smithi196.stdout: osd debug misdirected ops = true 2024-04-22T07:17:38.392 INFO:teuthology.orchestra.run.smithi196.stdout: bdev async discard = True 2024-04-22T07:17:38.392 INFO:teuthology.orchestra.run.smithi196.stdout: bdev enable discard = True 2024-04-22T07:17:38.393 INFO:teuthology.orchestra.run.smithi196.stdout: bluestore allocator = bitmap 2024-04-22T07:17:38.393 INFO:teuthology.orchestra.run.smithi196.stdout: bluestore block size = 96636764160 2024-04-22T07:17:38.393 INFO:teuthology.orchestra.run.smithi196.stdout: bluestore fsck on mount = True 2024-04-22T07:17:38.393 INFO:teuthology.orchestra.run.smithi196.stdout: debug bluefs = 1/20 2024-04-22T07:17:38.393 INFO:teuthology.orchestra.run.smithi196.stdout: debug bluestore = 1/20 2024-04-22T07:17:38.393 INFO:teuthology.orchestra.run.smithi196.stdout: debug ms = 1 2024-04-22T07:17:38.393 INFO:teuthology.orchestra.run.smithi196.stdout: debug osd = 20 2024-04-22T07:17:38.393 INFO:teuthology.orchestra.run.smithi196.stdout: debug rocksdb = 4/10 2024-04-22T07:17:38.393 INFO:teuthology.orchestra.run.smithi196.stdout: mon osd backfillfull_ratio = 0.85 2024-04-22T07:17:38.393 INFO:teuthology.orchestra.run.smithi196.stdout: mon osd full ratio = 0.9 2024-04-22T07:17:38.393 INFO:teuthology.orchestra.run.smithi196.stdout: mon osd nearfull ratio = 0.8 2024-04-22T07:17:38.393 INFO:teuthology.orchestra.run.smithi196.stdout: osd blocked scrub grace period = 3600 2024-04-22T07:17:38.393 INFO:teuthology.orchestra.run.smithi196.stdout: osd failsafe full ratio = 0.95 2024-04-22T07:17:38.393 INFO:teuthology.orchestra.run.smithi196.stdout: osd max markdown count = 1000 2024-04-22T07:17:38.393 INFO:teuthology.orchestra.run.smithi196.stdout: osd objectstore = bluestore 2024-04-22T07:17:38.394 INFO:teuthology.orchestra.run.smithi196.stdout: osd op complaint time = 180 2024-04-22T07:17:38.394 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-04-22T07:17:38.394 INFO:teuthology.orchestra.run.smithi196.stdout:[mgr] 2024-04-22T07:17:38.394 INFO:teuthology.orchestra.run.smithi196.stdout: debug ms = 1 2024-04-22T07:17:38.394 INFO:teuthology.orchestra.run.smithi196.stdout: debug mgr = 20 2024-04-22T07:17:38.394 INFO:teuthology.orchestra.run.smithi196.stdout: debug mon = 20 2024-04-22T07:17:38.394 INFO:teuthology.orchestra.run.smithi196.stdout: debug auth = 20 2024-04-22T07:17:38.394 INFO:teuthology.orchestra.run.smithi196.stdout: mon reweight min pgs per osd = 4 2024-04-22T07:17:38.394 INFO:teuthology.orchestra.run.smithi196.stdout: mon reweight min bytes per osd = 10 2024-04-22T07:17:38.394 INFO:teuthology.orchestra.run.smithi196.stdout: mgr/telemetry/nag = false 2024-04-22T07:17:38.394 INFO:teuthology.orchestra.run.smithi196.stdout: debug client = 20 2024-04-22T07:17:38.394 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-04-22T07:17:38.394 INFO:teuthology.orchestra.run.smithi196.stdout:[mon] 2024-04-22T07:17:38.394 INFO:teuthology.orchestra.run.smithi196.stdout: debug ms = 1 2024-04-22T07:17:38.395 INFO:teuthology.orchestra.run.smithi196.stdout: debug mon = 20 2024-04-22T07:17:38.395 INFO:teuthology.orchestra.run.smithi196.stdout: debug paxos = 20 2024-04-22T07:17:38.395 INFO:teuthology.orchestra.run.smithi196.stdout: debug auth = 20 2024-04-22T07:17:38.395 INFO:teuthology.orchestra.run.smithi196.stdout: mon data avail warn = 5 2024-04-22T07:17:38.395 INFO:teuthology.orchestra.run.smithi196.stdout: mon mgr mkfs grace = 240 2024-04-22T07:17:38.395 INFO:teuthology.orchestra.run.smithi196.stdout: mon reweight min pgs per osd = 4 2024-04-22T07:17:38.395 INFO:teuthology.orchestra.run.smithi196.stdout: mon osd reporter subtree level = osd 2024-04-22T07:17:38.395 INFO:teuthology.orchestra.run.smithi196.stdout: mon osd prime pg temp = true 2024-04-22T07:17:38.395 INFO:teuthology.orchestra.run.smithi196.stdout: mon reweight min bytes per osd = 10 2024-04-22T07:17:38.395 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-04-22T07:17:38.395 INFO:teuthology.orchestra.run.smithi196.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-22T07:17:38.395 INFO:teuthology.orchestra.run.smithi196.stdout: auth mon ticket ttl = 660 # 11m 2024-04-22T07:17:38.395 INFO:teuthology.orchestra.run.smithi196.stdout: auth service ticket ttl = 240 # 4m 2024-04-22T07:17:38.395 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-04-22T07:17:38.396 INFO:teuthology.orchestra.run.smithi196.stdout: # don't complain about insecure global_id in the test suite 2024-04-22T07:17:38.396 INFO:teuthology.orchestra.run.smithi196.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-22T07:17:38.396 INFO:teuthology.orchestra.run.smithi196.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-22T07:17:38.396 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-04-22T07:17:38.396 INFO:teuthology.orchestra.run.smithi196.stdout: # 1m isn't quite enough 2024-04-22T07:17:38.396 INFO:teuthology.orchestra.run.smithi196.stdout: mon_down_mkfs_grace = 2m 2024-04-22T07:17:38.396 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-04-22T07:17:38.396 INFO:teuthology.orchestra.run.smithi196.stdout: mon_warn_on_filestore_osds = false 2024-04-22T07:17:38.396 INFO:teuthology.orchestra.run.smithi196.stdout: mon down mkfs grace = 300 2024-04-22T07:17:38.396 INFO:teuthology.orchestra.run.smithi196.stdout: mon op complaint time = 120 2024-04-22T07:17:38.396 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-04-22T07:17:38.396 INFO:teuthology.orchestra.run.smithi196.stdout:[client] 2024-04-22T07:17:38.396 INFO:teuthology.orchestra.run.smithi196.stdout: rgw cache enabled = true 2024-04-22T07:17:38.396 INFO:teuthology.orchestra.run.smithi196.stdout: rgw enable ops log = true 2024-04-22T07:17:38.396 INFO:teuthology.orchestra.run.smithi196.stdout: rgw enable usage log = true 2024-04-22T07:17:38.397 INFO:teuthology.orchestra.run.smithi196.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-22T07:17:38.397 INFO:teuthology.orchestra.run.smithi196.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-22T07:17:38.397 INFO:teuthology.orchestra.run.smithi196.stdout: client mount timeout = 600 2024-04-22T07:17:38.397 INFO:teuthology.orchestra.run.smithi196.stdout: client_shutdown_timeout = 120 2024-04-22T07:17:38.397 INFO:teuthology.orchestra.run.smithi196.stdout: debug client = 20 2024-04-22T07:17:38.397 INFO:teuthology.orchestra.run.smithi196.stdout: debug ms = 1 2024-04-22T07:17:38.397 INFO:teuthology.orchestra.run.smithi196.stdout: rados mon op timeout = 900 2024-04-22T07:17:38.397 INFO:teuthology.orchestra.run.smithi196.stdout: rados osd op timeout = 900 2024-04-22T07:17:38.397 INFO:teuthology.orchestra.run.smithi196.stdout:[mon.a] 2024-04-22T07:17:38.397 INFO:teuthology.orchestra.run.smithi196.stdout:[mon.b] 2024-04-22T07:17:38.397 INFO:teuthology.orchestra.run.smithi196.stdout:[mon.c] 2024-04-22T07:17:38.397 INFO:teuthology.orchestra.run.smithi196.stdout:[mds.a] 2024-04-22T07:17:38.397 INFO:teuthology.orchestra.run.smithi196.stdout:[mds.c] 2024-04-22T07:17:38.397 INFO:teuthology.orchestra.run.smithi196.stdout:[mds.e] 2024-04-22T07:17:38.398 INFO:teuthology.orchestra.run.smithi196.stdout:[mds.b] 2024-04-22T07:17:38.398 INFO:teuthology.orchestra.run.smithi196.stdout:[mds.d] 2024-04-22T07:17:38.398 INFO:teuthology.orchestra.run.smithi196.stdout:[mds.f] 2024-04-22T07:17:38.398 INFO:teuthology.orchestra.run.smithi196.stdout:[mds] 2024-04-22T07:17:38.398 INFO:teuthology.orchestra.run.smithi196.stdout: debug mds = 20 2024-04-22T07:17:38.398 INFO:teuthology.orchestra.run.smithi196.stdout: debug mds balancer = 20 2024-04-22T07:17:38.398 INFO:teuthology.orchestra.run.smithi196.stdout: debug ms = 1 2024-04-22T07:17:38.398 INFO:teuthology.orchestra.run.smithi196.stdout: mds bal fragment size max = 10000 2024-04-22T07:17:38.398 INFO:teuthology.orchestra.run.smithi196.stdout: mds bal merge size = 5 2024-04-22T07:17:38.398 INFO:teuthology.orchestra.run.smithi196.stdout: mds bal split bits = 3 2024-04-22T07:17:38.398 INFO:teuthology.orchestra.run.smithi196.stdout: mds bal split size = 100 2024-04-22T07:17:38.398 INFO:teuthology.orchestra.run.smithi196.stdout: mds debug frag = True 2024-04-22T07:17:38.398 INFO:teuthology.orchestra.run.smithi196.stdout: mds debug scatterstat = True 2024-04-22T07:17:38.399 INFO:teuthology.orchestra.run.smithi196.stdout: mds oft prefetch dirfrags = True 2024-04-22T07:17:38.399 INFO:teuthology.orchestra.run.smithi196.stdout: mds op complaint time = 180 2024-04-22T07:17:38.399 INFO:teuthology.orchestra.run.smithi196.stdout: mds verify scatter = True 2024-04-22T07:17:38.399 INFO:teuthology.orchestra.run.smithi196.stdout: mds_dir_prefetch = True 2024-04-22T07:17:38.399 INFO:teuthology.orchestra.run.smithi196.stdout: mds_sleep_rank_change = 5000000.0 2024-04-22T07:17:38.399 INFO:teuthology.orchestra.run.smithi196.stdout: osd op complaint time = 180 2024-04-22T07:17:38.399 INFO:teuthology.orchestra.run.smithi196.stdout: rados mon op timeout = 900 2024-04-22T07:17:38.399 INFO:teuthology.orchestra.run.smithi196.stdout: rados osd op timeout = 900 2024-04-22T07:17:38.399 INFO:tasks.ceph:Creating admin key on mon.a... 2024-04-22T07:17:38.399 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-04-22T07:17:38.482 INFO:tasks.ceph:Copying monmap to all nodes... 2024-04-22T07:17:38.482 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-04-22T07:17:38.482 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-04-22T07:17:38.497 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-04-22T07:17:38.497 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-04-22T07:17:38.552 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi037.front.sepia.ceph.com 2024-04-22T07:17:38.552 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-04-22T07:17:38.552 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-22T07:17:38.552 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-22T07:17:38.626 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-04-22T07:17:38.626 DEBUG:teuthology.orchestra.run.smithi037:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-22T07:17:38.681 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi196.front.sepia.ceph.com 2024-04-22T07:17:38.682 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-04-22T07:17:38.682 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-22T07:17:38.682 DEBUG:teuthology.orchestra.run.smithi196:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-22T07:17:38.714 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-04-22T07:17:38.714 DEBUG:teuthology.orchestra.run.smithi196:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-22T07:17:38.769 INFO:tasks.ceph:Setting up mon nodes... 2024-04-22T07:17:38.769 INFO:tasks.ceph:Setting up mgr nodes... 2024-04-22T07:17:38.769 DEBUG:teuthology.orchestra.run.smithi037:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-04-22T07:17:38.820 INFO:teuthology.orchestra.run.smithi037.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-04-22T07:17:38.823 DEBUG:teuthology.orchestra.run.smithi196:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-04-22T07:17:38.897 INFO:teuthology.orchestra.run.smithi196.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-04-22T07:17:38.899 INFO:tasks.ceph:Setting up mds nodes... 2024-04-22T07:17:38.900 DEBUG:teuthology.orchestra.run.smithi037:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-04-22T07:17:38.949 INFO:teuthology.orchestra.run.smithi037.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-04-22T07:17:38.952 DEBUG:teuthology.orchestra.run.smithi037:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-04-22T07:17:38.976 DEBUG:teuthology.orchestra.run.smithi037:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-04-22T07:17:39.065 INFO:teuthology.orchestra.run.smithi037.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-04-22T07:17:39.068 DEBUG:teuthology.orchestra.run.smithi037:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-04-22T07:17:39.092 DEBUG:teuthology.orchestra.run.smithi037:> sudo mkdir -p /var/lib/ceph/mds/ceph-e && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.e /var/lib/ceph/mds/ceph-e/keyring 2024-04-22T07:17:39.182 INFO:teuthology.orchestra.run.smithi037.stdout:creating /var/lib/ceph/mds/ceph-e/keyring 2024-04-22T07:17:39.184 DEBUG:teuthology.orchestra.run.smithi037:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-e 2024-04-22T07:17:39.208 DEBUG:teuthology.orchestra.run.smithi196:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-04-22T07:17:39.257 INFO:teuthology.orchestra.run.smithi196.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-04-22T07:17:39.259 DEBUG:teuthology.orchestra.run.smithi196:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-04-22T07:17:39.282 DEBUG:teuthology.orchestra.run.smithi196:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-04-22T07:17:39.370 INFO:teuthology.orchestra.run.smithi196.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-04-22T07:17:39.372 DEBUG:teuthology.orchestra.run.smithi196:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-04-22T07:17:39.396 DEBUG:teuthology.orchestra.run.smithi196:> sudo mkdir -p /var/lib/ceph/mds/ceph-f && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.f /var/lib/ceph/mds/ceph-f/keyring 2024-04-22T07:17:39.483 INFO:teuthology.orchestra.run.smithi196.stdout:creating /var/lib/ceph/mds/ceph-f/keyring 2024-04-22T07:17:39.486 DEBUG:teuthology.orchestra.run.smithi196:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-f 2024-04-22T07:17:39.509 INFO:tasks.ceph_client:Setting up client nodes... 2024-04-22T07:17:39.509 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-04-22T07:17:39.550 INFO:teuthology.orchestra.run.smithi037.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-04-22T07:17:39.563 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-04-22T07:17:39.563 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi037.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi196.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-22T07:17:39.563 DEBUG:teuthology.orchestra.run.smithi037:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-04-22T07:17:39.628 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-22T07:17:39.628 INFO:tasks.ceph:role: osd.0 2024-04-22T07:17:39.628 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi037.front.sepia.ceph.com 2024-04-22T07:17:39.628 DEBUG:teuthology.orchestra.run.smithi037:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-22T07:17:39.700 INFO:teuthology.orchestra.run.smithi037.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-22T07:17:39.700 INFO:teuthology.orchestra.run.smithi037.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-22T07:17:39.700 INFO:teuthology.orchestra.run.smithi037.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-22T07:17:39.700 INFO:teuthology.orchestra.run.smithi037.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-22T07:17:39.700 INFO:teuthology.orchestra.run.smithi037.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-22T07:17:39.700 INFO:teuthology.orchestra.run.smithi037.stdout: = sunit=0 swidth=0 blks 2024-04-22T07:17:39.700 INFO:teuthology.orchestra.run.smithi037.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-22T07:17:39.700 INFO:teuthology.orchestra.run.smithi037.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-22T07:17:39.700 INFO:teuthology.orchestra.run.smithi037.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-22T07:17:39.700 INFO:teuthology.orchestra.run.smithi037.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-22T07:17:40.210 INFO:teuthology.orchestra.run.smithi037.stdout:Discarding blocks...Done. 2024-04-22T07:17:40.212 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi037.front.sepia.ceph.com -o noatime 2024-04-22T07:17:40.212 DEBUG:teuthology.orchestra.run.smithi037:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-04-22T07:17:40.355 DEBUG:teuthology.orchestra.run.smithi037:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-04-22T07:17:40.392 DEBUG:teuthology.orchestra.run.smithi037:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-04-22T07:17:40.460 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-22T07:17:40.460 INFO:tasks.ceph:role: osd.1 2024-04-22T07:17:40.460 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi037.front.sepia.ceph.com 2024-04-22T07:17:40.460 DEBUG:teuthology.orchestra.run.smithi037:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-22T07:17:40.535 INFO:teuthology.orchestra.run.smithi037.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-22T07:17:40.535 INFO:teuthology.orchestra.run.smithi037.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-22T07:17:40.535 INFO:teuthology.orchestra.run.smithi037.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-22T07:17:40.535 INFO:teuthology.orchestra.run.smithi037.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-22T07:17:40.535 INFO:teuthology.orchestra.run.smithi037.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-22T07:17:40.535 INFO:teuthology.orchestra.run.smithi037.stdout: = sunit=0 swidth=0 blks 2024-04-22T07:17:40.535 INFO:teuthology.orchestra.run.smithi037.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-22T07:17:40.535 INFO:teuthology.orchestra.run.smithi037.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-22T07:17:40.535 INFO:teuthology.orchestra.run.smithi037.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-22T07:17:40.535 INFO:teuthology.orchestra.run.smithi037.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-22T07:17:40.977 INFO:teuthology.orchestra.run.smithi037.stdout:Discarding blocks...Done. 2024-04-22T07:17:40.979 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi037.front.sepia.ceph.com -o noatime 2024-04-22T07:17:40.979 DEBUG:teuthology.orchestra.run.smithi037:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-04-22T07:17:41.069 DEBUG:teuthology.orchestra.run.smithi037:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-04-22T07:17:41.097 DEBUG:teuthology.orchestra.run.smithi037:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-04-22T07:17:41.161 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-22T07:17:41.161 INFO:tasks.ceph:role: osd.2 2024-04-22T07:17:41.162 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi037.front.sepia.ceph.com 2024-04-22T07:17:41.162 DEBUG:teuthology.orchestra.run.smithi037:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-22T07:17:41.234 INFO:teuthology.orchestra.run.smithi037.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-22T07:17:41.234 INFO:teuthology.orchestra.run.smithi037.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-22T07:17:41.234 INFO:teuthology.orchestra.run.smithi037.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-22T07:17:41.234 INFO:teuthology.orchestra.run.smithi037.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-22T07:17:41.234 INFO:teuthology.orchestra.run.smithi037.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-22T07:17:41.234 INFO:teuthology.orchestra.run.smithi037.stdout: = sunit=0 swidth=0 blks 2024-04-22T07:17:41.234 INFO:teuthology.orchestra.run.smithi037.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-22T07:17:41.234 INFO:teuthology.orchestra.run.smithi037.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-22T07:17:41.235 INFO:teuthology.orchestra.run.smithi037.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-22T07:17:41.235 INFO:teuthology.orchestra.run.smithi037.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-22T07:17:41.723 INFO:teuthology.orchestra.run.smithi037.stdout:Discarding blocks...Done. 2024-04-22T07:17:41.726 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi037.front.sepia.ceph.com -o noatime 2024-04-22T07:17:41.726 DEBUG:teuthology.orchestra.run.smithi037:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-04-22T07:17:41.859 DEBUG:teuthology.orchestra.run.smithi037:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-04-22T07:17:41.889 DEBUG:teuthology.orchestra.run.smithi037:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-04-22T07:17:41.952 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-22T07:17:41.953 INFO:tasks.ceph:role: osd.3 2024-04-22T07:17:41.953 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi037.front.sepia.ceph.com 2024-04-22T07:17:41.953 DEBUG:teuthology.orchestra.run.smithi037:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-22T07:17:42.024 INFO:teuthology.orchestra.run.smithi037.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-22T07:17:42.025 INFO:teuthology.orchestra.run.smithi037.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-22T07:17:42.025 INFO:teuthology.orchestra.run.smithi037.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-22T07:17:42.025 INFO:teuthology.orchestra.run.smithi037.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-22T07:17:42.025 INFO:teuthology.orchestra.run.smithi037.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-22T07:17:42.025 INFO:teuthology.orchestra.run.smithi037.stdout: = sunit=0 swidth=0 blks 2024-04-22T07:17:42.025 INFO:teuthology.orchestra.run.smithi037.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-22T07:17:42.025 INFO:teuthology.orchestra.run.smithi037.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-22T07:17:42.025 INFO:teuthology.orchestra.run.smithi037.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-22T07:17:42.025 INFO:teuthology.orchestra.run.smithi037.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-22T07:17:42.506 INFO:teuthology.orchestra.run.smithi037.stdout:Discarding blocks...Done. 2024-04-22T07:17:42.508 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi037.front.sepia.ceph.com -o noatime 2024-04-22T07:17:42.509 DEBUG:teuthology.orchestra.run.smithi037:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-04-22T07:17:42.633 DEBUG:teuthology.orchestra.run.smithi037:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-04-22T07:17:42.667 DEBUG:teuthology.orchestra.run.smithi037:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-22T07:17:42.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:17:42.762+0000 7f13a1f80640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-04-22T07:17:42.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:17:42.762+0000 7f13a1f80640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-04-22T07:17:42.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:17:42.763+0000 7f13a1f80640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-22T07:17:42.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:17:42.763+0000 7f13a1f80640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-22T07:17:42.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:17:42.763+0000 7f13a1f80640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-22T07:17:42.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:17:42.763+0000 7f13a1f80640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-04-22T07:17:45.618 DEBUG:teuthology.orchestra.run.smithi037:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-22T07:17:45.648 DEBUG:teuthology.orchestra.run.smithi037:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-22T07:17:45.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:17:45.738+0000 7f8e53e11640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-04-22T07:17:45.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:17:45.739+0000 7f8e53e11640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-04-22T07:17:45.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:17:45.739+0000 7f8e53e11640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-22T07:17:45.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:17:45.739+0000 7f8e53e11640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-22T07:17:45.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:17:45.739+0000 7f8e53e11640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-22T07:17:45.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:17:45.739+0000 7f8e53e11640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-04-22T07:17:48.594 DEBUG:teuthology.orchestra.run.smithi037:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-22T07:17:48.623 DEBUG:teuthology.orchestra.run.smithi037:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-22T07:17:48.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:17:48.715+0000 7ff46db63640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-04-22T07:17:48.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:17:48.716+0000 7ff46db63640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-04-22T07:17:48.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:17:48.716+0000 7ff46db63640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-22T07:17:48.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:17:48.716+0000 7ff46db63640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-22T07:17:48.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:17:48.716+0000 7ff46db63640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-22T07:17:48.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:17:48.716+0000 7ff46db63640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-04-22T07:17:51.569 DEBUG:teuthology.orchestra.run.smithi037:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-22T07:17:51.598 DEBUG:teuthology.orchestra.run.smithi037:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-22T07:17:51.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:17:51.690+0000 7f8ca1610640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-04-22T07:17:51.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:17:51.691+0000 7f8ca1610640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-04-22T07:17:51.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:17:51.691+0000 7f8ca1610640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-22T07:17:51.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:17:51.691+0000 7f8ca1610640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-22T07:17:51.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:17:51.691+0000 7f8ca1610640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-22T07:17:51.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:17:51.691+0000 7f8ca1610640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-04-22T07:17:54.541 DEBUG:teuthology.orchestra.run.smithi037:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-04-22T07:17:54.571 DEBUG:teuthology.orchestra.run.smithi196:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-04-22T07:17:54.599 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-22T07:17:54.599 INFO:tasks.ceph:role: osd.4 2024-04-22T07:17:54.599 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi196.front.sepia.ceph.com 2024-04-22T07:17:54.600 DEBUG:teuthology.orchestra.run.smithi196:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-22T07:17:54.673 INFO:teuthology.orchestra.run.smithi196.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-22T07:17:54.674 INFO:teuthology.orchestra.run.smithi196.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-22T07:17:54.674 INFO:teuthology.orchestra.run.smithi196.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-22T07:17:54.674 INFO:teuthology.orchestra.run.smithi196.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-22T07:17:54.674 INFO:teuthology.orchestra.run.smithi196.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-22T07:17:54.674 INFO:teuthology.orchestra.run.smithi196.stdout: = sunit=0 swidth=0 blks 2024-04-22T07:17:54.674 INFO:teuthology.orchestra.run.smithi196.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-22T07:17:54.674 INFO:teuthology.orchestra.run.smithi196.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-22T07:17:54.674 INFO:teuthology.orchestra.run.smithi196.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-22T07:17:54.674 INFO:teuthology.orchestra.run.smithi196.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-22T07:17:55.173 INFO:teuthology.orchestra.run.smithi196.stdout:Discarding blocks...Done. 2024-04-22T07:17:55.175 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi196.front.sepia.ceph.com -o noatime 2024-04-22T07:17:55.175 DEBUG:teuthology.orchestra.run.smithi196:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-04-22T07:17:55.284 DEBUG:teuthology.orchestra.run.smithi196:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-04-22T07:17:55.315 DEBUG:teuthology.orchestra.run.smithi196:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-04-22T07:17:55.379 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-22T07:17:55.379 INFO:tasks.ceph:role: osd.5 2024-04-22T07:17:55.379 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi196.front.sepia.ceph.com 2024-04-22T07:17:55.379 DEBUG:teuthology.orchestra.run.smithi196:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-22T07:17:55.450 INFO:teuthology.orchestra.run.smithi196.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-22T07:17:55.450 INFO:teuthology.orchestra.run.smithi196.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-22T07:17:55.451 INFO:teuthology.orchestra.run.smithi196.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-22T07:17:55.451 INFO:teuthology.orchestra.run.smithi196.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-22T07:17:55.451 INFO:teuthology.orchestra.run.smithi196.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-22T07:17:55.451 INFO:teuthology.orchestra.run.smithi196.stdout: = sunit=0 swidth=0 blks 2024-04-22T07:17:55.451 INFO:teuthology.orchestra.run.smithi196.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-22T07:17:55.451 INFO:teuthology.orchestra.run.smithi196.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-22T07:17:55.451 INFO:teuthology.orchestra.run.smithi196.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-22T07:17:55.451 INFO:teuthology.orchestra.run.smithi196.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-22T07:17:55.902 INFO:teuthology.orchestra.run.smithi196.stdout:Discarding blocks...Done. 2024-04-22T07:17:55.904 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi196.front.sepia.ceph.com -o noatime 2024-04-22T07:17:55.904 DEBUG:teuthology.orchestra.run.smithi196:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-04-22T07:17:55.976 DEBUG:teuthology.orchestra.run.smithi196:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-04-22T07:17:56.045 DEBUG:teuthology.orchestra.run.smithi196:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-04-22T07:17:56.108 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-22T07:17:56.108 INFO:tasks.ceph:role: osd.6 2024-04-22T07:17:56.108 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi196.front.sepia.ceph.com 2024-04-22T07:17:56.108 DEBUG:teuthology.orchestra.run.smithi196:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-22T07:17:56.179 INFO:teuthology.orchestra.run.smithi196.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-22T07:17:56.179 INFO:teuthology.orchestra.run.smithi196.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-22T07:17:56.179 INFO:teuthology.orchestra.run.smithi196.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-22T07:17:56.179 INFO:teuthology.orchestra.run.smithi196.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-22T07:17:56.179 INFO:teuthology.orchestra.run.smithi196.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-22T07:17:56.180 INFO:teuthology.orchestra.run.smithi196.stdout: = sunit=0 swidth=0 blks 2024-04-22T07:17:56.180 INFO:teuthology.orchestra.run.smithi196.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-22T07:17:56.180 INFO:teuthology.orchestra.run.smithi196.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-22T07:17:56.180 INFO:teuthology.orchestra.run.smithi196.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-22T07:17:56.180 INFO:teuthology.orchestra.run.smithi196.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-22T07:17:56.677 INFO:teuthology.orchestra.run.smithi196.stdout:Discarding blocks...Done. 2024-04-22T07:17:56.678 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi196.front.sepia.ceph.com -o noatime 2024-04-22T07:17:56.679 DEBUG:teuthology.orchestra.run.smithi196:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-04-22T07:17:56.775 DEBUG:teuthology.orchestra.run.smithi196:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-04-22T07:17:56.804 DEBUG:teuthology.orchestra.run.smithi196:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-04-22T07:17:56.867 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-22T07:17:56.867 INFO:tasks.ceph:role: osd.7 2024-04-22T07:17:56.868 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi196.front.sepia.ceph.com 2024-04-22T07:17:56.868 DEBUG:teuthology.orchestra.run.smithi196:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-22T07:17:56.938 INFO:teuthology.orchestra.run.smithi196.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-22T07:17:56.938 INFO:teuthology.orchestra.run.smithi196.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-22T07:17:56.938 INFO:teuthology.orchestra.run.smithi196.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-22T07:17:56.938 INFO:teuthology.orchestra.run.smithi196.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-22T07:17:56.938 INFO:teuthology.orchestra.run.smithi196.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-22T07:17:56.938 INFO:teuthology.orchestra.run.smithi196.stdout: = sunit=0 swidth=0 blks 2024-04-22T07:17:56.938 INFO:teuthology.orchestra.run.smithi196.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-22T07:17:56.938 INFO:teuthology.orchestra.run.smithi196.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-22T07:17:56.938 INFO:teuthology.orchestra.run.smithi196.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-22T07:17:56.939 INFO:teuthology.orchestra.run.smithi196.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-22T07:17:57.457 INFO:teuthology.orchestra.run.smithi196.stdout:Discarding blocks...Done. 2024-04-22T07:17:57.459 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi196.front.sepia.ceph.com -o noatime 2024-04-22T07:17:57.459 DEBUG:teuthology.orchestra.run.smithi196:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-04-22T07:17:57.605 DEBUG:teuthology.orchestra.run.smithi196:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-04-22T07:17:57.634 DEBUG:teuthology.orchestra.run.smithi196:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-22T07:17:57.735 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:17:57.736+0000 7f0c3f01c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-04-22T07:17:57.741 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:17:57.742+0000 7f0c3f01c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-04-22T07:17:57.741 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:17:57.742+0000 7f0c3f01c640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-22T07:17:57.742 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:17:57.742+0000 7f0c3f01c640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-22T07:17:57.742 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:17:57.742+0000 7f0c3f01c640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-22T07:17:57.745 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:17:57.748+0000 7f0c3f01c640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-04-22T07:18:00.598 DEBUG:teuthology.orchestra.run.smithi196:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-04-22T07:18:00.626 DEBUG:teuthology.orchestra.run.smithi196:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-22T07:18:00.715 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:00.717+0000 7f0199010640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-04-22T07:18:00.715 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:00.717+0000 7f0199010640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-04-22T07:18:00.715 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:00.717+0000 7f0199010640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-22T07:18:00.715 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:00.717+0000 7f0199010640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-22T07:18:00.715 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:00.717+0000 7f0199010640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-22T07:18:00.715 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:00.718+0000 7f0199010640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-04-22T07:18:03.563 DEBUG:teuthology.orchestra.run.smithi196:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-04-22T07:18:03.591 DEBUG:teuthology.orchestra.run.smithi196:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-22T07:18:03.679 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:03.681+0000 7fccc1ca6640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-04-22T07:18:03.679 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:03.681+0000 7fccc1ca6640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-04-22T07:18:03.679 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:03.681+0000 7fccc1ca6640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-22T07:18:03.679 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:03.681+0000 7fccc1ca6640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-22T07:18:03.679 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:03.681+0000 7fccc1ca6640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-22T07:18:03.679 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:03.681+0000 7fccc1ca6640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-04-22T07:18:06.441 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-22T07:18:06.443 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-22T07:18:06.538 DEBUG:teuthology.orchestra.run.smithi196:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-04-22T07:18:06.604 DEBUG:teuthology.orchestra.run.smithi196:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-22T07:18:06.689 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:06.691+0000 7fcdbfd6a640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-04-22T07:18:06.689 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:06.691+0000 7fcdbfd6a640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-04-22T07:18:06.689 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:06.692+0000 7fcdbfd6a640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-22T07:18:06.689 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:06.692+0000 7fcdbfd6a640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-22T07:18:06.689 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:06.692+0000 7fcdbfd6a640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-22T07:18:06.690 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:06.692+0000 7fcdbfd6a640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-04-22T07:18:09.546 DEBUG:teuthology.orchestra.run.smithi196:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-04-22T07:18:09.574 INFO:tasks.ceph:Reading keys from all nodes... 2024-04-22T07:18:09.574 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-04-22T07:18:09.575 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-04-22T07:18:09.604 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-04-22T07:18:09.604 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-04-22T07:18:09.673 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-04-22T07:18:09.673 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-04-22T07:18:09.742 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-04-22T07:18:09.742 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/mds/ceph-e/keyring of=/dev/stdout 2024-04-22T07:18:09.810 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-04-22T07:18:09.810 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-04-22T07:18:09.878 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-04-22T07:18:09.878 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-04-22T07:18:09.945 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-04-22T07:18:09.945 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-04-22T07:18:10.012 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-04-22T07:18:10.012 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-04-22T07:18:10.077 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-04-22T07:18:10.077 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-04-22T07:18:10.105 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-04-22T07:18:10.106 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-04-22T07:18:10.172 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-04-22T07:18:10.172 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-04-22T07:18:10.238 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-04-22T07:18:10.238 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/var/lib/ceph/mds/ceph-f/keyring of=/dev/stdout 2024-04-22T07:18:10.304 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-04-22T07:18:10.304 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-04-22T07:18:10.369 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-04-22T07:18:10.369 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-04-22T07:18:10.434 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-04-22T07:18:10.434 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-04-22T07:18:10.499 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-04-22T07:18:10.499 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-04-22T07:18:10.564 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-04-22T07:18:10.564 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-04-22T07:18:10.583 INFO:tasks.ceph:Adding keys to all mons... 2024-04-22T07:18:10.583 DEBUG:teuthology.orchestra.run.smithi037:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-22T07:18:10.625 DEBUG:teuthology.orchestra.run.smithi196:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-22T07:18:10.647 INFO:teuthology.orchestra.run.smithi196.stdout:[mgr.y] 2024-04-22T07:18:10.648 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQASDyZmT+cXMRAAmzvhZG61zyx8JXjHSJFu/g== 2024-04-22T07:18:10.648 INFO:teuthology.orchestra.run.smithi196.stdout:[mds.a] 2024-04-22T07:18:10.648 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQASDyZm5p3ROBAAE9MA3GuoVmGs+tf2R60PSQ== 2024-04-22T07:18:10.648 INFO:teuthology.orchestra.run.smithi196.stdout:[mds.c] 2024-04-22T07:18:10.648 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQATDyZmre8hBBAA3/qZZ/4QUTjq/goCplplBw== 2024-04-22T07:18:10.648 INFO:teuthology.orchestra.run.smithi196.stdout:[mds.e] 2024-04-22T07:18:10.648 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQATDyZmgGYMCxAAtAhNUoTbqFAIHxco4LZ81g== 2024-04-22T07:18:10.648 INFO:teuthology.orchestra.run.smithi196.stdout:[osd.0] 2024-04-22T07:18:10.648 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQAWDyZmfSuELRAA8oQHu4YdOXOSEDvu0y6Lww== 2024-04-22T07:18:10.648 INFO:teuthology.orchestra.run.smithi196.stdout:[osd.1] 2024-04-22T07:18:10.648 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQAZDyZmXLcYLBAA9xQPrL3d0wiP3xOdGSHtDg== 2024-04-22T07:18:10.648 INFO:teuthology.orchestra.run.smithi196.stdout:[osd.2] 2024-04-22T07:18:10.649 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQAcDyZmL8q5KhAAFeVEU3QAsOWLQI2C2+J2qQ== 2024-04-22T07:18:10.649 INFO:teuthology.orchestra.run.smithi196.stdout:[osd.3] 2024-04-22T07:18:10.649 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQAfDyZmCXo6KRAALHQHFJW1Z00dJK2dYJXFGw== 2024-04-22T07:18:10.649 INFO:teuthology.orchestra.run.smithi196.stdout:[mgr.x] 2024-04-22T07:18:10.649 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQASDyZmKputNRAAppyJKCsCOIchU+5um5Sx7A== 2024-04-22T07:18:10.649 INFO:teuthology.orchestra.run.smithi196.stdout:[mds.b] 2024-04-22T07:18:10.649 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQATDyZmUmGGDxAAzK1Y3rFx+sQvVQfA5Dc23A== 2024-04-22T07:18:10.649 INFO:teuthology.orchestra.run.smithi196.stdout:[mds.d] 2024-04-22T07:18:10.649 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQATDyZmGlxIFhAAIILZc95o4c1YP2kwIgbKNA== 2024-04-22T07:18:10.649 INFO:teuthology.orchestra.run.smithi196.stdout:[mds.f] 2024-04-22T07:18:10.649 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQATDyZmz4wEHRAASUKcugAZaZbA3iVX6nW7+w== 2024-04-22T07:18:10.649 INFO:teuthology.orchestra.run.smithi196.stdout:[osd.4] 2024-04-22T07:18:10.649 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQAlDyZmV9QILBAAgoZHuoUysXTBZChWQfgsAA== 2024-04-22T07:18:10.650 INFO:teuthology.orchestra.run.smithi196.stdout:[osd.5] 2024-04-22T07:18:10.650 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQAoDyZm+FvMKhAAgyz0G7iL42ASHH6mH/clEw== 2024-04-22T07:18:10.650 INFO:teuthology.orchestra.run.smithi196.stdout:[osd.6] 2024-04-22T07:18:10.650 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQArDyZmwC6mKBAAXprhUq8G21+e6ldKHed8RQ== 2024-04-22T07:18:10.650 INFO:teuthology.orchestra.run.smithi196.stdout:[osd.7] 2024-04-22T07:18:10.650 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQAuDyZmoShHKRAA33+0g/DnA4KkM4y9ZGcxtg== 2024-04-22T07:18:10.650 INFO:teuthology.orchestra.run.smithi196.stdout:[client.0] 2024-04-22T07:18:10.650 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQATDyZmVEgKIRAA2YQ2j6nK6PtK1Q7zn8DFDg== 2024-04-22T07:18:10.652 INFO:teuthology.orchestra.run.smithi037.stdout:[mgr.y] 2024-04-22T07:18:10.652 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQASDyZmT+cXMRAAmzvhZG61zyx8JXjHSJFu/g== 2024-04-22T07:18:10.652 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.a] 2024-04-22T07:18:10.652 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQASDyZm5p3ROBAAE9MA3GuoVmGs+tf2R60PSQ== 2024-04-22T07:18:10.652 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.c] 2024-04-22T07:18:10.652 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQATDyZmre8hBBAA3/qZZ/4QUTjq/goCplplBw== 2024-04-22T07:18:10.652 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.e] 2024-04-22T07:18:10.652 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQATDyZmgGYMCxAAtAhNUoTbqFAIHxco4LZ81g== 2024-04-22T07:18:10.652 INFO:teuthology.orchestra.run.smithi037.stdout:[osd.0] 2024-04-22T07:18:10.652 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQAWDyZmfSuELRAA8oQHu4YdOXOSEDvu0y6Lww== 2024-04-22T07:18:10.652 INFO:teuthology.orchestra.run.smithi037.stdout:[osd.1] 2024-04-22T07:18:10.652 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQAZDyZmXLcYLBAA9xQPrL3d0wiP3xOdGSHtDg== 2024-04-22T07:18:10.653 INFO:teuthology.orchestra.run.smithi037.stdout:[osd.2] 2024-04-22T07:18:10.653 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQAcDyZmL8q5KhAAFeVEU3QAsOWLQI2C2+J2qQ== 2024-04-22T07:18:10.653 INFO:teuthology.orchestra.run.smithi037.stdout:[osd.3] 2024-04-22T07:18:10.653 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQAfDyZmCXo6KRAALHQHFJW1Z00dJK2dYJXFGw== 2024-04-22T07:18:10.653 INFO:teuthology.orchestra.run.smithi037.stdout:[mgr.x] 2024-04-22T07:18:10.653 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQASDyZmKputNRAAppyJKCsCOIchU+5um5Sx7A== 2024-04-22T07:18:10.653 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.b] 2024-04-22T07:18:10.653 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQATDyZmUmGGDxAAzK1Y3rFx+sQvVQfA5Dc23A== 2024-04-22T07:18:10.653 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.d] 2024-04-22T07:18:10.653 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQATDyZmGlxIFhAAIILZc95o4c1YP2kwIgbKNA== 2024-04-22T07:18:10.653 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.f] 2024-04-22T07:18:10.653 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQATDyZmz4wEHRAASUKcugAZaZbA3iVX6nW7+w== 2024-04-22T07:18:10.653 INFO:teuthology.orchestra.run.smithi037.stdout:[osd.4] 2024-04-22T07:18:10.653 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQAlDyZmV9QILBAAgoZHuoUysXTBZChWQfgsAA== 2024-04-22T07:18:10.654 INFO:teuthology.orchestra.run.smithi037.stdout:[osd.5] 2024-04-22T07:18:10.654 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQAoDyZm+FvMKhAAgyz0G7iL42ASHH6mH/clEw== 2024-04-22T07:18:10.654 INFO:teuthology.orchestra.run.smithi037.stdout:[osd.6] 2024-04-22T07:18:10.654 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQArDyZmwC6mKBAAXprhUq8G21+e6ldKHed8RQ== 2024-04-22T07:18:10.654 INFO:teuthology.orchestra.run.smithi037.stdout:[osd.7] 2024-04-22T07:18:10.654 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQAuDyZmoShHKRAA33+0g/DnA4KkM4y9ZGcxtg== 2024-04-22T07:18:10.654 INFO:teuthology.orchestra.run.smithi037.stdout:[client.0] 2024-04-22T07:18:10.654 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQATDyZmVEgKIRAA2YQ2j6nK6PtK1Q7zn8DFDg== 2024-04-22T07:18:10.654 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-22T07:18:10.696 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-22T07:18:10.748 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-22T07:18:10.751 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-22T07:18:10.805 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-22T07:18:10.807 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-22T07:18:10.860 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-22T07:18:10.862 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-22T07:18:10.914 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-22T07:18:10.917 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-22T07:18:10.967 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-22T07:18:10.970 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-22T07:18:11.019 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-22T07:18:11.022 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-22T07:18:11.071 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-22T07:18:11.073 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-22T07:18:11.122 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-22T07:18:11.124 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-22T07:18:11.172 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-22T07:18:11.175 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-22T07:18:11.227 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-22T07:18:11.229 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-22T07:18:11.281 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-22T07:18:11.283 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-22T07:18:11.335 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-22T07:18:11.338 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-22T07:18:11.386 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-22T07:18:11.389 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-22T07:18:11.437 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-22T07:18:11.440 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-22T07:18:11.489 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-22T07:18:11.492 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-22T07:18:11.540 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-22T07:18:11.543 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-22T07:18:11.594 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-04-22T07:18:11.595 DEBUG:teuthology.orchestra.run.smithi037:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-04-22T07:18:11.619 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-22T07:18:11.715 DEBUG:teuthology.orchestra.run.smithi037:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-04-22T07:18:11.739 DEBUG:teuthology.orchestra.run.smithi196:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-04-22T07:18:11.763 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-22T07:18:11.858 DEBUG:teuthology.orchestra.run.smithi196:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-04-22T07:18:11.882 DEBUG:teuthology.orchestra.run.smithi196:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-04-22T07:18:11.945 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-22T07:18:12.039 DEBUG:teuthology.orchestra.run.smithi196:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-04-22T07:18:12.061 DEBUG:teuthology.orchestra.run.smithi037:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-22T07:18:12.064 DEBUG:teuthology.orchestra.run.smithi196:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-22T07:18:12.116 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-04-22T07:18:12.116 INFO:tasks.ceph.mon.a:Restarting daemon 2024-04-22T07:18:12.117 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-04-22T07:18:12.120 INFO:tasks.ceph.mon.a:Started 2024-04-22T07:18:12.120 INFO:tasks.ceph.mon.b:Restarting daemon 2024-04-22T07:18:12.120 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-04-22T07:18:12.159 INFO:tasks.ceph.mon.b:Started 2024-04-22T07:18:12.159 INFO:tasks.ceph.mon.c:Restarting daemon 2024-04-22T07:18:12.159 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-04-22T07:18:12.161 INFO:tasks.ceph.mon.c:Started 2024-04-22T07:18:12.161 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-04-22T07:18:12.162 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-04-22T07:18:12.164 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-04-22T07:18:12.166 INFO:tasks.ceph.mgr.y:Started 2024-04-22T07:18:12.167 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-04-22T07:18:12.167 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-04-22T07:18:12.169 INFO:tasks.ceph.mgr.x:Started 2024-04-22T07:18:12.169 INFO:tasks.ceph:Setting crush tunables to default 2024-04-22T07:18:12.169 DEBUG:teuthology.orchestra.run.smithi037:> sudo ceph --cluster ceph osd crush tunables default 2024-04-22T07:18:12.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:12.274+0000 7fd30b221640 1 Processor -- start 2024-04-22T07:18:12.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:12.274+0000 7fd30b221640 1 -- start start 2024-04-22T07:18:12.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:12.275+0000 7fd30b221640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd304151d80 0x7fd3040c8e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:12.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:12.275+0000 7fd30b221640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fd3040c65e0 0x7fd3040c6a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:12.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:12.275+0000 7fd30b221640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd3040c4c10 con 0x7fd304157de0 2024-04-22T07:18:12.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:12.275+0000 7fd30b221640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fd3040c9460 con 0x7fd304151d80 2024-04-22T07:18:12.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:12.275+0000 7fd30b221640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7fd3040c4eb0 con 0x7fd3040c65e0 2024-04-22T07:18:12.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:12.275+0000 7fd308fbd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd304151d80 0x7fd3040c8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:12.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:12.275+0000 7fd308fbd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd304151d80 0x7fd3040c8e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57228/0 (socket says 172.21.15.37:57228) 2024-04-22T07:18:12.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:12.275+0000 7fd308fbd640 1 -- 172.21.15.37:0/3323914739 learned_addr learned my addr 172.21.15.37:0/3323914739 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:18:12.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:12.275+0000 7fd3097be640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fd304157de0 0x7fd3041581e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:38240/0 (socket says 172.21.15.37:38240) 2024-04-22T07:18:12.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:12.275+0000 7fd303fff640 1 --2- 172.21.15.37:0/3323914739 >> v2:172.21.15.196:3300/0 conn(0x7fd3040c65e0 0x7fd3040c6a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:12.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:12.275+0000 7fd308fbd640 1 -- 172.21.15.37:0/3323914739 >> v2:172.21.15.37:3300/0 conn(0x7fd304151d80 msgr2=0x7fd3040c8e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-22T07:18:12.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:12.275+0000 7fd308fbd640 1 -- 172.21.15.37:0/3323914739 >> v2:172.21.15.37:3300/0 conn(0x7fd304151d80 msgr2=0x7fd3040c8e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-22T07:18:12.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:12.275+0000 7fd308fbd640 1 --2- 172.21.15.37:0/3323914739 >> v2:172.21.15.37:3300/0 conn(0x7fd304151d80 0x7fd3040c8e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-22T07:18:12.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:12.275+0000 7fd308fbd640 1 --2- 172.21.15.37:0/3323914739 >> v2:172.21.15.37:3300/0 conn(0x7fd304151d80 0x7fd3040c8e50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T07:18:12.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:12.275+0000 7fd303fff640 1 -- 172.21.15.37:0/3323914739 >> v2:172.21.15.196:3300/0 conn(0x7fd3040c65e0 msgr2=0x7fd3040c6a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-22T07:18:12.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:12.275+0000 7fd303fff640 1 -- 172.21.15.37:0/3323914739 >> v2:172.21.15.196:3300/0 conn(0x7fd3040c65e0 msgr2=0x7fd3040c6a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-22T07:18:12.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:12.275+0000 7fd303fff640 1 --2- 172.21.15.37:0/3323914739 >> v2:172.21.15.196:3300/0 conn(0x7fd3040c65e0 0x7fd3040c6a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-22T07:18:12.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:12.275+0000 7fd303fff640 1 --2- 172.21.15.37:0/3323914739 >> v2:172.21.15.196:3300/0 conn(0x7fd3040c65e0 0x7fd3040c6a20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T07:18:12.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:12.430+0000 7fd3037fe640 1 -- 172.21.15.37:0/3323914739 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2415474729 0 0) 0x7fd3040c4c10 con 0x7fd304157de0 2024-04-22T07:18:12.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:12.430+0000 7fd3037fe640 1 -- 172.21.15.37:0/3323914739 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd2f4003520 con 0x7fd304157de0 2024-04-22T07:18:12.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:12.430+0000 7fd3037fe640 1 -- 172.21.15.37:0/3323914739 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1602386962 0 0) 0x7fd2f4003520 con 0x7fd304157de0 2024-04-22T07:18:12.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:12.430+0000 7fd3037fe640 1 -- 172.21.15.37:0/3323914739 >> v2:172.21.15.196:3300/0 conn(0x7fd3040c65e0 msgr2=0x7fd3040c6a20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T07:18:12.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:12.430+0000 7fd3037fe640 1 --2- 172.21.15.37:0/3323914739 >> v2:172.21.15.196:3300/0 conn(0x7fd3040c65e0 0x7fd3040c6a20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:12.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:12.430+0000 7fd3037fe640 1 -- 172.21.15.37:0/3323914739 >> v2:172.21.15.37:3300/0 conn(0x7fd304151d80 msgr2=0x7fd3040c8e50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T07:18:12.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:12.430+0000 7fd3037fe640 1 --2- 172.21.15.37:0/3323914739 >> v2:172.21.15.37:3300/0 conn(0x7fd304151d80 0x7fd3040c8e50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:12.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:12.430+0000 7fd3037fe640 1 -- 172.21.15.37:0/3323914739 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3040c96b0 con 0x7fd304157de0 2024-04-22T07:18:12.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:12.430+0000 7fd3037fe640 1 -- 172.21.15.37:0/3323914739 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2576656170 0 0) 0x7fd2fc001a10 con 0x7fd304157de0 2024-04-22T07:18:12.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:12.430+0000 7fd3037fe640 1 -- 172.21.15.37:0/3323914739 >> v1:172.21.15.37:6789/0 conn(0x7fd304157de0 legacy=0x7fd3041581e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:12.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:12.430+0000 7fd3037fe640 1 --2- 172.21.15.37:0/3323914739 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd2f40039b0 0x7fd2f4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:12.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:12.430+0000 7fd3037fe640 1 --2- 172.21.15.37:0/3323914739 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd2f4004800 0x7fd2f4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:12.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:12.430+0000 7fd3037fe640 1 --2- 172.21.15.37:0/3323914739 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2f40051c0 0x7fd2f400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:12.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:12.430+0000 7fd3037fe640 1 -- 172.21.15.37:0/3323914739 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd3040c9460 con 0x7fd2f40051c0 2024-04-22T07:18:12.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:12.430+0000 7fd3037fe640 1 -- 172.21.15.37:0/3323914739 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fd3040c4eb0 con 0x7fd2f4004800 2024-04-22T07:18:12.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:12.430+0000 7fd3037fe640 1 -- 172.21.15.37:0/3323914739 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fd2f400c170 con 0x7fd2f40039b0 2024-04-22T07:18:12.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:12.430+0000 7fd3097be640 1 --2- 172.21.15.37:0/3323914739 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2f40051c0 0x7fd2f400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:12.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:12.430+0000 7fd308fbd640 1 --2- 172.21.15.37:0/3323914739 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd2f40039b0 0x7fd2f4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:12.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:12.430+0000 7fd303fff640 1 --2- 172.21.15.37:0/3323914739 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd2f4004800 0x7fd2f4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:12.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:12.430+0000 7fd3097be640 1 -- 172.21.15.37:0/3323914739 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd2f40039b0 msgr2=0x7fd2f4003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:18:12.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:12.430+0000 7fd3097be640 1 --2- 172.21.15.37:0/3323914739 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd2f40039b0 0x7fd2f4003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:12.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:12.430+0000 7fd3097be640 1 -- 172.21.15.37:0/3323914739 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd2f4004800 msgr2=0x7fd2f4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:18:12.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:12.430+0000 7fd3097be640 1 --2- 172.21.15.37:0/3323914739 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd2f4004800 0x7fd2f4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:12.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:12.430+0000 7fd3097be640 1 -- 172.21.15.37:0/3323914739 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2f4003520 con 0x7fd2f40051c0 2024-04-22T07:18:12.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:12.431+0000 7fd3097be640 1 -- 172.21.15.37:0/3323914739 reap_dead start 2024-04-22T07:18:12.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:12.431+0000 7fd3097be640 1 --2- 172.21.15.37:0/3323914739 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2f40051c0 0x7fd2f400b9c0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fd3040c4de0 tx=0x7fd2f4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=745b7f5d74a16920 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:12.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:12.431+0000 7fd3037fe640 1 -- 172.21.15.37:0/3323914739 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2fc00c100 con 0x7fd2f40051c0 2024-04-22T07:18:12.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:12.431+0000 7fd3037fe640 1 -- 172.21.15.37:0/3323914739 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2fc030070 con 0x7fd2f40051c0 2024-04-22T07:18:12.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:12.431+0000 7fd3037fe640 1 -- 172.21.15.37:0/3323914739 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2fc005b90 con 0x7fd2f40051c0 2024-04-22T07:18:12.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:12.432+0000 7fd30b221640 1 -- 172.21.15.37:0/3323914739 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2f40051c0 msgr2=0x7fd2f400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:12.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:12.432+0000 7fd30b221640 1 --2- 172.21.15.37:0/3323914739 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2f40051c0 0x7fd2f400b9c0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fd3040c4de0 tx=0x7fd2f4005830 comp rx=0 tx=0).stop 2024-04-22T07:18:12.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:12.432+0000 7fd30b221640 1 -- 172.21.15.37:0/3323914739 shutdown_connections 2024-04-22T07:18:12.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:12.432+0000 7fd30b221640 1 --2- 172.21.15.37:0/3323914739 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2f40051c0 0x7fd2f400b9c0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:12.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:12.432+0000 7fd30b221640 1 -- 172.21.15.37:0/3323914739 >> 172.21.15.37:0/3323914739 conn(0x7fd3040cd3e0 msgr2=0x7fd3040cd7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:12.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:12.432+0000 7fd30b221640 1 -- 172.21.15.37:0/3323914739 shutdown_connections 2024-04-22T07:18:12.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:12.432+0000 7fd30b221640 1 -- 172.21.15.37:0/3323914739 wait complete. 2024-04-22T07:18:12.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:12.434+0000 7fd30b221640 1 Processor -- start 2024-04-22T07:18:12.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:12.434+0000 7fd30b221640 1 -- start start 2024-04-22T07:18:12.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:12.434+0000 7fd30b221640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2f40051c0 0x7fd304153e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:12.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:12.434+0000 7fd30b221640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd3040cba30 0x7fd30413eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:12.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:12.434+0000 7fd30b221640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd3040cbe50 0x7fd30413f400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:12.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:12.434+0000 7fd30b221640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd3040c4860 con 0x7fd2f40051c0 2024-04-22T07:18:12.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:12.434+0000 7fd30b221640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fd304152160 con 0x7fd3040cba30 2024-04-22T07:18:12.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:12.434+0000 7fd30b221640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fd3040cc9d0 con 0x7fd3040cbe50 2024-04-22T07:18:12.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:12.435+0000 7fd308fbd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2f40051c0 0x7fd304153e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:12.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:12.435+0000 7fd308fbd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2f40051c0 0x7fd304153e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57260/0 (socket says 172.21.15.37:57260) 2024-04-22T07:18:12.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:12.435+0000 7fd308fbd640 1 -- 172.21.15.37:0/523236347 learned_addr learned my addr 172.21.15.37:0/523236347 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:18:12.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:12.435+0000 7fd303fff640 1 --2- 172.21.15.37:0/523236347 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd3040cba30 0x7fd30413eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:12.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:12.435+0000 7fd3097be640 1 --2- 172.21.15.37:0/523236347 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd3040cbe50 0x7fd30413f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:12.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:12.435+0000 7fd308fbd640 1 -- 172.21.15.37:0/523236347 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd3040cbe50 msgr2=0x7fd30413f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:12.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:12.435+0000 7fd308fbd640 1 --2- 172.21.15.37:0/523236347 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd3040cbe50 0x7fd30413f400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:12.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:12.435+0000 7fd308fbd640 1 -- 172.21.15.37:0/523236347 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd3040cba30 msgr2=0x7fd30413eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:12.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:12.435+0000 7fd308fbd640 1 --2- 172.21.15.37:0/523236347 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd3040cba30 0x7fd30413eec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:12.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:12.435+0000 7fd308fbd640 1 -- 172.21.15.37:0/523236347 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3041524b0 con 0x7fd2f40051c0 2024-04-22T07:18:12.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:12.435+0000 7fd308fbd640 1 --2- 172.21.15.37:0/523236347 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2f40051c0 0x7fd304153e70 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fd2f8011600 tx=0x7fd2f8011ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:12.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:12.435+0000 7fd3017fa640 1 -- 172.21.15.37:0/523236347 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2f8019070 con 0x7fd2f40051c0 2024-04-22T07:18:12.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:12.435+0000 7fd3017fa640 1 -- 172.21.15.37:0/523236347 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2f800f920 con 0x7fd2f40051c0 2024-04-22T07:18:12.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:12.435+0000 7fd30b221640 1 -- 172.21.15.37:0/523236347 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3040cb310 con 0x7fd2f40051c0 2024-04-22T07:18:12.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:12.435+0000 7fd3017fa640 1 -- 172.21.15.37:0/523236347 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2f800f040 con 0x7fd2f40051c0 2024-04-22T07:18:12.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:12.435+0000 7fd30b221640 1 -- 172.21.15.37:0/523236347 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd304152770 con 0x7fd2f40051c0 2024-04-22T07:18:12.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:12.436+0000 7fd3017fa640 1 -- 172.21.15.37:0/523236347 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fd2f801c070 con 0x7fd2f40051c0 2024-04-22T07:18:12.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:12.436+0000 7fd30b221640 1 -- 172.21.15.37:0/523236347 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd3040ccd60 con 0x7fd2f40051c0 2024-04-22T07:18:12.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:12.437+0000 7fd3017fa640 1 -- 172.21.15.37:0/523236347 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fd2f8005cd0 con 0x7fd2f40051c0 2024-04-22T07:18:12.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:12.439+0000 7fd3017fa640 1 -- 172.21.15.37:0/523236347 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7fd2f800fd90 con 0x7fd2f40051c0 2024-04-22T07:18:12.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:12.507+0000 7fd30b221640 1 -- 172.21.15.37:0/523236347 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7fd304068b20 con 0x7fd2f40051c0 2024-04-22T07:18:12.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:12.508+0000 7fd3017fa640 1 -- 172.21.15.37:0/523236347 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7fd2f8015460 con 0x7fd2f40051c0 2024-04-22T07:18:12.506 INFO:teuthology.orchestra.run.smithi037.stderr:adjusted tunables profile to default 2024-04-22T07:18:12.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:12.509+0000 7fd30b221640 1 -- 172.21.15.37:0/523236347 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2f40051c0 msgr2=0x7fd304153e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:12.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:12.509+0000 7fd30b221640 1 --2- 172.21.15.37:0/523236347 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2f40051c0 0x7fd304153e70 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fd2f8011600 tx=0x7fd2f8011ac0 comp rx=0 tx=0).stop 2024-04-22T07:18:12.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:12.509+0000 7fd30b221640 1 -- 172.21.15.37:0/523236347 shutdown_connections 2024-04-22T07:18:12.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:12.509+0000 7fd30b221640 1 --2- 172.21.15.37:0/523236347 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd3040cbe50 0x7fd30413f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:12.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:12.509+0000 7fd30b221640 1 --2- 172.21.15.37:0/523236347 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd3040cba30 0x7fd30413eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:12.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:12.509+0000 7fd30b221640 1 --2- 172.21.15.37:0/523236347 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2f40051c0 0x7fd304153e70 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:12.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:12.509+0000 7fd30b221640 1 -- 172.21.15.37:0/523236347 >> 172.21.15.37:0/523236347 conn(0x7fd3040cd3e0 msgr2=0x7fd30406b970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:12.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:12.509+0000 7fd30b221640 1 -- 172.21.15.37:0/523236347 shutdown_connections 2024-04-22T07:18:12.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:12.509+0000 7fd30b221640 1 -- 172.21.15.37:0/523236347 wait complete. 2024-04-22T07:18:12.518 INFO:tasks.ceph:check_enable_crimson: False 2024-04-22T07:18:12.518 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-04-22T07:18:12.518 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-04-22T07:18:12.518 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-04-22T07:18:12.536 INFO:tasks.ceph.mgr.x.smithi196.stderr:2024-04-22T07:18:12.538+0000 7f987822d040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-22T07:18:12.542 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-04-22T07:18:12.542 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-04-22T07:18:12.549 INFO:tasks.ceph.mgr.y.smithi037.stderr:2024-04-22T07:18:12.552+0000 7fb53ac12040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-22T07:18:12.572 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-04-22T07:18:12.573 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-04-22T07:18:12.637 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-04-22T07:18:12.638 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-04-22T07:18:12.683 INFO:tasks.ceph.mgr.x.smithi196.stderr:2024-04-22T07:18:12.685+0000 7f987822d040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-22T07:18:12.703 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-04-22T07:18:12.703 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-04-22T07:18:12.713 INFO:tasks.ceph.mgr.y.smithi037.stderr:2024-04-22T07:18:12.716+0000 7fb53ac12040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-22T07:18:12.726 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-04-22T07:18:12.726 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-04-22T07:18:12.738 INFO:tasks.ceph.mgr.x.smithi196.stderr:2024-04-22T07:18:12.740+0000 7f987822d040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-22T07:18:12.760 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-04-22T07:18:12.760 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-04-22T07:18:12.769 INFO:tasks.ceph.mgr.y.smithi037.stderr:2024-04-22T07:18:12.772+0000 7fb53ac12040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-22T07:18:12.823 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-04-22T07:18:12.824 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-04-22T07:18:12.887 DEBUG:teuthology.orchestra.run.smithi196:> sudo ceph --cluster ceph osd new e248f6e1-13ad-48e0-a8f8-ec3059995654 0 2024-04-22T07:18:13.011 INFO:tasks.ceph.mgr.x.smithi196.stderr:2024-04-22T07:18:13.014+0000 7f987822d040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-22T07:18:13.023 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.026+0000 7f5266a5c640 1 Processor -- start 2024-04-22T07:18:13.024 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.026+0000 7f5266a5c640 1 -- start start 2024-04-22T07:18:13.025 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.027+0000 7f5266a5c640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5260154f60 0x7f52600cd7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:13.025 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.027+0000 7f5266a5c640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f526015ee40 con 0x7f526015e2b0 2024-04-22T07:18:13.025 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.027+0000 7f5266a5c640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f526015f120 con 0x7f52600c5800 2024-04-22T07:18:13.025 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.027+0000 7f5266a5c640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f52600cca20 con 0x7f5260154f60 2024-04-22T07:18:13.025 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.027+0000 7f525ffff640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5260154f60 0x7f52600cd7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:13.025 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.027+0000 7f525f7fe640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7f52600c5800 0x7f52600d0530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.196:38466/0 (socket says 172.21.15.196:38466) 2024-04-22T07:18:13.025 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.027+0000 7f525f7fe640 1 -- 172.21.15.196:0/1611099282 learned_addr learned my addr 172.21.15.196:0/1611099282 (peer_addr_for_me v1:172.21.15.196:0/0) 2024-04-22T07:18:13.026 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.027+0000 7f525ffff640 1 -- 172.21.15.196:0/1611099282 >> v1:172.21.15.196:6789/0 conn(0x7f52600c5800 legacy=0x7f52600d0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:13.026 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.027+0000 7f525ffff640 1 -- 172.21.15.196:0/1611099282 >> v1:172.21.15.37:6789/0 conn(0x7f526015e2b0 legacy=0x7f5260165640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:18:13.026 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.027+0000 7f525ffff640 1 -- 172.21.15.196:0/1611099282 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52600ccd00 con 0x7f5260154f60 2024-04-22T07:18:13.026 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.027+0000 7f525effd640 1 -- 172.21.15.196:0/1611099282 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2542256159 0 0) 0x7f526015f120 con 0x7f52600c5800 2024-04-22T07:18:13.027 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.028+0000 7f525ffff640 1 --2- 172.21.15.196:0/1611099282 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5260154f60 0x7f52600cd7e0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f52540097d0 tx=0x7f525402b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=abf90d0b27ad23c5 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:13.027 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.028+0000 7f525effd640 1 -- 172.21.15.196:0/1611099282 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5254035020 con 0x7f5260154f60 2024-04-22T07:18:13.028 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.028+0000 7f525effd640 1 -- 172.21.15.196:0/1611099282 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5254031890 con 0x7f5260154f60 2024-04-22T07:18:13.028 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.028+0000 7f525effd640 1 -- 172.21.15.196:0/1611099282 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5254031c60 con 0x7f5260154f60 2024-04-22T07:18:13.028 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.029+0000 7f5266a5c640 1 -- 172.21.15.196:0/1611099282 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5260154f60 msgr2=0x7f52600cd7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:13.028 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.029+0000 7f5266a5c640 1 --2- 172.21.15.196:0/1611099282 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5260154f60 0x7f52600cd7e0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f52540097d0 tx=0x7f525402b930 comp rx=0 tx=0).stop 2024-04-22T07:18:13.028 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.029+0000 7f5266a5c640 1 -- 172.21.15.196:0/1611099282 shutdown_connections 2024-04-22T07:18:13.028 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.029+0000 7f5266a5c640 1 --2- 172.21.15.196:0/1611099282 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5260154f60 0x7f52600cd7e0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:13.028 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.029+0000 7f5266a5c640 1 -- 172.21.15.196:0/1611099282 >> 172.21.15.196:0/1611099282 conn(0x7f5260067aa0 msgr2=0x7f5260073440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:13.028 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.029+0000 7f5266a5c640 1 -- 172.21.15.196:0/1611099282 shutdown_connections 2024-04-22T07:18:13.028 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.029+0000 7f5266a5c640 1 -- 172.21.15.196:0/1611099282 wait complete. 2024-04-22T07:18:13.028 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.030+0000 7f5266a5c640 1 Processor -- start 2024-04-22T07:18:13.028 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.030+0000 7f5266a5c640 1 -- start start 2024-04-22T07:18:13.031 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.031+0000 7f5266a5c640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f52600c5800 0x7f52601e79d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:13.031 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.031+0000 7f5266a5c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5260154f60 0x7f52601f11a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:13.031 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.031+0000 7f5266a5c640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f526015e2b0 0x7f52600b5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:13.031 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.031+0000 7f5266a5c640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f5260155340 con 0x7f5260154f60 2024-04-22T07:18:13.031 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.031+0000 7f5266a5c640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f52600cd2c0 con 0x7f526015e2b0 2024-04-22T07:18:13.031 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.031+0000 7f5266a5c640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f52601554c0 con 0x7f52600c5800 2024-04-22T07:18:13.032 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.031+0000 7f525ffff640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f52600c5800 0x7f52601e79d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:13.032 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.031+0000 7f5264ff9640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f526015e2b0 0x7f52600b5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:13.032 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.031+0000 7f525ffff640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f52600c5800 0x7f52601e79d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.196:36340/0 (socket says 172.21.15.196:36340) 2024-04-22T07:18:13.032 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.031+0000 7f525ffff640 1 -- 172.21.15.196:0/3440987999 learned_addr learned my addr 172.21.15.196:0/3440987999 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-04-22T07:18:13.032 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.031+0000 7f525f7fe640 1 --2- 172.21.15.196:0/3440987999 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5260154f60 0x7f52601f11a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:13.032 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.031+0000 7f525ffff640 1 -- 172.21.15.196:0/3440987999 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f526015e2b0 msgr2=0x7f52600b5cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:13.032 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.031+0000 7f525ffff640 1 --2- 172.21.15.196:0/3440987999 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f526015e2b0 0x7f52600b5cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:13.032 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.031+0000 7f525ffff640 1 -- 172.21.15.196:0/3440987999 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5260154f60 msgr2=0x7f52601f11a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:13.032 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.031+0000 7f525ffff640 1 --2- 172.21.15.196:0/3440987999 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5260154f60 0x7f52601f11a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:13.032 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.031+0000 7f525ffff640 1 -- 172.21.15.196:0/3440987999 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52600b5870 con 0x7f52600c5800 2024-04-22T07:18:13.032 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.031+0000 7f5264ff9640 1 --2- 172.21.15.196:0/3440987999 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f526015e2b0 0x7f52600b5cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-22T07:18:13.033 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.031+0000 7f525ffff640 1 --2- 172.21.15.196:0/3440987999 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f52600c5800 0x7f52601e79d0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f52540098f0 tx=0x7f52540046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:13.033 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.032+0000 7f525cff9640 1 -- 172.21.15.196:0/3440987999 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52540453f0 con 0x7f52600c5800 2024-04-22T07:18:13.033 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.032+0000 7f525cff9640 1 -- 172.21.15.196:0/3440987999 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5254045590 con 0x7f52600c5800 2024-04-22T07:18:13.033 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.032+0000 7f5266a5c640 1 -- 172.21.15.196:0/3440987999 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52601f09c0 con 0x7f52600c5800 2024-04-22T07:18:13.033 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.032+0000 7f525cff9640 1 -- 172.21.15.196:0/3440987999 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5254045980 con 0x7f52600c5800 2024-04-22T07:18:13.033 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.032+0000 7f5266a5c640 1 -- 172.21.15.196:0/3440987999 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f52601f4700 con 0x7f52600c5800 2024-04-22T07:18:13.033 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.032+0000 7f525cff9640 1 -- 172.21.15.196:0/3440987999 <== mon.2 v2:172.21.15.196:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f525404c060 con 0x7f52600c5800 2024-04-22T07:18:13.033 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.032+0000 7f525cff9640 1 -- 172.21.15.196:0/3440987999 <== mon.2 v2:172.21.15.196:3301/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7f525404eb30 con 0x7f52600c5800 2024-04-22T07:18:13.033 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.033+0000 7f5266a5c640 1 -- 172.21.15.196:0/3440987999 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5260068b20 con 0x7f52600c5800 2024-04-22T07:18:13.034 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.035+0000 7f525cff9640 1 -- 172.21.15.196:0/3440987999 <== mon.2 v2:172.21.15.196:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f5254040070 con 0x7f52600c5800 2024-04-22T07:18:13.039 INFO:tasks.ceph.mgr.y.smithi037.stderr:2024-04-22T07:18:13.042+0000 7fb53ac12040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-22T07:18:13.060 INFO:tasks.ceph.mgr.x.smithi196.stderr:2024-04-22T07:18:13.062+0000 7f987822d040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-22T07:18:13.087 INFO:tasks.ceph.mgr.y.smithi037.stderr:2024-04-22T07:18:13.089+0000 7fb53ac12040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-22T07:18:13.104 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.107+0000 7f5266a5c640 1 -- 172.21.15.196:0/3440987999 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "osd new", "uuid": "e248f6e1-13ad-48e0-a8f8-ec3059995654", "id": 0} v 0) -- 0x7f526015dc30 con 0x7f52600c5800 2024-04-22T07:18:13.107 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.110+0000 7f525cff9640 1 -- 172.21.15.196:0/3440987999 <== mon.2 v2:172.21.15.196:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e248f6e1-13ad-48e0-a8f8-ec3059995654", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7f525402d040 con 0x7f52600c5800 2024-04-22T07:18:13.108 INFO:teuthology.orchestra.run.smithi196.stdout:0 2024-04-22T07:18:13.109 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.111+0000 7f5266a5c640 1 -- 172.21.15.196:0/3440987999 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f52600c5800 msgr2=0x7f52601e79d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:13.109 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.111+0000 7f5266a5c640 1 --2- 172.21.15.196:0/3440987999 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f52600c5800 0x7f52601e79d0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f52540098f0 tx=0x7f52540046c0 comp rx=0 tx=0).stop 2024-04-22T07:18:13.109 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.111+0000 7f5266a5c640 1 -- 172.21.15.196:0/3440987999 shutdown_connections 2024-04-22T07:18:13.109 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.111+0000 7f5266a5c640 1 --2- 172.21.15.196:0/3440987999 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f526015e2b0 0x7f52600b5cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:13.109 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.111+0000 7f5266a5c640 1 --2- 172.21.15.196:0/3440987999 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5260154f60 0x7f52601f11a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:13.109 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.111+0000 7f5266a5c640 1 --2- 172.21.15.196:0/3440987999 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f52600c5800 0x7f52601e79d0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:13.109 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.111+0000 7f5266a5c640 1 -- 172.21.15.196:0/3440987999 >> 172.21.15.196:0/3440987999 conn(0x7f5260067aa0 msgr2=0x7f52600ce740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:13.109 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.111+0000 7f5266a5c640 1 -- 172.21.15.196:0/3440987999 shutdown_connections 2024-04-22T07:18:13.109 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.111+0000 7f5266a5c640 1 -- 172.21.15.196:0/3440987999 wait complete. 2024-04-22T07:18:13.119 DEBUG:teuthology.orchestra.run.smithi196:> sudo ceph --cluster ceph osd new 01c71ab7-1326-432b-b73a-e5847abe5132 1 2024-04-22T07:18:13.216 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.218+0000 7f1ef47ef640 1 Processor -- start 2024-04-22T07:18:13.216 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.218+0000 7f1ef47ef640 1 -- start start 2024-04-22T07:18:13.217 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.219+0000 7f1ef47ef640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1eec06ef30 0x7f1eec06f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:13.217 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.219+0000 7f1ef47ef640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1eec0c3db0 con 0x7f1eec152f20 2024-04-22T07:18:13.218 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.219+0000 7f1ef47ef640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1eec153300 con 0x7f1eec0ca330 2024-04-22T07:18:13.218 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.219+0000 7f1ef47ef640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f1eec0c32c0 con 0x7f1eec06ef30 2024-04-22T07:18:13.218 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.220+0000 7f1ef2d8c640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1eec06ef30 0x7f1eec06f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:13.218 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.220+0000 7f1ef1d8a640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7f1eec0ca330 0x7f1eec0ce2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.196:38478/0 (socket says 172.21.15.196:38478) 2024-04-22T07:18:13.218 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.220+0000 7f1ef1d8a640 1 -- 172.21.15.196:0/4205514063 learned_addr learned my addr 172.21.15.196:0/4205514063 (peer_addr_for_me v1:172.21.15.196:0/0) 2024-04-22T07:18:13.218 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.220+0000 7f1ef2d8c640 1 -- 172.21.15.196:0/4205514063 >> v1:172.21.15.196:6789/0 conn(0x7f1eec0ca330 legacy=0x7f1eec0ce2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:13.218 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.220+0000 7f1ef1589640 1 -- 172.21.15.196:0/4205514063 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1076693606 0 0) 0x7f1eec153300 con 0x7f1eec0ca330 2024-04-22T07:18:13.218 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.220+0000 7f1ef2d8c640 1 -- 172.21.15.196:0/4205514063 >> v1:172.21.15.37:6789/0 conn(0x7f1eec152f20 legacy=0x7f1eec15cb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:13.218 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.220+0000 7f1ef2d8c640 1 -- 172.21.15.196:0/4205514063 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1eec0c3510 con 0x7f1eec06ef30 2024-04-22T07:18:13.219 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.221+0000 7f1ef2d8c640 1 --2- 172.21.15.196:0/4205514063 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1eec06ef30 0x7f1eec06f6d0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f1ee4009dc0 tx=0x7f1ee402bfa0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c0e097bb2e93e363 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:13.219 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.221+0000 7f1ef1589640 1 -- 172.21.15.196:0/4205514063 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ee4039070 con 0x7f1eec06ef30 2024-04-22T07:18:13.220 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.221+0000 7f1ef1589640 1 -- 172.21.15.196:0/4205514063 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ee402cd50 con 0x7f1eec06ef30 2024-04-22T07:18:13.220 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.221+0000 7f1ef1589640 1 -- 172.21.15.196:0/4205514063 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ee4034660 con 0x7f1eec06ef30 2024-04-22T07:18:13.220 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.221+0000 7f1ef47ef640 1 -- 172.21.15.196:0/4205514063 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1eec06ef30 msgr2=0x7f1eec06f6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:13.220 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.221+0000 7f1ef47ef640 1 --2- 172.21.15.196:0/4205514063 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1eec06ef30 0x7f1eec06f6d0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f1ee4009dc0 tx=0x7f1ee402bfa0 comp rx=0 tx=0).stop 2024-04-22T07:18:13.220 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.221+0000 7f1ef47ef640 1 -- 172.21.15.196:0/4205514063 shutdown_connections 2024-04-22T07:18:13.220 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.221+0000 7f1ef47ef640 1 --2- 172.21.15.196:0/4205514063 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1eec06ef30 0x7f1eec06f6d0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:13.220 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.221+0000 7f1ef47ef640 1 -- 172.21.15.196:0/4205514063 >> 172.21.15.196:0/4205514063 conn(0x7f1eec067d90 msgr2=0x7f1eec06db80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:13.220 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.222+0000 7f1ef47ef640 1 -- 172.21.15.196:0/4205514063 shutdown_connections 2024-04-22T07:18:13.220 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.222+0000 7f1ef47ef640 1 -- 172.21.15.196:0/4205514063 wait complete. 2024-04-22T07:18:13.223 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.223+0000 7f1ef47ef640 1 Processor -- start 2024-04-22T07:18:13.223 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.223+0000 7f1ef47ef640 1 -- start start 2024-04-22T07:18:13.223 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.223+0000 7f1ef47ef640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1eec06ef30 0x7f1eec1491f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:13.223 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.223+0000 7f1ef47ef640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1eec0ca330 0x7f1eec0c7490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:13.223 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.223+0000 7f1ef47ef640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1eec152f20 0x7f1eec1f1a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:13.223 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.223+0000 7f1ef47ef640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f1eec15c310 con 0x7f1eec152f20 2024-04-22T07:18:13.223 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.223+0000 7f1ef47ef640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f1eec0c3ad0 con 0x7f1eec06ef30 2024-04-22T07:18:13.223 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.223+0000 7f1ef47ef640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f1eec15c5f0 con 0x7f1eec0ca330 2024-04-22T07:18:13.223 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.223+0000 7f1ef258b640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1eec06ef30 0x7f1eec1491f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:13.223 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.223+0000 7f1ef1d8a640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1eec0ca330 0x7f1eec0c7490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:13.224 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.223+0000 7f1ef258b640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1eec06ef30 0x7f1eec1491f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:56666/0 (socket says 172.21.15.196:56666) 2024-04-22T07:18:13.224 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.223+0000 7f1ef258b640 1 -- 172.21.15.196:0/1029016424 learned_addr learned my addr 172.21.15.196:0/1029016424 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-04-22T07:18:13.224 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.224+0000 7f1ef2d8c640 1 --2- 172.21.15.196:0/1029016424 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1eec152f20 0x7f1eec1f1a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:13.224 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.224+0000 7f1ef1d8a640 1 -- 172.21.15.196:0/1029016424 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1eec06ef30 msgr2=0x7f1eec1491f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:13.224 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.224+0000 7f1ef1d8a640 1 --2- 172.21.15.196:0/1029016424 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1eec06ef30 0x7f1eec1491f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:13.224 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.224+0000 7f1ef1d8a640 1 -- 172.21.15.196:0/1029016424 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1eec152f20 msgr2=0x7f1eec1f1a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:13.224 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.224+0000 7f1ef1d8a640 1 --2- 172.21.15.196:0/1029016424 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1eec152f20 0x7f1eec1f1a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:13.224 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.224+0000 7f1ef1d8a640 1 -- 172.21.15.196:0/1029016424 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1eec1f2780 con 0x7f1eec0ca330 2024-04-22T07:18:13.224 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.224+0000 7f1ef1d8a640 1 --2- 172.21.15.196:0/1029016424 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1eec0ca330 0x7f1eec0c7490 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f1eec0ca7a0 tx=0x7f1ee800c870 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:13.224 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.224+0000 7f1ee2ffd640 1 -- 172.21.15.196:0/1029016424 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ee80074e0 con 0x7f1eec0ca330 2024-04-22T07:18:13.224 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.224+0000 7f1ee2ffd640 1 -- 172.21.15.196:0/1029016424 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ee8007680 con 0x7f1eec0ca330 2024-04-22T07:18:13.224 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.224+0000 7f1ef47ef640 1 -- 172.21.15.196:0/1029016424 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1eec15bcc0 con 0x7f1eec0ca330 2024-04-22T07:18:13.224 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.224+0000 7f1ee2ffd640 1 -- 172.21.15.196:0/1029016424 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ee8004a00 con 0x7f1eec0ca330 2024-04-22T07:18:13.225 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.224+0000 7f1ef47ef640 1 -- 172.21.15.196:0/1029016424 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f1eec0c6c90 con 0x7f1eec0ca330 2024-04-22T07:18:13.225 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.224+0000 7f1ee2ffd640 1 -- 172.21.15.196:0/1029016424 <== mon.2 v2:172.21.15.196:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f1ee8011070 con 0x7f1eec0ca330 2024-04-22T07:18:13.225 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.224+0000 7f1ee2ffd640 1 -- 172.21.15.196:0/1029016424 <== mon.2 v2:172.21.15.196:3301/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7f1ee8013770 con 0x7f1eec0ca330 2024-04-22T07:18:13.225 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.225+0000 7f1ef47ef640 1 -- 172.21.15.196:0/1029016424 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1eec068b20 con 0x7f1eec0ca330 2024-04-22T07:18:13.225 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.227+0000 7f1ee2ffd640 1 -- 172.21.15.196:0/1029016424 <== mon.2 v2:172.21.15.196:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f1ee80139c0 con 0x7f1eec0ca330 2024-04-22T07:18:13.297 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.299+0000 7f1ef47ef640 1 -- 172.21.15.196:0/1029016424 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "osd new", "uuid": "01c71ab7-1326-432b-b73a-e5847abe5132", "id": 1} v 0) -- 0x7f1eec0b3850 con 0x7f1eec0ca330 2024-04-22T07:18:13.302 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.304+0000 7f1ee2ffd640 1 -- 172.21.15.196:0/1029016424 <== mon.2 v2:172.21.15.196:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "01c71ab7-1326-432b-b73a-e5847abe5132", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7f1ee8013c70 con 0x7f1eec0ca330 2024-04-22T07:18:13.302 INFO:teuthology.orchestra.run.smithi196.stdout:1 2024-04-22T07:18:13.303 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.305+0000 7f1ef47ef640 1 -- 172.21.15.196:0/1029016424 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1eec0ca330 msgr2=0x7f1eec0c7490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:13.303 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.305+0000 7f1ef47ef640 1 --2- 172.21.15.196:0/1029016424 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1eec0ca330 0x7f1eec0c7490 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f1eec0ca7a0 tx=0x7f1ee800c870 comp rx=0 tx=0).stop 2024-04-22T07:18:13.303 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.305+0000 7f1ef47ef640 1 -- 172.21.15.196:0/1029016424 shutdown_connections 2024-04-22T07:18:13.303 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.305+0000 7f1ef47ef640 1 --2- 172.21.15.196:0/1029016424 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1eec152f20 0x7f1eec1f1a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:13.304 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.305+0000 7f1ef47ef640 1 --2- 172.21.15.196:0/1029016424 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1eec0ca330 0x7f1eec0c7490 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:13.304 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.305+0000 7f1ef47ef640 1 --2- 172.21.15.196:0/1029016424 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1eec06ef30 0x7f1eec1491f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:13.304 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.305+0000 7f1ef47ef640 1 -- 172.21.15.196:0/1029016424 >> 172.21.15.196:0/1029016424 conn(0x7f1eec067d90 msgr2=0x7f1eec062390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:13.304 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.305+0000 7f1ef47ef640 1 -- 172.21.15.196:0/1029016424 shutdown_connections 2024-04-22T07:18:13.304 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.305+0000 7f1ef47ef640 1 -- 172.21.15.196:0/1029016424 wait complete. 2024-04-22T07:18:13.314 DEBUG:teuthology.orchestra.run.smithi196:> sudo ceph --cluster ceph osd new 33a780fd-013a-41c8-9970-136c9e080897 2 2024-04-22T07:18:13.411 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.413+0000 7fc4fc575640 1 Processor -- start 2024-04-22T07:18:13.411 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.413+0000 7fc4fc575640 1 -- start start 2024-04-22T07:18:13.412 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.414+0000 7fc4fc575640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fc4f4154ff0 0x7fc4f415b610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:13.412 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.414+0000 7fc4fc575640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc4f40682d0 0x7fc4f4165720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:13.412 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.414+0000 7fc4fc575640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4f40c92a0 con 0x7fc4f415bb50 2024-04-22T07:18:13.412 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.414+0000 7fc4fc575640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fc4f40c9040 con 0x7fc4f40682d0 2024-04-22T07:18:13.412 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.414+0000 7fc4fc575640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7fc4f40733d0 con 0x7fc4f4154ff0 2024-04-22T07:18:13.413 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.414+0000 7fc4fa311640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fc4f4154ff0 0x7fc4f415b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:13.413 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.414+0000 7fc4fa311640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fc4f4154ff0 0x7fc4f415b610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:56680/0 (socket says 172.21.15.196:56680) 2024-04-22T07:18:13.413 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.414+0000 7fc4fa311640 1 -- 172.21.15.196:0/1303748671 learned_addr learned my addr 172.21.15.196:0/1303748671 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-04-22T07:18:13.413 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.414+0000 7fc4fab12640 1 --2- 172.21.15.196:0/1303748671 >> v2:172.21.15.37:3300/0 conn(0x7fc4f40682d0 0x7fc4f4165720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:13.413 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.415+0000 7fc4fa311640 1 -- 172.21.15.196:0/1303748671 >> v2:172.21.15.37:3300/0 conn(0x7fc4f40682d0 msgr2=0x7fc4f4165720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:18:13.413 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.415+0000 7fc4fa311640 1 --2- 172.21.15.196:0/1303748671 >> v2:172.21.15.37:3300/0 conn(0x7fc4f40682d0 0x7fc4f4165720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:13.413 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.415+0000 7fc4f930f640 1 -- 172.21.15.196:0/1303748671 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2894227464 0 0) 0x7fc4f40c92a0 con 0x7fc4f415bb50 2024-04-22T07:18:13.413 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.415+0000 7fc4fa311640 1 -- 172.21.15.196:0/1303748671 >> v1:172.21.15.37:6789/0 conn(0x7fc4f415bb50 legacy=0x7fc4f40676b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:13.413 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.415+0000 7fc4fa311640 1 -- 172.21.15.196:0/1303748671 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4f40736b0 con 0x7fc4f4154ff0 2024-04-22T07:18:13.414 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.415+0000 7fc4fa311640 1 --2- 172.21.15.196:0/1303748671 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc4f4154ff0 0x7fc4f415b610 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fc4f4073e90 tx=0x7fc4e802b9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=478e7f229a40b778 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:13.414 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.416+0000 7fc4f930f640 1 -- 172.21.15.196:0/1303748671 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4e8034070 con 0x7fc4f4154ff0 2024-04-22T07:18:13.415 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.416+0000 7fc4f930f640 1 -- 172.21.15.196:0/1303748671 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4e8030860 con 0x7fc4f4154ff0 2024-04-22T07:18:13.415 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.416+0000 7fc4f930f640 1 -- 172.21.15.196:0/1303748671 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4e8030c30 con 0x7fc4f4154ff0 2024-04-22T07:18:13.415 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.416+0000 7fc4fc575640 1 -- 172.21.15.196:0/1303748671 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc4f4154ff0 msgr2=0x7fc4f415b610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:13.415 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.416+0000 7fc4fc575640 1 --2- 172.21.15.196:0/1303748671 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc4f4154ff0 0x7fc4f415b610 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fc4f4073e90 tx=0x7fc4e802b9a0 comp rx=0 tx=0).stop 2024-04-22T07:18:13.415 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.416+0000 7fc4fc575640 1 -- 172.21.15.196:0/1303748671 shutdown_connections 2024-04-22T07:18:13.415 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.416+0000 7fc4fc575640 1 --2- 172.21.15.196:0/1303748671 >> v2:172.21.15.37:3300/0 conn(0x7fc4f40682d0 0x7fc4f4165720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:13.415 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.417+0000 7fc4fc575640 1 --2- 172.21.15.196:0/1303748671 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc4f4154ff0 0x7fc4f415b610 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:13.415 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.417+0000 7fc4fc575640 1 -- 172.21.15.196:0/1303748671 >> 172.21.15.196:0/1303748671 conn(0x7fc4f40728b0 msgr2=0x7fc4f4072cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:13.415 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.417+0000 7fc4fc575640 1 -- 172.21.15.196:0/1303748671 shutdown_connections 2024-04-22T07:18:13.415 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.417+0000 7fc4fc575640 1 -- 172.21.15.196:0/1303748671 wait complete. 2024-04-22T07:18:13.417 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.418+0000 7fc4fc575640 1 Processor -- start 2024-04-22T07:18:13.418 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.418+0000 7fc4fc575640 1 -- start start 2024-04-22T07:18:13.418 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.418+0000 7fc4fc575640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc4f40682d0 0x7fc4f4149b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:13.418 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.418+0000 7fc4fc575640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc4f4154ff0 0x7fc4f41536c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:13.418 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.418+0000 7fc4fc575640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc4f415bb50 0x7fc4f41541a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:13.418 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.418+0000 7fc4fc575640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc4f406b970 con 0x7fc4f415bb50 2024-04-22T07:18:13.418 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.418+0000 7fc4fc575640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fc4f415b0f0 con 0x7fc4f40682d0 2024-04-22T07:18:13.418 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.418+0000 7fc4fc575640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fc4f415ada0 con 0x7fc4f4154ff0 2024-04-22T07:18:13.418 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.419+0000 7fc4fa311640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc4f40682d0 0x7fc4f4149b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:13.418 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.419+0000 7fc4f9b10640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc4f4154ff0 0x7fc4f41536c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:13.418 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.419+0000 7fc4fa311640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc4f40682d0 0x7fc4f4149b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:56696/0 (socket says 172.21.15.196:56696) 2024-04-22T07:18:13.418 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.419+0000 7fc4fa311640 1 -- 172.21.15.196:0/168941337 learned_addr learned my addr 172.21.15.196:0/168941337 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-04-22T07:18:13.418 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.419+0000 7fc4fab12640 1 --2- 172.21.15.196:0/168941337 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc4f415bb50 0x7fc4f41541a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:13.419 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.419+0000 7fc4fa311640 1 -- 172.21.15.196:0/168941337 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc4f4154ff0 msgr2=0x7fc4f41536c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:13.419 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.419+0000 7fc4fa311640 1 --2- 172.21.15.196:0/168941337 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc4f4154ff0 0x7fc4f41536c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:13.419 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.419+0000 7fc4fa311640 1 -- 172.21.15.196:0/168941337 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc4f415bb50 msgr2=0x7fc4f41541a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:13.419 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.419+0000 7fc4fa311640 1 --2- 172.21.15.196:0/168941337 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc4f415bb50 0x7fc4f41541a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:13.419 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.419+0000 7fc4fa311640 1 -- 172.21.15.196:0/168941337 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4f414a600 con 0x7fc4f40682d0 2024-04-22T07:18:13.419 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.419+0000 7fc4f9b10640 1 --2- 172.21.15.196:0/168941337 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc4f4154ff0 0x7fc4f41536c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-22T07:18:13.419 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.419+0000 7fc4fa311640 1 --2- 172.21.15.196:0/168941337 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc4f40682d0 0x7fc4f4149b10 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fc4e8000c00 tx=0x7fc4e8004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:13.419 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.419+0000 7fc4e6ffd640 1 -- 172.21.15.196:0/168941337 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4e8048070 con 0x7fc4f40682d0 2024-04-22T07:18:13.419 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.419+0000 7fc4e6ffd640 1 -- 172.21.15.196:0/168941337 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4e8030660 con 0x7fc4f40682d0 2024-04-22T07:18:13.419 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.419+0000 7fc4e6ffd640 1 -- 172.21.15.196:0/168941337 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4e8034040 con 0x7fc4f40682d0 2024-04-22T07:18:13.419 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.419+0000 7fc4fc575640 1 -- 172.21.15.196:0/168941337 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4f4153c00 con 0x7fc4f40682d0 2024-04-22T07:18:13.419 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.419+0000 7fc4fc575640 1 -- 172.21.15.196:0/168941337 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4f41f3ed0 con 0x7fc4f40682d0 2024-04-22T07:18:13.419 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.420+0000 7fc4e6ffd640 1 -- 172.21.15.196:0/168941337 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fc4e804b070 con 0x7fc4f40682d0 2024-04-22T07:18:13.419 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.420+0000 7fc4e6ffd640 1 -- 172.21.15.196:0/168941337 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7fc4e8043830 con 0x7fc4f40682d0 2024-04-22T07:18:13.420 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.420+0000 7fc4fc575640 1 -- 172.21.15.196:0/168941337 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4f4068b20 con 0x7fc4f40682d0 2024-04-22T07:18:13.422 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.424+0000 7fc4e6ffd640 1 -- 172.21.15.196:0/168941337 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7fc4e8052070 con 0x7fc4f40682d0 2024-04-22T07:18:13.498 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.497+0000 7fc4fc575640 1 -- 172.21.15.196:0/168941337 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "osd new", "uuid": "33a780fd-013a-41c8-9970-136c9e080897", "id": 2} v 0) -- 0x7fc4f40c7df0 con 0x7fc4f40682d0 2024-04-22T07:18:13.500 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.503+0000 7fc4e6ffd640 1 -- 172.21.15.196:0/168941337 <== mon.1 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "33a780fd-013a-41c8-9970-136c9e080897", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7fc4e8030810 con 0x7fc4f40682d0 2024-04-22T07:18:13.500 INFO:teuthology.orchestra.run.smithi196.stdout:2 2024-04-22T07:18:13.501 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.503+0000 7fc4fc575640 1 -- 172.21.15.196:0/168941337 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc4f40682d0 msgr2=0x7fc4f4149b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:13.501 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.503+0000 7fc4fc575640 1 --2- 172.21.15.196:0/168941337 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc4f40682d0 0x7fc4f4149b10 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fc4e8000c00 tx=0x7fc4e8004730 comp rx=0 tx=0).stop 2024-04-22T07:18:13.501 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.504+0000 7fc4fc575640 1 -- 172.21.15.196:0/168941337 shutdown_connections 2024-04-22T07:18:13.501 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.504+0000 7fc4fc575640 1 --2- 172.21.15.196:0/168941337 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc4f415bb50 0x7fc4f41541a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:13.505 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.504+0000 7fc4fc575640 1 --2- 172.21.15.196:0/168941337 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc4f4154ff0 0x7fc4f41536c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:13.505 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.504+0000 7fc4fc575640 1 --2- 172.21.15.196:0/168941337 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc4f40682d0 0x7fc4f4149b10 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:13.505 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.504+0000 7fc4fc575640 1 -- 172.21.15.196:0/168941337 >> 172.21.15.196:0/168941337 conn(0x7fc4f40728b0 msgr2=0x7fc4f415a230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:13.505 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.504+0000 7fc4fc575640 1 -- 172.21.15.196:0/168941337 shutdown_connections 2024-04-22T07:18:13.505 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.504+0000 7fc4fc575640 1 -- 172.21.15.196:0/168941337 wait complete. 2024-04-22T07:18:13.512 DEBUG:teuthology.orchestra.run.smithi196:> sudo ceph --cluster ceph osd new b46e53c4-e5b9-4098-b243-ab5a0f1f3885 3 2024-04-22T07:18:13.609 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.611+0000 7fbddc893640 1 Processor -- start 2024-04-22T07:18:13.609 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.611+0000 7fbddc893640 1 -- start start 2024-04-22T07:18:13.611 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.612+0000 7fbddc893640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fbdd8154ff0 0x7fbdd815b610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:13.611 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.612+0000 7fbddc893640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbdd815bb50 0x7fbdd80676b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:13.611 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.612+0000 7fbddc893640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbdd80c92a0 con 0x7fbdd80682d0 2024-04-22T07:18:13.612 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.612+0000 7fbddc893640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7fbdd80c9040 con 0x7fbdd8154ff0 2024-04-22T07:18:13.612 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.612+0000 7fbddc893640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fbdd80733d0 con 0x7fbdd815bb50 2024-04-22T07:18:13.612 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.613+0000 7fbdd659c640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fbdd8154ff0 0x7fbdd815b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:13.612 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.613+0000 7fbdd659c640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fbdd8154ff0 0x7fbdd815b610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:56704/0 (socket says 172.21.15.196:56704) 2024-04-22T07:18:13.612 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.613+0000 7fbdd6d9d640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7fbdd80682d0 0x7fbdd815e390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.196:38482/0 (socket says 172.21.15.196:38482) 2024-04-22T07:18:13.612 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.613+0000 7fbdd5d9b640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbdd815bb50 0x7fbdd80676b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:13.612 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.613+0000 7fbdd659c640 1 -- 172.21.15.196:0/2958542654 learned_addr learned my addr 172.21.15.196:0/2958542654 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-04-22T07:18:13.612 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.613+0000 7fbdd5d9b640 1 -- 172.21.15.196:0/2958542654 >> v2:172.21.15.196:3300/0 conn(0x7fbdd8154ff0 msgr2=0x7fbdd815b610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:18:13.612 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.613+0000 7fbdd5d9b640 1 --2- 172.21.15.196:0/2958542654 >> v2:172.21.15.196:3300/0 conn(0x7fbdd8154ff0 0x7fbdd815b610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:13.612 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.613+0000 7fbdd5d9b640 1 -- 172.21.15.196:0/2958542654 >> v1:172.21.15.196:6789/0 conn(0x7fbdd80682d0 legacy=0x7fbdd815e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:13.612 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.613+0000 7fbdd559a640 1 -- 172.21.15.196:0/2958542654 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2353011212 0 0) 0x7fbdd80c92a0 con 0x7fbdd80682d0 2024-04-22T07:18:13.612 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.613+0000 7fbdd5d9b640 1 -- 172.21.15.196:0/2958542654 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbdd80736b0 con 0x7fbdd815bb50 2024-04-22T07:18:13.612 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.613+0000 7fbdd659c640 1 --2- 172.21.15.196:0/2958542654 >> v2:172.21.15.196:3300/0 conn(0x7fbdd8154ff0 0x7fbdd815b610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-22T07:18:13.613 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.614+0000 7fbdd5d9b640 1 --2- 172.21.15.196:0/2958542654 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbdd815bb50 0x7fbdd80676b0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fbdc00097a0 tx=0x7fbdc002b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3c54f09ce7aea591 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:13.613 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.614+0000 7fbdd559a640 1 -- 172.21.15.196:0/2958542654 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdc0034070 con 0x7fbdd815bb50 2024-04-22T07:18:13.613 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.614+0000 7fbdd559a640 1 -- 172.21.15.196:0/2958542654 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbdc0030610 con 0x7fbdd815bb50 2024-04-22T07:18:13.613 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.614+0000 7fbdd559a640 1 -- 172.21.15.196:0/2958542654 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdc00309e0 con 0x7fbdd815bb50 2024-04-22T07:18:13.616 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.614+0000 7fbddc893640 1 -- 172.21.15.196:0/2958542654 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbdd815bb50 msgr2=0x7fbdd80676b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:13.616 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.614+0000 7fbddc893640 1 --2- 172.21.15.196:0/2958542654 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbdd815bb50 0x7fbdd80676b0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fbdc00097a0 tx=0x7fbdc002b960 comp rx=0 tx=0).stop 2024-04-22T07:18:13.616 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.615+0000 7fbddc893640 1 -- 172.21.15.196:0/2958542654 shutdown_connections 2024-04-22T07:18:13.616 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.615+0000 7fbddc893640 1 --2- 172.21.15.196:0/2958542654 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbdd815bb50 0x7fbdd80676b0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:13.616 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.615+0000 7fbddc893640 1 --2- 172.21.15.196:0/2958542654 >> v2:172.21.15.196:3300/0 conn(0x7fbdd8154ff0 0x7fbdd815b610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:13.616 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.615+0000 7fbddc893640 1 -- 172.21.15.196:0/2958542654 >> 172.21.15.196:0/2958542654 conn(0x7fbdd80728b0 msgr2=0x7fbdd8072cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:13.616 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.615+0000 7fbddc893640 1 -- 172.21.15.196:0/2958542654 shutdown_connections 2024-04-22T07:18:13.616 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.615+0000 7fbddc893640 1 -- 172.21.15.196:0/2958542654 wait complete. 2024-04-22T07:18:13.616 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.616+0000 7fbddc893640 1 Processor -- start 2024-04-22T07:18:13.616 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.616+0000 7fbddc893640 1 -- start start 2024-04-22T07:18:13.616 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.617+0000 7fbddc893640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbdd80682d0 0x7fbdd80ccc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:13.617 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.617+0000 7fbddc893640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbdd8154ff0 0x7fbdd80c7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:13.617 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.617+0000 7fbddc893640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbdd815bb50 0x7fbdd80cb6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:13.617 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.617+0000 7fbddc893640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fbdd806b970 con 0x7fbdd80682d0 2024-04-22T07:18:13.617 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.617+0000 7fbddc893640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fbdd815b0f0 con 0x7fbdd8154ff0 2024-04-22T07:18:13.617 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.617+0000 7fbddc893640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fbdd815ada0 con 0x7fbdd815bb50 2024-04-22T07:18:13.617 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.617+0000 7fbdd6d9d640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbdd815bb50 0x7fbdd80cb6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:13.617 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.617+0000 7fbdd5d9b640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbdd8154ff0 0x7fbdd80c7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:13.617 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.617+0000 7fbdd6d9d640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbdd815bb50 0x7fbdd80cb6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.196:36380/0 (socket says 172.21.15.196:36380) 2024-04-22T07:18:13.617 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.617+0000 7fbdd6d9d640 1 -- 172.21.15.196:0/4277272388 learned_addr learned my addr 172.21.15.196:0/4277272388 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-04-22T07:18:13.617 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.617+0000 7fbdd659c640 1 --2- 172.21.15.196:0/4277272388 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbdd80682d0 0x7fbdd80ccc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:13.617 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.617+0000 7fbdd6d9d640 1 -- 172.21.15.196:0/4277272388 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbdd8154ff0 msgr2=0x7fbdd80c7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:13.617 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.617+0000 7fbdd6d9d640 1 --2- 172.21.15.196:0/4277272388 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbdd8154ff0 0x7fbdd80c7bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:13.617 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.617+0000 7fbdd6d9d640 1 -- 172.21.15.196:0/4277272388 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbdd80682d0 msgr2=0x7fbdd80ccc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:13.617 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.617+0000 7fbdd6d9d640 1 --2- 172.21.15.196:0/4277272388 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbdd80682d0 0x7fbdd80ccc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:13.618 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.617+0000 7fbdd6d9d640 1 -- 172.21.15.196:0/4277272388 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbdd8149180 con 0x7fbdd815bb50 2024-04-22T07:18:13.618 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.617+0000 7fbdd5d9b640 1 --2- 172.21.15.196:0/4277272388 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbdd8154ff0 0x7fbdd80c7bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-22T07:18:13.618 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.617+0000 7fbdd6d9d640 1 --2- 172.21.15.196:0/4277272388 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbdd815bb50 0x7fbdd80cb6e0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fbdd000c700 tx=0x7fbdd000cbc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:13.618 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.617+0000 7fbdceffd640 1 -- 172.21.15.196:0/4277272388 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdd0018070 con 0x7fbdd815bb50 2024-04-22T07:18:13.618 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.618+0000 7fbdceffd640 1 -- 172.21.15.196:0/4277272388 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbdd000ce10 con 0x7fbdd815bb50 2024-04-22T07:18:13.618 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.618+0000 7fbddc893640 1 -- 172.21.15.196:0/4277272388 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbdd80cb200 con 0x7fbdd815bb50 2024-04-22T07:18:13.618 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.618+0000 7fbdceffd640 1 -- 172.21.15.196:0/4277272388 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdd000a880 con 0x7fbdd815bb50 2024-04-22T07:18:13.618 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.618+0000 7fbddc893640 1 -- 172.21.15.196:0/4277272388 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fbdd81488e0 con 0x7fbdd815bb50 2024-04-22T07:18:13.618 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.618+0000 7fbdceffd640 1 -- 172.21.15.196:0/4277272388 <== mon.2 v2:172.21.15.196:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fbdd001b070 con 0x7fbdd815bb50 2024-04-22T07:18:13.618 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.618+0000 7fbdceffd640 1 -- 172.21.15.196:0/4277272388 <== mon.2 v2:172.21.15.196:3301/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7fbdd00077b0 con 0x7fbdd815bb50 2024-04-22T07:18:13.619 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.619+0000 7fbddc893640 1 -- 172.21.15.196:0/4277272388 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbdd80cb3d0 con 0x7fbdd815bb50 2024-04-22T07:18:13.619 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.621+0000 7fbdceffd640 1 -- 172.21.15.196:0/4277272388 <== mon.2 v2:172.21.15.196:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7fbdd00070d0 con 0x7fbdd815bb50 2024-04-22T07:18:13.690 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.693+0000 7fbddc893640 1 -- 172.21.15.196:0/4277272388 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "osd new", "uuid": "b46e53c4-e5b9-4098-b243-ab5a0f1f3885", "id": 3} v 0) -- 0x7fbdd8068b20 con 0x7fbdd815bb50 2024-04-22T07:18:13.695 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.698+0000 7fbdceffd640 1 -- 172.21.15.196:0/4277272388 <== mon.2 v2:172.21.15.196:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b46e53c4-e5b9-4098-b243-ab5a0f1f3885", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7fbdd0007390 con 0x7fbdd815bb50 2024-04-22T07:18:13.696 INFO:teuthology.orchestra.run.smithi196.stdout:3 2024-04-22T07:18:13.697 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.699+0000 7fbddc893640 1 -- 172.21.15.196:0/4277272388 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbdd815bb50 msgr2=0x7fbdd80cb6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:13.697 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.699+0000 7fbddc893640 1 --2- 172.21.15.196:0/4277272388 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbdd815bb50 0x7fbdd80cb6e0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fbdd000c700 tx=0x7fbdd000cbc0 comp rx=0 tx=0).stop 2024-04-22T07:18:13.697 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.699+0000 7fbddc893640 1 -- 172.21.15.196:0/4277272388 shutdown_connections 2024-04-22T07:18:13.697 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.699+0000 7fbddc893640 1 --2- 172.21.15.196:0/4277272388 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbdd815bb50 0x7fbdd80cb6e0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:13.697 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.699+0000 7fbddc893640 1 --2- 172.21.15.196:0/4277272388 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbdd8154ff0 0x7fbdd80c7bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:13.697 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.699+0000 7fbddc893640 1 --2- 172.21.15.196:0/4277272388 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbdd80682d0 0x7fbdd80ccc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:13.697 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.699+0000 7fbddc893640 1 -- 172.21.15.196:0/4277272388 >> 172.21.15.196:0/4277272388 conn(0x7fbdd80728b0 msgr2=0x7fbdd8153440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:13.697 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.699+0000 7fbddc893640 1 -- 172.21.15.196:0/4277272388 shutdown_connections 2024-04-22T07:18:13.697 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.699+0000 7fbddc893640 1 -- 172.21.15.196:0/4277272388 wait complete. 2024-04-22T07:18:13.707 DEBUG:teuthology.orchestra.run.smithi196:> sudo ceph --cluster ceph osd new cd1032c6-6a83-4e33-b7b1-baddf92a83af 4 2024-04-22T07:18:13.801 INFO:tasks.ceph.mgr.x.smithi196.stderr:2024-04-22T07:18:13.804+0000 7f987822d040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-22T07:18:13.803 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.806+0000 7fd2f3115640 1 Processor -- start 2024-04-22T07:18:13.803 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.806+0000 7fd2f3115640 1 -- start start 2024-04-22T07:18:13.805 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.807+0000 7fd2f3115640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd2ec151d80 0x7fd2ec0c8e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:13.805 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.807+0000 7fd2f3115640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd2ec0c65e0 0x7fd2ec0c6a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:13.805 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.807+0000 7fd2f3115640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fd2ec157de0 0x7fd2ec158250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:13.805 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.807+0000 7fd2f3115640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fd2ec0c9460 con 0x7fd2ec151d80 2024-04-22T07:18:13.805 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.807+0000 7fd2f3115640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7fd2ec158790 con 0x7fd2ec157de0 2024-04-22T07:18:13.805 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.807+0000 7fd2f3115640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fd2ec0c4c10 con 0x7fd2ec0c65e0 2024-04-22T07:18:13.805 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.807+0000 7fd2f16b2640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fd2ec157de0 0x7fd2ec158250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:13.805 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.807+0000 7fd2ebfff640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd2ec0c65e0 0x7fd2ec0c6a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:13.805 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.807+0000 7fd2ebfff640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd2ec0c65e0 0x7fd2ec0c6a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.196:36392/0 (socket says 172.21.15.196:36392) 2024-04-22T07:18:13.805 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.807+0000 7fd2f16b2640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fd2ec157de0 0x7fd2ec158250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:56726/0 (socket says 172.21.15.196:56726) 2024-04-22T07:18:13.806 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.807+0000 7fd2ebfff640 1 -- 172.21.15.196:0/118027896 learned_addr learned my addr 172.21.15.196:0/118027896 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-04-22T07:18:13.806 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.807+0000 7fd2f0eb1640 1 --2- 172.21.15.196:0/118027896 >> v2:172.21.15.37:3300/0 conn(0x7fd2ec151d80 0x7fd2ec0c8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:13.806 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.807+0000 7fd2f16b2640 1 -- 172.21.15.196:0/118027896 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd2ec0c65e0 msgr2=0x7fd2ec0c6a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:18:13.806 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.807+0000 7fd2f16b2640 1 --2- 172.21.15.196:0/118027896 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd2ec0c65e0 0x7fd2ec0c6a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:13.806 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.807+0000 7fd2f16b2640 1 -- 172.21.15.196:0/118027896 >> v2:172.21.15.37:3300/0 conn(0x7fd2ec151d80 msgr2=0x7fd2ec0c8e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:18:13.806 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.807+0000 7fd2f16b2640 1 --2- 172.21.15.196:0/118027896 >> v2:172.21.15.37:3300/0 conn(0x7fd2ec151d80 0x7fd2ec0c8e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:13.806 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.807+0000 7fd2f16b2640 1 -- 172.21.15.196:0/118027896 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2ec0c4eb0 con 0x7fd2ec157de0 2024-04-22T07:18:13.806 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.807+0000 7fd2ebfff640 1 --2- 172.21.15.196:0/118027896 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd2ec0c65e0 0x7fd2ec0c6a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-22T07:18:13.808 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.808+0000 7fd2f16b2640 1 --2- 172.21.15.196:0/118027896 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd2ec157de0 0x7fd2ec158250 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fd2ec0c82b0 tx=0x7fd2e402be20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=11ecc184557711d7 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:13.808 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.808+0000 7fd2eb7fe640 1 -- 172.21.15.196:0/118027896 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2e4039070 con 0x7fd2ec157de0 2024-04-22T07:18:13.808 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.808+0000 7fd2eb7fe640 1 -- 172.21.15.196:0/118027896 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2e402cbd0 con 0x7fd2ec157de0 2024-04-22T07:18:13.808 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.808+0000 7fd2eb7fe640 1 -- 172.21.15.196:0/118027896 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2e4034440 con 0x7fd2ec157de0 2024-04-22T07:18:13.808 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.809+0000 7fd2f3115640 1 -- 172.21.15.196:0/118027896 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd2ec157de0 msgr2=0x7fd2ec158250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:13.808 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.809+0000 7fd2f3115640 1 --2- 172.21.15.196:0/118027896 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd2ec157de0 0x7fd2ec158250 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fd2ec0c82b0 tx=0x7fd2e402be20 comp rx=0 tx=0).stop 2024-04-22T07:18:13.808 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.809+0000 7fd2f3115640 1 -- 172.21.15.196:0/118027896 shutdown_connections 2024-04-22T07:18:13.808 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.809+0000 7fd2f3115640 1 --2- 172.21.15.196:0/118027896 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd2ec0c65e0 0x7fd2ec0c6a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:13.808 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.809+0000 7fd2f3115640 1 --2- 172.21.15.196:0/118027896 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd2ec157de0 0x7fd2ec158250 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:13.808 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.809+0000 7fd2f3115640 1 --2- 172.21.15.196:0/118027896 >> v2:172.21.15.37:3300/0 conn(0x7fd2ec151d80 0x7fd2ec0c8e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:13.808 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.809+0000 7fd2f3115640 1 -- 172.21.15.196:0/118027896 >> 172.21.15.196:0/118027896 conn(0x7fd2ec0cd3e0 msgr2=0x7fd2ec0cd7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:13.808 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.809+0000 7fd2f3115640 1 -- 172.21.15.196:0/118027896 shutdown_connections 2024-04-22T07:18:13.809 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.809+0000 7fd2f3115640 1 -- 172.21.15.196:0/118027896 wait complete. 2024-04-22T07:18:13.809 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.810+0000 7fd2f3115640 1 Processor -- start 2024-04-22T07:18:13.809 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.810+0000 7fd2f3115640 1 -- start start 2024-04-22T07:18:13.811 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.811+0000 7fd2f3115640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2ec0c65e0 0x7fd2ec1573a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:13.811 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.811+0000 7fd2f3115640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd2ec151d80 0x7fd2ec1e21a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:13.811 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.811+0000 7fd2f3115640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd2ec157de0 0x7fd2ec1f0cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:13.811 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.811+0000 7fd2f3115640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd2ec152160 con 0x7fd2ec0c65e0 2024-04-22T07:18:13.811 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.811+0000 7fd2f3115640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fd2ec0c9990 con 0x7fd2ec151d80 2024-04-22T07:18:13.811 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.811+0000 7fd2f3115640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fd2ec0c4860 con 0x7fd2ec157de0 2024-04-22T07:18:13.811 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.811+0000 7fd2ebfff640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd2ec151d80 0x7fd2ec1e21a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:13.811 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.811+0000 7fd2f16b2640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd2ec157de0 0x7fd2ec1f0cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:13.811 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.811+0000 7fd2ebfff640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd2ec151d80 0x7fd2ec1e21a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:56740/0 (socket says 172.21.15.196:56740) 2024-04-22T07:18:13.811 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.811+0000 7fd2ebfff640 1 -- 172.21.15.196:0/3879659779 learned_addr learned my addr 172.21.15.196:0/3879659779 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-04-22T07:18:13.811 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.811+0000 7fd2f0eb1640 1 --2- 172.21.15.196:0/3879659779 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2ec0c65e0 0x7fd2ec1573a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:13.812 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.811+0000 7fd2ebfff640 1 -- 172.21.15.196:0/3879659779 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd2ec157de0 msgr2=0x7fd2ec1f0cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:13.812 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.811+0000 7fd2ebfff640 1 --2- 172.21.15.196:0/3879659779 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd2ec157de0 0x7fd2ec1f0cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:13.812 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.811+0000 7fd2ebfff640 1 -- 172.21.15.196:0/3879659779 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2ec0c65e0 msgr2=0x7fd2ec1573a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:13.812 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.811+0000 7fd2ebfff640 1 --2- 172.21.15.196:0/3879659779 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2ec0c65e0 0x7fd2ec1573a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:13.812 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.811+0000 7fd2ebfff640 1 -- 172.21.15.196:0/3879659779 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2ec1f43d0 con 0x7fd2ec151d80 2024-04-22T07:18:13.812 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.811+0000 7fd2ebfff640 1 --2- 172.21.15.196:0/3879659779 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd2ec151d80 0x7fd2ec1e21a0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fd2d800ed40 tx=0x7fd2d800d720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:13.812 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.811+0000 7fd2e97fa640 1 -- 172.21.15.196:0/3879659779 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2d8004230 con 0x7fd2ec151d80 2024-04-22T07:18:13.812 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.811+0000 7fd2e97fa640 1 -- 172.21.15.196:0/3879659779 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2d80043d0 con 0x7fd2ec151d80 2024-04-22T07:18:13.812 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.811+0000 7fd2e97fa640 1 -- 172.21.15.196:0/3879659779 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2d8003850 con 0x7fd2ec151d80 2024-04-22T07:18:13.812 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.811+0000 7fd2f3115640 1 -- 172.21.15.196:0/3879659779 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2ec1f4670 con 0x7fd2ec151d80 2024-04-22T07:18:13.812 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.812+0000 7fd2f3115640 1 -- 172.21.15.196:0/3879659779 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2ec14f750 con 0x7fd2ec151d80 2024-04-22T07:18:13.812 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.812+0000 7fd2e97fa640 1 -- 172.21.15.196:0/3879659779 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fd2d80039f0 con 0x7fd2ec151d80 2024-04-22T07:18:13.812 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.812+0000 7fd2e97fa640 1 -- 172.21.15.196:0/3879659779 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7fd2d8006580 con 0x7fd2ec151d80 2024-04-22T07:18:13.812 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.813+0000 7fd2f3115640 1 -- 172.21.15.196:0/3879659779 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2ec147d00 con 0x7fd2ec151d80 2024-04-22T07:18:13.813 INFO:tasks.ceph.mgr.y.smithi037.stderr:2024-04-22T07:18:13.815+0000 7fb53ac12040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-22T07:18:13.813 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.815+0000 7fd2e97fa640 1 -- 172.21.15.196:0/3879659779 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7fd2ec147d00 con 0x7fd2ec151d80 2024-04-22T07:18:13.898 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.900+0000 7fd2f3115640 1 -- 172.21.15.196:0/3879659779 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "osd new", "uuid": "cd1032c6-6a83-4e33-b7b1-baddf92a83af", "id": 4} v 0) -- 0x7fd2ec068b20 con 0x7fd2ec151d80 2024-04-22T07:18:13.901 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.903+0000 7fd2e97fa640 1 -- 172.21.15.196:0/3879659779 <== mon.1 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "cd1032c6-6a83-4e33-b7b1-baddf92a83af", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7fd2d8006860 con 0x7fd2ec151d80 2024-04-22T07:18:13.901 INFO:teuthology.orchestra.run.smithi196.stdout:4 2024-04-22T07:18:13.902 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.904+0000 7fd2f3115640 1 -- 172.21.15.196:0/3879659779 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd2ec151d80 msgr2=0x7fd2ec1e21a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:13.902 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.904+0000 7fd2f3115640 1 --2- 172.21.15.196:0/3879659779 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd2ec151d80 0x7fd2ec1e21a0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fd2d800ed40 tx=0x7fd2d800d720 comp rx=0 tx=0).stop 2024-04-22T07:18:13.902 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.904+0000 7fd2f3115640 1 -- 172.21.15.196:0/3879659779 shutdown_connections 2024-04-22T07:18:13.902 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.904+0000 7fd2f3115640 1 --2- 172.21.15.196:0/3879659779 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd2ec157de0 0x7fd2ec1f0cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:13.903 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.904+0000 7fd2f3115640 1 --2- 172.21.15.196:0/3879659779 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd2ec151d80 0x7fd2ec1e21a0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:13.903 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.904+0000 7fd2f3115640 1 --2- 172.21.15.196:0/3879659779 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2ec0c65e0 0x7fd2ec1573a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:13.903 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.904+0000 7fd2f3115640 1 -- 172.21.15.196:0/3879659779 >> 172.21.15.196:0/3879659779 conn(0x7fd2ec0cd3e0 msgr2=0x7fd2ec06c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:13.903 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.904+0000 7fd2f3115640 1 -- 172.21.15.196:0/3879659779 shutdown_connections 2024-04-22T07:18:13.903 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:13.904+0000 7fd2f3115640 1 -- 172.21.15.196:0/3879659779 wait complete. 2024-04-22T07:18:13.904 INFO:tasks.ceph.mgr.y.smithi037.stderr:2024-04-22T07:18:13.906+0000 7fb53ac12040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-22T07:18:13.904 INFO:tasks.ceph.mgr.x.smithi196.stderr:2024-04-22T07:18:13.906+0000 7f987822d040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-22T07:18:13.913 DEBUG:teuthology.orchestra.run.smithi196:> sudo ceph --cluster ceph osd new f561d48a-5f2d-4deb-8681-4329aed36bae 5 2024-04-22T07:18:13.948 INFO:tasks.ceph.mgr.y.smithi037.stderr:2024-04-22T07:18:13.951+0000 7fb53ac12040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-22T07:18:13.949 INFO:tasks.ceph.mgr.x.smithi196.stderr:2024-04-22T07:18:13.952+0000 7f987822d040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-22T07:18:14.009 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.012+0000 7f37e8cd2640 1 Processor -- start 2024-04-22T07:18:14.010 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.012+0000 7f37e8cd2640 1 -- start start 2024-04-22T07:18:14.011 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.013+0000 7f37e8cd2640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f37e4154ff0 0x7f37e415b610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:14.011 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.013+0000 7f37e8cd2640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f37e415bb50 0x7f37e40676b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:14.012 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.013+0000 7f37e8cd2640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f37e40c92a0 con 0x7f37e40682d0 2024-04-22T07:18:14.012 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.013+0000 7f37e8cd2640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f37e40c9040 con 0x7f37e4154ff0 2024-04-22T07:18:14.012 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.013+0000 7f37e8cd2640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f37e40733d0 con 0x7f37e415bb50 2024-04-22T07:18:14.012 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.013+0000 7f37e1d9b640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f37e415bb50 0x7f37e40676b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:14.012 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.013+0000 7f37e2d9d640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7f37e40682d0 0x7f37e415e390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.196:38490/0 (socket says 172.21.15.196:38490) 2024-04-22T07:18:14.012 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.013+0000 7f37e2d9d640 1 -- 172.21.15.196:0/1406485656 learned_addr learned my addr 172.21.15.196:0/1406485656 (peer_addr_for_me v1:172.21.15.196:0/0) 2024-04-22T07:18:14.012 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.013+0000 7f37e259c640 1 --2- 172.21.15.196:0/1406485656 >> v2:172.21.15.37:3300/0 conn(0x7f37e4154ff0 0x7f37e415b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:14.012 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.013+0000 7f37e159a640 1 -- 172.21.15.196:0/1406485656 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4156186493 0 0) 0x7f37e40c92a0 con 0x7f37e40682d0 2024-04-22T07:18:14.012 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.013+0000 7f37e1d9b640 1 -- 172.21.15.196:0/1406485656 >> v2:172.21.15.37:3300/0 conn(0x7f37e4154ff0 msgr2=0x7f37e415b610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:18:14.012 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.013+0000 7f37e1d9b640 1 --2- 172.21.15.196:0/1406485656 >> v2:172.21.15.37:3300/0 conn(0x7f37e4154ff0 0x7f37e415b610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:14.012 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.013+0000 7f37e1d9b640 1 -- 172.21.15.196:0/1406485656 >> v1:172.21.15.196:6789/0 conn(0x7f37e40682d0 legacy=0x7f37e415e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:14.012 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.013+0000 7f37e1d9b640 1 -- 172.21.15.196:0/1406485656 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37e40736b0 con 0x7f37e415bb50 2024-04-22T07:18:14.016 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.014+0000 7f37e1d9b640 1 --2- 172.21.15.196:0/1406485656 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f37e415bb50 0x7f37e40676b0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f37d80097a0 tx=0x7f37d802b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=33cd806ba21eda02 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:14.016 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.014+0000 7f37e159a640 1 -- 172.21.15.196:0/1406485656 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37d8034070 con 0x7f37e415bb50 2024-04-22T07:18:14.016 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.014+0000 7f37e159a640 1 -- 172.21.15.196:0/1406485656 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37d8030610 con 0x7f37e415bb50 2024-04-22T07:18:14.016 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.014+0000 7f37e159a640 1 -- 172.21.15.196:0/1406485656 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37d80309e0 con 0x7f37e415bb50 2024-04-22T07:18:14.016 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.015+0000 7f37e8cd2640 1 -- 172.21.15.196:0/1406485656 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f37e415bb50 msgr2=0x7f37e40676b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:14.016 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.015+0000 7f37e8cd2640 1 --2- 172.21.15.196:0/1406485656 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f37e415bb50 0x7f37e40676b0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f37d80097a0 tx=0x7f37d802b960 comp rx=0 tx=0).stop 2024-04-22T07:18:14.016 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.015+0000 7f37e8cd2640 1 -- 172.21.15.196:0/1406485656 shutdown_connections 2024-04-22T07:18:14.016 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.015+0000 7f37e8cd2640 1 --2- 172.21.15.196:0/1406485656 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f37e415bb50 0x7f37e40676b0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:14.017 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.015+0000 7f37e8cd2640 1 --2- 172.21.15.196:0/1406485656 >> v2:172.21.15.37:3300/0 conn(0x7f37e4154ff0 0x7f37e415b610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:14.017 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.015+0000 7f37e8cd2640 1 -- 172.21.15.196:0/1406485656 >> 172.21.15.196:0/1406485656 conn(0x7f37e40728b0 msgr2=0x7f37e4072cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:14.017 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.015+0000 7f37e8cd2640 1 -- 172.21.15.196:0/1406485656 shutdown_connections 2024-04-22T07:18:14.017 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.015+0000 7f37e8cd2640 1 -- 172.21.15.196:0/1406485656 wait complete. 2024-04-22T07:18:14.017 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.016+0000 7f37e8cd2640 1 Processor -- start 2024-04-22T07:18:14.017 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.016+0000 7f37e8cd2640 1 -- start start 2024-04-22T07:18:14.017 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.017+0000 7f37e8cd2640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f37e40682d0 0x7f37e40ccc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:14.017 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.017+0000 7f37e8cd2640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f37e4154ff0 0x7f37e40c7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:14.017 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.017+0000 7f37e8cd2640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f37e415bb50 0x7f37e40cb6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:14.017 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.017+0000 7f37e8cd2640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f37e406b970 con 0x7f37e40682d0 2024-04-22T07:18:14.017 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.017+0000 7f37e8cd2640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f37e415b0f0 con 0x7f37e4154ff0 2024-04-22T07:18:14.017 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.017+0000 7f37e8cd2640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f37e415ada0 con 0x7f37e415bb50 2024-04-22T07:18:14.017 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.017+0000 7f37e2d9d640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f37e415bb50 0x7f37e40cb6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:14.017 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.017+0000 7f37e2d9d640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f37e415bb50 0x7f37e40cb6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.196:36432/0 (socket says 172.21.15.196:36432) 2024-04-22T07:18:14.018 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.017+0000 7f37e2d9d640 1 -- 172.21.15.196:0/2094516865 learned_addr learned my addr 172.21.15.196:0/2094516865 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-04-22T07:18:14.018 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.017+0000 7f37e1d9b640 1 --2- 172.21.15.196:0/2094516865 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f37e4154ff0 0x7f37e40c7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:14.018 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.017+0000 7f37e259c640 1 --2- 172.21.15.196:0/2094516865 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f37e40682d0 0x7f37e40ccc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:14.018 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.017+0000 7f37e1d9b640 1 -- 172.21.15.196:0/2094516865 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f37e415bb50 msgr2=0x7f37e40cb6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:14.018 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.017+0000 7f37e1d9b640 1 --2- 172.21.15.196:0/2094516865 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f37e415bb50 0x7f37e40cb6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:14.018 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.017+0000 7f37e1d9b640 1 -- 172.21.15.196:0/2094516865 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f37e40682d0 msgr2=0x7f37e40ccc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:14.018 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.017+0000 7f37e1d9b640 1 --2- 172.21.15.196:0/2094516865 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f37e40682d0 0x7f37e40ccc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:14.018 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.017+0000 7f37e1d9b640 1 -- 172.21.15.196:0/2094516865 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37e4149180 con 0x7f37e4154ff0 2024-04-22T07:18:14.018 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.017+0000 7f37e2d9d640 1 --2- 172.21.15.196:0/2094516865 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f37e415bb50 0x7f37e40cb6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-22T07:18:14.018 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.017+0000 7f37e1d9b640 1 --2- 172.21.15.196:0/2094516865 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f37e4154ff0 0x7f37e40c7bb0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f37e4073550 tx=0x7f37d80046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:14.018 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.018+0000 7f37d2ffd640 1 -- 172.21.15.196:0/2094516865 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37d8034040 con 0x7f37e4154ff0 2024-04-22T07:18:14.018 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.018+0000 7f37d2ffd640 1 -- 172.21.15.196:0/2094516865 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37d8039a10 con 0x7f37e4154ff0 2024-04-22T07:18:14.018 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.018+0000 7f37e8cd2640 1 -- 172.21.15.196:0/2094516865 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37e40cb200 con 0x7f37e4154ff0 2024-04-22T07:18:14.019 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.018+0000 7f37d2ffd640 1 -- 172.21.15.196:0/2094516865 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37d8039e20 con 0x7f37e4154ff0 2024-04-22T07:18:14.019 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.018+0000 7f37e8cd2640 1 -- 172.21.15.196:0/2094516865 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37e41488e0 con 0x7f37e4154ff0 2024-04-22T07:18:14.019 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.018+0000 7f37d2ffd640 1 -- 172.21.15.196:0/2094516865 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f37d8037070 con 0x7f37e4154ff0 2024-04-22T07:18:14.019 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.018+0000 7f37d2ffd640 1 -- 172.21.15.196:0/2094516865 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7f37d804bc70 con 0x7f37e4154ff0 2024-04-22T07:18:14.019 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.019+0000 7f37e8cd2640 1 -- 172.21.15.196:0/2094516865 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37e40cb3d0 con 0x7f37e4154ff0 2024-04-22T07:18:14.020 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.022+0000 7f37d2ffd640 1 -- 172.21.15.196:0/2094516865 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f37d80304d0 con 0x7f37e4154ff0 2024-04-22T07:18:14.093 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.095+0000 7f37e8cd2640 1 -- 172.21.15.196:0/2094516865 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "osd new", "uuid": "f561d48a-5f2d-4deb-8681-4329aed36bae", "id": 5} v 0) -- 0x7f37e4068b20 con 0x7f37e4154ff0 2024-04-22T07:18:14.098 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.101+0000 7f37d2ffd640 1 -- 172.21.15.196:0/2094516865 <== mon.1 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f561d48a-5f2d-4deb-8681-4329aed36bae", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7f37d804b400 con 0x7f37e4154ff0 2024-04-22T07:18:14.098 INFO:teuthology.orchestra.run.smithi196.stdout:5 2024-04-22T07:18:14.099 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.102+0000 7f37e8cd2640 1 -- 172.21.15.196:0/2094516865 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f37e4154ff0 msgr2=0x7f37e40c7bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:14.100 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.102+0000 7f37e8cd2640 1 --2- 172.21.15.196:0/2094516865 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f37e4154ff0 0x7f37e40c7bb0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f37e4073550 tx=0x7f37d80046c0 comp rx=0 tx=0).stop 2024-04-22T07:18:14.100 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.102+0000 7f37e8cd2640 1 -- 172.21.15.196:0/2094516865 shutdown_connections 2024-04-22T07:18:14.100 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.102+0000 7f37e8cd2640 1 --2- 172.21.15.196:0/2094516865 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f37e415bb50 0x7f37e40cb6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:14.100 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.102+0000 7f37e8cd2640 1 --2- 172.21.15.196:0/2094516865 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f37e4154ff0 0x7f37e40c7bb0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:14.100 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.102+0000 7f37e8cd2640 1 --2- 172.21.15.196:0/2094516865 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f37e40682d0 0x7f37e40ccc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:14.100 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.102+0000 7f37e8cd2640 1 -- 172.21.15.196:0/2094516865 >> 172.21.15.196:0/2094516865 conn(0x7f37e40728b0 msgr2=0x7f37e4153440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:14.100 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.102+0000 7f37e8cd2640 1 -- 172.21.15.196:0/2094516865 shutdown_connections 2024-04-22T07:18:14.100 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.102+0000 7f37e8cd2640 1 -- 172.21.15.196:0/2094516865 wait complete. 2024-04-22T07:18:14.110 DEBUG:teuthology.orchestra.run.smithi196:> sudo ceph --cluster ceph osd new 1b239c7e-2504-42e0-b308-70f4e62519c8 6 2024-04-22T07:18:14.121 INFO:tasks.ceph.mgr.y.smithi037.stderr:2024-04-22T07:18:14.124+0000 7fb53ac12040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-22T07:18:14.125 INFO:tasks.ceph.mgr.x.smithi196.stderr:2024-04-22T07:18:14.128+0000 7f987822d040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-22T07:18:14.171 INFO:tasks.ceph.mgr.y.smithi037.stderr:2024-04-22T07:18:14.173+0000 7fb53ac12040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-22T07:18:14.176 INFO:tasks.ceph.mgr.x.smithi196.stderr:2024-04-22T07:18:14.178+0000 7f987822d040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-22T07:18:14.222 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.225+0000 7f2f0f8d2640 1 Processor -- start 2024-04-22T07:18:14.223 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.225+0000 7f2f0f8d2640 1 -- start start 2024-04-22T07:18:14.224 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.226+0000 7f2f0f8d2640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2f080c4860 0x7f2f080ce8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:14.224 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.226+0000 7f2f0f8d2640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f080ca0d0 con 0x7f2f080c3540 2024-04-22T07:18:14.224 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.226+0000 7f2f0f8d2640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f080ca370 con 0x7f2f08156300 2024-04-22T07:18:14.224 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.226+0000 7f2f0f8d2640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f2f080caca0 con 0x7f2f080c4860 2024-04-22T07:18:14.224 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.226+0000 7f2f0ce6d640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2f080c4860 0x7f2f080ce8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:14.224 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.226+0000 7f2f0d66e640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7f2f08156300 0x7f2f080c8f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.196:38496/0 (socket says 172.21.15.196:38496) 2024-04-22T07:18:14.224 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.226+0000 7f2f0d66e640 1 -- 172.21.15.196:0/785092069 learned_addr learned my addr 172.21.15.196:0/785092069 (peer_addr_for_me v1:172.21.15.196:0/0) 2024-04-22T07:18:14.224 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.226+0000 7f2efffff640 1 -- 172.21.15.196:0/785092069 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1958106963 0 0) 0x7f2f080ca370 con 0x7f2f08156300 2024-04-22T07:18:14.224 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.226+0000 7f2efffff640 1 -- 172.21.15.196:0/785092069 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2ef4003520 con 0x7f2f08156300 2024-04-22T07:18:14.225 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.226+0000 7f2f0ce6d640 1 -- 172.21.15.196:0/785092069 >> v1:172.21.15.196:6789/0 conn(0x7f2f08156300 legacy=0x7f2f080c8f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:14.225 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.226+0000 7f2f0ce6d640 1 -- 172.21.15.196:0/785092069 >> v1:172.21.15.37:6789/0 conn(0x7f2f080c3540 legacy=0x7f2f0815c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:14.225 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.226+0000 7f2f0ce6d640 1 -- 172.21.15.196:0/785092069 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f080ca650 con 0x7f2f080c4860 2024-04-22T07:18:14.226 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.227+0000 7f2f0ce6d640 1 --2- 172.21.15.196:0/785092069 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2f080c4860 0x7f2f080ce8b0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f2ef80097d0 tx=0x7f2ef802b9c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4c505f3d2ff91382 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:14.226 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.227+0000 7f2efffff640 1 -- 172.21.15.196:0/785092069 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ef8034070 con 0x7f2f080c4860 2024-04-22T07:18:14.227 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.227+0000 7f2efffff640 1 -- 172.21.15.196:0/785092069 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ef8030880 con 0x7f2f080c4860 2024-04-22T07:18:14.227 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.227+0000 7f2efffff640 1 -- 172.21.15.196:0/785092069 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ef8030c50 con 0x7f2f080c4860 2024-04-22T07:18:14.227 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.228+0000 7f2f0f8d2640 1 -- 172.21.15.196:0/785092069 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2f080c4860 msgr2=0x7f2f080ce8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:14.227 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.228+0000 7f2f0f8d2640 1 --2- 172.21.15.196:0/785092069 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2f080c4860 0x7f2f080ce8b0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f2ef80097d0 tx=0x7f2ef802b9c0 comp rx=0 tx=0).stop 2024-04-22T07:18:14.227 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.228+0000 7f2f0f8d2640 1 -- 172.21.15.196:0/785092069 shutdown_connections 2024-04-22T07:18:14.227 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.228+0000 7f2f0f8d2640 1 --2- 172.21.15.196:0/785092069 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2f080c4860 0x7f2f080ce8b0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:14.227 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.228+0000 7f2f0f8d2640 1 -- 172.21.15.196:0/785092069 >> 172.21.15.196:0/785092069 conn(0x7f2f08071680 msgr2=0x7f2f08071a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:14.227 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.228+0000 7f2f0f8d2640 1 -- 172.21.15.196:0/785092069 shutdown_connections 2024-04-22T07:18:14.227 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.228+0000 7f2f0f8d2640 1 -- 172.21.15.196:0/785092069 wait complete. 2024-04-22T07:18:14.227 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.229+0000 7f2f0f8d2640 1 Processor -- start 2024-04-22T07:18:14.227 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.229+0000 7f2f0f8d2640 1 -- start start 2024-04-22T07:18:14.228 INFO:tasks.ceph.mgr.y.smithi037.stderr:2024-04-22T07:18:14.228+0000 7fb53ac12040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-22T07:18:14.230 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.230+0000 7f2f0f8d2640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2f080c3540 0x7f2f080cd480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:14.230 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.230+0000 7f2f0f8d2640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2f080c4860 0x7f2f081f0e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:14.230 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.230+0000 7f2f0f8d2640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2f08156300 0x7f2f081f1390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:14.230 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.230+0000 7f2f0f8d2640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f2f081566e0 con 0x7f2f08156300 2024-04-22T07:18:14.230 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.230+0000 7f2f0f8d2640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f2f080c3a80 con 0x7f2f080c4860 2024-04-22T07:18:14.230 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.230+0000 7f2f0f8d2640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f2f0815c9b0 con 0x7f2f080c3540 2024-04-22T07:18:14.230 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.230+0000 7f2f0d66e640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2f080c3540 0x7f2f080cd480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:14.230 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.230+0000 7f2f0ce6d640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2f080c4860 0x7f2f081f0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:14.230 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.230+0000 7f2f0d66e640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2f080c3540 0x7f2f080cd480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.196:36446/0 (socket says 172.21.15.196:36446) 2024-04-22T07:18:14.231 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.230+0000 7f2f0d66e640 1 -- 172.21.15.196:0/367296480 learned_addr learned my addr 172.21.15.196:0/367296480 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-04-22T07:18:14.231 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.230+0000 7f2f0ce6d640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2f080c4860 0x7f2f081f0e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:56754/0 (socket says 172.21.15.196:56754) 2024-04-22T07:18:14.231 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.230+0000 7f2f0de6f640 1 --2- 172.21.15.196:0/367296480 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2f08156300 0x7f2f081f1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:14.231 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.230+0000 7f2f0ce6d640 1 -- 172.21.15.196:0/367296480 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2f080c3540 msgr2=0x7f2f080cd480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:14.231 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.230+0000 7f2f0ce6d640 1 --2- 172.21.15.196:0/367296480 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2f080c3540 0x7f2f080cd480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:14.231 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.230+0000 7f2f0ce6d640 1 -- 172.21.15.196:0/367296480 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2f08156300 msgr2=0x7f2f081f1390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:14.231 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.230+0000 7f2f0ce6d640 1 --2- 172.21.15.196:0/367296480 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2f08156300 0x7f2f081f1390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:14.231 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.230+0000 7f2f0ce6d640 1 -- 172.21.15.196:0/367296480 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f0815b540 con 0x7f2f080c4860 2024-04-22T07:18:14.231 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.230+0000 7f2f0d66e640 1 --2- 172.21.15.196:0/367296480 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2f080c3540 0x7f2f080cd480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-22T07:18:14.231 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.230+0000 7f2f0ce6d640 1 --2- 172.21.15.196:0/367296480 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2f080c4860 0x7f2f081f0e50 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f2ef8033000 tx=0x7f2ef80046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:14.231 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.230+0000 7f2efdffb640 1 -- 172.21.15.196:0/367296480 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ef8047070 con 0x7f2f080c4860 2024-04-22T07:18:14.231 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.230+0000 7f2efdffb640 1 -- 172.21.15.196:0/367296480 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ef8030680 con 0x7f2f080c4860 2024-04-22T07:18:14.231 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.230+0000 7f2f0f8d2640 1 -- 172.21.15.196:0/367296480 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f081f40f0 con 0x7f2f080c4860 2024-04-22T07:18:14.231 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.230+0000 7f2efdffb640 1 -- 172.21.15.196:0/367296480 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ef8034040 con 0x7f2f080c4860 2024-04-22T07:18:14.232 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.231+0000 7f2f0f8d2640 1 -- 172.21.15.196:0/367296480 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f081f4670 con 0x7f2f080c4860 2024-04-22T07:18:14.232 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.231+0000 7f2efdffb640 1 -- 172.21.15.196:0/367296480 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f2ef804a070 con 0x7f2f080c4860 2024-04-22T07:18:14.232 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.231+0000 7f2efdffb640 1 -- 172.21.15.196:0/367296480 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7f2ef802f9c0 con 0x7f2f080c4860 2024-04-22T07:18:14.232 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.232+0000 7f2f0f8d2640 1 -- 172.21.15.196:0/367296480 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f08068b20 con 0x7f2f080c4860 2024-04-22T07:18:14.233 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.235+0000 7f2efdffb640 1 -- 172.21.15.196:0/367296480 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f2ef8051070 con 0x7f2f080c4860 2024-04-22T07:18:14.233 INFO:tasks.ceph.mgr.x.smithi196.stderr:2024-04-22T07:18:14.236+0000 7f987822d040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-22T07:18:14.305 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.307+0000 7f2f0f8d2640 1 -- 172.21.15.196:0/367296480 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "osd new", "uuid": "1b239c7e-2504-42e0-b308-70f4e62519c8", "id": 6} v 0) -- 0x7f2f080c9690 con 0x7f2f080c4860 2024-04-22T07:18:14.311 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.313+0000 7f2efdffb640 1 -- 172.21.15.196:0/367296480 <== mon.1 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "1b239c7e-2504-42e0-b308-70f4e62519c8", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7f2f0815b540 con 0x7f2f080c4860 2024-04-22T07:18:14.311 INFO:teuthology.orchestra.run.smithi196.stdout:6 2024-04-22T07:18:14.312 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.314+0000 7f2f0f8d2640 1 -- 172.21.15.196:0/367296480 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2f080c4860 msgr2=0x7f2f081f0e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:14.312 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.314+0000 7f2f0f8d2640 1 --2- 172.21.15.196:0/367296480 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2f080c4860 0x7f2f081f0e50 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f2ef8033000 tx=0x7f2ef80046c0 comp rx=0 tx=0).stop 2024-04-22T07:18:14.312 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.314+0000 7f2f0f8d2640 1 -- 172.21.15.196:0/367296480 shutdown_connections 2024-04-22T07:18:14.312 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.314+0000 7f2f0f8d2640 1 --2- 172.21.15.196:0/367296480 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2f08156300 0x7f2f081f1390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:14.312 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.314+0000 7f2f0f8d2640 1 --2- 172.21.15.196:0/367296480 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2f080c4860 0x7f2f081f0e50 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:14.312 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.314+0000 7f2f0f8d2640 1 --2- 172.21.15.196:0/367296480 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2f080c3540 0x7f2f080cd480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:14.312 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.314+0000 7f2f0f8d2640 1 -- 172.21.15.196:0/367296480 >> 172.21.15.196:0/367296480 conn(0x7f2f08071680 msgr2=0x7f2f08071a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:14.312 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.314+0000 7f2f0f8d2640 1 -- 172.21.15.196:0/367296480 shutdown_connections 2024-04-22T07:18:14.312 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.314+0000 7f2f0f8d2640 1 -- 172.21.15.196:0/367296480 wait complete. 2024-04-22T07:18:14.323 DEBUG:teuthology.orchestra.run.smithi196:> sudo ceph --cluster ceph osd new 084318d4-d1fd-4b58-8c33-b1d7856fe323 7 2024-04-22T07:18:14.343 INFO:tasks.ceph.mgr.y.smithi037.stderr:2024-04-22T07:18:14.346+0000 7fb53ac12040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-22T07:18:14.352 INFO:tasks.ceph.mgr.x.smithi196.stderr:2024-04-22T07:18:14.354+0000 7f987822d040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-22T07:18:14.420 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.423+0000 7f38d60d2640 1 Processor -- start 2024-04-22T07:18:14.420 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.423+0000 7f38d60d2640 1 -- start start 2024-04-22T07:18:14.421 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.423+0000 7f38d60d2640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f38d00c4860 0x7f38d015c310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:14.422 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.423+0000 7f38d60d2640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38d0156750 con 0x7f38d0156370 2024-04-22T07:18:14.422 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.423+0000 7f38d60d2640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38d00c9410 con 0x7f38d00c8f20 2024-04-22T07:18:14.422 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.423+0000 7f38d60d2640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f38d00ca130 con 0x7f38d00c4860 2024-04-22T07:18:14.422 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.423+0000 7f38cffff640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f38d00c4860 0x7f38d015c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:14.422 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.423+0000 7f38ceffd640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7f38d00c8f20 0x7f38d00ce8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.196:38502/0 (socket says 172.21.15.196:38502) 2024-04-22T07:18:14.422 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.424+0000 7f38ceffd640 1 -- 172.21.15.196:0/1115583857 learned_addr learned my addr 172.21.15.196:0/1115583857 (peer_addr_for_me v1:172.21.15.196:0/0) 2024-04-22T07:18:14.422 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.424+0000 7f38ce7fc640 1 -- 172.21.15.196:0/1115583857 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1051824943 0 0) 0x7f38d00c9410 con 0x7f38d00c8f20 2024-04-22T07:18:14.422 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.424+0000 7f38cffff640 1 -- 172.21.15.196:0/1115583857 >> v1:172.21.15.196:6789/0 conn(0x7f38d00c8f20 legacy=0x7f38d00ce8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:14.422 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.424+0000 7f38cffff640 1 -- 172.21.15.196:0/1115583857 >> v1:172.21.15.37:6789/0 conn(0x7f38d0156370 legacy=0x7f38d00c3540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:14.422 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.424+0000 7f38cffff640 1 -- 172.21.15.196:0/1115583857 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38d00ca380 con 0x7f38d00c4860 2024-04-22T07:18:14.423 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.425+0000 7f38cffff640 1 --2- 172.21.15.196:0/1115583857 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f38d00c4860 0x7f38d015c310 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f38c8009dc0 tx=0x7f38c802bf20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=890e2c33deb9bb29 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:14.423 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.425+0000 7f38ce7fc640 1 -- 172.21.15.196:0/1115583857 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38c8039070 con 0x7f38d00c4860 2024-04-22T07:18:14.424 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.425+0000 7f38ce7fc640 1 -- 172.21.15.196:0/1115583857 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38c802ccd0 con 0x7f38d00c4860 2024-04-22T07:18:14.424 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.425+0000 7f38ce7fc640 1 -- 172.21.15.196:0/1115583857 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38c8034660 con 0x7f38d00c4860 2024-04-22T07:18:14.424 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.425+0000 7f38d60d2640 1 -- 172.21.15.196:0/1115583857 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f38d00c4860 msgr2=0x7f38d015c310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:14.424 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.425+0000 7f38d60d2640 1 --2- 172.21.15.196:0/1115583857 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f38d00c4860 0x7f38d015c310 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f38c8009dc0 tx=0x7f38c802bf20 comp rx=0 tx=0).stop 2024-04-22T07:18:14.424 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.425+0000 7f38d60d2640 1 -- 172.21.15.196:0/1115583857 shutdown_connections 2024-04-22T07:18:14.424 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.425+0000 7f38d60d2640 1 --2- 172.21.15.196:0/1115583857 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f38d00c4860 0x7f38d015c310 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:14.424 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.425+0000 7f38d60d2640 1 -- 172.21.15.196:0/1115583857 >> 172.21.15.196:0/1115583857 conn(0x7f38d00676b0 msgr2=0x7f38d0067ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:14.424 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.425+0000 7f38d60d2640 1 -- 172.21.15.196:0/1115583857 shutdown_connections 2024-04-22T07:18:14.424 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.425+0000 7f38d60d2640 1 -- 172.21.15.196:0/1115583857 wait complete. 2024-04-22T07:18:14.426 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.426+0000 7f38d60d2640 1 Processor -- start 2024-04-22T07:18:14.426 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.427+0000 7f38d60d2640 1 -- start start 2024-04-22T07:18:14.427 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.427+0000 7f38d60d2640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f38d00c4860 0x7f38d00aeb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:14.427 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.427+0000 7f38d60d2640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f38d00c8f20 0x7f38d006d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:14.427 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.427+0000 7f38d60d2640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f38d0156370 0x7f38d0152d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:14.427 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.427+0000 7f38d60d2640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f38d00ca940 con 0x7f38d00c8f20 2024-04-22T07:18:14.427 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.427+0000 7f38d60d2640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f38d00cacb0 con 0x7f38d0156370 2024-04-22T07:18:14.427 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.427+0000 7f38d60d2640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f38d00cf000 con 0x7f38d00c4860 2024-04-22T07:18:14.427 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.427+0000 7f38cffff640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f38d0156370 0x7f38d0152d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:14.427 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.427+0000 7f38cf7fe640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f38d00c4860 0x7f38d00aeb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:14.427 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.427+0000 7f38cffff640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f38d0156370 0x7f38d0152d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:56764/0 (socket says 172.21.15.196:56764) 2024-04-22T07:18:14.428 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.427+0000 7f38cffff640 1 -- 172.21.15.196:0/938980585 learned_addr learned my addr 172.21.15.196:0/938980585 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-04-22T07:18:14.428 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.428+0000 7f38ceffd640 1 --2- 172.21.15.196:0/938980585 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f38d00c8f20 0x7f38d006d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:14.428 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.428+0000 7f38cf7fe640 1 -- 172.21.15.196:0/938980585 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f38d0156370 msgr2=0x7f38d0152d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:14.428 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.428+0000 7f38cf7fe640 1 --2- 172.21.15.196:0/938980585 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f38d0156370 0x7f38d0152d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:14.428 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.428+0000 7f38cf7fe640 1 -- 172.21.15.196:0/938980585 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f38d00c8f20 msgr2=0x7f38d006d350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:14.428 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.428+0000 7f38cf7fe640 1 --2- 172.21.15.196:0/938980585 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f38d00c8f20 0x7f38d006d350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:14.428 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.428+0000 7f38cf7fe640 1 -- 172.21.15.196:0/938980585 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38d006c600 con 0x7f38d00c4860 2024-04-22T07:18:14.428 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.428+0000 7f38cffff640 1 --2- 172.21.15.196:0/938980585 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f38d0156370 0x7f38d0152d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-22T07:18:14.428 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.428+0000 7f38cf7fe640 1 --2- 172.21.15.196:0/938980585 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f38d00c4860 0x7f38d00aeb00 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f38c000c390 tx=0x7f38c000c850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:14.428 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.428+0000 7f38b7fff640 1 -- 172.21.15.196:0/938980585 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38c0017070 con 0x7f38d00c4860 2024-04-22T07:18:14.428 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.428+0000 7f38b7fff640 1 -- 172.21.15.196:0/938980585 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38c00052d0 con 0x7f38d00c4860 2024-04-22T07:18:14.428 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.428+0000 7f38b7fff640 1 -- 172.21.15.196:0/938980585 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38c0003830 con 0x7f38d00c4860 2024-04-22T07:18:14.429 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.428+0000 7f38d60d2640 1 -- 172.21.15.196:0/938980585 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38d01592e0 con 0x7f38d00c4860 2024-04-22T07:18:14.429 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.428+0000 7f38d60d2640 1 -- 172.21.15.196:0/938980585 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f38d01598a0 con 0x7f38d00c4860 2024-04-22T07:18:14.429 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.428+0000 7f38b7fff640 1 -- 172.21.15.196:0/938980585 <== mon.2 v2:172.21.15.196:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f38c001a070 con 0x7f38d00c4860 2024-04-22T07:18:14.429 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.428+0000 7f38b7fff640 1 -- 172.21.15.196:0/938980585 <== mon.2 v2:172.21.15.196:3301/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7f38c0011b30 con 0x7f38d00c4860 2024-04-22T07:18:14.429 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.429+0000 7f38d60d2640 1 -- 172.21.15.196:0/938980585 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38d0068b20 con 0x7f38d00c4860 2024-04-22T07:18:14.429 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.431+0000 7f38b7fff640 1 -- 172.21.15.196:0/938980585 <== mon.2 v2:172.21.15.196:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f38c0021080 con 0x7f38d00c4860 2024-04-22T07:18:14.502 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.505+0000 7f38d60d2640 1 -- 172.21.15.196:0/938980585 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "osd new", "uuid": "084318d4-d1fd-4b58-8c33-b1d7856fe323", "id": 7} v 0) -- 0x7f38d00c97b0 con 0x7f38d00c4860 2024-04-22T07:18:14.508 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.511+0000 7f38b7fff640 1 -- 172.21.15.196:0/938980585 <== mon.2 v2:172.21.15.196:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "084318d4-d1fd-4b58-8c33-b1d7856fe323", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7f38c0011d80 con 0x7f38d00c4860 2024-04-22T07:18:14.508 INFO:teuthology.orchestra.run.smithi196.stdout:7 2024-04-22T07:18:14.509 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.512+0000 7f38d60d2640 1 -- 172.21.15.196:0/938980585 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f38d00c4860 msgr2=0x7f38d00aeb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:14.510 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.512+0000 7f38d60d2640 1 --2- 172.21.15.196:0/938980585 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f38d00c4860 0x7f38d00aeb00 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f38c000c390 tx=0x7f38c000c850 comp rx=0 tx=0).stop 2024-04-22T07:18:14.510 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.512+0000 7f38d60d2640 1 -- 172.21.15.196:0/938980585 shutdown_connections 2024-04-22T07:18:14.510 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.512+0000 7f38d60d2640 1 --2- 172.21.15.196:0/938980585 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f38d0156370 0x7f38d0152d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:14.510 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.512+0000 7f38d60d2640 1 --2- 172.21.15.196:0/938980585 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f38d00c8f20 0x7f38d006d350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:14.510 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.512+0000 7f38d60d2640 1 --2- 172.21.15.196:0/938980585 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f38d00c4860 0x7f38d00aeb00 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:14.510 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.512+0000 7f38d60d2640 1 -- 172.21.15.196:0/938980585 >> 172.21.15.196:0/938980585 conn(0x7f38d00676b0 msgr2=0x7f38d00c3540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:14.510 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.512+0000 7f38d60d2640 1 -- 172.21.15.196:0/938980585 shutdown_connections 2024-04-22T07:18:14.510 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-22T07:18:14.512+0000 7f38d60d2640 1 -- 172.21.15.196:0/938980585 wait complete. 2024-04-22T07:18:14.520 INFO:tasks.ceph.osd.0:Restarting daemon 2024-04-22T07:18:14.520 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-04-22T07:18:14.522 INFO:tasks.ceph.osd.0:Started 2024-04-22T07:18:14.522 INFO:tasks.ceph.osd.1:Restarting daemon 2024-04-22T07:18:14.523 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-04-22T07:18:14.524 INFO:tasks.ceph.osd.1:Started 2024-04-22T07:18:14.525 INFO:tasks.ceph.osd.2:Restarting daemon 2024-04-22T07:18:14.525 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-04-22T07:18:14.527 INFO:tasks.ceph.osd.2:Started 2024-04-22T07:18:14.527 INFO:tasks.ceph.osd.3:Restarting daemon 2024-04-22T07:18:14.527 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-04-22T07:18:14.529 INFO:tasks.ceph.osd.3:Started 2024-04-22T07:18:14.530 INFO:tasks.ceph.osd.4:Restarting daemon 2024-04-22T07:18:14.530 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-04-22T07:18:14.562 INFO:tasks.ceph.osd.4:Started 2024-04-22T07:18:14.563 INFO:tasks.ceph.osd.5:Restarting daemon 2024-04-22T07:18:14.563 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-04-22T07:18:14.565 INFO:tasks.ceph.osd.5:Started 2024-04-22T07:18:14.565 INFO:tasks.ceph.osd.6:Restarting daemon 2024-04-22T07:18:14.565 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-04-22T07:18:14.567 INFO:tasks.ceph.osd.6:Started 2024-04-22T07:18:14.567 INFO:tasks.ceph.osd.7:Restarting daemon 2024-04-22T07:18:14.567 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-04-22T07:18:14.570 INFO:tasks.ceph.osd.7:Started 2024-04-22T07:18:14.570 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-22T07:18:14.695 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:14.697+0000 7fb4e96f1640 1 Processor -- start 2024-04-22T07:18:14.695 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:14.697+0000 7fb4e96f1640 1 -- start start 2024-04-22T07:18:14.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:14.698+0000 7fb4e96f1640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb4e40c3610 0x7fb4e40c8ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:14.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:14.698+0000 7fb4e96f1640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fb4e406ffe0 0x7fb4e40c3d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:14.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:14.698+0000 7fb4e96f1640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb4e40ca100 con 0x7fb4e4152e50 2024-04-22T07:18:14.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:14.698+0000 7fb4e96f1640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7fb4e40c94f0 con 0x7fb4e406ffe0 2024-04-22T07:18:14.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:14.698+0000 7fb4e96f1640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fb4e40ca6c0 con 0x7fb4e40c3610 2024-04-22T07:18:14.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:14.698+0000 7fb4e2ffd640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fb4e4152e50 0x7fb4e4159440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:38280/0 (socket says 172.21.15.37:38280) 2024-04-22T07:18:14.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:14.698+0000 7fb4e2ffd640 1 -- 172.21.15.37:0/579390739 learned_addr learned my addr 172.21.15.37:0/579390739 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-04-22T07:18:14.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:14.698+0000 7fb4e37fe640 1 --2- 172.21.15.37:0/579390739 >> v2:172.21.15.196:3300/0 conn(0x7fb4e406ffe0 0x7fb4e40c3d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:14.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:14.698+0000 7fb4e27fc640 1 --2- 172.21.15.37:0/579390739 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb4e40c3610 0x7fb4e40c8ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:14.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:14.698+0000 7fb4e1ffb640 1 -- 172.21.15.37:0/579390739 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4133187107 0 0) 0x7fb4e40ca100 con 0x7fb4e4152e50 2024-04-22T07:18:14.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:14.698+0000 7fb4e1ffb640 1 -- 172.21.15.37:0/579390739 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb4cc003520 con 0x7fb4e4152e50 2024-04-22T07:18:14.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:14.699+0000 7fb4e37fe640 1 -- 172.21.15.37:0/579390739 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb4e40c3610 msgr2=0x7fb4e40c8ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:18:14.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:14.699+0000 7fb4e37fe640 1 --2- 172.21.15.37:0/579390739 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb4e40c3610 0x7fb4e40c8ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:14.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:14.699+0000 7fb4e37fe640 1 -- 172.21.15.37:0/579390739 >> v1:172.21.15.37:6789/0 conn(0x7fb4e4152e50 legacy=0x7fb4e4159440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:14.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:14.699+0000 7fb4e37fe640 1 -- 172.21.15.37:0/579390739 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4e40ca3e0 con 0x7fb4e406ffe0 2024-04-22T07:18:14.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:14.699+0000 7fb4e37fe640 1 --2- 172.21.15.37:0/579390739 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb4e406ffe0 0x7fb4e40c3d20 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fb4d4009d90 tx=0x7fb4d402be10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9a63fe444c06f736 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:14.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:14.700+0000 7fb4e1ffb640 1 -- 172.21.15.37:0/579390739 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4d4039070 con 0x7fb4e406ffe0 2024-04-22T07:18:14.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:14.700+0000 7fb4e1ffb640 1 -- 172.21.15.37:0/579390739 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4d402cbc0 con 0x7fb4e406ffe0 2024-04-22T07:18:14.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:14.700+0000 7fb4e1ffb640 1 -- 172.21.15.37:0/579390739 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4d4034440 con 0x7fb4e406ffe0 2024-04-22T07:18:14.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:14.700+0000 7fb4e96f1640 1 -- 172.21.15.37:0/579390739 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb4e406ffe0 msgr2=0x7fb4e40c3d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:14.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:14.700+0000 7fb4e96f1640 1 --2- 172.21.15.37:0/579390739 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb4e406ffe0 0x7fb4e40c3d20 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fb4d4009d90 tx=0x7fb4d402be10 comp rx=0 tx=0).stop 2024-04-22T07:18:14.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:14.700+0000 7fb4e96f1640 1 -- 172.21.15.37:0/579390739 shutdown_connections 2024-04-22T07:18:14.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:14.700+0000 7fb4e96f1640 1 --2- 172.21.15.37:0/579390739 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb4e406ffe0 0x7fb4e40c3d20 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:14.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:14.700+0000 7fb4e96f1640 1 --2- 172.21.15.37:0/579390739 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb4e40c3610 0x7fb4e40c8ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:14.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:14.700+0000 7fb4e96f1640 1 -- 172.21.15.37:0/579390739 >> 172.21.15.37:0/579390739 conn(0x7fb4e40715d0 msgr2=0x7fb4e40719b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:14.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:14.700+0000 7fb4e96f1640 1 -- 172.21.15.37:0/579390739 shutdown_connections 2024-04-22T07:18:14.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:14.700+0000 7fb4e96f1640 1 -- 172.21.15.37:0/579390739 wait complete. 2024-04-22T07:18:14.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:14.701+0000 7fb4e96f1640 1 Processor -- start 2024-04-22T07:18:14.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:14.702+0000 7fb4e96f1640 1 -- start start 2024-04-22T07:18:14.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:14.702+0000 7fb4e96f1640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb4e406ffe0 0x7fb4e406d550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:14.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:14.702+0000 7fb4e96f1640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb4e40c3610 0x7fb4e41f1190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:14.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:14.702+0000 7fb4e96f1640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb4e4152e50 0x7fb4e415ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:14.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:14.702+0000 7fb4e96f1640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fb4e40ca8e0 con 0x7fb4e40c3610 2024-04-22T07:18:14.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:14.702+0000 7fb4e96f1640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fb4e406fac0 con 0x7fb4e4152e50 2024-04-22T07:18:14.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:14.702+0000 7fb4e96f1640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fb4e40caa60 con 0x7fb4e406ffe0 2024-04-22T07:18:14.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:14.702+0000 7fb4e27fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb4e40c3610 0x7fb4e41f1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:14.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:14.702+0000 7fb4e27fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb4e40c3610 0x7fb4e41f1190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57340/0 (socket says 172.21.15.37:57340) 2024-04-22T07:18:14.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:14.702+0000 7fb4e27fc640 1 -- 172.21.15.37:0/565449801 learned_addr learned my addr 172.21.15.37:0/565449801 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:18:14.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:14.702+0000 7fb4e37fe640 1 --2- 172.21.15.37:0/565449801 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb4e4152e50 0x7fb4e415ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:14.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:14.702+0000 7fb4e2ffd640 1 --2- 172.21.15.37:0/565449801 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb4e406ffe0 0x7fb4e406d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:14.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:14.703+0000 7fb4e27fc640 1 -- 172.21.15.37:0/565449801 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb4e406ffe0 msgr2=0x7fb4e406d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:14.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:14.703+0000 7fb4e27fc640 1 --2- 172.21.15.37:0/565449801 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb4e406ffe0 0x7fb4e406d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:14.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:14.703+0000 7fb4e27fc640 1 -- 172.21.15.37:0/565449801 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb4e4152e50 msgr2=0x7fb4e415ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:14.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:14.703+0000 7fb4e27fc640 1 --2- 172.21.15.37:0/565449801 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb4e4152e50 0x7fb4e415ba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:14.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:14.703+0000 7fb4e27fc640 1 -- 172.21.15.37:0/565449801 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4e406cfd0 con 0x7fb4e40c3610 2024-04-22T07:18:14.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:14.703+0000 7fb4e27fc640 1 --2- 172.21.15.37:0/565449801 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb4e40c3610 0x7fb4e41f1190 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fb4d800e9e0 tx=0x7fb4d800eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:14.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:14.703+0000 7fb4cb7fe640 1 -- 172.21.15.37:0/565449801 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4d8017070 con 0x7fb4e40c3610 2024-04-22T07:18:14.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:14.703+0000 7fb4cb7fe640 1 -- 172.21.15.37:0/565449801 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4d800c9d0 con 0x7fb4e40c3610 2024-04-22T07:18:14.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:14.703+0000 7fb4e96f1640 1 -- 172.21.15.37:0/565449801 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4e406d270 con 0x7fb4e40c3610 2024-04-22T07:18:14.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:14.703+0000 7fb4cb7fe640 1 -- 172.21.15.37:0/565449801 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4d800cdc0 con 0x7fb4e40c3610 2024-04-22T07:18:14.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:14.703+0000 7fb4e96f1640 1 -- 172.21.15.37:0/565449801 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4e406be60 con 0x7fb4e40c3610 2024-04-22T07:18:14.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:14.703+0000 7fb4cb7fe640 1 -- 172.21.15.37:0/565449801 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fb4d801a070 con 0x7fb4e40c3610 2024-04-22T07:18:14.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:14.703+0000 7fb4cb7fe640 1 -- 172.21.15.37:0/565449801 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7fb4d8006660 con 0x7fb4e40c3610 2024-04-22T07:18:14.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:14.704+0000 7fb4e96f1640 1 -- 172.21.15.37:0/565449801 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb4e406b970 con 0x7fb4e40c3610 2024-04-22T07:18:14.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:14.706+0000 7fb4cb7fe640 1 -- 172.21.15.37:0/565449801 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7fb4d8005990 con 0x7fb4e40c3610 2024-04-22T07:18:14.763 INFO:tasks.ceph.mgr.x.smithi196.stderr:2024-04-22T07:18:14.765+0000 7f987822d040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-22T07:18:14.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:14.769+0000 7fb4e96f1640 1 -- 172.21.15.37:0/565449801 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb4e4068b20 con 0x7fb4e40c3610 2024-04-22T07:18:14.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:14.770+0000 7fb4cb7fe640 1 -- 172.21.15.37:0/565449801 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7fb4d8005990 con 0x7fb4e40c3610 2024-04-22T07:18:14.767 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-22T07:18:14.768 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":10,"fsid":"10d90a41-52d3-4e09-8022-c8ac67897ad1","created":"2024-04-22T07:18:12.420756+0000","modified":"2024-04-22T07:18:14.506974+0000","last_up_change":"0.000000","last_in_change":"2024-04-22T07:18:14.506974+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"e248f6e1-13ad-48e0-a8f8-ec3059995654","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"01c71ab7-1326-432b-b73a-e5847abe5132","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"33a780fd-013a-41c8-9970-136c9e080897","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"b46e53c4-e5b9-4098-b243-ab5a0f1f3885","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"cd1032c6-6a83-4e33-b7b1-baddf92a83af","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"f561d48a-5f2d-4deb-8681-4329aed36bae","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"1b239c7e-2504-42e0-b308-70f4e62519c8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"084318d4-d1fd-4b58-8c33-b1d7856fe323","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-22T07:18:14.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:14.771+0000 7fb4e96f1640 1 -- 172.21.15.37:0/565449801 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb4e40c3610 msgr2=0x7fb4e41f1190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:14.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:14.771+0000 7fb4e96f1640 1 --2- 172.21.15.37:0/565449801 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb4e40c3610 0x7fb4e41f1190 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fb4d800e9e0 tx=0x7fb4d800eea0 comp rx=0 tx=0).stop 2024-04-22T07:18:14.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:14.771+0000 7fb4e96f1640 1 -- 172.21.15.37:0/565449801 shutdown_connections 2024-04-22T07:18:14.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:14.771+0000 7fb4e96f1640 1 --2- 172.21.15.37:0/565449801 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb4e4152e50 0x7fb4e415ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:14.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:14.771+0000 7fb4e96f1640 1 --2- 172.21.15.37:0/565449801 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb4e40c3610 0x7fb4e41f1190 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:14.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:14.771+0000 7fb4e96f1640 1 --2- 172.21.15.37:0/565449801 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb4e406ffe0 0x7fb4e406d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:14.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:14.771+0000 7fb4e96f1640 1 -- 172.21.15.37:0/565449801 >> 172.21.15.37:0/565449801 conn(0x7fb4e40715d0 msgr2=0x7fb4e4150e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:14.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:14.771+0000 7fb4e96f1640 1 -- 172.21.15.37:0/565449801 shutdown_connections 2024-04-22T07:18:14.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:14.771+0000 7fb4e96f1640 1 -- 172.21.15.37:0/565449801 wait complete. 2024-04-22T07:18:14.770 INFO:tasks.ceph.mgr.y.smithi037.stderr:2024-04-22T07:18:14.772+0000 7fb53ac12040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-22T07:18:14.779 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-04-22T07:18:14.780 INFO:tasks.ceph:Waiting for OSDs to come up 2024-04-22T07:18:15.022 INFO:tasks.ceph.mgr.x.smithi196.stderr:2024-04-22T07:18:15.024+0000 7f987822d040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-22T07:18:15.041 INFO:tasks.ceph.mgr.y.smithi037.stderr:2024-04-22T07:18:15.044+0000 7fb53ac12040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-22T07:18:15.073 INFO:tasks.ceph.mgr.x.smithi196.stderr:2024-04-22T07:18:15.075+0000 7f987822d040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-22T07:18:15.096 INFO:tasks.ceph.mgr.y.smithi037.stderr:2024-04-22T07:18:15.098+0000 7fb53ac12040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-22T07:18:15.135 INFO:tasks.ceph.osd.0.smithi037.stderr:2024-04-22T07:18:15.137+0000 7f1961ff1640 -1 Falling back to public interface 2024-04-22T07:18:15.143 INFO:tasks.ceph.osd.1.smithi037.stderr:2024-04-22T07:18:15.145+0000 7f8f79c11640 -1 Falling back to public interface 2024-04-22T07:18:15.143 INFO:tasks.ceph.osd.3.smithi037.stderr:2024-04-22T07:18:15.145+0000 7f5d49a22640 -1 Falling back to public interface 2024-04-22T07:18:15.157 INFO:tasks.ceph.osd.2.smithi037.stderr:2024-04-22T07:18:15.159+0000 7feaf2405640 -1 Falling back to public interface 2024-04-22T07:18:15.158 INFO:tasks.ceph.osd.5.smithi196.stderr:2024-04-22T07:18:15.160+0000 7fcf883a5640 -1 Falling back to public interface 2024-04-22T07:18:15.172 INFO:tasks.ceph.osd.4.smithi196.stderr:2024-04-22T07:18:15.174+0000 7f4e19c0f640 -1 Falling back to public interface 2024-04-22T07:18:15.180 INFO:tasks.ceph.osd.7.smithi196.stderr:2024-04-22T07:18:15.182+0000 7fdcea411640 -1 Falling back to public interface 2024-04-22T07:18:15.180 INFO:tasks.ceph.osd.6.smithi196.stderr:2024-04-22T07:18:15.182+0000 7f5602f8e640 -1 Falling back to public interface 2024-04-22T07:18:15.189 INFO:tasks.ceph.mgr.x.smithi196.stderr:2024-04-22T07:18:15.192+0000 7f987822d040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-22T07:18:15.223 INFO:tasks.ceph.mgr.y.smithi037.stderr:2024-04-22T07:18:15.225+0000 7fb53ac12040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-22T07:18:15.470 INFO:tasks.ceph.mgr.x.smithi196.stderr:2024-04-22T07:18:15.472+0000 7f987822d040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-22T07:18:15.516 INFO:tasks.ceph.mgr.y.smithi037.stderr:2024-04-22T07:18:15.519+0000 7fb53ac12040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-22T07:18:15.517 INFO:tasks.ceph.mgr.x.smithi196.stderr:2024-04-22T07:18:15.520+0000 7f987822d040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-22T07:18:15.566 INFO:tasks.ceph.mgr.y.smithi037.stderr:2024-04-22T07:18:15.568+0000 7fb53ac12040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-22T07:18:15.584 DEBUG:teuthology.orchestra.run.smithi037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-22T07:18:15.672 INFO:tasks.ceph.mgr.x.smithi196.stderr:2024-04-22T07:18:15.674+0000 7f987822d040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-22T07:18:15.676 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:15.679+0000 7fe34926d640 1 Processor -- start 2024-04-22T07:18:15.676 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:15.679+0000 7fe34926d640 1 -- start start 2024-04-22T07:18:15.678 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:15.680+0000 7fe34926d640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fe344154c00 0x7fe3440b1e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:15.679 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:15.680+0000 7fe34926d640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe34406b920 0x7fe34406bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:15.679 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:15.680+0000 7fe34926d640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe34415adf0 con 0x7fe3440caa20 2024-04-22T07:18:15.679 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:15.680+0000 7fe34926d640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fe3440cd4d0 con 0x7fe34406b920 2024-04-22T07:18:15.679 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:15.680+0000 7fe34926d640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7fe3440cd7b0 con 0x7fe344154c00 2024-04-22T07:18:15.679 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:15.680+0000 7fe3437fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe34406b920 0x7fe34406bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:15.679 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:15.680+0000 7fe3437fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe34406b920 0x7fe34406bdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57346/0 (socket says 172.21.15.37:57346) 2024-04-22T07:18:15.679 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:15.680+0000 7fe3437fe640 1 -- 172.21.15.37:0/3414093131 learned_addr learned my addr 172.21.15.37:0/3414093131 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:18:15.679 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:15.680+0000 7fe342ffd640 1 --2- 172.21.15.37:0/3414093131 >> v2:172.21.15.196:3300/0 conn(0x7fe344154c00 0x7fe3440b1e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:15.679 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:15.680+0000 7fe3437fe640 1 -- 172.21.15.37:0/3414093131 >> v2:172.21.15.196:3300/0 conn(0x7fe344154c00 msgr2=0x7fe3440b1e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:18:15.679 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:15.680+0000 7fe3437fe640 1 --2- 172.21.15.37:0/3414093131 >> v2:172.21.15.196:3300/0 conn(0x7fe344154c00 0x7fe3440b1e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:15.679 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:15.680+0000 7fe3437fe640 1 -- 172.21.15.37:0/3414093131 >> v1:172.21.15.196:6789/0 conn(0x7fe3440caa20 legacy=0x7fe34415b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:15.679 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:15.680+0000 7fe3437fe640 1 -- 172.21.15.37:0/3414093131 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe34415b090 con 0x7fe34406b920 2024-04-22T07:18:15.679 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:15.681+0000 7fe3437fe640 1 --2- 172.21.15.37:0/3414093131 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe34406b920 0x7fe34406bdb0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fe34406efe0 tx=0x7fe33c02bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3e58cfb5781e6dc server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:15.680 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:15.681+0000 7fe341ffb640 1 -- 172.21.15.37:0/3414093131 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe33c02cb20 con 0x7fe34406b920 2024-04-22T07:18:15.680 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:15.681+0000 7fe341ffb640 1 -- 172.21.15.37:0/3414093131 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe33c02ccc0 con 0x7fe34406b920 2024-04-22T07:18:15.680 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:15.681+0000 7fe341ffb640 1 -- 172.21.15.37:0/3414093131 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe33c034610 con 0x7fe34406b920 2024-04-22T07:18:15.681 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:15.682+0000 7fe34926d640 1 -- 172.21.15.37:0/3414093131 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe34406b920 msgr2=0x7fe34406bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:15.681 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:15.682+0000 7fe34926d640 1 --2- 172.21.15.37:0/3414093131 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe34406b920 0x7fe34406bdb0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fe34406efe0 tx=0x7fe33c02bf80 comp rx=0 tx=0).stop 2024-04-22T07:18:15.681 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:15.682+0000 7fe34926d640 1 -- 172.21.15.37:0/3414093131 shutdown_connections 2024-04-22T07:18:15.681 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:15.682+0000 7fe34926d640 1 --2- 172.21.15.37:0/3414093131 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe34406b920 0x7fe34406bdb0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:15.681 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:15.682+0000 7fe34926d640 1 --2- 172.21.15.37:0/3414093131 >> v2:172.21.15.196:3300/0 conn(0x7fe344154c00 0x7fe3440b1e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:15.681 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:15.682+0000 7fe34926d640 1 -- 172.21.15.37:0/3414093131 >> 172.21.15.37:0/3414093131 conn(0x7fe344070320 msgr2=0x7fe3440ccc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:15.681 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:15.682+0000 7fe34926d640 1 -- 172.21.15.37:0/3414093131 shutdown_connections 2024-04-22T07:18:15.681 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:15.682+0000 7fe34926d640 1 -- 172.21.15.37:0/3414093131 wait complete. 2024-04-22T07:18:15.681 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:15.683+0000 7fe34926d640 1 Processor -- start 2024-04-22T07:18:15.681 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:15.683+0000 7fe34926d640 1 -- start start 2024-04-22T07:18:15.684 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:15.684+0000 7fe34926d640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe34406b920 0x7fe3441f4160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:15.684 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:15.684+0000 7fe34926d640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe3440caa20 0x7fe3441f46a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:15.684 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:15.684+0000 7fe34926d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe344154c00 0x7fe3440727a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:15.684 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:15.684+0000 7fe34926d640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe34415e2d0 con 0x7fe344154c00 2024-04-22T07:18:15.684 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:15.684+0000 7fe34926d640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fe3440b23b0 con 0x7fe34406b920 2024-04-22T07:18:15.684 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:15.684+0000 7fe34926d640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fe34415e450 con 0x7fe3440caa20 2024-04-22T07:18:15.684 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:15.684+0000 7fe3437fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe344154c00 0x7fe3440727a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:15.684 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:15.684+0000 7fe3437fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe344154c00 0x7fe3440727a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57356/0 (socket says 172.21.15.37:57356) 2024-04-22T07:18:15.684 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:15.684+0000 7fe3437fe640 1 -- 172.21.15.37:0/2642872689 learned_addr learned my addr 172.21.15.37:0/2642872689 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:18:15.684 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:15.684+0000 7fe342ffd640 1 --2- 172.21.15.37:0/2642872689 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe34406b920 0x7fe3441f4160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:15.684 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:15.684+0000 7fe3427fc640 1 --2- 172.21.15.37:0/2642872689 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe3440caa20 0x7fe3441f46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:15.684 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:15.684+0000 7fe3437fe640 1 -- 172.21.15.37:0/2642872689 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe3440caa20 msgr2=0x7fe3441f46a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:15.685 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:15.684+0000 7fe3437fe640 1 --2- 172.21.15.37:0/2642872689 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe3440caa20 0x7fe3441f46a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:15.685 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:15.684+0000 7fe3437fe640 1 -- 172.21.15.37:0/2642872689 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe34406b920 msgr2=0x7fe3441f4160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:15.685 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:15.684+0000 7fe3437fe640 1 --2- 172.21.15.37:0/2642872689 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe34406b920 0x7fe3441f4160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:15.685 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:15.684+0000 7fe3437fe640 1 -- 172.21.15.37:0/2642872689 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe344159a50 con 0x7fe344154c00 2024-04-22T07:18:15.685 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:15.684+0000 7fe3437fe640 1 --2- 172.21.15.37:0/2642872689 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe344154c00 0x7fe3440727a0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fe33c009f40 tx=0x7fe33c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:15.685 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:15.685+0000 7fe32b7fe640 1 -- 172.21.15.37:0/2642872689 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe33c043020 con 0x7fe344154c00 2024-04-22T07:18:15.685 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:15.685+0000 7fe32b7fe640 1 -- 172.21.15.37:0/2642872689 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe33c03e450 con 0x7fe344154c00 2024-04-22T07:18:15.685 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:15.685+0000 7fe34926d640 1 -- 172.21.15.37:0/2642872689 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe344159d30 con 0x7fe344154c00 2024-04-22T07:18:15.685 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:15.685+0000 7fe32b7fe640 1 -- 172.21.15.37:0/2642872689 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe33c009510 con 0x7fe344154c00 2024-04-22T07:18:15.685 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:15.685+0000 7fe34926d640 1 -- 172.21.15.37:0/2642872689 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe34415bf10 con 0x7fe344154c00 2024-04-22T07:18:15.685 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:15.685+0000 7fe32b7fe640 1 -- 172.21.15.37:0/2642872689 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fe33c046020 con 0x7fe344154c00 2024-04-22T07:18:15.685 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:15.685+0000 7fe32b7fe640 1 -- 172.21.15.37:0/2642872689 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7fe33c048ad0 con 0x7fe344154c00 2024-04-22T07:18:15.685 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:15.686+0000 7fe34926d640 1 -- 172.21.15.37:0/2642872689 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe34404fce0 con 0x7fe344154c00 2024-04-22T07:18:15.686 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:15.688+0000 7fe32b7fe640 1 -- 172.21.15.37:0/2642872689 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7fe33c04d030 con 0x7fe344154c00 2024-04-22T07:18:15.734 INFO:tasks.ceph.mgr.y.smithi037.stderr:2024-04-22T07:18:15.736+0000 7fb53ac12040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-22T07:18:15.748 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:15.750+0000 7fe34926d640 1 -- 172.21.15.37:0/2642872689 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe3441586d0 con 0x7fe344154c00 2024-04-22T07:18:15.748 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:15.751+0000 7fe32b7fe640 1 -- 172.21.15.37:0/2642872689 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7fe33c02cb30 con 0x7fe344154c00 2024-04-22T07:18:15.749 INFO:teuthology.misc.health.smithi037.stdout: 2024-04-22T07:18:15.749 INFO:teuthology.misc.health.smithi037.stdout:{"epoch":10,"fsid":"10d90a41-52d3-4e09-8022-c8ac67897ad1","created":"2024-04-22T07:18:12.420756+0000","modified":"2024-04-22T07:18:14.506974+0000","last_up_change":"0.000000","last_in_change":"2024-04-22T07:18:14.506974+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"e248f6e1-13ad-48e0-a8f8-ec3059995654","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"01c71ab7-1326-432b-b73a-e5847abe5132","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"33a780fd-013a-41c8-9970-136c9e080897","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"b46e53c4-e5b9-4098-b243-ab5a0f1f3885","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"cd1032c6-6a83-4e33-b7b1-baddf92a83af","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"f561d48a-5f2d-4deb-8681-4329aed36bae","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"1b239c7e-2504-42e0-b308-70f4e62519c8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"084318d4-d1fd-4b58-8c33-b1d7856fe323","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-22T07:18:15.750 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:15.752+0000 7fe34926d640 1 -- 172.21.15.37:0/2642872689 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe344154c00 msgr2=0x7fe3440727a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:15.750 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:15.752+0000 7fe34926d640 1 --2- 172.21.15.37:0/2642872689 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe344154c00 0x7fe3440727a0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fe33c009f40 tx=0x7fe33c004a40 comp rx=0 tx=0).stop 2024-04-22T07:18:15.750 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:15.752+0000 7fe34926d640 1 -- 172.21.15.37:0/2642872689 shutdown_connections 2024-04-22T07:18:15.750 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:15.752+0000 7fe34926d640 1 --2- 172.21.15.37:0/2642872689 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe344154c00 0x7fe3440727a0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:15.750 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:15.752+0000 7fe34926d640 1 --2- 172.21.15.37:0/2642872689 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe3440caa20 0x7fe3441f46a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:15.750 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:15.752+0000 7fe34926d640 1 --2- 172.21.15.37:0/2642872689 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe34406b920 0x7fe3441f4160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:15.750 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:15.752+0000 7fe34926d640 1 -- 172.21.15.37:0/2642872689 >> 172.21.15.37:0/2642872689 conn(0x7fe344070320 msgr2=0x7fe34414fb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:15.750 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:15.752+0000 7fe34926d640 1 -- 172.21.15.37:0/2642872689 shutdown_connections 2024-04-22T07:18:15.750 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:15.752+0000 7fe34926d640 1 -- 172.21.15.37:0/2642872689 wait complete. 2024-04-22T07:18:15.759 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-04-22T07:18:15.810 INFO:tasks.ceph.mgr.x.smithi196.stderr:2024-04-22T07:18:15.813+0000 7f987822d040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-22T07:18:15.859 INFO:tasks.ceph.mgr.x.smithi196.stderr:2024-04-22T07:18:15.862+0000 7f987822d040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-22T07:18:15.879 INFO:tasks.ceph.mgr.y.smithi037.stderr:2024-04-22T07:18:15.881+0000 7fb53ac12040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-22T07:18:15.928 INFO:tasks.ceph.mgr.x.smithi196.stderr:2024-04-22T07:18:15.931+0000 7f987822d040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-22T07:18:15.931 INFO:tasks.ceph.mgr.y.smithi037.stderr:2024-04-22T07:18:15.933+0000 7fb53ac12040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-22T07:18:15.973 INFO:tasks.ceph.mgr.x.smithi196.stderr:2024-04-22T07:18:15.976+0000 7f987822d040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-22T07:18:16.004 INFO:tasks.ceph.mgr.y.smithi037.stderr:2024-04-22T07:18:16.006+0000 7fb53ac12040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-22T07:18:16.051 INFO:tasks.ceph.mgr.y.smithi037.stderr:2024-04-22T07:18:16.054+0000 7fb53ac12040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-22T07:18:16.452 INFO:tasks.ceph.mgr.x.smithi196.stderr:2024-04-22T07:18:16.454+0000 7f987822d040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-22T07:18:16.552 INFO:tasks.ceph.mgr.y.smithi037.stderr:2024-04-22T07:18:16.554+0000 7fb53ac12040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-22T07:18:16.569 INFO:tasks.ceph.mgr.x.smithi196.stderr:2024-04-22T07:18:16.571+0000 7f987822d040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-22T07:18:16.674 INFO:tasks.ceph.mgr.y.smithi037.stderr:2024-04-22T07:18:16.677+0000 7fb53ac12040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-22T07:18:17.585 INFO:tasks.ceph.mgr.x.smithi196.stderr:2024-04-22T07:18:17.587+0000 7f98186fc640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-04-22T07:18:17.585 INFO:tasks.ceph.mgr.x.smithi196.stderr:2024-04-22T07:18:17.588+0000 7f98186fc640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-04-22T07:18:18.601 INFO:tasks.ceph.osd.0.smithi037.stderr:2024-04-22T07:18:18.604+0000 7f1961ff1640 -1 osd.0 0 log_to_monitors true 2024-04-22T07:18:18.603 INFO:tasks.ceph.osd.5.smithi196.stderr:2024-04-22T07:18:18.605+0000 7fcf883a5640 -1 osd.5 0 log_to_monitors true 2024-04-22T07:18:18.642 INFO:tasks.ceph.osd.4.smithi196.stderr:2024-04-22T07:18:18.645+0000 7f4e19c0f640 -1 osd.4 0 log_to_monitors true 2024-04-22T07:18:18.658 INFO:tasks.ceph.osd.3.smithi037.stderr:2024-04-22T07:18:18.660+0000 7f5d49a22640 -1 osd.3 0 log_to_monitors true 2024-04-22T07:18:18.666 INFO:tasks.ceph.osd.1.smithi037.stderr:2024-04-22T07:18:18.669+0000 7f8f79c11640 -1 osd.1 0 log_to_monitors true 2024-04-22T07:18:18.668 INFO:tasks.ceph.osd.2.smithi037.stderr:2024-04-22T07:18:18.671+0000 7feaf2405640 -1 osd.2 0 log_to_monitors true 2024-04-22T07:18:18.685 INFO:tasks.ceph.osd.6.smithi196.stderr:2024-04-22T07:18:18.687+0000 7f5602f8e640 -1 osd.6 0 log_to_monitors true 2024-04-22T07:18:18.728 INFO:tasks.ceph.osd.7.smithi196.stderr:2024-04-22T07:18:18.731+0000 7fdcea411640 -1 osd.7 0 log_to_monitors true 2024-04-22T07:18:22.567 DEBUG:teuthology.orchestra.run.smithi037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-22T07:18:22.631 INFO:tasks.ceph.osd.5.smithi196.stderr:2024-04-22T07:18:22.634+0000 7fcf8433b640 -1 osd.5 0 waiting for initial osdmap 2024-04-22T07:18:22.644 INFO:tasks.ceph.osd.6.smithi196.stderr:2024-04-22T07:18:22.647+0000 7f55fef24640 -1 osd.6 0 waiting for initial osdmap 2024-04-22T07:18:22.645 INFO:tasks.ceph.osd.5.smithi196.stderr:2024-04-22T07:18:22.648+0000 7fcf7c15b640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-22T07:18:22.654 INFO:tasks.ceph.osd.1.smithi037.stderr:2024-04-22T07:18:22.656+0000 7f8f755aa640 -1 osd.1 0 waiting for initial osdmap 2024-04-22T07:18:22.658 INFO:tasks.ceph.osd.6.smithi196.stderr:2024-04-22T07:18:22.661+0000 7f55f6d44640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-22T07:18:22.665 INFO:tasks.ceph.osd.7.smithi196.stderr:2024-04-22T07:18:22.668+0000 7fdce651e640 -1 osd.7 0 waiting for initial osdmap 2024-04-22T07:18:22.669 INFO:tasks.ceph.osd.1.smithi037.stderr:2024-04-22T07:18:22.672+0000 7f8f6d3ca640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-22T07:18:22.680 INFO:tasks.ceph.osd.7.smithi196.stderr:2024-04-22T07:18:22.683+0000 7fdcddb2a640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-22T07:18:22.687 INFO:tasks.ceph.osd.4.smithi196.stderr:2024-04-22T07:18:22.689+0000 7f4e155ff640 -1 osd.4 0 waiting for initial osdmap 2024-04-22T07:18:22.702 INFO:tasks.ceph.osd.4.smithi196.stderr:2024-04-22T07:18:22.705+0000 7f4e0d41f640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-22T07:18:22.715 INFO:tasks.ceph.osd.2.smithi037.stderr:2024-04-22T07:18:22.718+0000 7feaee39b640 -1 osd.2 0 waiting for initial osdmap 2024-04-22T07:18:22.716 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:22.719+0000 7f918e0d2640 1 Processor -- start 2024-04-22T07:18:22.716 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:22.719+0000 7f918e0d2640 1 -- start start 2024-04-22T07:18:22.721 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:22.720+0000 7f918e0d2640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f9188071770 0x7f91880ca540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:22.721 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:22.720+0000 7f918e0d2640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f9188071b50 0x7f9188152a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:22.721 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:22.720+0000 7f918e0d2640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9188152fc0 0x7f9188158e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:22.721 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:22.720+0000 7f918e0d2640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f9188153400 con 0x7f9188071770 2024-04-22T07:18:22.721 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:22.720+0000 7f9186ffd640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f9188071b50 0x7f9188152a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:22.721 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:22.720+0000 7f9186ffd640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f9188071b50 0x7f9188152a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.37:53562/0 (socket says 172.21.15.37:53562) 2024-04-22T07:18:22.722 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:22.720+0000 7f9186ffd640 1 -- 172.21.15.37:0/582659227 learned_addr learned my addr 172.21.15.37:0/582659227 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:18:22.722 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:22.720+0000 7f9187fff640 1 --2- 172.21.15.37:0/582659227 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9188152fc0 0x7f9188158e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:22.722 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:22.721+0000 7f91877fe640 1 --2- 172.21.15.37:0/582659227 >> v2:172.21.15.37:3300/0 conn(0x7f9188071770 0x7f91880ca540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:22.722 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:22.721+0000 7f918e0d2640 1 -- 172.21.15.37:0/582659227 --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f91880c9de0 con 0x7f9188071b50 2024-04-22T07:18:22.722 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:22.721+0000 7f918e0d2640 1 -- 172.21.15.37:0/582659227 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f91880ca0c0 con 0x7f9188152fc0 2024-04-22T07:18:22.722 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:22.721+0000 7f9186ffd640 1 -- 172.21.15.37:0/582659227 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9188152fc0 msgr2=0x7f9188158e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:18:22.722 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:22.721+0000 7f9186ffd640 1 --2- 172.21.15.37:0/582659227 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9188152fc0 0x7f9188158e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:22.722 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:22.721+0000 7f9186ffd640 1 -- 172.21.15.37:0/582659227 >> v2:172.21.15.37:3300/0 conn(0x7f9188071770 msgr2=0x7f91880ca540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:18:22.722 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:22.721+0000 7f9186ffd640 1 --2- 172.21.15.37:0/582659227 >> v2:172.21.15.37:3300/0 conn(0x7f9188071770 0x7f91880ca540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:22.722 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:22.721+0000 7f9186ffd640 1 -- 172.21.15.37:0/582659227 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91880c3470 con 0x7f9188071b50 2024-04-22T07:18:22.722 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:22.721+0000 7f9187fff640 1 --2- 172.21.15.37:0/582659227 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9188152fc0 0x7f9188158e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-22T07:18:22.723 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:22.721+0000 7f91877fe640 1 --2- 172.21.15.37:0/582659227 >> v2:172.21.15.37:3300/0 conn(0x7f9188071770 0x7f91880ca540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-22T07:18:22.723 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:22.723+0000 7f9186ffd640 1 --2- 172.21.15.37:0/582659227 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9188071b50 0x7f9188152a80 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f91880c8e40 tx=0x7f917c02b9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=88c73caafda56246 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:22.723 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:22.723+0000 7f91867fc640 1 -- 172.21.15.37:0/582659227 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f917c034070 con 0x7f9188071b50 2024-04-22T07:18:22.723 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:22.723+0000 7f91867fc640 1 -- 172.21.15.37:0/582659227 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f917c030860 con 0x7f9188071b50 2024-04-22T07:18:22.723 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:22.723+0000 7f91867fc640 1 -- 172.21.15.37:0/582659227 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f917c030c30 con 0x7f9188071b50 2024-04-22T07:18:22.726 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:22.724+0000 7f918e0d2640 1 -- 172.21.15.37:0/582659227 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9188071b50 msgr2=0x7f9188152a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:22.726 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:22.724+0000 7f918e0d2640 1 --2- 172.21.15.37:0/582659227 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9188071b50 0x7f9188152a80 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f91880c8e40 tx=0x7f917c02b9a0 comp rx=0 tx=0).stop 2024-04-22T07:18:22.726 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:22.724+0000 7f918e0d2640 1 -- 172.21.15.37:0/582659227 shutdown_connections 2024-04-22T07:18:22.726 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:22.724+0000 7f918e0d2640 1 --2- 172.21.15.37:0/582659227 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9188152fc0 0x7f9188158e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:22.726 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:22.724+0000 7f918e0d2640 1 --2- 172.21.15.37:0/582659227 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9188071b50 0x7f9188152a80 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:22.726 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:22.724+0000 7f918e0d2640 1 --2- 172.21.15.37:0/582659227 >> v2:172.21.15.37:3300/0 conn(0x7f9188071770 0x7f91880ca540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:22.726 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:22.724+0000 7f918e0d2640 1 -- 172.21.15.37:0/582659227 >> 172.21.15.37:0/582659227 conn(0x7f9188062570 msgr2=0x7f918806f910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:22.726 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:22.724+0000 7f918e0d2640 1 -- 172.21.15.37:0/582659227 shutdown_connections 2024-04-22T07:18:22.727 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:22.724+0000 7f918e0d2640 1 -- 172.21.15.37:0/582659227 wait complete. 2024-04-22T07:18:22.727 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:22.725+0000 7f918e0d2640 1 Processor -- start 2024-04-22T07:18:22.727 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:22.726+0000 7f918e0d2640 1 -- start start 2024-04-22T07:18:22.727 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:22.726+0000 7f918e0d2640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9188071770 0x7f918814e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:22.727 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:22.726+0000 7f918e0d2640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9188071b50 0x7f918814e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:22.727 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:22.726+0000 7f918e0d2640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9188152fc0 0x7f91880c6ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:22.727 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:22.726+0000 7f918e0d2640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f91880c3d10 con 0x7f9188152fc0 2024-04-22T07:18:22.727 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:22.726+0000 7f918e0d2640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f91880c3a30 con 0x7f9188071770 2024-04-22T07:18:22.727 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:22.726+0000 7f918e0d2640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f91880c5510 con 0x7f9188071b50 2024-04-22T07:18:22.727 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:22.727+0000 7f9187fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9188152fc0 0x7f91880c6ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:22.727 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:22.727+0000 7f9187fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9188152fc0 0x7f91880c6ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34358/0 (socket says 172.21.15.37:34358) 2024-04-22T07:18:22.727 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:22.727+0000 7f9187fff640 1 -- 172.21.15.37:0/1413058745 learned_addr learned my addr 172.21.15.37:0/1413058745 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:18:22.727 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:22.727+0000 7f91877fe640 1 --2- 172.21.15.37:0/1413058745 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9188071770 0x7f918814e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:22.728 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:22.727+0000 7f9186ffd640 1 --2- 172.21.15.37:0/1413058745 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9188071b50 0x7f918814e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:22.728 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:22.727+0000 7f9187fff640 1 -- 172.21.15.37:0/1413058745 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9188071b50 msgr2=0x7f918814e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:22.728 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:22.727+0000 7f9187fff640 1 --2- 172.21.15.37:0/1413058745 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9188071b50 0x7f918814e580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:22.728 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:22.727+0000 7f9187fff640 1 -- 172.21.15.37:0/1413058745 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9188071770 msgr2=0x7f918814e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:22.728 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:22.727+0000 7f9187fff640 1 --2- 172.21.15.37:0/1413058745 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9188071770 0x7f918814e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:22.728 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:22.727+0000 7f9187fff640 1 -- 172.21.15.37:0/1413058745 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91881ef810 con 0x7f9188152fc0 2024-04-22T07:18:22.728 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:22.727+0000 7f9187fff640 1 --2- 172.21.15.37:0/1413058745 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9188152fc0 0x7f91880c6ef0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f918000efc0 tx=0x7f918000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:22.728 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:22.727+0000 7f916ffff640 1 -- 172.21.15.37:0/1413058745 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9180018030 con 0x7f9188152fc0 2024-04-22T07:18:22.728 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:22.727+0000 7f918e0d2640 1 -- 172.21.15.37:0/1413058745 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91881efaf0 con 0x7f9188152fc0 2024-04-22T07:18:22.728 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:22.727+0000 7f916ffff640 1 -- 172.21.15.37:0/1413058745 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f918000cd90 con 0x7f9188152fc0 2024-04-22T07:18:22.728 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:22.728+0000 7f918e0d2640 1 -- 172.21.15.37:0/1413058745 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91880c66f0 con 0x7f9188152fc0 2024-04-22T07:18:22.728 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:22.728+0000 7f916ffff640 1 -- 172.21.15.37:0/1413058745 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9180003b90 con 0x7f9188152fc0 2024-04-22T07:18:22.729 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:22.729+0000 7f918e0d2640 1 -- 172.21.15.37:0/1413058745 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9168005290 con 0x7f9188152fc0 2024-04-22T07:18:22.729 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:22.729+0000 7f916ffff640 1 -- 172.21.15.37:0/1413058745 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 4) ==== 90984+0+0 (secure 0 0 0) 0x7f918001b070 con 0x7f9188152fc0 2024-04-22T07:18:22.729 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:22.730+0000 7f916ffff640 1 --2- 172.21.15.37:0/1413058745 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f917406c890 0x7f917406ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:22.729 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:22.730+0000 7f916ffff640 1 -- 172.21.15.37:0/1413058745 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 2231+0+0 (secure 0 0 0) 0x7f918008b120 con 0x7f9188152fc0 2024-04-22T07:18:22.730 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:22.730+0000 7f91877fe640 1 --2- 172.21.15.37:0/1413058745 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f917406c890 0x7f917406ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:22.730 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:22.731+0000 7f91877fe640 1 --2- 172.21.15.37:0/1413058745 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f917406c890 0x7f917406ed50 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f9178009560 tx=0x7f9178009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:22.730 INFO:tasks.ceph.osd.2.smithi037.stderr:2024-04-22T07:18:22.733+0000 7feae61bb640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-22T07:18:22.731 INFO:tasks.ceph.osd.3.smithi037.stderr:2024-04-22T07:18:22.733+0000 7f5d452f6640 -1 osd.3 0 waiting for initial osdmap 2024-04-22T07:18:22.732 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:22.735+0000 7f916ffff640 1 -- 172.21.15.37:0/1413058745 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f9180022070 con 0x7f9188152fc0 2024-04-22T07:18:22.739 INFO:tasks.ceph.osd.0.smithi037.stderr:2024-04-22T07:18:22.742+0000 7f195e79b640 -1 osd.0 0 waiting for initial osdmap 2024-04-22T07:18:22.742 INFO:tasks.ceph.osd.3.smithi037.stderr:2024-04-22T07:18:22.745+0000 7f5d3d116640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-22T07:18:22.750 INFO:tasks.ceph.osd.0.smithi037.stderr:2024-04-22T07:18:22.753+0000 7f1955da7640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-22T07:18:22.921 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:22.924+0000 7f918e0d2640 1 -- 172.21.15.37:0/1413058745 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9168005580 con 0x7f9188152fc0 2024-04-22T07:18:22.922 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:22.924+0000 7f916ffff640 1 -- 172.21.15.37:0/1413058745 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) ==== 74+0+7058 (secure 0 0 0) 0x7f9180010040 con 0x7f9188152fc0 2024-04-22T07:18:22.922 INFO:teuthology.misc.health.smithi037.stdout: 2024-04-22T07:18:22.922 INFO:teuthology.misc.health.smithi037.stdout:{"epoch":12,"fsid":"10d90a41-52d3-4e09-8022-c8ac67897ad1","created":"2024-04-22T07:18:12.420756+0000","modified":"2024-04-22T07:18:20.587613+0000","last_up_change":"0.000000","last_in_change":"2024-04-22T07:18:14.506974+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"e248f6e1-13ad-48e0-a8f8-ec3059995654","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"01c71ab7-1326-432b-b73a-e5847abe5132","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"33a780fd-013a-41c8-9970-136c9e080897","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"b46e53c4-e5b9-4098-b243-ab5a0f1f3885","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"cd1032c6-6a83-4e33-b7b1-baddf92a83af","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"f561d48a-5f2d-4deb-8681-4329aed36bae","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"1b239c7e-2504-42e0-b308-70f4e62519c8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"084318d4-d1fd-4b58-8c33-b1d7856fe323","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-22T07:18:22.924 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:22.926+0000 7f918e0d2640 1 -- 172.21.15.37:0/1413058745 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f917406c890 msgr2=0x7f917406ed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:22.924 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:22.926+0000 7f918e0d2640 1 --2- 172.21.15.37:0/1413058745 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f917406c890 0x7f917406ed50 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f9178009560 tx=0x7f9178009190 comp rx=0 tx=0).stop 2024-04-22T07:18:22.924 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:22.926+0000 7f918e0d2640 1 -- 172.21.15.37:0/1413058745 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9188152fc0 msgr2=0x7f91880c6ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:22.924 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:22.926+0000 7f918e0d2640 1 --2- 172.21.15.37:0/1413058745 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9188152fc0 0x7f91880c6ef0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f918000efc0 tx=0x7f918000c490 comp rx=0 tx=0).stop 2024-04-22T07:18:22.924 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:22.926+0000 7f918e0d2640 1 -- 172.21.15.37:0/1413058745 shutdown_connections 2024-04-22T07:18:22.924 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:22.926+0000 7f918e0d2640 1 --2- 172.21.15.37:0/1413058745 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f917406c890 0x7f917406ed50 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:22.924 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:22.926+0000 7f918e0d2640 1 --2- 172.21.15.37:0/1413058745 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9188152fc0 0x7f91880c6ef0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:22.924 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:22.926+0000 7f918e0d2640 1 --2- 172.21.15.37:0/1413058745 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9188071b50 0x7f918814e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:22.924 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:22.926+0000 7f918e0d2640 1 --2- 172.21.15.37:0/1413058745 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9188071770 0x7f918814e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:22.925 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:22.926+0000 7f918e0d2640 1 -- 172.21.15.37:0/1413058745 >> 172.21.15.37:0/1413058745 conn(0x7f9188062570 msgr2=0x7f91880ccab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:22.925 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:22.926+0000 7f918e0d2640 1 -- 172.21.15.37:0/1413058745 shutdown_connections 2024-04-22T07:18:22.925 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:22.926+0000 7f918e0d2640 1 -- 172.21.15.37:0/1413058745 wait complete. 2024-04-22T07:18:22.933 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-04-22T07:18:29.740 DEBUG:teuthology.orchestra.run.smithi037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-22T07:18:29.844 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:29.847+0000 7f6464ac8640 1 Processor -- start 2024-04-22T07:18:29.845 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:29.847+0000 7f6464ac8640 1 -- start start 2024-04-22T07:18:29.846 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:29.848+0000 7f6464ac8640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f6460154f50 0x7f646015adb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:29.846 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:29.848+0000 7f6464ac8640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f64600cb680 0x7f64600c6e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:29.846 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:29.848+0000 7f6464ac8640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f646015b720 con 0x7f64600c7370 2024-04-22T07:18:29.846 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:29.848+0000 7f6464ac8640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f64600c69a0 con 0x7f6460154f50 2024-04-22T07:18:29.846 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:29.848+0000 7f6464ac8640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f646015ba00 con 0x7f64600cb680 2024-04-22T07:18:29.846 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:29.848+0000 7f645e59c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f6460154f50 0x7f646015adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:29.846 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:29.848+0000 7f645e59c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f6460154f50 0x7f646015adb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49194/0 (socket says 172.21.15.37:49194) 2024-04-22T07:18:29.846 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:29.848+0000 7f645e59c640 1 -- 172.21.15.37:0/62107443 learned_addr learned my addr 172.21.15.37:0/62107443 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:18:29.847 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:29.848+0000 7f6457fff640 1 --2- 172.21.15.37:0/62107443 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f64600cb680 0x7f64600c6e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:29.847 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:29.848+0000 7f645e59c640 1 -- 172.21.15.37:0/62107443 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f64600cb680 msgr2=0x7f64600c6e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:18:29.847 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:29.848+0000 7f645e59c640 1 --2- 172.21.15.37:0/62107443 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f64600cb680 0x7f64600c6e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:29.847 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:29.848+0000 7f645e59c640 1 -- 172.21.15.37:0/62107443 >> v1:172.21.15.196:6789/0 conn(0x7f64600c7370 legacy=0x7f64600d06b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:18:29.847 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:29.848+0000 7f645e59c640 1 -- 172.21.15.37:0/62107443 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f646015bce0 con 0x7f6460154f50 2024-04-22T07:18:29.848 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:29.849+0000 7f645e59c640 1 --2- 172.21.15.37:0/62107443 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6460154f50 0x7f646015adb0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f6450009870 tx=0x7f645002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ec090c6adc07231 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:29.848 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:29.849+0000 7f645dd9b640 1 -- 172.21.15.37:0/62107443 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6450035020 con 0x7f6460154f50 2024-04-22T07:18:29.848 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:29.849+0000 7f645dd9b640 1 -- 172.21.15.37:0/62107443 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6450031640 con 0x7f6460154f50 2024-04-22T07:18:29.848 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:29.849+0000 7f645dd9b640 1 -- 172.21.15.37:0/62107443 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f645002d040 con 0x7f6460154f50 2024-04-22T07:18:29.848 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:29.850+0000 7f6464ac8640 1 -- 172.21.15.37:0/62107443 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6460154f50 msgr2=0x7f646015adb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:29.848 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:29.850+0000 7f6464ac8640 1 --2- 172.21.15.37:0/62107443 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6460154f50 0x7f646015adb0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f6450009870 tx=0x7f645002b8f0 comp rx=0 tx=0).stop 2024-04-22T07:18:29.848 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:29.850+0000 7f6464ac8640 1 -- 172.21.15.37:0/62107443 shutdown_connections 2024-04-22T07:18:29.849 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:29.850+0000 7f6464ac8640 1 --2- 172.21.15.37:0/62107443 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f64600cb680 0x7f64600c6e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:29.849 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:29.850+0000 7f6464ac8640 1 --2- 172.21.15.37:0/62107443 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6460154f50 0x7f646015adb0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:29.849 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:29.850+0000 7f6464ac8640 1 -- 172.21.15.37:0/62107443 >> 172.21.15.37:0/62107443 conn(0x7f6460062390 msgr2=0x7f6460072960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:29.849 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:29.850+0000 7f6464ac8640 1 -- 172.21.15.37:0/62107443 shutdown_connections 2024-04-22T07:18:29.849 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:29.850+0000 7f6464ac8640 1 -- 172.21.15.37:0/62107443 wait complete. 2024-04-22T07:18:29.851 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:29.851+0000 7f6464ac8640 1 Processor -- start 2024-04-22T07:18:29.851 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:29.851+0000 7f6464ac8640 1 -- start start 2024-04-22T07:18:29.851 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:29.852+0000 7f6464ac8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64600c7370 0x7f6460157dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:29.851 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:29.852+0000 7f6464ac8640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f64600cb680 0x7f64601f4530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:29.852 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:29.852+0000 7f6464ac8640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6460154f50 0x7f64601f4a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:29.852 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:29.852+0000 7f6464ac8640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f6460062930 con 0x7f64600c7370 2024-04-22T07:18:29.852 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:29.852+0000 7f6464ac8640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f64600c6630 con 0x7f6460154f50 2024-04-22T07:18:29.852 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:29.852+0000 7f6464ac8640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f64600cc8a0 con 0x7f64600cb680 2024-04-22T07:18:29.852 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:29.852+0000 7f645e59c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64600c7370 0x7f6460157dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:29.852 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:29.852+0000 7f645e59c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64600c7370 0x7f6460157dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49200/0 (socket says 172.21.15.37:49200) 2024-04-22T07:18:29.852 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:29.852+0000 7f645e59c640 1 -- 172.21.15.37:0/1552886962 learned_addr learned my addr 172.21.15.37:0/1552886962 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:18:29.852 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:29.852+0000 7f6457fff640 1 --2- 172.21.15.37:0/1552886962 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f64600cb680 0x7f64601f4530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:29.852 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:29.852+0000 7f645e59c640 1 -- 172.21.15.37:0/1552886962 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f64600cb680 msgr2=0x7f64601f4530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:29.852 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:29.852+0000 7f645ed9d640 1 --2- 172.21.15.37:0/1552886962 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6460154f50 0x7f64601f4a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:29.852 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:29.852+0000 7f645e59c640 1 --2- 172.21.15.37:0/1552886962 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f64600cb680 0x7f64601f4530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:29.852 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:29.852+0000 7f645e59c640 1 -- 172.21.15.37:0/1552886962 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6460154f50 msgr2=0x7f64601f4a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:29.852 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:29.852+0000 7f645e59c640 1 --2- 172.21.15.37:0/1552886962 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6460154f50 0x7f64601f4a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:29.852 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:29.852+0000 7f645e59c640 1 -- 172.21.15.37:0/1552886962 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f646015d1b0 con 0x7f64600c7370 2024-04-22T07:18:29.853 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:29.852+0000 7f6457fff640 1 --2- 172.21.15.37:0/1552886962 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f64600cb680 0x7f64601f4530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-22T07:18:29.853 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:29.853+0000 7f645e59c640 1 --2- 172.21.15.37:0/1552886962 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64600c7370 0x7f6460157dc0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f645002b930 tx=0x7f64500046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:29.853 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:29.853+0000 7f6456ffd640 1 -- 172.21.15.37:0/1552886962 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6450040070 con 0x7f64600c7370 2024-04-22T07:18:29.853 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:29.853+0000 7f6456ffd640 1 -- 172.21.15.37:0/1552886962 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64500399f0 con 0x7f64600c7370 2024-04-22T07:18:29.853 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:29.853+0000 7f6464ac8640 1 -- 172.21.15.37:0/1552886962 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f646015cbf0 con 0x7f64600c7370 2024-04-22T07:18:29.853 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:29.853+0000 7f6456ffd640 1 -- 172.21.15.37:0/1552886962 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6450035040 con 0x7f64600c7370 2024-04-22T07:18:29.853 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:29.853+0000 7f6464ac8640 1 -- 172.21.15.37:0/1552886962 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f646015d4a0 con 0x7f64600c7370 2024-04-22T07:18:29.853 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:29.854+0000 7f6464ac8640 1 -- 172.21.15.37:0/1552886962 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6460068dc0 con 0x7f64600c7370 2024-04-22T07:18:29.854 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:29.854+0000 7f6456ffd640 1 -- 172.21.15.37:0/1552886962 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f645004b060 con 0x7f64600c7370 2024-04-22T07:18:29.854 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:29.855+0000 7f6456ffd640 1 --2- 172.21.15.37:0/1552886962 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f644006c8f0 0x7f644006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:29.854 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:29.855+0000 7f6456ffd640 1 -- 172.21.15.37:0/1552886962 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f64500ad0e0 con 0x7f64600c7370 2024-04-22T07:18:29.854 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:29.855+0000 7f6457fff640 1 --2- 172.21.15.37:0/1552886962 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f644006c8f0 0x7f644006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:29.854 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:29.856+0000 7f6457fff640 1 --2- 172.21.15.37:0/1552886962 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f644006c8f0 0x7f644006edb0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f6448006fd0 tx=0x7f6448008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:29.858 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:29.859+0000 7f6456ffd640 1 -- 172.21.15.37:0/1552886962 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f6460068dc0 con 0x7f64600c7370 2024-04-22T07:18:30.043 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:30.045+0000 7f6464ac8640 1 -- 172.21.15.37:0/1552886962 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6460155330 con 0x7f64600c7370 2024-04-22T07:18:30.044 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:30.046+0000 7f6456ffd640 1 -- 172.21.15.37:0/1552886962 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) ==== 74+0+12860 (secure 0 0 0) 0x7f6460155330 con 0x7f64600c7370 2024-04-22T07:18:30.044 INFO:teuthology.misc.health.smithi037.stdout: 2024-04-22T07:18:30.044 INFO:teuthology.misc.health.smithi037.stdout:{"epoch":16,"fsid":"10d90a41-52d3-4e09-8022-c8ac67897ad1","created":"2024-04-22T07:18:12.420756+0000","modified":"2024-04-22T07:18:26.843673+0000","last_up_change":"2024-04-22T07:18:23.649808+0000","last_in_change":"2024-04-22T07:18:14.506974+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-22T07:18:24.602243+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e248f6e1-13ad-48e0-a8f8-ec3059995654","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":1488290385},{"type":"v1","addr":"172.21.15.37:6801","nonce":1488290385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1488290385},{"type":"v1","addr":"172.21.15.37:6803","nonce":1488290385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1488290385},{"type":"v1","addr":"172.21.15.37:6807","nonce":1488290385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1488290385},{"type":"v1","addr":"172.21.15.37:6805","nonce":1488290385}]},"public_addr":"172.21.15.37:6801/1488290385","cluster_addr":"172.21.15.37:6803/1488290385","heartbeat_back_addr":"172.21.15.37:6807/1488290385","heartbeat_front_addr":"172.21.15.37:6805/1488290385","state":["exists","up"]},{"osd":1,"uuid":"01c71ab7-1326-432b-b73a-e5847abe5132","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3918584183},{"type":"v1","addr":"172.21.15.37:6811","nonce":3918584183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6813","nonce":3918584183},{"type":"v1","addr":"172.21.15.37:6816","nonce":3918584183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":3918584183},{"type":"v1","addr":"172.21.15.37:6823","nonce":3918584183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":3918584183},{"type":"v1","addr":"172.21.15.37:6821","nonce":3918584183}]},"public_addr":"172.21.15.37:6811/3918584183","cluster_addr":"172.21.15.37:6816/3918584183","heartbeat_back_addr":"172.21.15.37:6823/3918584183","heartbeat_front_addr":"172.21.15.37:6821/3918584183","state":["exists","up"]},{"osd":2,"uuid":"33a780fd-013a-41c8-9970-136c9e080897","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1895439419},{"type":"v1","addr":"172.21.15.37:6825","nonce":1895439419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1895439419},{"type":"v1","addr":"172.21.15.37:6827","nonce":1895439419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1895439419},{"type":"v1","addr":"172.21.15.37:6831","nonce":1895439419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1895439419},{"type":"v1","addr":"172.21.15.37:6829","nonce":1895439419}]},"public_addr":"172.21.15.37:6825/1895439419","cluster_addr":"172.21.15.37:6827/1895439419","heartbeat_back_addr":"172.21.15.37:6831/1895439419","heartbeat_front_addr":"172.21.15.37:6829/1895439419","state":["exists","up"]},{"osd":3,"uuid":"b46e53c4-e5b9-4098-b243-ab5a0f1f3885","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6809","nonce":1160021017},{"type":"v1","addr":"172.21.15.37:6810","nonce":1160021017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1160021017},{"type":"v1","addr":"172.21.15.37:6814","nonce":1160021017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":1160021017},{"type":"v1","addr":"172.21.15.37:6820","nonce":1160021017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6815","nonce":1160021017},{"type":"v1","addr":"172.21.15.37:6817","nonce":1160021017}]},"public_addr":"172.21.15.37:6810/1160021017","cluster_addr":"172.21.15.37:6814/1160021017","heartbeat_back_addr":"172.21.15.37:6820/1160021017","heartbeat_front_addr":"172.21.15.37:6817/1160021017","state":["exists","up"]},{"osd":4,"uuid":"cd1032c6-6a83-4e33-b7b1-baddf92a83af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":374829049},{"type":"v1","addr":"172.21.15.196:6809","nonce":374829049}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":374829049},{"type":"v1","addr":"172.21.15.196:6811","nonce":374829049}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":374829049},{"type":"v1","addr":"172.21.15.196:6815","nonce":374829049}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":374829049},{"type":"v1","addr":"172.21.15.196:6813","nonce":374829049}]},"public_addr":"172.21.15.196:6809/374829049","cluster_addr":"172.21.15.196:6811/374829049","heartbeat_back_addr":"172.21.15.196:6815/374829049","heartbeat_front_addr":"172.21.15.196:6813/374829049","state":["exists","up"]},{"osd":5,"uuid":"f561d48a-5f2d-4deb-8681-4329aed36bae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":479311302},{"type":"v1","addr":"172.21.15.196:6801","nonce":479311302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":479311302},{"type":"v1","addr":"172.21.15.196:6803","nonce":479311302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":479311302},{"type":"v1","addr":"172.21.15.196:6807","nonce":479311302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":479311302},{"type":"v1","addr":"172.21.15.196:6805","nonce":479311302}]},"public_addr":"172.21.15.196:6801/479311302","cluster_addr":"172.21.15.196:6803/479311302","heartbeat_back_addr":"172.21.15.196:6807/479311302","heartbeat_front_addr":"172.21.15.196:6805/479311302","state":["exists","up"]},{"osd":6,"uuid":"1b239c7e-2504-42e0-b308-70f4e62519c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6817","nonce":691777224},{"type":"v1","addr":"172.21.15.196:6819","nonce":691777224}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6821","nonce":691777224},{"type":"v1","addr":"172.21.15.196:6823","nonce":691777224}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6829","nonce":691777224},{"type":"v1","addr":"172.21.15.196:6831","nonce":691777224}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6825","nonce":691777224},{"type":"v1","addr":"172.21.15.196:6827","nonce":691777224}]},"public_addr":"172.21.15.196:6819/691777224","cluster_addr":"172.21.15.196:6823/691777224","heartbeat_back_addr":"172.21.15.196:6831/691777224","heartbeat_front_addr":"172.21.15.196:6827/691777224","state":["exists","up"]},{"osd":7,"uuid":"084318d4-d1fd-4b58-8c33-b1d7856fe323","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":3106266066},{"type":"v1","addr":"172.21.15.196:6818","nonce":3106266066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":3106266066},{"type":"v1","addr":"172.21.15.196:6822","nonce":3106266066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":3106266066},{"type":"v1","addr":"172.21.15.196:6830","nonce":3106266066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":3106266066},{"type":"v1","addr":"172.21.15.196:6826","nonce":3106266066}]},"public_addr":"172.21.15.196:6818/3106266066","cluster_addr":"172.21.15.196:6822/3106266066","heartbeat_back_addr":"172.21.15.196:6830/3106266066","heartbeat_front_addr":"172.21.15.196:6826/3106266066","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:18:19.587791+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:18:19.706541+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:18:19.690674+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:18:19.648354+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:18:19.666671+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:18:19.560709+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:18:19.661412+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:18:19.770650+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-22T07:18:30.046 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:30.048+0000 7f6464ac8640 1 -- 172.21.15.37:0/1552886962 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f644006c8f0 msgr2=0x7f644006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:30.046 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:30.048+0000 7f6464ac8640 1 --2- 172.21.15.37:0/1552886962 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f644006c8f0 0x7f644006edb0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f6448006fd0 tx=0x7f6448008040 comp rx=0 tx=0).stop 2024-04-22T07:18:30.046 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:30.048+0000 7f6464ac8640 1 -- 172.21.15.37:0/1552886962 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64600c7370 msgr2=0x7f6460157dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:30.046 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:30.048+0000 7f6464ac8640 1 --2- 172.21.15.37:0/1552886962 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64600c7370 0x7f6460157dc0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f645002b930 tx=0x7f64500046c0 comp rx=0 tx=0).stop 2024-04-22T07:18:30.046 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:30.048+0000 7f6464ac8640 1 -- 172.21.15.37:0/1552886962 shutdown_connections 2024-04-22T07:18:30.046 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:30.048+0000 7f6464ac8640 1 --2- 172.21.15.37:0/1552886962 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f644006c8f0 0x7f644006edb0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:30.046 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:30.048+0000 7f6464ac8640 1 --2- 172.21.15.37:0/1552886962 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6460154f50 0x7f64601f4a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:30.047 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:30.048+0000 7f6464ac8640 1 --2- 172.21.15.37:0/1552886962 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f64600cb680 0x7f64601f4530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:30.047 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:30.048+0000 7f6464ac8640 1 --2- 172.21.15.37:0/1552886962 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64600c7370 0x7f6460157dc0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:30.047 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:30.048+0000 7f6464ac8640 1 -- 172.21.15.37:0/1552886962 >> 172.21.15.37:0/1552886962 conn(0x7f6460062390 msgr2=0x7f64600b3070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:30.047 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:30.048+0000 7f6464ac8640 1 -- 172.21.15.37:0/1552886962 shutdown_connections 2024-04-22T07:18:30.047 INFO:teuthology.misc.health.smithi037.stderr:2024-04-22T07:18:30.048+0000 7f6464ac8640 1 -- 172.21.15.37:0/1552886962 wait complete. 2024-04-22T07:18:30.055 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-04-22T07:18:30.056 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-04-22T07:18:30.056 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-22T07:18:30.056 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-22T07:18:30.061 INFO:tasks.ceph.mds.a:Started 2024-04-22T07:18:30.061 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-22T07:18:30.062 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-22T07:18:30.063 INFO:tasks.ceph.mds.c:Started 2024-04-22T07:18:30.064 INFO:tasks.ceph.mds.e:Restarting daemon 2024-04-22T07:18:30.064 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i e 2024-04-22T07:18:30.066 INFO:tasks.ceph.mds.e:Started 2024-04-22T07:18:30.066 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-22T07:18:30.066 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-22T07:18:30.069 INFO:tasks.ceph.mds.b:Started 2024-04-22T07:18:30.069 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-22T07:18:30.069 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-22T07:18:30.072 INFO:tasks.ceph.mds.d:Started 2024-04-22T07:18:30.072 INFO:tasks.ceph.mds.f:Restarting daemon 2024-04-22T07:18:30.072 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i f 2024-04-22T07:18:30.074 INFO:tasks.ceph.mds.f:Started 2024-04-22T07:18:30.074 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-04-22T07:18:30.075 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-22T07:18:30.138 INFO:tasks.ceph.mds.a.smithi037.stdout:starting mds.a at 2024-04-22T07:18:30.142 INFO:tasks.ceph.mds.c.smithi037.stdout:starting mds.c at 2024-04-22T07:18:30.143 INFO:tasks.ceph.mds.e.smithi037.stdout:starting mds.e at 2024-04-22T07:18:30.154 INFO:tasks.ceph.mds.d.smithi196.stdout:starting mds.d at 2024-04-22T07:18:30.155 INFO:tasks.ceph.mds.b.smithi196.stdout:starting mds.b at 2024-04-22T07:18:30.155 INFO:tasks.ceph.mds.f.smithi196.stdout:starting mds.f at 2024-04-22T07:18:30.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.186+0000 7f4a3adce640 1 Processor -- start 2024-04-22T07:18:30.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.186+0000 7f4a3adce640 1 -- start start 2024-04-22T07:18:30.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.187+0000 7f4a3adce640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4a34159520 0x7f4a340ca190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:30.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.187+0000 7f4a3adce640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f4a340c4550 0x7f4a340ca6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:30.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.187+0000 7f4a3adce640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a34153250 con 0x7f4a34152e70 2024-04-22T07:18:30.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.187+0000 7f4a3adce640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f4a341599b0 con 0x7f4a340c4550 2024-04-22T07:18:30.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.187+0000 7f4a3adce640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f4a3415c140 con 0x7f4a34159520 2024-04-22T07:18:30.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.187+0000 7f4a38b6a640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f4a34152e70 0x7f4a340c3e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:41772/0 (socket says 172.21.15.37:41772) 2024-04-22T07:18:30.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.187+0000 7f4a38b6a640 1 -- 172.21.15.37:0/1806393498 learned_addr learned my addr 172.21.15.37:0/1806393498 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-04-22T07:18:30.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.187+0000 7f4a3936b640 1 --2- 172.21.15.37:0/1806393498 >> v2:172.21.15.37:3300/0 conn(0x7f4a340c4550 0x7f4a340ca6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:30.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.188+0000 7f4a33fff640 1 --2- 172.21.15.37:0/1806393498 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4a34159520 0x7f4a340ca190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:30.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.188+0000 7f4a3936b640 1 -- 172.21.15.37:0/1806393498 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4a34159520 msgr2=0x7f4a340ca190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:18:30.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.188+0000 7f4a3936b640 1 --2- 172.21.15.37:0/1806393498 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4a34159520 0x7f4a340ca190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:30.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.188+0000 7f4a3936b640 1 -- 172.21.15.37:0/1806393498 >> v1:172.21.15.37:6789/0 conn(0x7f4a34152e70 legacy=0x7f4a340c3e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:30.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.188+0000 7f4a3936b640 1 -- 172.21.15.37:0/1806393498 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a3415c420 con 0x7f4a340c4550 2024-04-22T07:18:30.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.188+0000 7f4a3936b640 1 --2- 172.21.15.37:0/1806393498 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a340c4550 0x7f4a340ca6d0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4a2c0097a0 tx=0x7f4a2c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e54eef602d530f19 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:30.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.189+0000 7f4a337fe640 1 -- 172.21.15.37:0/1806393498 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a2c035020 con 0x7f4a340c4550 2024-04-22T07:18:30.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.189+0000 7f4a337fe640 1 -- 172.21.15.37:0/1806393498 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a2c031830 con 0x7f4a340c4550 2024-04-22T07:18:30.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.189+0000 7f4a337fe640 1 -- 172.21.15.37:0/1806393498 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a2c031c00 con 0x7f4a340c4550 2024-04-22T07:18:30.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.189+0000 7f4a3adce640 1 -- 172.21.15.37:0/1806393498 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a340c4550 msgr2=0x7f4a340ca6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:30.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.189+0000 7f4a3adce640 1 --2- 172.21.15.37:0/1806393498 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a340c4550 0x7f4a340ca6d0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4a2c0097a0 tx=0x7f4a2c02b8d0 comp rx=0 tx=0).stop 2024-04-22T07:18:30.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.189+0000 7f4a3adce640 1 -- 172.21.15.37:0/1806393498 shutdown_connections 2024-04-22T07:18:30.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.189+0000 7f4a3adce640 1 --2- 172.21.15.37:0/1806393498 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a340c4550 0x7f4a340ca6d0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:30.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.189+0000 7f4a3adce640 1 --2- 172.21.15.37:0/1806393498 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4a34159520 0x7f4a340ca190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:30.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.189+0000 7f4a3adce640 1 -- 172.21.15.37:0/1806393498 >> 172.21.15.37:0/1806393498 conn(0x7f4a3406e370 msgr2=0x7f4a34071540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:30.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.189+0000 7f4a3adce640 1 -- 172.21.15.37:0/1806393498 shutdown_connections 2024-04-22T07:18:30.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.189+0000 7f4a3adce640 1 -- 172.21.15.37:0/1806393498 wait complete. 2024-04-22T07:18:30.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.191+0000 7f4a3adce640 1 Processor -- start 2024-04-22T07:18:30.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.191+0000 7f4a3adce640 1 -- start start 2024-04-22T07:18:30.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.192+0000 7f4a3adce640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4a34152e70 0x7f4a3414d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:30.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.192+0000 7f4a3adce640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a340cc490 0x7f4a340cd760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:30.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.192+0000 7f4a3adce640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4a341f03a0 0x7f4a341f0820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:30.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.192+0000 7f4a3adce640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f4a34070ed0 con 0x7f4a340cc490 2024-04-22T07:18:30.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.192+0000 7f4a3adce640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f4a3415c9e0 con 0x7f4a34152e70 2024-04-22T07:18:30.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.192+0000 7f4a33fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a340cc490 0x7f4a340cd760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:30.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.192+0000 7f4a33fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a340cc490 0x7f4a340cd760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49266/0 (socket says 172.21.15.37:49266) 2024-04-22T07:18:30.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.192+0000 7f4a3adce640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f4a34071050 con 0x7f4a341f03a0 2024-04-22T07:18:30.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.192+0000 7f4a33fff640 1 -- 172.21.15.37:0/2720550853 learned_addr learned my addr 172.21.15.37:0/2720550853 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:18:30.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.192+0000 7f4a38b6a640 1 --2- 172.21.15.37:0/2720550853 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4a34152e70 0x7f4a3414d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:30.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.192+0000 7f4a3936b640 1 --2- 172.21.15.37:0/2720550853 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4a341f03a0 0x7f4a341f0820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:30.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.192+0000 7f4a33fff640 1 -- 172.21.15.37:0/2720550853 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4a341f03a0 msgr2=0x7f4a341f0820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:30.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.192+0000 7f4a33fff640 1 --2- 172.21.15.37:0/2720550853 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4a341f03a0 0x7f4a341f0820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:30.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.192+0000 7f4a33fff640 1 -- 172.21.15.37:0/2720550853 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4a34152e70 msgr2=0x7f4a3414d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:30.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.192+0000 7f4a33fff640 1 --2- 172.21.15.37:0/2720550853 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4a34152e70 0x7f4a3414d480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:30.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.192+0000 7f4a33fff640 1 -- 172.21.15.37:0/2720550853 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a341f0d60 con 0x7f4a340cc490 2024-04-22T07:18:30.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.192+0000 7f4a33fff640 1 --2- 172.21.15.37:0/2720550853 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a340cc490 0x7f4a340cd760 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f4a24007ea0 tx=0x7f4a24007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:30.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.192+0000 7f4a317fa640 1 -- 172.21.15.37:0/2720550853 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a24014620 con 0x7f4a340cc490 2024-04-22T07:18:30.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.192+0000 7f4a317fa640 1 -- 172.21.15.37:0/2720550853 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a24019070 con 0x7f4a340cc490 2024-04-22T07:18:30.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.193+0000 7f4a3adce640 1 -- 172.21.15.37:0/2720550853 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a340ce060 con 0x7f4a340cc490 2024-04-22T07:18:30.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.193+0000 7f4a317fa640 1 -- 172.21.15.37:0/2720550853 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a24014a00 con 0x7f4a340cc490 2024-04-22T07:18:30.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.193+0000 7f4a3adce640 1 -- 172.21.15.37:0/2720550853 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a340ce620 con 0x7f4a340cc490 2024-04-22T07:18:30.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.194+0000 7f4a3adce640 1 -- 172.21.15.37:0/2720550853 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a34070910 con 0x7f4a340cc490 2024-04-22T07:18:30.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.194+0000 7f4a317fa640 1 -- 172.21.15.37:0/2720550853 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4a24014ba0 con 0x7f4a340cc490 2024-04-22T07:18:30.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.195+0000 7f4a317fa640 1 --2- 172.21.15.37:0/2720550853 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f4a1406c8f0 0x7f4a1406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:30.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.195+0000 7f4a317fa640 1 -- 172.21.15.37:0/2720550853 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f4a2408bf30 con 0x7f4a340cc490 2024-04-22T07:18:30.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.195+0000 7f4a38b6a640 1 --2- 172.21.15.37:0/2720550853 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f4a1406c8f0 0x7f4a1406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:30.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.196+0000 7f4a38b6a640 1 --2- 172.21.15.37:0/2720550853 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f4a1406c8f0 0x7f4a1406edb0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f4a1c007fd0 tx=0x7f4a1c007e80 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:30.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.199+0000 7f4a317fa640 1 -- 172.21.15.37:0/2720550853 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f4a34070910 con 0x7f4a340cc490 2024-04-22T07:18:30.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.384+0000 7f4a3adce640 1 -- 172.21.15.37:0/2720550853 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4a34068b20 con 0x7f4a340cc490 2024-04-22T07:18:30.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.385+0000 7f4a317fa640 1 -- 172.21.15.37:0/2720550853 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) ==== 74+0+12860 (secure 0 0 0) 0x7f4a341f0d60 con 0x7f4a340cc490 2024-04-22T07:18:30.383 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-22T07:18:30.383 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":16,"fsid":"10d90a41-52d3-4e09-8022-c8ac67897ad1","created":"2024-04-22T07:18:12.420756+0000","modified":"2024-04-22T07:18:26.843673+0000","last_up_change":"2024-04-22T07:18:23.649808+0000","last_in_change":"2024-04-22T07:18:14.506974+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-22T07:18:24.602243+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e248f6e1-13ad-48e0-a8f8-ec3059995654","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":1488290385},{"type":"v1","addr":"172.21.15.37:6801","nonce":1488290385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1488290385},{"type":"v1","addr":"172.21.15.37:6803","nonce":1488290385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1488290385},{"type":"v1","addr":"172.21.15.37:6807","nonce":1488290385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1488290385},{"type":"v1","addr":"172.21.15.37:6805","nonce":1488290385}]},"public_addr":"172.21.15.37:6801/1488290385","cluster_addr":"172.21.15.37:6803/1488290385","heartbeat_back_addr":"172.21.15.37:6807/1488290385","heartbeat_front_addr":"172.21.15.37:6805/1488290385","state":["exists","up"]},{"osd":1,"uuid":"01c71ab7-1326-432b-b73a-e5847abe5132","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3918584183},{"type":"v1","addr":"172.21.15.37:6811","nonce":3918584183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6813","nonce":3918584183},{"type":"v1","addr":"172.21.15.37:6816","nonce":3918584183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":3918584183},{"type":"v1","addr":"172.21.15.37:6823","nonce":3918584183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":3918584183},{"type":"v1","addr":"172.21.15.37:6821","nonce":3918584183}]},"public_addr":"172.21.15.37:6811/3918584183","cluster_addr":"172.21.15.37:6816/3918584183","heartbeat_back_addr":"172.21.15.37:6823/3918584183","heartbeat_front_addr":"172.21.15.37:6821/3918584183","state":["exists","up"]},{"osd":2,"uuid":"33a780fd-013a-41c8-9970-136c9e080897","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1895439419},{"type":"v1","addr":"172.21.15.37:6825","nonce":1895439419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1895439419},{"type":"v1","addr":"172.21.15.37:6827","nonce":1895439419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1895439419},{"type":"v1","addr":"172.21.15.37:6831","nonce":1895439419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1895439419},{"type":"v1","addr":"172.21.15.37:6829","nonce":1895439419}]},"public_addr":"172.21.15.37:6825/1895439419","cluster_addr":"172.21.15.37:6827/1895439419","heartbeat_back_addr":"172.21.15.37:6831/1895439419","heartbeat_front_addr":"172.21.15.37:6829/1895439419","state":["exists","up"]},{"osd":3,"uuid":"b46e53c4-e5b9-4098-b243-ab5a0f1f3885","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6809","nonce":1160021017},{"type":"v1","addr":"172.21.15.37:6810","nonce":1160021017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1160021017},{"type":"v1","addr":"172.21.15.37:6814","nonce":1160021017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":1160021017},{"type":"v1","addr":"172.21.15.37:6820","nonce":1160021017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6815","nonce":1160021017},{"type":"v1","addr":"172.21.15.37:6817","nonce":1160021017}]},"public_addr":"172.21.15.37:6810/1160021017","cluster_addr":"172.21.15.37:6814/1160021017","heartbeat_back_addr":"172.21.15.37:6820/1160021017","heartbeat_front_addr":"172.21.15.37:6817/1160021017","state":["exists","up"]},{"osd":4,"uuid":"cd1032c6-6a83-4e33-b7b1-baddf92a83af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":374829049},{"type":"v1","addr":"172.21.15.196:6809","nonce":374829049}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":374829049},{"type":"v1","addr":"172.21.15.196:6811","nonce":374829049}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":374829049},{"type":"v1","addr":"172.21.15.196:6815","nonce":374829049}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":374829049},{"type":"v1","addr":"172.21.15.196:6813","nonce":374829049}]},"public_addr":"172.21.15.196:6809/374829049","cluster_addr":"172.21.15.196:6811/374829049","heartbeat_back_addr":"172.21.15.196:6815/374829049","heartbeat_front_addr":"172.21.15.196:6813/374829049","state":["exists","up"]},{"osd":5,"uuid":"f561d48a-5f2d-4deb-8681-4329aed36bae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":479311302},{"type":"v1","addr":"172.21.15.196:6801","nonce":479311302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":479311302},{"type":"v1","addr":"172.21.15.196:6803","nonce":479311302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":479311302},{"type":"v1","addr":"172.21.15.196:6807","nonce":479311302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":479311302},{"type":"v1","addr":"172.21.15.196:6805","nonce":479311302}]},"public_addr":"172.21.15.196:6801/479311302","cluster_addr":"172.21.15.196:6803/479311302","heartbeat_back_addr":"172.21.15.196:6807/479311302","heartbeat_front_addr":"172.21.15.196:6805/479311302","state":["exists","up"]},{"osd":6,"uuid":"1b239c7e-2504-42e0-b308-70f4e62519c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6817","nonce":691777224},{"type":"v1","addr":"172.21.15.196:6819","nonce":691777224}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6821","nonce":691777224},{"type":"v1","addr":"172.21.15.196:6823","nonce":691777224}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6829","nonce":691777224},{"type":"v1","addr":"172.21.15.196:6831","nonce":691777224}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6825","nonce":691777224},{"type":"v1","addr":"172.21.15.196:6827","nonce":691777224}]},"public_addr":"172.21.15.196:6819/691777224","cluster_addr":"172.21.15.196:6823/691777224","heartbeat_back_addr":"172.21.15.196:6831/691777224","heartbeat_front_addr":"172.21.15.196:6827/691777224","state":["exists","up"]},{"osd":7,"uuid":"084318d4-d1fd-4b58-8c33-b1d7856fe323","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":3106266066},{"type":"v1","addr":"172.21.15.196:6818","nonce":3106266066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":3106266066},{"type":"v1","addr":"172.21.15.196:6822","nonce":3106266066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":3106266066},{"type":"v1","addr":"172.21.15.196:6830","nonce":3106266066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":3106266066},{"type":"v1","addr":"172.21.15.196:6826","nonce":3106266066}]},"public_addr":"172.21.15.196:6818/3106266066","cluster_addr":"172.21.15.196:6822/3106266066","heartbeat_back_addr":"172.21.15.196:6830/3106266066","heartbeat_front_addr":"172.21.15.196:6826/3106266066","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:18:19.587791+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:18:19.706541+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:18:19.690674+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:18:19.648354+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:18:19.666671+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:18:19.560709+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:18:19.661412+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:18:19.770650+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-22T07:18:30.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.387+0000 7f4a3adce640 1 -- 172.21.15.37:0/2720550853 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f4a1406c8f0 msgr2=0x7f4a1406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:30.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.387+0000 7f4a3adce640 1 --2- 172.21.15.37:0/2720550853 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f4a1406c8f0 0x7f4a1406edb0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f4a1c007fd0 tx=0x7f4a1c007e80 comp rx=0 tx=0).stop 2024-04-22T07:18:30.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.387+0000 7f4a3adce640 1 -- 172.21.15.37:0/2720550853 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a340cc490 msgr2=0x7f4a340cd760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:30.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.387+0000 7f4a3adce640 1 --2- 172.21.15.37:0/2720550853 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a340cc490 0x7f4a340cd760 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f4a24007ea0 tx=0x7f4a24007f90 comp rx=0 tx=0).stop 2024-04-22T07:18:30.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.387+0000 7f4a3adce640 1 -- 172.21.15.37:0/2720550853 shutdown_connections 2024-04-22T07:18:30.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.387+0000 7f4a3adce640 1 --2- 172.21.15.37:0/2720550853 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f4a1406c8f0 0x7f4a1406edb0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:30.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.387+0000 7f4a3adce640 1 --2- 172.21.15.37:0/2720550853 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4a341f03a0 0x7f4a341f0820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:30.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.387+0000 7f4a3adce640 1 --2- 172.21.15.37:0/2720550853 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a340cc490 0x7f4a340cd760 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:30.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.387+0000 7f4a3adce640 1 --2- 172.21.15.37:0/2720550853 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4a34152e70 0x7f4a3414d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:30.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.387+0000 7f4a3adce640 1 -- 172.21.15.37:0/2720550853 >> 172.21.15.37:0/2720550853 conn(0x7f4a3406e370 msgr2=0x7f4a340ca950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:30.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.387+0000 7f4a3adce640 1 -- 172.21.15.37:0/2720550853 shutdown_connections 2024-04-22T07:18:30.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.387+0000 7f4a3adce640 1 -- 172.21.15.37:0/2720550853 wait complete. 2024-04-22T07:18:30.396 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-22T07:18:24.602243+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-22T07:18:30.396 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-22T07:18:30.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.502+0000 7f3db608c640 1 Processor -- start 2024-04-22T07:18:30.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.502+0000 7f3db608c640 1 -- start start 2024-04-22T07:18:30.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.503+0000 7f3db608c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f3db0155250 0x7f3db015af40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:30.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.503+0000 7f3db608c640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3db00b3190 0x7f3db00b35b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:30.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.503+0000 7f3db608c640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3db00b3bd0 con 0x7f3db00ccd20 2024-04-22T07:18:30.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.503+0000 7f3db608c640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f3db00cb6a0 con 0x7f3db0155250 2024-04-22T07:18:30.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.503+0000 7f3db608c640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f3db015e4b0 con 0x7f3db00b3190 2024-04-22T07:18:30.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.503+0000 7f3daf7fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f3db0155250 0x7f3db015af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:30.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.503+0000 7f3daf7fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f3db0155250 0x7f3db015af40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49274/0 (socket says 172.21.15.37:49274) 2024-04-22T07:18:30.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.503+0000 7f3daf7fe640 1 -- 172.21.15.37:0/1313613307 learned_addr learned my addr 172.21.15.37:0/1313613307 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:18:30.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.503+0000 7f3daeffd640 1 --2- 172.21.15.37:0/1313613307 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3db00b3190 0x7f3db00b35b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:30.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.503+0000 7f3daf7fe640 1 -- 172.21.15.37:0/1313613307 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3db00b3190 msgr2=0x7f3db00b35b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:18:30.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.503+0000 7f3daf7fe640 1 --2- 172.21.15.37:0/1313613307 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3db00b3190 0x7f3db00b35b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:30.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.503+0000 7f3daf7fe640 1 -- 172.21.15.37:0/1313613307 >> v1:172.21.15.196:6789/0 conn(0x7f3db00ccd20 legacy=0x7f3db00cd1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:18:30.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.503+0000 7f3daf7fe640 1 -- 172.21.15.37:0/1313613307 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3db00b3eb0 con 0x7f3db0155250 2024-04-22T07:18:30.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.503+0000 7f3daeffd640 1 --2- 172.21.15.37:0/1313613307 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3db00b3190 0x7f3db00b35b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-22T07:18:30.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.504+0000 7f3daf7fe640 1 --2- 172.21.15.37:0/1313613307 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3db0155250 0x7f3db015af40 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f3da0009870 tx=0x7f3da002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c56f388ffc1b64a2 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:30.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.504+0000 7f3dae7fc640 1 -- 172.21.15.37:0/1313613307 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3da0035020 con 0x7f3db0155250 2024-04-22T07:18:30.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.504+0000 7f3dae7fc640 1 -- 172.21.15.37:0/1313613307 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3da0031640 con 0x7f3db0155250 2024-04-22T07:18:30.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.504+0000 7f3dae7fc640 1 -- 172.21.15.37:0/1313613307 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3da002d040 con 0x7f3db0155250 2024-04-22T07:18:30.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.505+0000 7f3db608c640 1 -- 172.21.15.37:0/1313613307 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3db0155250 msgr2=0x7f3db015af40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:30.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.505+0000 7f3db608c640 1 --2- 172.21.15.37:0/1313613307 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3db0155250 0x7f3db015af40 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f3da0009870 tx=0x7f3da002b8f0 comp rx=0 tx=0).stop 2024-04-22T07:18:30.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.505+0000 7f3db608c640 1 -- 172.21.15.37:0/1313613307 shutdown_connections 2024-04-22T07:18:30.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.505+0000 7f3db608c640 1 --2- 172.21.15.37:0/1313613307 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3db00b3190 0x7f3db00b35b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:30.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.505+0000 7f3db608c640 1 --2- 172.21.15.37:0/1313613307 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3db0155250 0x7f3db015af40 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:30.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.505+0000 7f3db608c640 1 -- 172.21.15.37:0/1313613307 >> 172.21.15.37:0/1313613307 conn(0x7f3db0071f90 msgr2=0x7f3db00723a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:30.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.505+0000 7f3db608c640 1 -- 172.21.15.37:0/1313613307 shutdown_connections 2024-04-22T07:18:30.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.505+0000 7f3db608c640 1 -- 172.21.15.37:0/1313613307 wait complete. 2024-04-22T07:18:30.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.506+0000 7f3db608c640 1 Processor -- start 2024-04-22T07:18:30.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.506+0000 7f3db608c640 1 -- start start 2024-04-22T07:18:30.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.507+0000 7f3db608c640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3db00b3190 0x7f3db00ca750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:30.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.507+0000 7f3db608c640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3db00ccd20 0x7f3db01f4410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:30.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.507+0000 7f3db608c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3db0155250 0x7f3db014c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:30.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.507+0000 7f3db608c640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3db015ecc0 con 0x7f3db0155250 2024-04-22T07:18:30.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.507+0000 7f3db608c640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f3db015e9e0 con 0x7f3db00ccd20 2024-04-22T07:18:30.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.507+0000 7f3db608c640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f3db0155630 con 0x7f3db00b3190 2024-04-22T07:18:30.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.507+0000 7f3daffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3db0155250 0x7f3db014c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:30.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.507+0000 7f3daf7fe640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3db00b3190 0x7f3db00ca750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:30.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.507+0000 7f3daf7fe640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3db00b3190 0x7f3db00ca750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.37:59066/0 (socket says 172.21.15.37:59066) 2024-04-22T07:18:30.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.507+0000 7f3daf7fe640 1 -- 172.21.15.37:0/1736459866 learned_addr learned my addr 172.21.15.37:0/1736459866 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:18:30.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.507+0000 7f3daffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3db0155250 0x7f3db014c980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49286/0 (socket says 172.21.15.37:49286) 2024-04-22T07:18:30.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.507+0000 7f3daeffd640 1 --2- 172.21.15.37:0/1736459866 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3db00ccd20 0x7f3db01f4410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:30.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.507+0000 7f3daffff640 1 -- 172.21.15.37:0/1736459866 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3db00b3190 msgr2=0x7f3db00ca750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:30.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.507+0000 7f3daffff640 1 --2- 172.21.15.37:0/1736459866 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3db00b3190 0x7f3db00ca750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:30.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.507+0000 7f3daffff640 1 -- 172.21.15.37:0/1736459866 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3db00ccd20 msgr2=0x7f3db01f4410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:30.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.507+0000 7f3daffff640 1 --2- 172.21.15.37:0/1736459866 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3db00ccd20 0x7f3db01f4410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:30.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.507+0000 7f3daffff640 1 -- 172.21.15.37:0/1736459866 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3db00c8350 con 0x7f3db0155250 2024-04-22T07:18:30.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.507+0000 7f3daffff640 1 --2- 172.21.15.37:0/1736459866 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3db0155250 0x7f3db014c980 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f3da800c7b0 tx=0x7f3da800cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:30.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.507+0000 7f3d97fff640 1 -- 172.21.15.37:0/1736459866 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3da8016020 con 0x7f3db0155250 2024-04-22T07:18:30.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.507+0000 7f3d97fff640 1 -- 172.21.15.37:0/1736459866 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3da800aa50 con 0x7f3db0155250 2024-04-22T07:18:30.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.507+0000 7f3db608c640 1 -- 172.21.15.37:0/1736459866 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3db00c9490 con 0x7f3db0155250 2024-04-22T07:18:30.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.507+0000 7f3d97fff640 1 -- 172.21.15.37:0/1736459866 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3da800ce60 con 0x7f3db0155250 2024-04-22T07:18:30.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.507+0000 7f3db608c640 1 -- 172.21.15.37:0/1736459866 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3db01f4e40 con 0x7f3db0155250 2024-04-22T07:18:30.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.508+0000 7f3db608c640 1 -- 172.21.15.37:0/1736459866 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3db0069cc0 con 0x7f3db0155250 2024-04-22T07:18:30.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.509+0000 7f3d97fff640 1 -- 172.21.15.37:0/1736459866 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3da8019020 con 0x7f3db0155250 2024-04-22T07:18:30.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.509+0000 7f3d97fff640 1 --2- 172.21.15.37:0/1736459866 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f3d9c06c920 0x7f3d9c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:30.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.509+0000 7f3d97fff640 1 -- 172.21.15.37:0/1736459866 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f3da808b8a0 con 0x7f3db0155250 2024-04-22T07:18:30.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.509+0000 7f3daf7fe640 1 --2- 172.21.15.37:0/1736459866 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f3d9c06c920 0x7f3d9c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:30.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.510+0000 7f3daf7fe640 1 --2- 172.21.15.37:0/1736459866 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f3d9c06c920 0x7f3d9c06ede0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f3da0009870 tx=0x7f3da003c040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:30.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.514+0000 7f3d97fff640 1 -- 172.21.15.37:0/1736459866 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f3da8020020 con 0x7f3db0155250 2024-04-22T07:18:30.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.696+0000 7f3db608c640 1 -- 172.21.15.37:0/1736459866 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f3db015be80 con 0x7f3db0155250 2024-04-22T07:18:30.695 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.697+0000 7f3d97fff640 1 -- 172.21.15.37:0/1736459866 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) ==== 93+0+10 (secure 0 0 0) 0x7f3da80599d0 con 0x7f3db0155250 2024-04-22T07:18:30.695 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2024-04-22T07:18:30.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.699+0000 7f3db608c640 1 -- 172.21.15.37:0/1736459866 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f3d9c06c920 msgr2=0x7f3d9c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:30.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.699+0000 7f3db608c640 1 --2- 172.21.15.37:0/1736459866 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f3d9c06c920 0x7f3d9c06ede0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f3da0009870 tx=0x7f3da003c040 comp rx=0 tx=0).stop 2024-04-22T07:18:30.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.699+0000 7f3db608c640 1 -- 172.21.15.37:0/1736459866 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3db0155250 msgr2=0x7f3db014c980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:30.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.699+0000 7f3db608c640 1 --2- 172.21.15.37:0/1736459866 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3db0155250 0x7f3db014c980 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f3da800c7b0 tx=0x7f3da800cc70 comp rx=0 tx=0).stop 2024-04-22T07:18:30.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.699+0000 7f3db608c640 1 -- 172.21.15.37:0/1736459866 shutdown_connections 2024-04-22T07:18:30.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.699+0000 7f3db608c640 1 --2- 172.21.15.37:0/1736459866 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f3d9c06c920 0x7f3d9c06ede0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:30.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.699+0000 7f3db608c640 1 --2- 172.21.15.37:0/1736459866 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3db0155250 0x7f3db014c980 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:30.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.699+0000 7f3db608c640 1 --2- 172.21.15.37:0/1736459866 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3db00ccd20 0x7f3db01f4410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:30.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.699+0000 7f3db608c640 1 --2- 172.21.15.37:0/1736459866 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3db00b3190 0x7f3db00ca750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:30.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.699+0000 7f3db608c640 1 -- 172.21.15.37:0/1736459866 >> 172.21.15.37:0/1736459866 conn(0x7f3db0071f90 msgr2=0x7f3db014d5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:30.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.699+0000 7f3db608c640 1 -- 172.21.15.37:0/1736459866 shutdown_connections 2024-04-22T07:18:30.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.699+0000 7f3db608c640 1 -- 172.21.15.37:0/1736459866 wait complete. 2024-04-22T07:18:30.707 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-22T07:18:30.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.810+0000 7f549d4d2640 1 Processor -- start 2024-04-22T07:18:30.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.810+0000 7f549d4d2640 1 -- start start 2024-04-22T07:18:30.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.811+0000 7f549d4d2640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f5498158380 0x7f549806b970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:30.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.811+0000 7f549d4d2640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f549815b7a0 0x7f549815ee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:30.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.811+0000 7f549d4d2640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f54980c4df0 con 0x7f54980c8e80 2024-04-22T07:18:30.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.811+0000 7f549d4d2640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f5498158760 con 0x7f5498158380 2024-04-22T07:18:30.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.811+0000 7f549d4d2640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f54980c5060 con 0x7f549815b7a0 2024-04-22T07:18:30.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.811+0000 7f54967fc640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f54980c8e80 0x7f549806c380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:41784/0 (socket says 172.21.15.37:41784) 2024-04-22T07:18:30.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.811+0000 7f54967fc640 1 -- 172.21.15.37:0/2428749314 learned_addr learned my addr 172.21.15.37:0/2428749314 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-04-22T07:18:30.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.811+0000 7f54977fe640 1 --2- 172.21.15.37:0/2428749314 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f549815b7a0 0x7f549815ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:30.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.811+0000 7f5496ffd640 1 --2- 172.21.15.37:0/2428749314 >> v2:172.21.15.196:3300/0 conn(0x7f5498158380 0x7f549806b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:30.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.811+0000 7f5495ffb640 1 -- 172.21.15.37:0/2428749314 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1360177738 0 0) 0x7f54980c4df0 con 0x7f54980c8e80 2024-04-22T07:18:30.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.812+0000 7f5495ffb640 1 -- 172.21.15.37:0/2428749314 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5484003520 con 0x7f54980c8e80 2024-04-22T07:18:30.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.812+0000 7f5495ffb640 1 -- 172.21.15.37:0/2428749314 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2303559596 0 0) 0x7f5484003520 con 0x7f54980c8e80 2024-04-22T07:18:30.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.812+0000 7f5495ffb640 1 -- 172.21.15.37:0/2428749314 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f549815b7a0 msgr2=0x7f549815ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:18:30.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.812+0000 7f5495ffb640 1 --2- 172.21.15.37:0/2428749314 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f549815b7a0 0x7f549815ee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:30.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.812+0000 7f5495ffb640 1 -- 172.21.15.37:0/2428749314 >> v2:172.21.15.196:3300/0 conn(0x7f5498158380 msgr2=0x7f549806b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:18:30.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.812+0000 7f5495ffb640 1 --2- 172.21.15.37:0/2428749314 >> v2:172.21.15.196:3300/0 conn(0x7f5498158380 0x7f549806b970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:30.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.812+0000 7f5495ffb640 1 -- 172.21.15.37:0/2428749314 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54980c5340 con 0x7f54980c8e80 2024-04-22T07:18:30.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.812+0000 7f5495ffb640 1 -- 172.21.15.37:0/2428749314 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2576656170 0 0) 0x7f5480001690 con 0x7f54980c8e80 2024-04-22T07:18:30.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.812+0000 7f5495ffb640 1 -- 172.21.15.37:0/2428749314 >> v1:172.21.15.37:6789/0 conn(0x7f54980c8e80 legacy=0x7f549806c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:30.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.812+0000 7f5495ffb640 1 --2- 172.21.15.37:0/2428749314 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f549815b7a0 0x7f54840039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:30.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.812+0000 7f5495ffb640 1 --2- 172.21.15.37:0/2428749314 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5484003f30 0x7f5484004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:30.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.812+0000 7f5495ffb640 1 --2- 172.21.15.37:0/2428749314 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5484004d40 0x7f54840051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:30.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.812+0000 7f5495ffb640 1 -- 172.21.15.37:0/2428749314 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f5498158760 con 0x7f5484004d40 2024-04-22T07:18:30.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.812+0000 7f5495ffb640 1 -- 172.21.15.37:0/2428749314 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f54980c5060 con 0x7f5484003f30 2024-04-22T07:18:30.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.812+0000 7f5495ffb640 1 -- 172.21.15.37:0/2428749314 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f548400b9c0 con 0x7f549815b7a0 2024-04-22T07:18:30.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.812+0000 7f54977fe640 1 --2- 172.21.15.37:0/2428749314 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5484004d40 0x7f54840051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:30.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.812+0000 7f5496ffd640 1 --2- 172.21.15.37:0/2428749314 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f549815b7a0 0x7f54840039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:30.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.812+0000 7f54967fc640 1 --2- 172.21.15.37:0/2428749314 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5484003f30 0x7f5484004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:30.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.812+0000 7f54977fe640 1 -- 172.21.15.37:0/2428749314 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f549815b7a0 msgr2=0x7f54840039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:18:30.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.812+0000 7f54977fe640 1 --2- 172.21.15.37:0/2428749314 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f549815b7a0 0x7f54840039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:30.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.812+0000 7f54977fe640 1 -- 172.21.15.37:0/2428749314 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5484003f30 msgr2=0x7f5484004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:18:30.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.812+0000 7f54977fe640 1 --2- 172.21.15.37:0/2428749314 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5484003f30 0x7f5484004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:30.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.812+0000 7f54977fe640 1 -- 172.21.15.37:0/2428749314 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5484003520 con 0x7f5484004d40 2024-04-22T07:18:30.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.813+0000 7f54977fe640 1 --2- 172.21.15.37:0/2428749314 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5484004d40 0x7f54840051c0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f5488009fc0 tx=0x7f5484005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73779bbd9546bbf6 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:30.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.813+0000 7f5495ffb640 1 -- 172.21.15.37:0/2428749314 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5488039070 con 0x7f5484004d40 2024-04-22T07:18:30.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.813+0000 7f5495ffb640 1 -- 172.21.15.37:0/2428749314 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f548802cc00 con 0x7f5484004d40 2024-04-22T07:18:30.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.813+0000 7f5495ffb640 1 -- 172.21.15.37:0/2428749314 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5488009c10 con 0x7f5484004d40 2024-04-22T07:18:30.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.814+0000 7f549d4d2640 1 -- 172.21.15.37:0/2428749314 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5484004d40 msgr2=0x7f54840051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:30.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.814+0000 7f549d4d2640 1 --2- 172.21.15.37:0/2428749314 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5484004d40 0x7f54840051c0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f5488009fc0 tx=0x7f5484005830 comp rx=0 tx=0).stop 2024-04-22T07:18:30.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.814+0000 7f54977fe640 1 -- 172.21.15.37:0/2428749314 reap_dead start 2024-04-22T07:18:30.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.814+0000 7f549d4d2640 1 -- 172.21.15.37:0/2428749314 shutdown_connections 2024-04-22T07:18:30.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.814+0000 7f549d4d2640 1 -- 172.21.15.37:0/2428749314 >> 172.21.15.37:0/2428749314 conn(0x7f549806e3e0 msgr2=0x7f5498071570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:30.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.814+0000 7f549d4d2640 1 -- 172.21.15.37:0/2428749314 shutdown_connections 2024-04-22T07:18:30.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.814+0000 7f549d4d2640 1 -- 172.21.15.37:0/2428749314 wait complete. 2024-04-22T07:18:30.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.815+0000 7f549d4d2640 1 Processor -- start 2024-04-22T07:18:30.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.815+0000 7f549d4d2640 1 -- start start 2024-04-22T07:18:30.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.816+0000 7f549d4d2640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f549815aaf0 0x7f54980aec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:30.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.816+0000 7f549d4d2640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f549815aed0 0x7f54980c7a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:30.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.816+0000 7f549d4d2640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f54980c5880 0x7f54980c7f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:30.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.816+0000 7f549d4d2640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f549815e8f0 con 0x7f549815aaf0 2024-04-22T07:18:30.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.816+0000 7f549d4d2640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f549815e610 con 0x7f549815aed0 2024-04-22T07:18:30.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.816+0000 7f549d4d2640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f549806ca90 con 0x7f54980c5880 2024-04-22T07:18:30.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.816+0000 7f5496ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f549815aaf0 0x7f54980aec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:30.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.816+0000 7f5496ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f549815aaf0 0x7f54980aec80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49304/0 (socket says 172.21.15.37:49304) 2024-04-22T07:18:30.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.816+0000 7f5496ffd640 1 -- 172.21.15.37:0/3059574249 learned_addr learned my addr 172.21.15.37:0/3059574249 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:18:30.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.816+0000 7f54977fe640 1 --2- 172.21.15.37:0/3059574249 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f54980c5880 0x7f54980c7f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:30.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.816+0000 7f54967fc640 1 --2- 172.21.15.37:0/3059574249 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f549815aed0 0x7f54980c7a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:30.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.816+0000 7f5496ffd640 1 -- 172.21.15.37:0/3059574249 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f54980c5880 msgr2=0x7f54980c7f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:30.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.816+0000 7f5496ffd640 1 --2- 172.21.15.37:0/3059574249 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f54980c5880 0x7f54980c7f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:30.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.816+0000 7f5496ffd640 1 -- 172.21.15.37:0/3059574249 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f549815aed0 msgr2=0x7f54980c7a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:30.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.816+0000 7f5496ffd640 1 --2- 172.21.15.37:0/3059574249 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f549815aed0 0x7f54980c7a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:30.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.816+0000 7f5496ffd640 1 -- 172.21.15.37:0/3059574249 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54981f14c0 con 0x7f549815aaf0 2024-04-22T07:18:30.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.816+0000 7f54977fe640 1 --2- 172.21.15.37:0/3059574249 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f54980c5880 0x7f54980c7f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T07:18:30.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.816+0000 7f54967fc640 1 --2- 172.21.15.37:0/3059574249 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f549815aed0 0x7f54980c7a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T07:18:30.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.816+0000 7f5496ffd640 1 --2- 172.21.15.37:0/3059574249 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f549815aaf0 0x7f54980aec80 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f5490011a70 tx=0x7f5490011f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:30.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.816+0000 7f548f7fe640 1 -- 172.21.15.37:0/3059574249 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f549000fb50 con 0x7f549815aaf0 2024-04-22T07:18:30.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.816+0000 7f548f7fe640 1 -- 172.21.15.37:0/3059574249 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f549000fcf0 con 0x7f549815aaf0 2024-04-22T07:18:30.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.816+0000 7f549d4d2640 1 -- 172.21.15.37:0/3059574249 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54980c6c70 con 0x7f549815aaf0 2024-04-22T07:18:30.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.816+0000 7f548f7fe640 1 -- 172.21.15.37:0/3059574249 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f549000fea0 con 0x7f549815aaf0 2024-04-22T07:18:30.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.817+0000 7f549d4d2640 1 -- 172.21.15.37:0/3059574249 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54980c7230 con 0x7f549815aaf0 2024-04-22T07:18:30.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.817+0000 7f549d4d2640 1 -- 172.21.15.37:0/3059574249 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5498068b20 con 0x7f549815aaf0 2024-04-22T07:18:30.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.818+0000 7f548f7fe640 1 -- 172.21.15.37:0/3059574249 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5490012040 con 0x7f549815aaf0 2024-04-22T07:18:30.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.818+0000 7f548f7fe640 1 --2- 172.21.15.37:0/3059574249 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f547806c920 0x7f547806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:30.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.818+0000 7f548f7fe640 1 -- 172.21.15.37:0/3059574249 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f549008bef0 con 0x7f549815aaf0 2024-04-22T07:18:30.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.819+0000 7f54967fc640 1 --2- 172.21.15.37:0/3059574249 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f547806c920 0x7f547806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:30.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.819+0000 7f54967fc640 1 --2- 172.21.15.37:0/3059574249 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f547806c920 0x7f547806ede0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f5498157360 tx=0x7f5480009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:30.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:30.823+0000 7f548f7fe640 1 -- 172.21.15.37:0/3059574249 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f5490019030 con 0x7f549815aaf0 2024-04-22T07:18:31.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:31.046+0000 7f549d4d2640 1 -- 172.21.15.37:0/3059574249 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f549806d180 con 0x7f549815aaf0 2024-04-22T07:18:31.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:31.047+0000 7f548f7fe640 1 -- 172.21.15.37:0/3059574249 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1392 (secure 0 0 0) 0x7f549005a670 con 0x7f549815aaf0 2024-04-22T07:18:31.045 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-22T07:18:31.045 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6833/1549427395","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1549427395},{"type":"v1","addr":"172.21.15.37:6833","nonce":1549427395}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-04-22T07:18:31.045 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 2 2024-04-22T07:18:31.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:31.049+0000 7f549d4d2640 1 -- 172.21.15.37:0/3059574249 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f547806c920 msgr2=0x7f547806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:31.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:31.049+0000 7f549d4d2640 1 --2- 172.21.15.37:0/3059574249 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f547806c920 0x7f547806ede0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f5498157360 tx=0x7f5480009040 comp rx=0 tx=0).stop 2024-04-22T07:18:31.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:31.049+0000 7f549d4d2640 1 -- 172.21.15.37:0/3059574249 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f549815aaf0 msgr2=0x7f54980aec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:31.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:31.049+0000 7f549d4d2640 1 --2- 172.21.15.37:0/3059574249 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f549815aaf0 0x7f54980aec80 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f5490011a70 tx=0x7f5490011f30 comp rx=0 tx=0).stop 2024-04-22T07:18:31.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:31.049+0000 7f549d4d2640 1 -- 172.21.15.37:0/3059574249 shutdown_connections 2024-04-22T07:18:31.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:31.049+0000 7f549d4d2640 1 --2- 172.21.15.37:0/3059574249 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f547806c920 0x7f547806ede0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:31.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:31.049+0000 7f549d4d2640 1 --2- 172.21.15.37:0/3059574249 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f54980c5880 0x7f54980c7f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:31.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:31.049+0000 7f549d4d2640 1 --2- 172.21.15.37:0/3059574249 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f549815aed0 0x7f54980c7a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:31.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:31.049+0000 7f549d4d2640 1 --2- 172.21.15.37:0/3059574249 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f549815aaf0 0x7f54980aec80 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:31.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:31.049+0000 7f549d4d2640 1 -- 172.21.15.37:0/3059574249 >> 172.21.15.37:0/3059574249 conn(0x7f549806e3e0 msgr2=0x7f54980b3fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:31.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:31.049+0000 7f549d4d2640 1 -- 172.21.15.37:0/3059574249 shutdown_connections 2024-04-22T07:18:31.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:31.049+0000 7f549d4d2640 1 -- 172.21.15.37:0/3059574249 wait complete. 2024-04-22T07:18:33.058 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-22T07:18:33.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.174+0000 7f6597fed640 1 Processor -- start 2024-04-22T07:18:33.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.174+0000 7f6597fed640 1 -- start start 2024-04-22T07:18:33.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.175+0000 7f6597fed640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f6590154f90 0x7f65900cc7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:33.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.175+0000 7f6597fed640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65900c6d20 con 0x7f6590071f90 2024-04-22T07:18:33.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.175+0000 7f6597fed640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6590072540 con 0x7f65900caf70 2024-04-22T07:18:33.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.175+0000 7f6597fed640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f6590072820 con 0x7f6590154f90 2024-04-22T07:18:33.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.175+0000 7f6595588640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f6590071f90 0x7f659015e280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:41794/0 (socket says 172.21.15.37:41794) 2024-04-22T07:18:33.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.175+0000 7f6595588640 1 -- 172.21.15.37:0/2667904474 learned_addr learned my addr 172.21.15.37:0/2667904474 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-04-22T07:18:33.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.175+0000 7f6595d89640 1 --2- 172.21.15.37:0/2667904474 >> v2:172.21.15.196:3300/0 conn(0x7f6590154f90 0x7f65900cc7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:33.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.175+0000 7f6594d87640 1 -- 172.21.15.37:0/2667904474 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1044608241 0 0) 0x7f65900c6d20 con 0x7f6590071f90 2024-04-22T07:18:33.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.175+0000 7f6594d87640 1 -- 172.21.15.37:0/2667904474 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6578003520 con 0x7f6590071f90 2024-04-22T07:18:33.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.176+0000 7f6594d87640 1 -- 172.21.15.37:0/2667904474 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1662474937 0 0) 0x7f6578003520 con 0x7f6590071f90 2024-04-22T07:18:33.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.176+0000 7f6595d89640 1 -- 172.21.15.37:0/2667904474 >> v1:172.21.15.196:6789/0 conn(0x7f65900caf70 legacy=0x7f6590165610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:33.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.176+0000 7f6595d89640 1 -- 172.21.15.37:0/2667904474 >> v1:172.21.15.37:6789/0 conn(0x7f6590071f90 legacy=0x7f659015e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:33.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.176+0000 7f6595d89640 1 -- 172.21.15.37:0/2667904474 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65900c5f60 con 0x7f6590154f90 2024-04-22T07:18:33.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.177+0000 7f6595d89640 1 --2- 172.21.15.37:0/2667904474 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6590154f90 0x7f65900cc7a0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f6580009d90 tx=0x7f658002be10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aec91c7eefb9fa30 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:33.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.177+0000 7f6594d87640 1 -- 172.21.15.37:0/2667904474 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6580039070 con 0x7f6590154f90 2024-04-22T07:18:33.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.177+0000 7f6594d87640 1 -- 172.21.15.37:0/2667904474 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f658002c940 con 0x7f6590154f90 2024-04-22T07:18:33.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.177+0000 7f6594d87640 1 -- 172.21.15.37:0/2667904474 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6584001670 con 0x7f6590154f90 2024-04-22T07:18:33.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.177+0000 7f6597fed640 1 -- 172.21.15.37:0/2667904474 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6590154f90 msgr2=0x7f65900cc7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:33.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.177+0000 7f6597fed640 1 --2- 172.21.15.37:0/2667904474 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6590154f90 0x7f65900cc7a0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f6580009d90 tx=0x7f658002be10 comp rx=0 tx=0).stop 2024-04-22T07:18:33.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.177+0000 7f6597fed640 1 -- 172.21.15.37:0/2667904474 shutdown_connections 2024-04-22T07:18:33.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.177+0000 7f6597fed640 1 --2- 172.21.15.37:0/2667904474 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6590154f90 0x7f65900cc7a0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:33.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.177+0000 7f6597fed640 1 -- 172.21.15.37:0/2667904474 >> 172.21.15.37:0/2667904474 conn(0x7f6590067ad0 msgr2=0x7f65900d05f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:33.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.177+0000 7f6597fed640 1 -- 172.21.15.37:0/2667904474 shutdown_connections 2024-04-22T07:18:33.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.177+0000 7f6597fed640 1 -- 172.21.15.37:0/2667904474 wait complete. 2024-04-22T07:18:33.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.179+0000 7f6597fed640 1 Processor -- start 2024-04-22T07:18:33.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.179+0000 7f6597fed640 1 -- start start 2024-04-22T07:18:33.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.179+0000 7f6597fed640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6590071f90 0x7f659014f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:33.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.179+0000 7f6597fed640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f65900caf70 0x7f65901f0dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:33.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.179+0000 7f6597fed640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6590154f90 0x7f6590150870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:33.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.179+0000 7f6597fed640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f65900c6800 con 0x7f65900caf70 2024-04-22T07:18:33.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.179+0000 7f6597fed640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f65900c6520 con 0x7f6590071f90 2024-04-22T07:18:33.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.179+0000 7f6597fed640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f6590155370 con 0x7f6590154f90 2024-04-22T07:18:33.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.179+0000 7f6595588640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f65900caf70 0x7f65901f0dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:33.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.180+0000 7f6595588640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f65900caf70 0x7f65901f0dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49320/0 (socket says 172.21.15.37:49320) 2024-04-22T07:18:33.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.180+0000 7f6595588640 1 -- 172.21.15.37:0/2852418389 learned_addr learned my addr 172.21.15.37:0/2852418389 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:18:33.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.180+0000 7f6595d89640 1 --2- 172.21.15.37:0/2852418389 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6590071f90 0x7f659014f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:33.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.180+0000 7f659658a640 1 --2- 172.21.15.37:0/2852418389 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6590154f90 0x7f6590150870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:33.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.180+0000 7f6595588640 1 -- 172.21.15.37:0/2852418389 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6590154f90 msgr2=0x7f6590150870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:33.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.180+0000 7f6595588640 1 --2- 172.21.15.37:0/2852418389 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6590154f90 0x7f6590150870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:33.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.180+0000 7f6595588640 1 -- 172.21.15.37:0/2852418389 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6590071f90 msgr2=0x7f659014f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:33.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.180+0000 7f6595588640 1 --2- 172.21.15.37:0/2852418389 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6590071f90 0x7f659014f4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:33.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.180+0000 7f6595588640 1 -- 172.21.15.37:0/2852418389 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65900d0260 con 0x7f65900caf70 2024-04-22T07:18:33.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.180+0000 7f6595588640 1 --2- 172.21.15.37:0/2852418389 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f65900caf70 0x7f65901f0dc0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f658400c550 tx=0x7f658400ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:33.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.180+0000 7f658e7fc640 1 -- 172.21.15.37:0/2852418389 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6584017070 con 0x7f65900caf70 2024-04-22T07:18:33.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.180+0000 7f658e7fc640 1 -- 172.21.15.37:0/2852418389 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6584005ce0 con 0x7f65900caf70 2024-04-22T07:18:33.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.180+0000 7f6597fed640 1 -- 172.21.15.37:0/2852418389 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6590150290 con 0x7f65900caf70 2024-04-22T07:18:33.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.180+0000 7f658e7fc640 1 -- 172.21.15.37:0/2852418389 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65840072b0 con 0x7f65900caf70 2024-04-22T07:18:33.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.180+0000 7f6597fed640 1 -- 172.21.15.37:0/2852418389 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65901f05e0 con 0x7f65900caf70 2024-04-22T07:18:33.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.181+0000 7f6597fed640 1 -- 172.21.15.37:0/2852418389 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f659014ba60 con 0x7f65900caf70 2024-04-22T07:18:33.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.182+0000 7f658e7fc640 1 -- 172.21.15.37:0/2852418389 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f658401a070 con 0x7f65900caf70 2024-04-22T07:18:33.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.182+0000 7f658e7fc640 1 --2- 172.21.15.37:0/2852418389 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f657c06c920 0x7f657c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:33.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.182+0000 7f658e7fc640 1 -- 172.21.15.37:0/2852418389 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f658408ab60 con 0x7f65900caf70 2024-04-22T07:18:33.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.182+0000 7f6595d89640 1 --2- 172.21.15.37:0/2852418389 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f657c06c920 0x7f657c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:33.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.183+0000 7f6595d89640 1 --2- 172.21.15.37:0/2852418389 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f657c06c920 0x7f657c06ede0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f6580036000 tx=0x7f6580030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:33.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.187+0000 7f658e7fc640 1 -- 172.21.15.37:0/2852418389 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f6584058c90 con 0x7f65900caf70 2024-04-22T07:18:33.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.416+0000 7f6597fed640 1 -- 172.21.15.37:0/2852418389 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6590069cc0 con 0x7f65900caf70 2024-04-22T07:18:33.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.417+0000 7f658e7fc640 1 -- 172.21.15.37:0/2852418389 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+5515 (secure 0 0 0) 0x7f658405cf90 con 0x7f65900caf70 2024-04-22T07:18:33.415 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-22T07:18:33.415 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4265,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6839/671847354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6835","nonce":671847354},{"type":"v1","addr":"172.21.15.196:6839","nonce":671847354}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6833/1549427395","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1549427395},{"type":"v1","addr":"172.21.15.37:6833","nonce":1549427395}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6836/3825988951","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":3825988951},{"type":"v1","addr":"172.21.15.37:6836","nonce":3825988951}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4272,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/611771502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6835","nonce":611771502},{"type":"v1","addr":"172.21.15.37:6837","nonce":611771502}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4291,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6837/3055080225","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6834","nonce":3055080225},{"type":"v1","addr":"172.21.15.196:6837","nonce":3055080225}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4294,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6838/3264179771","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6836","nonce":3264179771},{"type":"v1","addr":"172.21.15.196:6838","nonce":3264179771}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-04-22T07:18:33.415 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 3 2024-04-22T07:18:33.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.419+0000 7f6597fed640 1 -- 172.21.15.37:0/2852418389 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f657c06c920 msgr2=0x7f657c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:33.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.419+0000 7f6597fed640 1 --2- 172.21.15.37:0/2852418389 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f657c06c920 0x7f657c06ede0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f6580036000 tx=0x7f6580030000 comp rx=0 tx=0).stop 2024-04-22T07:18:33.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.419+0000 7f6597fed640 1 -- 172.21.15.37:0/2852418389 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f65900caf70 msgr2=0x7f65901f0dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:33.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.419+0000 7f6597fed640 1 --2- 172.21.15.37:0/2852418389 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f65900caf70 0x7f65901f0dc0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f658400c550 tx=0x7f658400ca10 comp rx=0 tx=0).stop 2024-04-22T07:18:33.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.419+0000 7f6597fed640 1 -- 172.21.15.37:0/2852418389 shutdown_connections 2024-04-22T07:18:33.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.419+0000 7f6597fed640 1 --2- 172.21.15.37:0/2852418389 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f657c06c920 0x7f657c06ede0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:33.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.419+0000 7f6597fed640 1 --2- 172.21.15.37:0/2852418389 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6590154f90 0x7f6590150870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:33.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.419+0000 7f6597fed640 1 --2- 172.21.15.37:0/2852418389 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f65900caf70 0x7f65901f0dc0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:33.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.419+0000 7f6597fed640 1 --2- 172.21.15.37:0/2852418389 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6590071f90 0x7f659014f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:33.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.419+0000 7f6597fed640 1 -- 172.21.15.37:0/2852418389 >> 172.21.15.37:0/2852418389 conn(0x7f6590067ad0 msgr2=0x7f6590072a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:33.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.419+0000 7f6597fed640 1 -- 172.21.15.37:0/2852418389 shutdown_connections 2024-04-22T07:18:33.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.419+0000 7f6597fed640 1 -- 172.21.15.37:0/2852418389 wait complete. 2024-04-22T07:18:33.428 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-22T07:18:33.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.530+0000 7fac85354640 1 Processor -- start 2024-04-22T07:18:33.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.530+0000 7fac85354640 1 -- start start 2024-04-22T07:18:33.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.531+0000 7fac85354640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fac801552f0 0x7fac800cb430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:33.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.531+0000 7fac85354640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac8015f280 con 0x7fac800b38f0 2024-04-22T07:18:33.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.531+0000 7fac85354640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac800cda00 con 0x7fac800ccd10 2024-04-22T07:18:33.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.531+0000 7fac85354640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fac800b3100 con 0x7fac801552f0 2024-04-22T07:18:33.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.531+0000 7fac7effd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fac801552f0 0x7fac800cb430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:33.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.531+0000 7fac77fff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fac800b38f0 0x7fac8015aeb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:41800/0 (socket says 172.21.15.37:41800) 2024-04-22T07:18:33.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.531+0000 7fac77fff640 1 -- 172.21.15.37:0/1595199592 learned_addr learned my addr 172.21.15.37:0/1595199592 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-04-22T07:18:33.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.531+0000 7fac7effd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fac801552f0 0x7fac800cb430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49332/0 (socket says 172.21.15.37:49332) 2024-04-22T07:18:33.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.531+0000 7fac7effd640 1 -- 172.21.15.37:0/1595199592 >> v1:172.21.15.196:6789/0 conn(0x7fac800ccd10 legacy=0x7fac80165750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:33.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.531+0000 7fac7effd640 1 -- 172.21.15.37:0/1595199592 >> v1:172.21.15.37:6789/0 conn(0x7fac800b38f0 legacy=0x7fac8015aeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:33.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.531+0000 7fac7effd640 1 -- 172.21.15.37:0/1595199592 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac800b3350 con 0x7fac801552f0 2024-04-22T07:18:33.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.532+0000 7fac7effd640 1 --2- 172.21.15.37:0/1595199592 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac801552f0 0x7fac800cb430 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fac700097a0 tx=0x7fac7002b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ce2ef5fba181381 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:33.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.532+0000 7fac7e7fc640 1 -- 172.21.15.37:0/1595199592 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac70034070 con 0x7fac801552f0 2024-04-22T07:18:33.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.532+0000 7fac7e7fc640 1 -- 172.21.15.37:0/1595199592 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac70030610 con 0x7fac801552f0 2024-04-22T07:18:33.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.532+0000 7fac7e7fc640 1 -- 172.21.15.37:0/1595199592 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac700309e0 con 0x7fac801552f0 2024-04-22T07:18:33.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.532+0000 7fac85354640 1 -- 172.21.15.37:0/1595199592 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac801552f0 msgr2=0x7fac800cb430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:33.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.533+0000 7fac85354640 1 --2- 172.21.15.37:0/1595199592 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac801552f0 0x7fac800cb430 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fac700097a0 tx=0x7fac7002b960 comp rx=0 tx=0).stop 2024-04-22T07:18:33.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.533+0000 7fac85354640 1 -- 172.21.15.37:0/1595199592 shutdown_connections 2024-04-22T07:18:33.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.533+0000 7fac85354640 1 --2- 172.21.15.37:0/1595199592 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac801552f0 0x7fac800cb430 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:33.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.533+0000 7fac85354640 1 -- 172.21.15.37:0/1595199592 >> 172.21.15.37:0/1595199592 conn(0x7fac80071f90 msgr2=0x7fac800723a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:33.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.533+0000 7fac85354640 1 -- 172.21.15.37:0/1595199592 shutdown_connections 2024-04-22T07:18:33.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.533+0000 7fac85354640 1 -- 172.21.15.37:0/1595199592 wait complete. 2024-04-22T07:18:33.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.534+0000 7fac85354640 1 Processor -- start 2024-04-22T07:18:33.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.534+0000 7fac85354640 1 -- start start 2024-04-22T07:18:33.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.534+0000 7fac85354640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac800b38f0 0x7fac80149dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:33.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.534+0000 7fac85354640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fac800ccd10 0x7fac801f1570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:33.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.534+0000 7fac85354640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fac801552f0 0x7fac800c5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:33.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.534+0000 7fac85354640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fac8015e7a0 con 0x7fac800b38f0 2024-04-22T07:18:33.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.534+0000 7fac85354640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fac8015e4c0 con 0x7fac800ccd10 2024-04-22T07:18:33.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.534+0000 7fac85354640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fac8015ea80 con 0x7fac801552f0 2024-04-22T07:18:33.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.535+0000 7fac7effd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac800b38f0 0x7fac80149dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:33.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.535+0000 7fac7effd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac800b38f0 0x7fac80149dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49340/0 (socket says 172.21.15.37:49340) 2024-04-22T07:18:33.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.535+0000 7fac7effd640 1 -- 172.21.15.37:0/2410533929 learned_addr learned my addr 172.21.15.37:0/2410533929 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:18:33.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.535+0000 7fac77fff640 1 --2- 172.21.15.37:0/2410533929 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fac800ccd10 0x7fac801f1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:33.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.535+0000 7fac7f7fe640 1 --2- 172.21.15.37:0/2410533929 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fac801552f0 0x7fac800c5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:33.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.535+0000 7fac7effd640 1 -- 172.21.15.37:0/2410533929 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fac801552f0 msgr2=0x7fac800c5990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:33.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.535+0000 7fac7effd640 1 --2- 172.21.15.37:0/2410533929 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fac801552f0 0x7fac800c5990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:33.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.535+0000 7fac7effd640 1 -- 172.21.15.37:0/2410533929 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fac800ccd10 msgr2=0x7fac801f1570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:33.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.535+0000 7fac7effd640 1 --2- 172.21.15.37:0/2410533929 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fac800ccd10 0x7fac801f1570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:33.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.535+0000 7fac7effd640 1 -- 172.21.15.37:0/2410533929 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac801f1ab0 con 0x7fac800b38f0 2024-04-22T07:18:33.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.535+0000 7fac7effd640 1 --2- 172.21.15.37:0/2410533929 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac800b38f0 0x7fac80149dd0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fac70009890 tx=0x7fac700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:33.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.535+0000 7fac777fe640 1 -- 172.21.15.37:0/2410533929 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac70034040 con 0x7fac800b38f0 2024-04-22T07:18:33.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.535+0000 7fac777fe640 1 -- 172.21.15.37:0/2410533929 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac7003acc0 con 0x7fac800b38f0 2024-04-22T07:18:33.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.535+0000 7fac85354640 1 -- 172.21.15.37:0/2410533929 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac8015d0b0 con 0x7fac800b38f0 2024-04-22T07:18:33.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.535+0000 7fac777fe640 1 -- 172.21.15.37:0/2410533929 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac70044630 con 0x7fac800b38f0 2024-04-22T07:18:33.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.535+0000 7fac85354640 1 -- 172.21.15.37:0/2410533929 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac8015c010 con 0x7fac800b38f0 2024-04-22T07:18:33.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.536+0000 7fac85354640 1 -- 172.21.15.37:0/2410533929 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac80069cc0 con 0x7fac800b38f0 2024-04-22T07:18:33.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.537+0000 7fac777fe640 1 -- 172.21.15.37:0/2410533929 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fac7004b060 con 0x7fac800b38f0 2024-04-22T07:18:33.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.537+0000 7fac777fe640 1 --2- 172.21.15.37:0/2410533929 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fac6006c920 0x7fac6006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:33.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.537+0000 7fac777fe640 1 -- 172.21.15.37:0/2410533929 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7fac700ad5e0 con 0x7fac800b38f0 2024-04-22T07:18:33.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.537+0000 7fac77fff640 1 --2- 172.21.15.37:0/2410533929 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fac6006c920 0x7fac6006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:33.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.538+0000 7fac77fff640 1 --2- 172.21.15.37:0/2410533929 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fac6006c920 0x7fac6006ede0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fac80153970 tx=0x7fac68009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:33.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.542+0000 7fac777fe640 1 -- 172.21.15.37:0/2410533929 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fac7003f070 con 0x7fac800b38f0 2024-04-22T07:18:33.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.729+0000 7fac85354640 1 -- 172.21.15.37:0/2410533929 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fac800cbfe0 con 0x7fac800b38f0 2024-04-22T07:18:33.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.730+0000 7fac777fe640 1 -- 172.21.15.37:0/2410533929 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) ==== 74+0+12860 (secure 0 0 0) 0x7fac7007b710 con 0x7fac800b38f0 2024-04-22T07:18:33.728 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-22T07:18:33.728 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":16,"fsid":"10d90a41-52d3-4e09-8022-c8ac67897ad1","created":"2024-04-22T07:18:12.420756+0000","modified":"2024-04-22T07:18:26.843673+0000","last_up_change":"2024-04-22T07:18:23.649808+0000","last_in_change":"2024-04-22T07:18:14.506974+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-22T07:18:24.602243+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e248f6e1-13ad-48e0-a8f8-ec3059995654","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":1488290385},{"type":"v1","addr":"172.21.15.37:6801","nonce":1488290385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1488290385},{"type":"v1","addr":"172.21.15.37:6803","nonce":1488290385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1488290385},{"type":"v1","addr":"172.21.15.37:6807","nonce":1488290385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1488290385},{"type":"v1","addr":"172.21.15.37:6805","nonce":1488290385}]},"public_addr":"172.21.15.37:6801/1488290385","cluster_addr":"172.21.15.37:6803/1488290385","heartbeat_back_addr":"172.21.15.37:6807/1488290385","heartbeat_front_addr":"172.21.15.37:6805/1488290385","state":["exists","up"]},{"osd":1,"uuid":"01c71ab7-1326-432b-b73a-e5847abe5132","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3918584183},{"type":"v1","addr":"172.21.15.37:6811","nonce":3918584183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6813","nonce":3918584183},{"type":"v1","addr":"172.21.15.37:6816","nonce":3918584183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":3918584183},{"type":"v1","addr":"172.21.15.37:6823","nonce":3918584183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":3918584183},{"type":"v1","addr":"172.21.15.37:6821","nonce":3918584183}]},"public_addr":"172.21.15.37:6811/3918584183","cluster_addr":"172.21.15.37:6816/3918584183","heartbeat_back_addr":"172.21.15.37:6823/3918584183","heartbeat_front_addr":"172.21.15.37:6821/3918584183","state":["exists","up"]},{"osd":2,"uuid":"33a780fd-013a-41c8-9970-136c9e080897","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1895439419},{"type":"v1","addr":"172.21.15.37:6825","nonce":1895439419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1895439419},{"type":"v1","addr":"172.21.15.37:6827","nonce":1895439419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1895439419},{"type":"v1","addr":"172.21.15.37:6831","nonce":1895439419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1895439419},{"type":"v1","addr":"172.21.15.37:6829","nonce":1895439419}]},"public_addr":"172.21.15.37:6825/1895439419","cluster_addr":"172.21.15.37:6827/1895439419","heartbeat_back_addr":"172.21.15.37:6831/1895439419","heartbeat_front_addr":"172.21.15.37:6829/1895439419","state":["exists","up"]},{"osd":3,"uuid":"b46e53c4-e5b9-4098-b243-ab5a0f1f3885","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6809","nonce":1160021017},{"type":"v1","addr":"172.21.15.37:6810","nonce":1160021017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1160021017},{"type":"v1","addr":"172.21.15.37:6814","nonce":1160021017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":1160021017},{"type":"v1","addr":"172.21.15.37:6820","nonce":1160021017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6815","nonce":1160021017},{"type":"v1","addr":"172.21.15.37:6817","nonce":1160021017}]},"public_addr":"172.21.15.37:6810/1160021017","cluster_addr":"172.21.15.37:6814/1160021017","heartbeat_back_addr":"172.21.15.37:6820/1160021017","heartbeat_front_addr":"172.21.15.37:6817/1160021017","state":["exists","up"]},{"osd":4,"uuid":"cd1032c6-6a83-4e33-b7b1-baddf92a83af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":374829049},{"type":"v1","addr":"172.21.15.196:6809","nonce":374829049}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":374829049},{"type":"v1","addr":"172.21.15.196:6811","nonce":374829049}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":374829049},{"type":"v1","addr":"172.21.15.196:6815","nonce":374829049}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":374829049},{"type":"v1","addr":"172.21.15.196:6813","nonce":374829049}]},"public_addr":"172.21.15.196:6809/374829049","cluster_addr":"172.21.15.196:6811/374829049","heartbeat_back_addr":"172.21.15.196:6815/374829049","heartbeat_front_addr":"172.21.15.196:6813/374829049","state":["exists","up"]},{"osd":5,"uuid":"f561d48a-5f2d-4deb-8681-4329aed36bae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":479311302},{"type":"v1","addr":"172.21.15.196:6801","nonce":479311302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":479311302},{"type":"v1","addr":"172.21.15.196:6803","nonce":479311302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":479311302},{"type":"v1","addr":"172.21.15.196:6807","nonce":479311302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":479311302},{"type":"v1","addr":"172.21.15.196:6805","nonce":479311302}]},"public_addr":"172.21.15.196:6801/479311302","cluster_addr":"172.21.15.196:6803/479311302","heartbeat_back_addr":"172.21.15.196:6807/479311302","heartbeat_front_addr":"172.21.15.196:6805/479311302","state":["exists","up"]},{"osd":6,"uuid":"1b239c7e-2504-42e0-b308-70f4e62519c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6817","nonce":691777224},{"type":"v1","addr":"172.21.15.196:6819","nonce":691777224}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6821","nonce":691777224},{"type":"v1","addr":"172.21.15.196:6823","nonce":691777224}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6829","nonce":691777224},{"type":"v1","addr":"172.21.15.196:6831","nonce":691777224}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6825","nonce":691777224},{"type":"v1","addr":"172.21.15.196:6827","nonce":691777224}]},"public_addr":"172.21.15.196:6819/691777224","cluster_addr":"172.21.15.196:6823/691777224","heartbeat_back_addr":"172.21.15.196:6831/691777224","heartbeat_front_addr":"172.21.15.196:6827/691777224","state":["exists","up"]},{"osd":7,"uuid":"084318d4-d1fd-4b58-8c33-b1d7856fe323","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":3106266066},{"type":"v1","addr":"172.21.15.196:6818","nonce":3106266066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":3106266066},{"type":"v1","addr":"172.21.15.196:6822","nonce":3106266066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":3106266066},{"type":"v1","addr":"172.21.15.196:6830","nonce":3106266066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":3106266066},{"type":"v1","addr":"172.21.15.196:6826","nonce":3106266066}]},"public_addr":"172.21.15.196:6818/3106266066","cluster_addr":"172.21.15.196:6822/3106266066","heartbeat_back_addr":"172.21.15.196:6830/3106266066","heartbeat_front_addr":"172.21.15.196:6826/3106266066","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:18:19.587791+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:18:19.706541+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:18:19.690674+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:18:19.648354+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:18:19.666671+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:18:19.560709+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:18:19.661412+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:18:19.770650+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-22T07:18:33.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.732+0000 7fac85354640 1 -- 172.21.15.37:0/2410533929 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fac6006c920 msgr2=0x7fac6006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:33.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.732+0000 7fac85354640 1 --2- 172.21.15.37:0/2410533929 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fac6006c920 0x7fac6006ede0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fac80153970 tx=0x7fac68009040 comp rx=0 tx=0).stop 2024-04-22T07:18:33.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.732+0000 7fac85354640 1 -- 172.21.15.37:0/2410533929 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac800b38f0 msgr2=0x7fac80149dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:33.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.732+0000 7fac85354640 1 --2- 172.21.15.37:0/2410533929 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac800b38f0 0x7fac80149dd0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fac70009890 tx=0x7fac700046c0 comp rx=0 tx=0).stop 2024-04-22T07:18:33.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.732+0000 7fac85354640 1 -- 172.21.15.37:0/2410533929 shutdown_connections 2024-04-22T07:18:33.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.732+0000 7fac85354640 1 --2- 172.21.15.37:0/2410533929 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fac6006c920 0x7fac6006ede0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:33.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.732+0000 7fac85354640 1 --2- 172.21.15.37:0/2410533929 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fac801552f0 0x7fac800c5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:33.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.732+0000 7fac85354640 1 --2- 172.21.15.37:0/2410533929 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fac800ccd10 0x7fac801f1570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:33.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.732+0000 7fac85354640 1 --2- 172.21.15.37:0/2410533929 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac800b38f0 0x7fac80149dd0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:33.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.732+0000 7fac85354640 1 -- 172.21.15.37:0/2410533929 >> 172.21.15.37:0/2410533929 conn(0x7fac80071f90 msgr2=0x7fac80152eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:33.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.732+0000 7fac85354640 1 -- 172.21.15.37:0/2410533929 shutdown_connections 2024-04-22T07:18:33.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.732+0000 7fac85354640 1 -- 172.21.15.37:0/2410533929 wait complete. 2024-04-22T07:18:33.741 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-22T07:18:24.602243+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-22T07:18:33.741 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-22T07:18:33.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.846+0000 7fa215e3a640 1 Processor -- start 2024-04-22T07:18:33.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.846+0000 7fa215e3a640 1 -- start start 2024-04-22T07:18:33.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.847+0000 7fa215e3a640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fa2101551f0 0x7fa2100cc460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:33.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.847+0000 7fa215e3a640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2101555d0 con 0x7fa2100cde00 2024-04-22T07:18:33.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.847+0000 7fa215e3a640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2100ccbc0 con 0x7fa2100cb0b0 2024-04-22T07:18:33.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.847+0000 7fa215e3a640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7fa2100cc9a0 con 0x7fa2101551f0 2024-04-22T07:18:33.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.847+0000 7fa20effd640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fa2100cde00 0x7fa21015e4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:41802/0 (socket says 172.21.15.37:41802) 2024-04-22T07:18:33.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.847+0000 7fa20effd640 1 -- 172.21.15.37:0/3060248543 learned_addr learned my addr 172.21.15.37:0/3060248543 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-04-22T07:18:33.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.847+0000 7fa20f7fe640 1 --2- 172.21.15.37:0/3060248543 >> v2:172.21.15.196:3300/0 conn(0x7fa2101551f0 0x7fa2100cc460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:33.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.847+0000 7fa20e7fc640 1 -- 172.21.15.37:0/3060248543 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 283174414 0 0) 0x7fa2101555d0 con 0x7fa2100cde00 2024-04-22T07:18:33.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.847+0000 7fa20e7fc640 1 -- 172.21.15.37:0/3060248543 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa1f8003520 con 0x7fa2100cde00 2024-04-22T07:18:33.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.847+0000 7fa20e7fc640 1 -- 172.21.15.37:0/3060248543 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1450598753 0 0) 0x7fa1f8003520 con 0x7fa2100cde00 2024-04-22T07:18:33.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.847+0000 7fa20e7fc640 1 -- 172.21.15.37:0/3060248543 >> v2:172.21.15.196:3300/0 conn(0x7fa2101551f0 msgr2=0x7fa2100cc460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:18:33.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.847+0000 7fa20e7fc640 1 --2- 172.21.15.37:0/3060248543 >> v2:172.21.15.196:3300/0 conn(0x7fa2101551f0 0x7fa2100cc460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:33.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.847+0000 7fa20e7fc640 1 -- 172.21.15.37:0/3060248543 >> v1:172.21.15.196:6789/0 conn(0x7fa2100cb0b0 legacy=0x7fa2100730c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:33.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.847+0000 7fa20e7fc640 1 -- 172.21.15.37:0/3060248543 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2100ccea0 con 0x7fa2100cde00 2024-04-22T07:18:33.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.847+0000 7fa20e7fc640 1 -- 172.21.15.37:0/3060248543 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2576656170 0 0) 0x7fa204001670 con 0x7fa2100cde00 2024-04-22T07:18:33.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.847+0000 7fa20e7fc640 1 -- 172.21.15.37:0/3060248543 >> v1:172.21.15.37:6789/0 conn(0x7fa2100cde00 legacy=0x7fa21015e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:33.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.847+0000 7fa20e7fc640 1 --2- 172.21.15.37:0/3060248543 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1f80039b0 0x7fa1f8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:33.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.847+0000 7fa20e7fc640 1 --2- 172.21.15.37:0/3060248543 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa1f8004800 0x7fa1f8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:33.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.847+0000 7fa20e7fc640 1 --2- 172.21.15.37:0/3060248543 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa1f80051c0 0x7fa1f800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:33.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.847+0000 7fa20e7fc640 1 -- 172.21.15.37:0/3060248543 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa2100cc9a0 con 0x7fa1f80039b0 2024-04-22T07:18:33.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.847+0000 7fa20e7fc640 1 -- 172.21.15.37:0/3060248543 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fa1f800c070 con 0x7fa1f8004800 2024-04-22T07:18:33.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.847+0000 7fa20e7fc640 1 -- 172.21.15.37:0/3060248543 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fa1f800c270 con 0x7fa1f80051c0 2024-04-22T07:18:33.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.847+0000 7fa20f7fe640 1 --2- 172.21.15.37:0/3060248543 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1f80039b0 0x7fa1f8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:33.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.848+0000 7fa20effd640 1 --2- 172.21.15.37:0/3060248543 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa1f8004800 0x7fa1f8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:33.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.848+0000 7fa20ffff640 1 --2- 172.21.15.37:0/3060248543 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa1f80051c0 0x7fa1f800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:33.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.848+0000 7fa20f7fe640 1 -- 172.21.15.37:0/3060248543 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa1f80051c0 msgr2=0x7fa1f800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:18:33.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.848+0000 7fa20f7fe640 1 --2- 172.21.15.37:0/3060248543 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa1f80051c0 0x7fa1f800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:33.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.848+0000 7fa20f7fe640 1 -- 172.21.15.37:0/3060248543 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa1f8004800 msgr2=0x7fa1f8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:18:33.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.848+0000 7fa20f7fe640 1 --2- 172.21.15.37:0/3060248543 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa1f8004800 0x7fa1f8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:33.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.848+0000 7fa20f7fe640 1 -- 172.21.15.37:0/3060248543 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1f8003520 con 0x7fa1f80039b0 2024-04-22T07:18:33.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.848+0000 7fa20ffff640 1 -- 172.21.15.37:0/3060248543 reap_dead start 2024-04-22T07:18:33.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.849+0000 7fa20f7fe640 1 --2- 172.21.15.37:0/3060248543 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1f80039b0 0x7fa1f8003dd0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fa200009ac0 tx=0x7fa1f8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b28df52a41a1fa2 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:33.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.849+0000 7fa20e7fc640 1 -- 172.21.15.37:0/3060248543 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa200039070 con 0x7fa1f80039b0 2024-04-22T07:18:33.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.849+0000 7fa20e7fc640 1 -- 172.21.15.37:0/3060248543 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa20002c6d0 con 0x7fa1f80039b0 2024-04-22T07:18:33.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.849+0000 7fa20e7fc640 1 -- 172.21.15.37:0/3060248543 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa200009690 con 0x7fa1f80039b0 2024-04-22T07:18:33.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.849+0000 7fa215e3a640 1 -- 172.21.15.37:0/3060248543 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1f80039b0 msgr2=0x7fa1f8003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:33.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.849+0000 7fa215e3a640 1 --2- 172.21.15.37:0/3060248543 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1f80039b0 0x7fa1f8003dd0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fa200009ac0 tx=0x7fa1f8005830 comp rx=0 tx=0).stop 2024-04-22T07:18:33.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.849+0000 7fa215e3a640 1 -- 172.21.15.37:0/3060248543 shutdown_connections 2024-04-22T07:18:33.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.849+0000 7fa215e3a640 1 --2- 172.21.15.37:0/3060248543 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1f80039b0 0x7fa1f8003dd0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:33.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.849+0000 7fa215e3a640 1 -- 172.21.15.37:0/3060248543 >> 172.21.15.37:0/3060248543 conn(0x7fa21006c410 msgr2=0x7fa2100676b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:33.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.849+0000 7fa215e3a640 1 -- 172.21.15.37:0/3060248543 shutdown_connections 2024-04-22T07:18:33.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.849+0000 7fa215e3a640 1 -- 172.21.15.37:0/3060248543 wait complete. 2024-04-22T07:18:33.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.850+0000 7fa215e3a640 1 Processor -- start 2024-04-22T07:18:33.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.851+0000 7fa215e3a640 1 -- start start 2024-04-22T07:18:33.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.851+0000 7fa215e3a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1f80039b0 0x7fa2100b5460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:33.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.851+0000 7fa215e3a640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa21015a0a0 0x7fa210145290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:33.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.851+0000 7fa215e3a640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa2101457d0 0x7fa210153a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:33.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.851+0000 7fa215e3a640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa21015b5c0 con 0x7fa1f80039b0 2024-04-22T07:18:33.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.851+0000 7fa215e3a640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fa21015b2e0 con 0x7fa21015a0a0 2024-04-22T07:18:33.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.851+0000 7fa215e3a640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fa21015b8a0 con 0x7fa2101457d0 2024-04-22T07:18:33.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.851+0000 7fa20f7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1f80039b0 0x7fa2100b5460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:33.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.851+0000 7fa20f7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1f80039b0 0x7fa2100b5460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49362/0 (socket says 172.21.15.37:49362) 2024-04-22T07:18:33.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.851+0000 7fa20f7fe640 1 -- 172.21.15.37:0/3762222745 learned_addr learned my addr 172.21.15.37:0/3762222745 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:18:33.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.852+0000 7fa20ffff640 1 --2- 172.21.15.37:0/3762222745 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa2101457d0 0x7fa210153a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:33.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.852+0000 7fa20effd640 1 --2- 172.21.15.37:0/3762222745 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa21015a0a0 0x7fa210145290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:33.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.852+0000 7fa20f7fe640 1 -- 172.21.15.37:0/3762222745 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa2101457d0 msgr2=0x7fa210153a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:33.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.852+0000 7fa20f7fe640 1 --2- 172.21.15.37:0/3762222745 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa2101457d0 0x7fa210153a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:33.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.852+0000 7fa20f7fe640 1 -- 172.21.15.37:0/3762222745 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa21015a0a0 msgr2=0x7fa210145290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:33.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.852+0000 7fa20f7fe640 1 --2- 172.21.15.37:0/3762222745 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa21015a0a0 0x7fa210145290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:33.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.852+0000 7fa20f7fe640 1 -- 172.21.15.37:0/3762222745 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa210159970 con 0x7fa1f80039b0 2024-04-22T07:18:33.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.852+0000 7fa20effd640 1 --2- 172.21.15.37:0/3762222745 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa21015a0a0 0x7fa210145290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-22T07:18:33.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.852+0000 7fa20f7fe640 1 --2- 172.21.15.37:0/3762222745 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1f80039b0 0x7fa2100b5460 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fa200009ac0 tx=0x7fa200004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:33.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.852+0000 7fa1f7fff640 1 -- 172.21.15.37:0/3762222745 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa200039050 con 0x7fa1f80039b0 2024-04-22T07:18:33.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.852+0000 7fa1f7fff640 1 -- 172.21.15.37:0/3762222745 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa200045070 con 0x7fa1f80039b0 2024-04-22T07:18:33.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.852+0000 7fa215e3a640 1 -- 172.21.15.37:0/3762222745 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa210159c30 con 0x7fa1f80039b0 2024-04-22T07:18:33.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.852+0000 7fa1f7fff640 1 -- 172.21.15.37:0/3762222745 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2000044e0 con 0x7fa1f80039b0 2024-04-22T07:18:33.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.852+0000 7fa215e3a640 1 -- 172.21.15.37:0/3762222745 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa21015aa30 con 0x7fa1f80039b0 2024-04-22T07:18:33.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.853+0000 7fa215e3a640 1 -- 172.21.15.37:0/3762222745 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa210069cc0 con 0x7fa1f80039b0 2024-04-22T07:18:33.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.854+0000 7fa1f7fff640 1 -- 172.21.15.37:0/3762222745 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa200003a30 con 0x7fa1f80039b0 2024-04-22T07:18:33.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.854+0000 7fa1f7fff640 1 --2- 172.21.15.37:0/3762222745 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fa1fc06c920 0x7fa1fc06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:33.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.854+0000 7fa1f7fff640 1 -- 172.21.15.37:0/3762222745 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7fa2000ad2f0 con 0x7fa1f80039b0 2024-04-22T07:18:33.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.854+0000 7fa20effd640 1 --2- 172.21.15.37:0/3762222745 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fa1fc06c920 0x7fa1fc06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:33.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.855+0000 7fa20effd640 1 --2- 172.21.15.37:0/3762222745 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fa1fc06c920 0x7fa1fc06ede0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa210158ba0 tx=0x7fa204009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:33.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:33.858+0000 7fa1f7fff640 1 -- 172.21.15.37:0/3762222745 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fa20004e020 con 0x7fa1f80039b0 2024-04-22T07:18:34.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.045+0000 7fa215e3a640 1 -- 172.21.15.37:0/3762222745 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fa2100cab60 con 0x7fa1f80039b0 2024-04-22T07:18:34.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.045+0000 7fa1f7fff640 1 -- 172.21.15.37:0/3762222745 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) ==== 93+0+10 (secure 0 0 0) 0x7fa20007bb00 con 0x7fa1f80039b0 2024-04-22T07:18:34.043 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2024-04-22T07:18:34.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.048+0000 7fa215e3a640 1 -- 172.21.15.37:0/3762222745 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fa1fc06c920 msgr2=0x7fa1fc06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:34.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.048+0000 7fa215e3a640 1 --2- 172.21.15.37:0/3762222745 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fa1fc06c920 0x7fa1fc06ede0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa210158ba0 tx=0x7fa204009040 comp rx=0 tx=0).stop 2024-04-22T07:18:34.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.048+0000 7fa215e3a640 1 -- 172.21.15.37:0/3762222745 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1f80039b0 msgr2=0x7fa2100b5460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:34.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.048+0000 7fa215e3a640 1 --2- 172.21.15.37:0/3762222745 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1f80039b0 0x7fa2100b5460 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fa200009ac0 tx=0x7fa200004730 comp rx=0 tx=0).stop 2024-04-22T07:18:34.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.048+0000 7fa215e3a640 1 -- 172.21.15.37:0/3762222745 shutdown_connections 2024-04-22T07:18:34.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.048+0000 7fa215e3a640 1 --2- 172.21.15.37:0/3762222745 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fa1fc06c920 0x7fa1fc06ede0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:34.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.048+0000 7fa215e3a640 1 --2- 172.21.15.37:0/3762222745 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa2101457d0 0x7fa210153a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:34.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.048+0000 7fa215e3a640 1 --2- 172.21.15.37:0/3762222745 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa21015a0a0 0x7fa210145290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:34.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.048+0000 7fa215e3a640 1 --2- 172.21.15.37:0/3762222745 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1f80039b0 0x7fa2100b5460 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:34.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.048+0000 7fa215e3a640 1 -- 172.21.15.37:0/3762222745 >> 172.21.15.37:0/3762222745 conn(0x7fa21006c410 msgr2=0x7fa2100cf490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:34.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.048+0000 7fa215e3a640 1 -- 172.21.15.37:0/3762222745 shutdown_connections 2024-04-22T07:18:34.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.048+0000 7fa215e3a640 1 -- 172.21.15.37:0/3762222745 wait complete. 2024-04-22T07:18:34.056 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-22T07:18:34.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.158+0000 7f57bd043640 1 Processor -- start 2024-04-22T07:18:34.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.158+0000 7f57bd043640 1 -- start start 2024-04-22T07:18:34.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.159+0000 7f57bd043640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f57b81552f0 0x7f57b80cb430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:34.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.159+0000 7f57bd043640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f57b815f280 con 0x7f57b80b38f0 2024-04-22T07:18:34.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.159+0000 7f57bd043640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f57b80cda00 con 0x7f57b80ccd10 2024-04-22T07:18:34.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.159+0000 7f57bd043640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f57b80b3100 con 0x7f57b81552f0 2024-04-22T07:18:34.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.159+0000 7f57affff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f57b80b38f0 0x7f57b815aeb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:41808/0 (socket says 172.21.15.37:41808) 2024-04-22T07:18:34.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.159+0000 7f57affff640 1 -- 172.21.15.37:0/600985106 learned_addr learned my addr 172.21.15.37:0/600985106 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-04-22T07:18:34.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.159+0000 7f57b6d9d640 1 --2- 172.21.15.37:0/600985106 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f57b81552f0 0x7f57b80cb430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:34.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.159+0000 7f57b659c640 1 -- 172.21.15.37:0/600985106 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2759818053 0 0) 0x7f57b815f280 con 0x7f57b80b38f0 2024-04-22T07:18:34.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.159+0000 7f57b659c640 1 -- 172.21.15.37:0/600985106 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f57a4003520 con 0x7f57b80b38f0 2024-04-22T07:18:34.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.159+0000 7f57b659c640 1 -- 172.21.15.37:0/600985106 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3124207840 0 0) 0x7f57b80cda00 con 0x7f57b80ccd10 2024-04-22T07:18:34.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.159+0000 7f57b6d9d640 1 -- 172.21.15.37:0/600985106 >> v1:172.21.15.196:6789/0 conn(0x7f57b80ccd10 legacy=0x7f57b8165750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:34.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.159+0000 7f57b6d9d640 1 -- 172.21.15.37:0/600985106 >> v1:172.21.15.37:6789/0 conn(0x7f57b80b38f0 legacy=0x7f57b815aeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:34.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.159+0000 7f57b6d9d640 1 -- 172.21.15.37:0/600985106 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57b80b3350 con 0x7f57b81552f0 2024-04-22T07:18:34.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.160+0000 7f57b6d9d640 1 --2- 172.21.15.37:0/600985106 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f57b81552f0 0x7f57b80cb430 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f57a80097d0 tx=0x7f57a802b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=19b40f4b11e028b2 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:34.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.160+0000 7f57b659c640 1 -- 172.21.15.37:0/600985106 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57a8035020 con 0x7f57b81552f0 2024-04-22T07:18:34.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.160+0000 7f57b659c640 1 -- 172.21.15.37:0/600985106 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57a8031890 con 0x7f57b81552f0 2024-04-22T07:18:34.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.160+0000 7f57b659c640 1 -- 172.21.15.37:0/600985106 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57a8031c40 con 0x7f57b81552f0 2024-04-22T07:18:34.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.161+0000 7f57bd043640 1 -- 172.21.15.37:0/600985106 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f57b81552f0 msgr2=0x7f57b80cb430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:34.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.161+0000 7f57bd043640 1 --2- 172.21.15.37:0/600985106 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f57b81552f0 0x7f57b80cb430 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f57a80097d0 tx=0x7f57a802b930 comp rx=0 tx=0).stop 2024-04-22T07:18:34.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.161+0000 7f57bd043640 1 -- 172.21.15.37:0/600985106 shutdown_connections 2024-04-22T07:18:34.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.161+0000 7f57bd043640 1 --2- 172.21.15.37:0/600985106 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f57b81552f0 0x7f57b80cb430 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:34.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.161+0000 7f57bd043640 1 -- 172.21.15.37:0/600985106 >> 172.21.15.37:0/600985106 conn(0x7f57b8071f90 msgr2=0x7f57b80723a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:34.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.161+0000 7f57bd043640 1 -- 172.21.15.37:0/600985106 shutdown_connections 2024-04-22T07:18:34.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.161+0000 7f57bd043640 1 -- 172.21.15.37:0/600985106 wait complete. 2024-04-22T07:18:34.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.162+0000 7f57bd043640 1 Processor -- start 2024-04-22T07:18:34.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.162+0000 7f57bd043640 1 -- start start 2024-04-22T07:18:34.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.163+0000 7f57bd043640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57b80b38f0 0x7f57b814f260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:34.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.163+0000 7f57bd043640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f57b80ccd10 0x7f57b815ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:34.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.163+0000 7f57bd043640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f57b81552f0 0x7f57b815b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:34.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.163+0000 7f57bd043640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f57b815e7a0 con 0x7f57b80b38f0 2024-04-22T07:18:34.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.163+0000 7f57bd043640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f57b815e4c0 con 0x7f57b80ccd10 2024-04-22T07:18:34.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.163+0000 7f57bd043640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f57b815ea80 con 0x7f57b81552f0 2024-04-22T07:18:34.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.163+0000 7f57b6d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57b80b38f0 0x7f57b814f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:34.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.163+0000 7f57b6d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57b80b38f0 0x7f57b814f260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49376/0 (socket says 172.21.15.37:49376) 2024-04-22T07:18:34.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.163+0000 7f57b6d9d640 1 -- 172.21.15.37:0/2833532450 learned_addr learned my addr 172.21.15.37:0/2833532450 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:18:34.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.163+0000 7f57b759e640 1 --2- 172.21.15.37:0/2833532450 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f57b81552f0 0x7f57b815b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:34.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.163+0000 7f57affff640 1 --2- 172.21.15.37:0/2833532450 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f57b80ccd10 0x7f57b815ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:34.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.163+0000 7f57b6d9d640 1 -- 172.21.15.37:0/2833532450 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f57b81552f0 msgr2=0x7f57b815b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:34.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.163+0000 7f57b6d9d640 1 --2- 172.21.15.37:0/2833532450 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f57b81552f0 0x7f57b815b380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:34.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.163+0000 7f57b6d9d640 1 -- 172.21.15.37:0/2833532450 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f57b80ccd10 msgr2=0x7f57b815ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:34.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.163+0000 7f57b6d9d640 1 --2- 172.21.15.37:0/2833532450 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f57b80ccd10 0x7f57b815ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:34.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.163+0000 7f57b6d9d640 1 -- 172.21.15.37:0/2833532450 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57b80d0780 con 0x7f57b80b38f0 2024-04-22T07:18:34.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.163+0000 7f57b6d9d640 1 --2- 172.21.15.37:0/2833532450 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57b80b38f0 0x7f57b814f260 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f57a802b970 tx=0x7f57a80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:34.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.164+0000 7f57af7fe640 1 -- 172.21.15.37:0/2833532450 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57a8035040 con 0x7f57b80b38f0 2024-04-22T07:18:34.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.164+0000 7f57af7fe640 1 -- 172.21.15.37:0/2833532450 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57a8030d20 con 0x7f57b80b38f0 2024-04-22T07:18:34.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.164+0000 7f57bd043640 1 -- 172.21.15.37:0/2833532450 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57b80cf260 con 0x7f57b80b38f0 2024-04-22T07:18:34.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.164+0000 7f57af7fe640 1 -- 172.21.15.37:0/2833532450 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57a80456c0 con 0x7f57b80b38f0 2024-04-22T07:18:34.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.164+0000 7f57bd043640 1 -- 172.21.15.37:0/2833532450 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57b815a080 con 0x7f57b80b38f0 2024-04-22T07:18:34.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.165+0000 7f57bd043640 1 -- 172.21.15.37:0/2833532450 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f57b8069cc0 con 0x7f57b80b38f0 2024-04-22T07:18:34.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.165+0000 7f57af7fe640 1 -- 172.21.15.37:0/2833532450 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f57a8038020 con 0x7f57b80b38f0 2024-04-22T07:18:34.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.165+0000 7f57af7fe640 1 --2- 172.21.15.37:0/2833532450 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f579806c920 0x7f579806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:34.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.165+0000 7f57af7fe640 1 -- 172.21.15.37:0/2833532450 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f57a80adc20 con 0x7f57b80b38f0 2024-04-22T07:18:34.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.166+0000 7f57affff640 1 --2- 172.21.15.37:0/2833532450 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f579806c920 0x7f579806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:34.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.166+0000 7f57affff640 1 --2- 172.21.15.37:0/2833532450 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f579806c920 0x7f579806ede0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f57b814cd80 tx=0x7f57a0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:34.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.170+0000 7f57af7fe640 1 -- 172.21.15.37:0/2833532450 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f57a804a060 con 0x7f57b80b38f0 2024-04-22T07:18:34.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.356+0000 7f57bd043640 1 -- 172.21.15.37:0/2833532450 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f57b80d13e0 con 0x7f57b80b38f0 2024-04-22T07:18:34.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.357+0000 7f57af7fe640 1 -- 172.21.15.37:0/2833532450 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) ==== 84+0+65 (secure 0 0 0) 0x7f57a802d040 con 0x7f57b80b38f0 2024-04-22T07:18:34.355 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-22T07:18:34.355 INFO:teuthology.orchestra.run.smithi037.stdout:[ 2024-04-22T07:18:34.355 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-04-22T07:18:34.355 INFO:teuthology.orchestra.run.smithi037.stdout: "poolnum": 1, 2024-04-22T07:18:34.355 INFO:teuthology.orchestra.run.smithi037.stdout: "poolname": ".mgr" 2024-04-22T07:18:34.355 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-04-22T07:18:34.356 INFO:teuthology.orchestra.run.smithi037.stdout:] 2024-04-22T07:18:34.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.359+0000 7f57bd043640 1 -- 172.21.15.37:0/2833532450 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f579806c920 msgr2=0x7f579806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:34.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.359+0000 7f57bd043640 1 --2- 172.21.15.37:0/2833532450 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f579806c920 0x7f579806ede0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f57b814cd80 tx=0x7f57a0009040 comp rx=0 tx=0).stop 2024-04-22T07:18:34.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.359+0000 7f57bd043640 1 -- 172.21.15.37:0/2833532450 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57b80b38f0 msgr2=0x7f57b814f260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:34.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.359+0000 7f57bd043640 1 --2- 172.21.15.37:0/2833532450 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57b80b38f0 0x7f57b814f260 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f57a802b970 tx=0x7f57a80046c0 comp rx=0 tx=0).stop 2024-04-22T07:18:34.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.359+0000 7f57bd043640 1 -- 172.21.15.37:0/2833532450 shutdown_connections 2024-04-22T07:18:34.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.359+0000 7f57bd043640 1 --2- 172.21.15.37:0/2833532450 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f579806c920 0x7f579806ede0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:34.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.359+0000 7f57bd043640 1 --2- 172.21.15.37:0/2833532450 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f57b81552f0 0x7f57b815b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:34.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.359+0000 7f57bd043640 1 --2- 172.21.15.37:0/2833532450 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f57b80ccd10 0x7f57b815ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:34.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.359+0000 7f57bd043640 1 --2- 172.21.15.37:0/2833532450 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57b80b38f0 0x7f57b814f260 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:34.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.359+0000 7f57bd043640 1 -- 172.21.15.37:0/2833532450 >> 172.21.15.37:0/2833532450 conn(0x7f57b8071f90 msgr2=0x7f57b8153b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:34.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.359+0000 7f57bd043640 1 -- 172.21.15.37:0/2833532450 shutdown_connections 2024-04-22T07:18:34.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.359+0000 7f57bd043640 1 -- 172.21.15.37:0/2833532450 wait complete. 2024-04-22T07:18:34.367 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-22T07:18:34.367 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-22T07:18:34.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.473+0000 7ff26f975640 1 Processor -- start 2024-04-22T07:18:34.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.474+0000 7ff26f975640 1 -- start start 2024-04-22T07:18:34.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.474+0000 7ff26f975640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff26815b870 0x7ff2680c5fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:34.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.474+0000 7ff26f975640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2680c6990 con 0x7ff2681552c0 2024-04-22T07:18:34.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.474+0000 7ff26f975640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2680c66b0 con 0x7ff2680cb010 2024-04-22T07:18:34.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.474+0000 7ff26f975640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7ff2681556a0 con 0x7ff26815b870 2024-04-22T07:18:34.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.475+0000 7ff26df12640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff26815b870 0x7ff2680c5fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:34.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.475+0000 7ff26d711640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7ff2681552c0 0x7ff2680676b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:41812/0 (socket says 172.21.15.37:41812) 2024-04-22T07:18:34.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.475+0000 7ff26d711640 1 -- 172.21.15.37:0/1533442317 learned_addr learned my addr 172.21.15.37:0/1533442317 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-04-22T07:18:34.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.475+0000 7ff26df12640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff26815b870 0x7ff2680c5fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49392/0 (socket says 172.21.15.37:49392) 2024-04-22T07:18:34.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.475+0000 7ff26df12640 1 -- 172.21.15.37:0/1533442317 >> v1:172.21.15.196:6789/0 conn(0x7ff2680cb010 legacy=0x7ff26815b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:34.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.475+0000 7ff26df12640 1 -- 172.21.15.37:0/1533442317 >> v1:172.21.15.37:6789/0 conn(0x7ff2681552c0 legacy=0x7ff2680676b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:34.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.475+0000 7ff26df12640 1 -- 172.21.15.37:0/1533442317 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2680cc560 con 0x7ff26815b870 2024-04-22T07:18:34.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.475+0000 7ff25ffff640 1 -- 172.21.15.37:0/1533442317 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3197678167 0 0) 0x7ff2680c6990 con 0x7ff2681552c0 2024-04-22T07:18:34.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.476+0000 7ff26df12640 1 --2- 172.21.15.37:0/1533442317 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff26815b870 0x7ff2680c5fe0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff260009d90 tx=0x7ff26002bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4a35ee330cb5347 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:34.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.476+0000 7ff25ffff640 1 -- 172.21.15.37:0/1533442317 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff260039070 con 0x7ff26815b870 2024-04-22T07:18:34.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.476+0000 7ff25ffff640 1 -- 172.21.15.37:0/1533442317 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff26002cd00 con 0x7ff26815b870 2024-04-22T07:18:34.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.476+0000 7ff25ffff640 1 -- 172.21.15.37:0/1533442317 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff260034660 con 0x7ff26815b870 2024-04-22T07:18:34.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.476+0000 7ff26f975640 1 -- 172.21.15.37:0/1533442317 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff26815b870 msgr2=0x7ff2680c5fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:34.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.476+0000 7ff26f975640 1 --2- 172.21.15.37:0/1533442317 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff26815b870 0x7ff2680c5fe0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff260009d90 tx=0x7ff26002bf50 comp rx=0 tx=0).stop 2024-04-22T07:18:34.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.476+0000 7ff26f975640 1 -- 172.21.15.37:0/1533442317 shutdown_connections 2024-04-22T07:18:34.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.476+0000 7ff26f975640 1 --2- 172.21.15.37:0/1533442317 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff26815b870 0x7ff2680c5fe0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:34.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.476+0000 7ff26f975640 1 -- 172.21.15.37:0/1533442317 >> 172.21.15.37:0/1533442317 conn(0x7ff26806d330 msgr2=0x7ff26806c290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:34.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.476+0000 7ff26f975640 1 -- 172.21.15.37:0/1533442317 shutdown_connections 2024-04-22T07:18:34.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.476+0000 7ff26f975640 1 -- 172.21.15.37:0/1533442317 wait complete. 2024-04-22T07:18:34.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.478+0000 7ff26f975640 1 Processor -- start 2024-04-22T07:18:34.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.478+0000 7ff26f975640 1 -- start start 2024-04-22T07:18:34.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.478+0000 7ff26f975640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff2680cb010 0x7ff2681f1330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:34.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.478+0000 7ff26f975640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff2681552c0 0x7ff268154460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:34.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.478+0000 7ff26f975640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff26815b870 0x7ff268156940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:34.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.478+0000 7ff26f975640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff2680cce00 con 0x7ff2681552c0 2024-04-22T07:18:34.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.478+0000 7ff26f975640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7ff2680ccb20 con 0x7ff26815b870 2024-04-22T07:18:34.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.478+0000 7ff26f975640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7ff268067dc0 con 0x7ff2680cb010 2024-04-22T07:18:34.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.478+0000 7ff26cf10640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff2681552c0 0x7ff268154460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:34.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.478+0000 7ff26cf10640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff2681552c0 0x7ff268154460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49396/0 (socket says 172.21.15.37:49396) 2024-04-22T07:18:34.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.478+0000 7ff26cf10640 1 -- 172.21.15.37:0/2499887263 learned_addr learned my addr 172.21.15.37:0/2499887263 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:18:34.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.479+0000 7ff26d711640 1 --2- 172.21.15.37:0/2499887263 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff2680cb010 0x7ff2681f1330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:34.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.479+0000 7ff26df12640 1 --2- 172.21.15.37:0/2499887263 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff26815b870 0x7ff268156940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:34.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.479+0000 7ff26cf10640 1 -- 172.21.15.37:0/2499887263 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff2680cb010 msgr2=0x7ff2681f1330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:34.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.479+0000 7ff26cf10640 1 --2- 172.21.15.37:0/2499887263 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff2680cb010 0x7ff2681f1330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:34.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.479+0000 7ff26cf10640 1 -- 172.21.15.37:0/2499887263 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff26815b870 msgr2=0x7ff268156940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:34.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.479+0000 7ff26cf10640 1 --2- 172.21.15.37:0/2499887263 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff26815b870 0x7ff268156940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:34.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.479+0000 7ff26cf10640 1 -- 172.21.15.37:0/2499887263 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff26815a700 con 0x7ff2681552c0 2024-04-22T07:18:34.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.479+0000 7ff26df12640 1 --2- 172.21.15.37:0/2499887263 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff26815b870 0x7ff268156940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-22T07:18:34.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.479+0000 7ff26cf10640 1 --2- 172.21.15.37:0/2499887263 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff2681552c0 0x7ff268154460 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff25800c400 tx=0x7ff25800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:34.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.479+0000 7ff25dffb640 1 -- 172.21.15.37:0/2499887263 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff258017070 con 0x7ff2681552c0 2024-04-22T07:18:34.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.479+0000 7ff25dffb640 1 -- 172.21.15.37:0/2499887263 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2580052d0 con 0x7ff2681552c0 2024-04-22T07:18:34.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.479+0000 7ff26f975640 1 -- 172.21.15.37:0/2499887263 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff26815a9c0 con 0x7ff2681552c0 2024-04-22T07:18:34.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.479+0000 7ff25dffb640 1 -- 172.21.15.37:0/2499887263 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff258003830 con 0x7ff2681552c0 2024-04-22T07:18:34.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.479+0000 7ff26f975640 1 -- 172.21.15.37:0/2499887263 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff268158b70 con 0x7ff2681552c0 2024-04-22T07:18:34.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.480+0000 7ff26f975640 1 -- 172.21.15.37:0/2499887263 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff268069cc0 con 0x7ff2681552c0 2024-04-22T07:18:34.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.480+0000 7ff25dffb640 1 -- 172.21.15.37:0/2499887263 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff25801a070 con 0x7ff2681552c0 2024-04-22T07:18:34.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.481+0000 7ff25dffb640 1 --2- 172.21.15.37:0/2499887263 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7ff24c06c8f0 0x7ff24c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:34.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.481+0000 7ff25dffb640 1 -- 172.21.15.37:0/2499887263 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7ff25808ac70 con 0x7ff2681552c0 2024-04-22T07:18:34.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.481+0000 7ff26d711640 1 --2- 172.21.15.37:0/2499887263 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7ff24c06c8f0 0x7ff24c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:34.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.481+0000 7ff26d711640 1 --2- 172.21.15.37:0/2499887263 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7ff24c06c8f0 0x7ff24c06edb0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff264000f60 tx=0x7ff264007d00 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:34.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.485+0000 7ff25dffb640 1 -- 172.21.15.37:0/2499887263 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ff2580592c0 con 0x7ff2681552c0 2024-04-22T07:18:34.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.669+0000 7ff26f975640 1 -- 172.21.15.37:0/2499887263 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7ff2680cb660 con 0x7ff2681552c0 2024-04-22T07:18:34.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.727+0000 7ff25dffb640 1 -- 172.21.15.37:0/2499887263 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v17) ==== 138+0+0 (secure 0 0 0) 0x7ff258058bc0 con 0x7ff2681552c0 2024-04-22T07:18:34.725 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_metadata' created 2024-04-22T07:18:34.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.730+0000 7ff26f975640 1 -- 172.21.15.37:0/2499887263 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7ff24c06c8f0 msgr2=0x7ff24c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:34.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.730+0000 7ff26f975640 1 --2- 172.21.15.37:0/2499887263 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7ff24c06c8f0 0x7ff24c06edb0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff264000f60 tx=0x7ff264007d00 comp rx=0 tx=0).stop 2024-04-22T07:18:34.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.730+0000 7ff26f975640 1 -- 172.21.15.37:0/2499887263 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff2681552c0 msgr2=0x7ff268154460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:34.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.730+0000 7ff26f975640 1 --2- 172.21.15.37:0/2499887263 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff2681552c0 0x7ff268154460 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff25800c400 tx=0x7ff25800c8c0 comp rx=0 tx=0).stop 2024-04-22T07:18:34.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.730+0000 7ff26f975640 1 -- 172.21.15.37:0/2499887263 shutdown_connections 2024-04-22T07:18:34.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.730+0000 7ff26f975640 1 --2- 172.21.15.37:0/2499887263 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7ff24c06c8f0 0x7ff24c06edb0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:34.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.730+0000 7ff26f975640 1 --2- 172.21.15.37:0/2499887263 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff26815b870 0x7ff268156940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:34.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.730+0000 7ff26f975640 1 --2- 172.21.15.37:0/2499887263 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff2681552c0 0x7ff268154460 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:34.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.730+0000 7ff26f975640 1 --2- 172.21.15.37:0/2499887263 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff2680cb010 0x7ff2681f1330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:34.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.730+0000 7ff26f975640 1 -- 172.21.15.37:0/2499887263 >> 172.21.15.37:0/2499887263 conn(0x7ff26806d330 msgr2=0x7ff26806c290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:34.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.730+0000 7ff26f975640 1 -- 172.21.15.37:0/2499887263 shutdown_connections 2024-04-22T07:18:34.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.730+0000 7ff26f975640 1 -- 172.21.15.37:0/2499887263 wait complete. 2024-04-22T07:18:34.742 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-22T07:18:34.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.851+0000 7fbcd66eb640 1 Processor -- start 2024-04-22T07:18:34.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.851+0000 7fbcd66eb640 1 -- start start 2024-04-22T07:18:34.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.852+0000 7fbcd66eb640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbcd0152b60 0x7fbcd006f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:34.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.852+0000 7fbcd66eb640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbcd00c8b80 con 0x7fbcd00c4a00 2024-04-22T07:18:34.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.852+0000 7fbcd66eb640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbcd006ed20 con 0x7fbcd006fa20 2024-04-22T07:18:34.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.852+0000 7fbcd66eb640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fbcd006f050 con 0x7fbcd0152b60 2024-04-22T07:18:34.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.852+0000 7fbccf7fe640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fbcd00c4a00 0x7fbcd015c100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:41826/0 (socket says 172.21.15.37:41826) 2024-04-22T07:18:34.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.852+0000 7fbccf7fe640 1 -- 172.21.15.37:0/3776474776 learned_addr learned my addr 172.21.15.37:0/3776474776 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-04-22T07:18:34.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.852+0000 7fbccffff640 1 --2- 172.21.15.37:0/3776474776 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbcd0152b60 0x7fbcd006f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:34.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.852+0000 7fbcceffd640 1 -- 172.21.15.37:0/3776474776 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2053849438 0 0) 0x7fbcd00c8b80 con 0x7fbcd00c4a00 2024-04-22T07:18:34.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.852+0000 7fbcceffd640 1 -- 172.21.15.37:0/3776474776 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbcbc003520 con 0x7fbcd00c4a00 2024-04-22T07:18:34.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.852+0000 7fbcceffd640 1 -- 172.21.15.37:0/3776474776 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1803743025 0 0) 0x7fbcd006ed20 con 0x7fbcd006fa20 2024-04-22T07:18:34.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.852+0000 7fbcceffd640 1 -- 172.21.15.37:0/3776474776 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbcd00c8b80 con 0x7fbcd006fa20 2024-04-22T07:18:34.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.852+0000 7fbcceffd640 1 -- 172.21.15.37:0/3776474776 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 192948047 0 0) 0x7fbcbc003520 con 0x7fbcd00c4a00 2024-04-22T07:18:34.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.852+0000 7fbcceffd640 1 -- 172.21.15.37:0/3776474776 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbcd0152b60 msgr2=0x7fbcd006f4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:18:34.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.852+0000 7fbcceffd640 1 --2- 172.21.15.37:0/3776474776 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbcd0152b60 0x7fbcd006f4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:34.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.852+0000 7fbcceffd640 1 -- 172.21.15.37:0/3776474776 >> v1:172.21.15.196:6789/0 conn(0x7fbcd006fa20 legacy=0x7fbcd015c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:34.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.852+0000 7fbcceffd640 1 -- 172.21.15.37:0/3776474776 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcd00c85c0 con 0x7fbcd00c4a00 2024-04-22T07:18:34.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.852+0000 7fbcceffd640 1 -- 172.21.15.37:0/3776474776 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2576656170 0 0) 0x7fbcb80015f0 con 0x7fbcd00c4a00 2024-04-22T07:18:34.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.852+0000 7fbccffff640 1 --2- 172.21.15.37:0/3776474776 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbcd0152b60 0x7fbcd006f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-22T07:18:34.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.852+0000 7fbcceffd640 1 -- 172.21.15.37:0/3776474776 >> v1:172.21.15.37:6789/0 conn(0x7fbcd00c4a00 legacy=0x7fbcd015c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:34.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.853+0000 7fbcceffd640 1 --2- 172.21.15.37:0/3776474776 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbcbc003b70 0x7fbcbc003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:34.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.853+0000 7fbcceffd640 1 --2- 172.21.15.37:0/3776474776 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbcbc004800 0x7fbcbc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:34.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.853+0000 7fbcceffd640 1 --2- 172.21.15.37:0/3776474776 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbcd0152b60 0x7fbcbc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:34.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.853+0000 7fbcceffd640 1 -- 172.21.15.37:0/3776474776 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fbcd006f050 con 0x7fbcbc004800 2024-04-22T07:18:34.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.853+0000 7fbcceffd640 1 -- 172.21.15.37:0/3776474776 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fbcbc00ba70 con 0x7fbcbc003b70 2024-04-22T07:18:34.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.853+0000 7fbcceffd640 1 -- 172.21.15.37:0/3776474776 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fbcbc00bc40 con 0x7fbcd0152b60 2024-04-22T07:18:34.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.853+0000 7fbccf7fe640 1 --2- 172.21.15.37:0/3776474776 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbcbc004800 0x7fbcbc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:34.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.853+0000 7fbccffff640 1 --2- 172.21.15.37:0/3776474776 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbcbc003b70 0x7fbcbc003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:34.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.853+0000 7fbcd4c88640 1 --2- 172.21.15.37:0/3776474776 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbcd0152b60 0x7fbcbc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:34.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.853+0000 7fbccf7fe640 1 -- 172.21.15.37:0/3776474776 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbcd0152b60 msgr2=0x7fbcbc0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:18:34.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.853+0000 7fbccf7fe640 1 --2- 172.21.15.37:0/3776474776 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbcd0152b60 0x7fbcbc0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:34.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.853+0000 7fbccf7fe640 1 -- 172.21.15.37:0/3776474776 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbcbc003b70 msgr2=0x7fbcbc003f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:18:34.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.853+0000 7fbccf7fe640 1 --2- 172.21.15.37:0/3776474776 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbcbc003b70 0x7fbcbc003f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:34.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.853+0000 7fbccf7fe640 1 -- 172.21.15.37:0/3776474776 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcbc003520 con 0x7fbcbc004800 2024-04-22T07:18:34.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.854+0000 7fbccf7fe640 1 --2- 172.21.15.37:0/3776474776 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbcbc004800 0x7fbcbc004c80 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fbcb8007f50 tx=0x7fbcbc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88491c9a4ec769da server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:34.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.854+0000 7fbcceffd640 1 -- 172.21.15.37:0/3776474776 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcb8007ba0 con 0x7fbcbc004800 2024-04-22T07:18:34.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.854+0000 7fbcceffd640 1 -- 172.21.15.37:0/3776474776 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbcb8030070 con 0x7fbcbc004800 2024-04-22T07:18:34.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.854+0000 7fbcceffd640 1 -- 172.21.15.37:0/3776474776 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcb8005df0 con 0x7fbcbc004800 2024-04-22T07:18:34.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.854+0000 7fbcd66eb640 1 -- 172.21.15.37:0/3776474776 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbcbc004800 msgr2=0x7fbcbc004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:34.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.854+0000 7fbcd66eb640 1 --2- 172.21.15.37:0/3776474776 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbcbc004800 0x7fbcbc004c80 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fbcb8007f50 tx=0x7fbcbc005830 comp rx=0 tx=0).stop 2024-04-22T07:18:34.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.854+0000 7fbcd4c88640 1 -- 172.21.15.37:0/3776474776 reap_dead start 2024-04-22T07:18:34.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.854+0000 7fbcd66eb640 1 -- 172.21.15.37:0/3776474776 shutdown_connections 2024-04-22T07:18:34.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.854+0000 7fbcd66eb640 1 -- 172.21.15.37:0/3776474776 >> 172.21.15.37:0/3776474776 conn(0x7fbcd00cc270 msgr2=0x7fbcd00cc680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:34.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.854+0000 7fbcd66eb640 1 -- 172.21.15.37:0/3776474776 shutdown_connections 2024-04-22T07:18:34.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.854+0000 7fbcd66eb640 1 -- 172.21.15.37:0/3776474776 wait complete. 2024-04-22T07:18:34.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.856+0000 7fbcd66eb640 1 Processor -- start 2024-04-22T07:18:34.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.856+0000 7fbcd66eb640 1 -- start start 2024-04-22T07:18:34.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.856+0000 7fbcd66eb640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbcbc004800 0x7fbcd0148160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:34.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.856+0000 7fbcd66eb640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbcd01486a0 0x7fbcd0159eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:34.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.856+0000 7fbcd66eb640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbcd015a3f0 0x7fbcd01f1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:34.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.856+0000 7fbcd66eb640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fbcd0152f40 con 0x7fbcbc004800 2024-04-22T07:18:34.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.856+0000 7fbcd66eb640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fbcd006d630 con 0x7fbcd01486a0 2024-04-22T07:18:34.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.856+0000 7fbcd66eb640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fbcd00c4fd0 con 0x7fbcd015a3f0 2024-04-22T07:18:34.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.857+0000 7fbccffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbcbc004800 0x7fbcd0148160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:34.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.857+0000 7fbccffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbcbc004800 0x7fbcd0148160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49406/0 (socket says 172.21.15.37:49406) 2024-04-22T07:18:34.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.857+0000 7fbccffff640 1 -- 172.21.15.37:0/1699112225 learned_addr learned my addr 172.21.15.37:0/1699112225 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:18:34.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.857+0000 7fbcd4c88640 1 --2- 172.21.15.37:0/1699112225 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbcd015a3f0 0x7fbcd01f1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:34.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.857+0000 7fbccf7fe640 1 --2- 172.21.15.37:0/1699112225 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbcd01486a0 0x7fbcd0159eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:34.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.857+0000 7fbccffff640 1 -- 172.21.15.37:0/1699112225 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbcd015a3f0 msgr2=0x7fbcd01f1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:34.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.857+0000 7fbccffff640 1 --2- 172.21.15.37:0/1699112225 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbcd015a3f0 0x7fbcd01f1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:34.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.857+0000 7fbccffff640 1 -- 172.21.15.37:0/1699112225 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbcd01486a0 msgr2=0x7fbcd0159eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:34.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.857+0000 7fbccffff640 1 --2- 172.21.15.37:0/1699112225 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbcd01486a0 0x7fbcd0159eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:34.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.857+0000 7fbccffff640 1 -- 172.21.15.37:0/1699112225 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcd015a8a0 con 0x7fbcbc004800 2024-04-22T07:18:34.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.857+0000 7fbccffff640 1 --2- 172.21.15.37:0/1699112225 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbcbc004800 0x7fbcd0148160 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fbcc0011930 tx=0x7fbcc0011df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:34.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.857+0000 7fbcccff9640 1 -- 172.21.15.37:0/1699112225 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcc000faf0 con 0x7fbcbc004800 2024-04-22T07:18:34.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.857+0000 7fbcccff9640 1 -- 172.21.15.37:0/1699112225 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbcc000fc90 con 0x7fbcbc004800 2024-04-22T07:18:34.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.857+0000 7fbcd66eb640 1 -- 172.21.15.37:0/1699112225 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbcd01f1c50 con 0x7fbcbc004800 2024-04-22T07:18:34.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.857+0000 7fbcccff9640 1 -- 172.21.15.37:0/1699112225 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcc0004030 con 0x7fbcbc004800 2024-04-22T07:18:34.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.857+0000 7fbcd66eb640 1 -- 172.21.15.37:0/1699112225 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbcd01ee820 con 0x7fbcbc004800 2024-04-22T07:18:34.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.858+0000 7fbcd66eb640 1 -- 172.21.15.37:0/1699112225 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbcd0069cc0 con 0x7fbcbc004800 2024-04-22T07:18:34.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.859+0000 7fbcccff9640 1 -- 172.21.15.37:0/1699112225 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fbcc0012040 con 0x7fbcbc004800 2024-04-22T07:18:34.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.859+0000 7fbcccff9640 1 --2- 172.21.15.37:0/1699112225 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fbcb006c8f0 0x7fbcb006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:34.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.859+0000 7fbcccff9640 1 -- 172.21.15.37:0/1699112225 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 5227+0+0 (secure 0 0 0) 0x7fbcc008bca0 con 0x7fbcbc004800 2024-04-22T07:18:34.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.860+0000 7fbccf7fe640 1 --2- 172.21.15.37:0/1699112225 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fbcb006c8f0 0x7fbcb006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:34.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.860+0000 7fbccf7fe640 1 --2- 172.21.15.37:0/1699112225 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fbcb006c8f0 0x7fbcb006edb0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fbcbc0057e0 tx=0x7fbcb8009030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:34.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:34.864+0000 7fbcccff9640 1 -- 172.21.15.37:0/1699112225 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fbcc0019070 con 0x7fbcbc004800 2024-04-22T07:18:35.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:35.051+0000 7fbcd66eb640 1 -- 172.21.15.37:0/1699112225 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fbcd00c3bc0 con 0x7fbcbc004800 2024-04-22T07:18:35.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:35.730+0000 7fbcccff9640 1 -- 172.21.15.37:0/1699112225 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v18) ==== 170+0+0 (secure 0 0 0) 0x7fbcc005a220 con 0x7fbcbc004800 2024-04-22T07:18:35.728 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_data' created 2024-04-22T07:18:35.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:35.733+0000 7fbcd66eb640 1 -- 172.21.15.37:0/1699112225 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fbcb006c8f0 msgr2=0x7fbcb006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:35.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:35.733+0000 7fbcd66eb640 1 --2- 172.21.15.37:0/1699112225 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fbcb006c8f0 0x7fbcb006edb0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fbcbc0057e0 tx=0x7fbcb8009030 comp rx=0 tx=0).stop 2024-04-22T07:18:35.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:35.733+0000 7fbcd66eb640 1 -- 172.21.15.37:0/1699112225 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbcbc004800 msgr2=0x7fbcd0148160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:35.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:35.733+0000 7fbcd66eb640 1 --2- 172.21.15.37:0/1699112225 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbcbc004800 0x7fbcd0148160 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fbcc0011930 tx=0x7fbcc0011df0 comp rx=0 tx=0).stop 2024-04-22T07:18:35.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:35.733+0000 7fbcd66eb640 1 -- 172.21.15.37:0/1699112225 shutdown_connections 2024-04-22T07:18:35.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:35.733+0000 7fbcd66eb640 1 --2- 172.21.15.37:0/1699112225 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fbcb006c8f0 0x7fbcb006edb0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:35.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:35.733+0000 7fbcd66eb640 1 --2- 172.21.15.37:0/1699112225 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbcd015a3f0 0x7fbcd01f1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:35.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:35.733+0000 7fbcd66eb640 1 --2- 172.21.15.37:0/1699112225 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbcd01486a0 0x7fbcd0159eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:35.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:35.733+0000 7fbcd66eb640 1 --2- 172.21.15.37:0/1699112225 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbcbc004800 0x7fbcd0148160 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:35.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:35.733+0000 7fbcd66eb640 1 -- 172.21.15.37:0/1699112225 >> 172.21.15.37:0/1699112225 conn(0x7fbcd00cc270 msgr2=0x7fbcd00c78d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:35.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:35.733+0000 7fbcd66eb640 1 -- 172.21.15.37:0/1699112225 shutdown_connections 2024-04-22T07:18:35.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:35.733+0000 7fbcd66eb640 1 -- 172.21.15.37:0/1699112225 wait complete. 2024-04-22T07:18:35.758 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-22T07:18:35.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:35.869+0000 7fc1d6adf640 1 Processor -- start 2024-04-22T07:18:35.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:35.869+0000 7fc1d6adf640 1 -- start start 2024-04-22T07:18:35.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:35.870+0000 7fc1d6adf640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fc1d01551f0 0x7fc1d00cc460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:35.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:35.870+0000 7fc1d6adf640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc1d00cde00 0x7fc1d015e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:35.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:35.870+0000 7fc1d6adf640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc1d015ea20 0x7fc1d00730c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:35.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:35.870+0000 7fc1d6adf640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fc1d00cc9a0 con 0x7fc1d015ea20 2024-04-22T07:18:35.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:35.870+0000 7fc1d6adf640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7fc1d01555d0 con 0x7fc1d01551f0 2024-04-22T07:18:35.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:35.870+0000 7fc1d6adf640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fc1d00ccbc0 con 0x7fc1d00cde00 2024-04-22T07:18:35.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:35.870+0000 7fc1d507c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc1d015ea20 0x7fc1d00730c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:35.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:35.870+0000 7fc1d507c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc1d015ea20 0x7fc1d00730c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49408/0 (socket says 172.21.15.37:49408) 2024-04-22T07:18:35.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:35.870+0000 7fc1d507c640 1 -- 172.21.15.37:0/1910759925 learned_addr learned my addr 172.21.15.37:0/1910759925 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:18:35.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:35.870+0000 7fc1cffff640 1 --2- 172.21.15.37:0/1910759925 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc1d00cde00 0x7fc1d015e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:35.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:35.870+0000 7fc1d487b640 1 --2- 172.21.15.37:0/1910759925 >> v2:172.21.15.196:3300/0 conn(0x7fc1d01551f0 0x7fc1d00cc460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:35.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:35.870+0000 7fc1d507c640 1 -- 172.21.15.37:0/1910759925 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc1d00cde00 msgr2=0x7fc1d015e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:18:35.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:35.870+0000 7fc1d507c640 1 --2- 172.21.15.37:0/1910759925 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc1d00cde00 0x7fc1d015e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:35.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:35.870+0000 7fc1d507c640 1 -- 172.21.15.37:0/1910759925 >> v2:172.21.15.196:3300/0 conn(0x7fc1d01551f0 msgr2=0x7fc1d00cc460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:18:35.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:35.870+0000 7fc1d507c640 1 --2- 172.21.15.37:0/1910759925 >> v2:172.21.15.196:3300/0 conn(0x7fc1d01551f0 0x7fc1d00cc460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:35.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:35.870+0000 7fc1d507c640 1 -- 172.21.15.37:0/1910759925 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1d00ccea0 con 0x7fc1d015ea20 2024-04-22T07:18:35.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:35.871+0000 7fc1d507c640 1 --2- 172.21.15.37:0/1910759925 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc1d015ea20 0x7fc1d00730c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc1d0073c40 tx=0x7fc1c802bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93eae3b3f46d930 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:35.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:35.871+0000 7fc1cf7fe640 1 -- 172.21.15.37:0/1910759925 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1c802cb00 con 0x7fc1d015ea20 2024-04-22T07:18:35.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:35.871+0000 7fc1cf7fe640 1 -- 172.21.15.37:0/1910759925 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1c802cca0 con 0x7fc1d015ea20 2024-04-22T07:18:35.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:35.871+0000 7fc1cf7fe640 1 -- 172.21.15.37:0/1910759925 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1c8034610 con 0x7fc1d015ea20 2024-04-22T07:18:35.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:35.872+0000 7fc1d6adf640 1 -- 172.21.15.37:0/1910759925 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc1d015ea20 msgr2=0x7fc1d00730c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:35.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:35.872+0000 7fc1d6adf640 1 --2- 172.21.15.37:0/1910759925 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc1d015ea20 0x7fc1d00730c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc1d0073c40 tx=0x7fc1c802bf60 comp rx=0 tx=0).stop 2024-04-22T07:18:35.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:35.872+0000 7fc1d6adf640 1 -- 172.21.15.37:0/1910759925 shutdown_connections 2024-04-22T07:18:35.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:35.872+0000 7fc1d6adf640 1 --2- 172.21.15.37:0/1910759925 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc1d00cde00 0x7fc1d015e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:35.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:35.872+0000 7fc1d6adf640 1 --2- 172.21.15.37:0/1910759925 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc1d015ea20 0x7fc1d00730c0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:35.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:35.872+0000 7fc1d6adf640 1 --2- 172.21.15.37:0/1910759925 >> v2:172.21.15.196:3300/0 conn(0x7fc1d01551f0 0x7fc1d00cc460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:35.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:35.872+0000 7fc1d6adf640 1 -- 172.21.15.37:0/1910759925 >> 172.21.15.37:0/1910759925 conn(0x7fc1d006c410 msgr2=0x7fc1d00676b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:35.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:35.872+0000 7fc1d6adf640 1 -- 172.21.15.37:0/1910759925 shutdown_connections 2024-04-22T07:18:35.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:35.872+0000 7fc1d6adf640 1 -- 172.21.15.37:0/1910759925 wait complete. 2024-04-22T07:18:35.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:35.873+0000 7fc1d6adf640 1 Processor -- start 2024-04-22T07:18:35.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:35.873+0000 7fc1d6adf640 1 -- start start 2024-04-22T07:18:35.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:35.874+0000 7fc1d6adf640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc1d00cde00 0x7fc1d00b54a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:35.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:35.874+0000 7fc1d6adf640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc1d01551f0 0x7fc1d0152ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:35.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:35.874+0000 7fc1d6adf640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc1d015ea20 0x7fc1d0153430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:35.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:35.874+0000 7fc1d6adf640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc1d015b5c0 con 0x7fc1d01551f0 2024-04-22T07:18:35.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:35.874+0000 7fc1d6adf640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fc1d015b2e0 con 0x7fc1d015ea20 2024-04-22T07:18:35.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:35.874+0000 7fc1d6adf640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fc1d015b8a0 con 0x7fc1d00cde00 2024-04-22T07:18:35.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:35.874+0000 7fc1cffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc1d01551f0 0x7fc1d0152ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:35.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:35.874+0000 7fc1cffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc1d01551f0 0x7fc1d0152ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49416/0 (socket says 172.21.15.37:49416) 2024-04-22T07:18:35.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:35.874+0000 7fc1cffff640 1 -- 172.21.15.37:0/3077135113 learned_addr learned my addr 172.21.15.37:0/3077135113 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:18:35.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:35.874+0000 7fc1d487b640 1 --2- 172.21.15.37:0/3077135113 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc1d00cde00 0x7fc1d00b54a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:35.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:35.874+0000 7fc1d507c640 1 --2- 172.21.15.37:0/3077135113 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc1d015ea20 0x7fc1d0153430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:35.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:35.874+0000 7fc1cffff640 1 -- 172.21.15.37:0/3077135113 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc1d00cde00 msgr2=0x7fc1d00b54a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:35.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:35.874+0000 7fc1cffff640 1 --2- 172.21.15.37:0/3077135113 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc1d00cde00 0x7fc1d00b54a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:35.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:35.874+0000 7fc1cffff640 1 -- 172.21.15.37:0/3077135113 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc1d015ea20 msgr2=0x7fc1d0153430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:35.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:35.874+0000 7fc1cffff640 1 --2- 172.21.15.37:0/3077135113 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc1d015ea20 0x7fc1d0153430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:35.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:35.874+0000 7fc1cffff640 1 -- 172.21.15.37:0/3077135113 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1d0152a10 con 0x7fc1d01551f0 2024-04-22T07:18:35.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:35.874+0000 7fc1cffff640 1 --2- 172.21.15.37:0/3077135113 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc1d01551f0 0x7fc1d0152ef0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc1bc00e890 tx=0x7fc1bc00ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:35.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:35.874+0000 7fc1cd7fa640 1 -- 172.21.15.37:0/3077135113 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1bc017070 con 0x7fc1d01551f0 2024-04-22T07:18:35.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:35.874+0000 7fc1cd7fa640 1 -- 172.21.15.37:0/3077135113 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1bc00c940 con 0x7fc1d01551f0 2024-04-22T07:18:35.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:35.874+0000 7fc1d6adf640 1 -- 172.21.15.37:0/3077135113 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1d0154200 con 0x7fc1d01551f0 2024-04-22T07:18:35.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:35.874+0000 7fc1cd7fa640 1 -- 172.21.15.37:0/3077135113 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1bc00cd10 con 0x7fc1d01551f0 2024-04-22T07:18:35.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:35.874+0000 7fc1d6adf640 1 -- 172.21.15.37:0/3077135113 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1d015cb70 con 0x7fc1d01551f0 2024-04-22T07:18:35.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:35.875+0000 7fc1d6adf640 1 -- 172.21.15.37:0/3077135113 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1d0069cc0 con 0x7fc1d01551f0 2024-04-22T07:18:35.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:35.876+0000 7fc1cd7fa640 1 -- 172.21.15.37:0/3077135113 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc1bc01a070 con 0x7fc1d01551f0 2024-04-22T07:18:35.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:35.876+0000 7fc1cd7fa640 1 --2- 172.21.15.37:0/3077135113 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fc1b406c8f0 0x7fc1b406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:35.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:35.877+0000 7fc1cd7fa640 1 -- 172.21.15.37:0/3077135113 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 5609+0+0 (secure 0 0 0) 0x7fc1bc08bd80 con 0x7fc1d01551f0 2024-04-22T07:18:35.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:35.877+0000 7fc1d487b640 1 --2- 172.21.15.37:0/3077135113 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fc1b406c8f0 0x7fc1b406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:35.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:35.877+0000 7fc1d487b640 1 --2- 172.21.15.37:0/3077135113 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fc1b406c8f0 0x7fc1b406edb0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc1c4009b40 tx=0x7fc1c4009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:35.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:35.881+0000 7fc1cd7fa640 1 -- 172.21.15.37:0/3077135113 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc1bc059bc0 con 0x7fc1d01551f0 2024-04-22T07:18:36.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:36.110+0000 7fc1d6adf640 1 -- 172.21.15.37:0/3077135113 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fc1d00cab60 con 0x7fc1d01551f0 2024-04-22T07:18:36.503 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-22T07:18:36.506 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-22T07:18:36.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:36.756+0000 7fc1cd7fa640 1 -- 172.21.15.37:0/3077135113 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7fc1bc05dec0 con 0x7fc1d01551f0 2024-04-22T07:18:36.754 INFO:teuthology.orchestra.run.smithi037.stderr:new fs with metadata pool 2 and data pool 3 2024-04-22T07:18:36.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:36.763+0000 7fc1d6adf640 1 -- 172.21.15.37:0/3077135113 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fc1b406c8f0 msgr2=0x7fc1b406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:36.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:36.763+0000 7fc1d6adf640 1 --2- 172.21.15.37:0/3077135113 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fc1b406c8f0 0x7fc1b406edb0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc1c4009b40 tx=0x7fc1c4009190 comp rx=0 tx=0).stop 2024-04-22T07:18:36.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:36.763+0000 7fc1d6adf640 1 -- 172.21.15.37:0/3077135113 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc1d01551f0 msgr2=0x7fc1d0152ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:36.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:36.763+0000 7fc1d6adf640 1 --2- 172.21.15.37:0/3077135113 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc1d01551f0 0x7fc1d0152ef0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc1bc00e890 tx=0x7fc1bc00ed50 comp rx=0 tx=0).stop 2024-04-22T07:18:36.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:36.764+0000 7fc1d6adf640 1 -- 172.21.15.37:0/3077135113 shutdown_connections 2024-04-22T07:18:36.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:36.764+0000 7fc1d6adf640 1 --2- 172.21.15.37:0/3077135113 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fc1b406c8f0 0x7fc1b406edb0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:36.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:36.764+0000 7fc1d6adf640 1 --2- 172.21.15.37:0/3077135113 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc1d015ea20 0x7fc1d0153430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:36.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:36.764+0000 7fc1d6adf640 1 --2- 172.21.15.37:0/3077135113 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc1d01551f0 0x7fc1d0152ef0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:36.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:36.764+0000 7fc1d6adf640 1 --2- 172.21.15.37:0/3077135113 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc1d00cde00 0x7fc1d00b54a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:36.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:36.764+0000 7fc1d6adf640 1 -- 172.21.15.37:0/3077135113 >> 172.21.15.37:0/3077135113 conn(0x7fc1d006c410 msgr2=0x7fc1d014a810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:36.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:36.764+0000 7fc1d6adf640 1 -- 172.21.15.37:0/3077135113 shutdown_connections 2024-04-22T07:18:36.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:36.764+0000 7fc1d6adf640 1 -- 172.21.15.37:0/3077135113 wait complete. 2024-04-22T07:18:36.780 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-22T07:18:36.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:36.887+0000 7f7033a3a640 1 Processor -- start 2024-04-22T07:18:36.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:36.887+0000 7f7033a3a640 1 -- start start 2024-04-22T07:18:36.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:36.888+0000 7f7033a3a640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f702c0d0af0 0x7f702c0d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:36.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:36.888+0000 7f7033a3a640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f702c15ae70 con 0x7f702c06c6a0 2024-04-22T07:18:36.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:36.888+0000 7f7033a3a640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f702c0cc650 con 0x7f702c1550b0 2024-04-22T07:18:36.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:36.888+0000 7f7033a3a640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f702c0c5530 con 0x7f702c0d0af0 2024-04-22T07:18:36.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:36.888+0000 7f7030fd5640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f702c06c6a0 0x7f702c15b610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:41842/0 (socket says 172.21.15.37:41842) 2024-04-22T07:18:36.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:36.888+0000 7f7030fd5640 1 -- 172.21.15.37:0/1169680524 learned_addr learned my addr 172.21.15.37:0/1169680524 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-04-22T07:18:36.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:36.888+0000 7f7031fd7640 1 --2- 172.21.15.37:0/1169680524 >> v2:172.21.15.196:3300/0 conn(0x7f702c0d0af0 0x7f702c0d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:36.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:36.889+0000 7f702bfff640 1 -- 172.21.15.37:0/1169680524 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2724869998 0 0) 0x7f7020001110 con 0x7f702c06c6a0 2024-04-22T07:18:36.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:36.889+0000 7f702bfff640 1 -- 172.21.15.37:0/1169680524 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7014003520 con 0x7f702c06c6a0 2024-04-22T07:18:36.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:36.889+0000 7f702bfff640 1 -- 172.21.15.37:0/1169680524 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3207069046 0 0) 0x7f702c0cc650 con 0x7f702c1550b0 2024-04-22T07:18:36.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:36.889+0000 7f702bfff640 1 -- 172.21.15.37:0/1169680524 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7020001110 con 0x7f702c1550b0 2024-04-22T07:18:36.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:36.889+0000 7f702bfff640 1 -- 172.21.15.37:0/1169680524 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3851376535 0 0) 0x7f7014003520 con 0x7f702c06c6a0 2024-04-22T07:18:36.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:36.889+0000 7f702bfff640 1 -- 172.21.15.37:0/1169680524 >> v2:172.21.15.196:3300/0 conn(0x7f702c0d0af0 msgr2=0x7f702c0d0f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:18:36.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:36.889+0000 7f702bfff640 1 --2- 172.21.15.37:0/1169680524 >> v2:172.21.15.196:3300/0 conn(0x7f702c0d0af0 0x7f702c0d0f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:36.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:36.889+0000 7f702bfff640 1 -- 172.21.15.37:0/1169680524 >> v1:172.21.15.196:6789/0 conn(0x7f702c1550b0 legacy=0x7f702c0cbf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:36.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:36.889+0000 7f702bfff640 1 -- 172.21.15.37:0/1169680524 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f702c15f290 con 0x7f702c06c6a0 2024-04-22T07:18:36.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:36.889+0000 7f702bfff640 1 -- 172.21.15.37:0/1169680524 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2576656170 0 0) 0x7f7020001840 con 0x7f702c06c6a0 2024-04-22T07:18:36.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:36.889+0000 7f702bfff640 1 -- 172.21.15.37:0/1169680524 >> v1:172.21.15.37:6789/0 conn(0x7f702c06c6a0 legacy=0x7f702c15b610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:36.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:36.889+0000 7f702bfff640 1 --2- 172.21.15.37:0/1169680524 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7014003b40 0x7f7014003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:36.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:36.889+0000 7f702bfff640 1 --2- 172.21.15.37:0/1169680524 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7014004800 0x7f7014004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:36.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:36.889+0000 7f702bfff640 1 --2- 172.21.15.37:0/1169680524 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70140051c0 0x7f701400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:36.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:36.889+0000 7f702bfff640 1 -- 172.21.15.37:0/1169680524 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f701400c010 con 0x7f70140051c0 2024-04-22T07:18:36.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:36.889+0000 7f702bfff640 1 -- 172.21.15.37:0/1169680524 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f701400c1c0 con 0x7f7014004800 2024-04-22T07:18:36.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:36.889+0000 7f702bfff640 1 -- 172.21.15.37:0/1169680524 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f701400c3c0 con 0x7f7014003b40 2024-04-22T07:18:36.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:36.889+0000 7f7031fd7640 1 --2- 172.21.15.37:0/1169680524 >> v2:172.21.15.196:3300/0 conn(0x7f702c0d0af0 0x7f702c0d0f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-22T07:18:36.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:36.889+0000 7f7031fd7640 1 --2- 172.21.15.37:0/1169680524 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70140051c0 0x7f701400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:36.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:36.889+0000 7f7030fd5640 1 --2- 172.21.15.37:0/1169680524 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7014004800 0x7f7014004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:36.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:36.889+0000 7f70317d6640 1 --2- 172.21.15.37:0/1169680524 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7014003b40 0x7f7014003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:36.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:36.889+0000 7f7031fd7640 1 -- 172.21.15.37:0/1169680524 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7014003b40 msgr2=0x7f7014003f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:18:36.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:36.889+0000 7f7031fd7640 1 --2- 172.21.15.37:0/1169680524 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7014003b40 0x7f7014003f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:36.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:36.889+0000 7f7031fd7640 1 -- 172.21.15.37:0/1169680524 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7014004800 msgr2=0x7f7014004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:18:36.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:36.889+0000 7f7031fd7640 1 --2- 172.21.15.37:0/1169680524 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7014004800 0x7f7014004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:36.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:36.889+0000 7f7031fd7640 1 -- 172.21.15.37:0/1169680524 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7014003520 con 0x7f70140051c0 2024-04-22T07:18:36.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:36.890+0000 7f7031fd7640 1 -- 172.21.15.37:0/1169680524 reap_dead start 2024-04-22T07:18:36.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:36.890+0000 7f7031fd7640 1 --2- 172.21.15.37:0/1169680524 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70140051c0 0x7f701400b9c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7024009c70 tx=0x7f7014005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=154c3c342ad89c2d server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:36.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:36.890+0000 7f702bfff640 1 -- 172.21.15.37:0/1169680524 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7024009840 con 0x7f70140051c0 2024-04-22T07:18:36.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:36.890+0000 7f702bfff640 1 -- 172.21.15.37:0/1169680524 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7024004020 con 0x7f70140051c0 2024-04-22T07:18:36.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:36.890+0000 7f702bfff640 1 -- 172.21.15.37:0/1169680524 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7024004410 con 0x7f70140051c0 2024-04-22T07:18:36.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:36.891+0000 7f7033a3a640 1 -- 172.21.15.37:0/1169680524 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70140051c0 msgr2=0x7f701400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:36.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:36.891+0000 7f7033a3a640 1 --2- 172.21.15.37:0/1169680524 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70140051c0 0x7f701400b9c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7024009c70 tx=0x7f7014005830 comp rx=0 tx=0).stop 2024-04-22T07:18:36.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:36.891+0000 7f7033a3a640 1 -- 172.21.15.37:0/1169680524 shutdown_connections 2024-04-22T07:18:36.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:36.891+0000 7f7033a3a640 1 --2- 172.21.15.37:0/1169680524 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70140051c0 0x7f701400b9c0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:36.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:36.891+0000 7f7033a3a640 1 -- 172.21.15.37:0/1169680524 >> 172.21.15.37:0/1169680524 conn(0x7f702c073630 msgr2=0x7f702c073a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:36.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:36.891+0000 7f7033a3a640 1 -- 172.21.15.37:0/1169680524 shutdown_connections 2024-04-22T07:18:36.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:36.891+0000 7f7033a3a640 1 -- 172.21.15.37:0/1169680524 wait complete. 2024-04-22T07:18:36.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:36.892+0000 7f7033a3a640 1 Processor -- start 2024-04-22T07:18:36.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:36.892+0000 7f7033a3a640 1 -- start start 2024-04-22T07:18:36.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:36.893+0000 7f7033a3a640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f70140051c0 0x7f702c156290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:36.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:36.893+0000 7f7033a3a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f702c0ca8c0 0x7f702c0cf880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:36.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:36.893+0000 7f7033a3a640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f702c1f0bd0 0x7f702c1511a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:36.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:36.893+0000 7f7033a3a640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f702c15b0f0 con 0x7f702c0ca8c0 2024-04-22T07:18:36.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:36.893+0000 7f7033a3a640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f702c0ccbd0 con 0x7f70140051c0 2024-04-22T07:18:36.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:36.893+0000 7f7033a3a640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f702c155490 con 0x7f702c1f0bd0 2024-04-22T07:18:36.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:36.893+0000 7f7030fd5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f702c0ca8c0 0x7f702c0cf880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:36.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:36.893+0000 7f7030fd5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f702c0ca8c0 0x7f702c0cf880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49436/0 (socket says 172.21.15.37:49436) 2024-04-22T07:18:36.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:36.893+0000 7f7030fd5640 1 -- 172.21.15.37:0/862917772 learned_addr learned my addr 172.21.15.37:0/862917772 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:18:36.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:36.893+0000 7f70317d6640 1 --2- 172.21.15.37:0/862917772 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f70140051c0 0x7f702c156290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:36.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:36.893+0000 7f7031fd7640 1 --2- 172.21.15.37:0/862917772 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f702c1f0bd0 0x7f702c1511a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:36.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:36.893+0000 7f7030fd5640 1 -- 172.21.15.37:0/862917772 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f702c1f0bd0 msgr2=0x7f702c1511a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:36.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:36.893+0000 7f7030fd5640 1 --2- 172.21.15.37:0/862917772 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f702c1f0bd0 0x7f702c1511a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:36.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:36.893+0000 7f7030fd5640 1 -- 172.21.15.37:0/862917772 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f70140051c0 msgr2=0x7f702c156290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:36.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:36.893+0000 7f7030fd5640 1 --2- 172.21.15.37:0/862917772 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f70140051c0 0x7f702c156290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:36.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:36.893+0000 7f7030fd5640 1 -- 172.21.15.37:0/862917772 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f702c0c7c50 con 0x7f702c0ca8c0 2024-04-22T07:18:36.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:36.893+0000 7f70317d6640 1 --2- 172.21.15.37:0/862917772 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f70140051c0 0x7f702c156290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T07:18:36.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:36.893+0000 7f7031fd7640 1 --2- 172.21.15.37:0/862917772 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f702c1f0bd0 0x7f702c1511a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T07:18:36.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:36.894+0000 7f7030fd5640 1 --2- 172.21.15.37:0/862917772 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f702c0ca8c0 0x7f702c0cf880 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7020007340 tx=0x7f7020007800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:36.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:36.894+0000 7f7029ffb640 1 -- 172.21.15.37:0/862917772 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f702001a070 con 0x7f702c0ca8c0 2024-04-22T07:18:36.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:36.894+0000 7f7029ffb640 1 -- 172.21.15.37:0/862917772 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f702000f9a0 con 0x7f702c0ca8c0 2024-04-22T07:18:36.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:36.894+0000 7f7033a3a640 1 -- 172.21.15.37:0/862917772 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f702c0c7f30 con 0x7f702c0ca8c0 2024-04-22T07:18:36.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:36.894+0000 7f7029ffb640 1 -- 172.21.15.37:0/862917772 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f702000fd70 con 0x7f702c0ca8c0 2024-04-22T07:18:36.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:36.894+0000 7f7033a3a640 1 -- 172.21.15.37:0/862917772 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f702c1f4670 con 0x7f702c0ca8c0 2024-04-22T07:18:36.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:36.895+0000 7f7033a3a640 1 -- 172.21.15.37:0/862917772 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f702c069cc0 con 0x7f702c0ca8c0 2024-04-22T07:18:36.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:36.895+0000 7f7029ffb640 1 -- 172.21.15.37:0/862917772 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f702001d070 con 0x7f702c0ca8c0 2024-04-22T07:18:36.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:36.896+0000 7f7029ffb640 1 --2- 172.21.15.37:0/862917772 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f701806c920 0x7f701806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:36.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:36.896+0000 7f7029ffb640 1 -- 172.21.15.37:0/862917772 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5709+0+0 (secure 0 0 0) 0x7f702008b5e0 con 0x7f702c0ca8c0 2024-04-22T07:18:36.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:36.896+0000 7f70317d6640 1 --2- 172.21.15.37:0/862917772 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f701806c920 0x7f701806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:36.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:36.896+0000 7f70317d6640 1 --2- 172.21.15.37:0/862917772 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f701806c920 0x7f701806ede0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f701c000f80 tx=0x7f701c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:36.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:36.900+0000 7f7029ffb640 1 -- 172.21.15.37:0/862917772 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f702c15ae70 con 0x7f702c0ca8c0 2024-04-22T07:18:37.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:37.084+0000 7f7033a3a640 1 -- 172.21.15.37:0/862917772 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f702c0cb560 con 0x7f702c0ca8c0 2024-04-22T07:18:37.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:37.085+0000 7f7029ffb640 1 -- 172.21.15.37:0/862917772 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) ==== 74+0+16594 (secure 0 0 0) 0x7f7020059a10 con 0x7f702c0ca8c0 2024-04-22T07:18:37.083 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-22T07:18:37.083 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":19,"fsid":"10d90a41-52d3-4e09-8022-c8ac67897ad1","created":"2024-04-22T07:18:12.420756+0000","modified":"2024-04-22T07:18:36.111652+0000","last_up_change":"2024-04-22T07:18:23.649808+0000","last_in_change":"2024-04-22T07:18:14.506974+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-22T07:18:24.602243+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-22T07:18:34.673639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-22T07:18:35.055184+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e248f6e1-13ad-48e0-a8f8-ec3059995654","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":1488290385},{"type":"v1","addr":"172.21.15.37:6801","nonce":1488290385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1488290385},{"type":"v1","addr":"172.21.15.37:6803","nonce":1488290385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1488290385},{"type":"v1","addr":"172.21.15.37:6807","nonce":1488290385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1488290385},{"type":"v1","addr":"172.21.15.37:6805","nonce":1488290385}]},"public_addr":"172.21.15.37:6801/1488290385","cluster_addr":"172.21.15.37:6803/1488290385","heartbeat_back_addr":"172.21.15.37:6807/1488290385","heartbeat_front_addr":"172.21.15.37:6805/1488290385","state":["exists","up"]},{"osd":1,"uuid":"01c71ab7-1326-432b-b73a-e5847abe5132","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3918584183},{"type":"v1","addr":"172.21.15.37:6811","nonce":3918584183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6813","nonce":3918584183},{"type":"v1","addr":"172.21.15.37:6816","nonce":3918584183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":3918584183},{"type":"v1","addr":"172.21.15.37:6823","nonce":3918584183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":3918584183},{"type":"v1","addr":"172.21.15.37:6821","nonce":3918584183}]},"public_addr":"172.21.15.37:6811/3918584183","cluster_addr":"172.21.15.37:6816/3918584183","heartbeat_back_addr":"172.21.15.37:6823/3918584183","heartbeat_front_addr":"172.21.15.37:6821/3918584183","state":["exists","up"]},{"osd":2,"uuid":"33a780fd-013a-41c8-9970-136c9e080897","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1895439419},{"type":"v1","addr":"172.21.15.37:6825","nonce":1895439419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1895439419},{"type":"v1","addr":"172.21.15.37:6827","nonce":1895439419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1895439419},{"type":"v1","addr":"172.21.15.37:6831","nonce":1895439419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1895439419},{"type":"v1","addr":"172.21.15.37:6829","nonce":1895439419}]},"public_addr":"172.21.15.37:6825/1895439419","cluster_addr":"172.21.15.37:6827/1895439419","heartbeat_back_addr":"172.21.15.37:6831/1895439419","heartbeat_front_addr":"172.21.15.37:6829/1895439419","state":["exists","up"]},{"osd":3,"uuid":"b46e53c4-e5b9-4098-b243-ab5a0f1f3885","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6809","nonce":1160021017},{"type":"v1","addr":"172.21.15.37:6810","nonce":1160021017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1160021017},{"type":"v1","addr":"172.21.15.37:6814","nonce":1160021017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":1160021017},{"type":"v1","addr":"172.21.15.37:6820","nonce":1160021017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6815","nonce":1160021017},{"type":"v1","addr":"172.21.15.37:6817","nonce":1160021017}]},"public_addr":"172.21.15.37:6810/1160021017","cluster_addr":"172.21.15.37:6814/1160021017","heartbeat_back_addr":"172.21.15.37:6820/1160021017","heartbeat_front_addr":"172.21.15.37:6817/1160021017","state":["exists","up"]},{"osd":4,"uuid":"cd1032c6-6a83-4e33-b7b1-baddf92a83af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":374829049},{"type":"v1","addr":"172.21.15.196:6809","nonce":374829049}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":374829049},{"type":"v1","addr":"172.21.15.196:6811","nonce":374829049}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":374829049},{"type":"v1","addr":"172.21.15.196:6815","nonce":374829049}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":374829049},{"type":"v1","addr":"172.21.15.196:6813","nonce":374829049}]},"public_addr":"172.21.15.196:6809/374829049","cluster_addr":"172.21.15.196:6811/374829049","heartbeat_back_addr":"172.21.15.196:6815/374829049","heartbeat_front_addr":"172.21.15.196:6813/374829049","state":["exists","up"]},{"osd":5,"uuid":"f561d48a-5f2d-4deb-8681-4329aed36bae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":479311302},{"type":"v1","addr":"172.21.15.196:6801","nonce":479311302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":479311302},{"type":"v1","addr":"172.21.15.196:6803","nonce":479311302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":479311302},{"type":"v1","addr":"172.21.15.196:6807","nonce":479311302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":479311302},{"type":"v1","addr":"172.21.15.196:6805","nonce":479311302}]},"public_addr":"172.21.15.196:6801/479311302","cluster_addr":"172.21.15.196:6803/479311302","heartbeat_back_addr":"172.21.15.196:6807/479311302","heartbeat_front_addr":"172.21.15.196:6805/479311302","state":["exists","up"]},{"osd":6,"uuid":"1b239c7e-2504-42e0-b308-70f4e62519c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6817","nonce":691777224},{"type":"v1","addr":"172.21.15.196:6819","nonce":691777224}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6821","nonce":691777224},{"type":"v1","addr":"172.21.15.196:6823","nonce":691777224}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6829","nonce":691777224},{"type":"v1","addr":"172.21.15.196:6831","nonce":691777224}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6825","nonce":691777224},{"type":"v1","addr":"172.21.15.196:6827","nonce":691777224}]},"public_addr":"172.21.15.196:6819/691777224","cluster_addr":"172.21.15.196:6823/691777224","heartbeat_back_addr":"172.21.15.196:6831/691777224","heartbeat_front_addr":"172.21.15.196:6827/691777224","state":["exists","up"]},{"osd":7,"uuid":"084318d4-d1fd-4b58-8c33-b1d7856fe323","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":3106266066},{"type":"v1","addr":"172.21.15.196:6818","nonce":3106266066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":3106266066},{"type":"v1","addr":"172.21.15.196:6822","nonce":3106266066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":3106266066},{"type":"v1","addr":"172.21.15.196:6830","nonce":3106266066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":3106266066},{"type":"v1","addr":"172.21.15.196:6826","nonce":3106266066}]},"public_addr":"172.21.15.196:6818/3106266066","cluster_addr":"172.21.15.196:6822/3106266066","heartbeat_back_addr":"172.21.15.196:6830/3106266066","heartbeat_front_addr":"172.21.15.196:6826/3106266066","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:18:19.587791+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:18:19.706541+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:18:19.690674+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:18:19.648354+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:18:19.666671+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:18:19.560709+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:18:19.661412+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:18:19.770650+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-22T07:18:37.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:37.087+0000 7f7033a3a640 1 -- 172.21.15.37:0/862917772 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f701806c920 msgr2=0x7f701806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:37.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:37.087+0000 7f7033a3a640 1 --2- 172.21.15.37:0/862917772 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f701806c920 0x7f701806ede0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f701c000f80 tx=0x7f701c009040 comp rx=0 tx=0).stop 2024-04-22T07:18:37.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:37.087+0000 7f7033a3a640 1 -- 172.21.15.37:0/862917772 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f702c0ca8c0 msgr2=0x7f702c0cf880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:37.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:37.087+0000 7f7033a3a640 1 --2- 172.21.15.37:0/862917772 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f702c0ca8c0 0x7f702c0cf880 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7020007340 tx=0x7f7020007800 comp rx=0 tx=0).stop 2024-04-22T07:18:37.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:37.087+0000 7f7033a3a640 1 -- 172.21.15.37:0/862917772 shutdown_connections 2024-04-22T07:18:37.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:37.087+0000 7f7033a3a640 1 --2- 172.21.15.37:0/862917772 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f701806c920 0x7f701806ede0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:37.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:37.087+0000 7f7033a3a640 1 --2- 172.21.15.37:0/862917772 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f702c1f0bd0 0x7f702c1511a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:37.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:37.087+0000 7f7033a3a640 1 --2- 172.21.15.37:0/862917772 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f702c0ca8c0 0x7f702c0cf880 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:37.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:37.087+0000 7f7033a3a640 1 --2- 172.21.15.37:0/862917772 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f70140051c0 0x7f702c156290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:37.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:37.087+0000 7f7033a3a640 1 -- 172.21.15.37:0/862917772 >> 172.21.15.37:0/862917772 conn(0x7f702c073630 msgr2=0x7f702c0b3c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:37.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:37.087+0000 7f7033a3a640 1 -- 172.21.15.37:0/862917772 shutdown_connections 2024-04-22T07:18:37.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:37.087+0000 7f7033a3a640 1 -- 172.21.15.37:0/862917772 wait complete. 2024-04-22T07:18:37.096 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-22T07:18:37.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:37.198+0000 7f67333a4640 1 Processor -- start 2024-04-22T07:18:37.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:37.198+0000 7f67333a4640 1 -- start start 2024-04-22T07:18:37.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:37.199+0000 7f67333a4640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f672c1552f0 0x7f672c0cb430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:37.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:37.199+0000 7f67333a4640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f672c0ccd10 0x7f672c0cd150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:37.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:37.199+0000 7f67333a4640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f672c15f280 con 0x7f672c0b38f0 2024-04-22T07:18:37.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:37.199+0000 7f67333a4640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f672c0b3100 con 0x7f672c0ccd10 2024-04-22T07:18:37.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:37.199+0000 7f67333a4640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f672c0cda00 con 0x7f672c1552f0 2024-04-22T07:18:37.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:37.199+0000 7f6731941640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f672c0ccd10 0x7f672c0cd150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:37.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:37.199+0000 7f6731941640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f672c0ccd10 0x7f672c0cd150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49448/0 (socket says 172.21.15.37:49448) 2024-04-22T07:18:37.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:37.199+0000 7f6731941640 1 -- 172.21.15.37:0/3651058278 learned_addr learned my addr 172.21.15.37:0/3651058278 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:18:37.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:37.199+0000 7f673093f640 1 --1- 172.21.15.37:0/3651058278 >> v1:172.21.15.37:6789/0 conn(0x7f672c0b38f0 0x7f672c15aeb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:41854/0 (socket says 172.21.15.37:41854) 2024-04-22T07:18:37.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:37.199+0000 7f6731140640 1 --2- 172.21.15.37:0/3651058278 >> v2:172.21.15.196:3300/0 conn(0x7f672c1552f0 0x7f672c0cb430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:37.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:37.199+0000 7f6731941640 1 -- 172.21.15.37:0/3651058278 >> v2:172.21.15.196:3300/0 conn(0x7f672c1552f0 msgr2=0x7f672c0cb430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:18:37.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:37.199+0000 7f6731941640 1 --2- 172.21.15.37:0/3651058278 >> v2:172.21.15.196:3300/0 conn(0x7f672c1552f0 0x7f672c0cb430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:37.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:37.199+0000 7f6731941640 1 -- 172.21.15.37:0/3651058278 >> v1:172.21.15.37:6789/0 conn(0x7f672c0b38f0 legacy=0x7f672c15aeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:37.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:37.199+0000 7f6723fff640 1 -- 172.21.15.37:0/3651058278 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4036291834 0 0) 0x7f672c15f280 con 0x7f672c0b38f0 2024-04-22T07:18:37.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:37.199+0000 7f6731941640 1 -- 172.21.15.37:0/3651058278 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f672c0b3350 con 0x7f672c0ccd10 2024-04-22T07:18:37.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:37.199+0000 7f6731140640 1 --2- 172.21.15.37:0/3651058278 >> v2:172.21.15.196:3300/0 conn(0x7f672c1552f0 0x7f672c0cb430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-22T07:18:37.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:37.200+0000 7f6731941640 1 --2- 172.21.15.37:0/3651058278 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f672c0ccd10 0x7f672c0cd150 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f672c0d1750 tx=0x7f672402bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d248a615f61ad4b server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:37.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:37.200+0000 7f6723fff640 1 -- 172.21.15.37:0/3651058278 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f672402cb20 con 0x7f672c0ccd10 2024-04-22T07:18:37.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:37.200+0000 7f6723fff640 1 -- 172.21.15.37:0/3651058278 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f672402ccc0 con 0x7f672c0ccd10 2024-04-22T07:18:37.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:37.200+0000 7f6723fff640 1 -- 172.21.15.37:0/3651058278 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6724034610 con 0x7f672c0ccd10 2024-04-22T07:18:37.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:37.201+0000 7f67333a4640 1 -- 172.21.15.37:0/3651058278 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f672c0ccd10 msgr2=0x7f672c0cd150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:37.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:37.201+0000 7f67333a4640 1 --2- 172.21.15.37:0/3651058278 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f672c0ccd10 0x7f672c0cd150 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f672c0d1750 tx=0x7f672402bf80 comp rx=0 tx=0).stop 2024-04-22T07:18:37.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:37.201+0000 7f67333a4640 1 -- 172.21.15.37:0/3651058278 shutdown_connections 2024-04-22T07:18:37.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:37.201+0000 7f67333a4640 1 --2- 172.21.15.37:0/3651058278 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f672c0ccd10 0x7f672c0cd150 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:37.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:37.201+0000 7f67333a4640 1 --2- 172.21.15.37:0/3651058278 >> v2:172.21.15.196:3300/0 conn(0x7f672c1552f0 0x7f672c0cb430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:37.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:37.201+0000 7f67333a4640 1 -- 172.21.15.37:0/3651058278 >> 172.21.15.37:0/3651058278 conn(0x7f672c071f90 msgr2=0x7f672c0723a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:37.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:37.201+0000 7f67333a4640 1 -- 172.21.15.37:0/3651058278 shutdown_connections 2024-04-22T07:18:37.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:37.201+0000 7f67333a4640 1 -- 172.21.15.37:0/3651058278 wait complete. 2024-04-22T07:18:37.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:37.202+0000 7f67333a4640 1 Processor -- start 2024-04-22T07:18:37.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:37.202+0000 7f67333a4640 1 -- start start 2024-04-22T07:18:37.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:37.203+0000 7f67333a4640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f672c0b38f0 0x7f672c14ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:37.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:37.203+0000 7f67333a4640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f672c0ccd10 0x7f672c1f3be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:37.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:37.203+0000 7f67333a4640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f672c1552f0 0x7f672c1f4120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:37.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:37.203+0000 7f67333a4640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f672c15e7a0 con 0x7f672c1552f0 2024-04-22T07:18:37.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:37.203+0000 7f67333a4640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f672c15e4c0 con 0x7f672c0ccd10 2024-04-22T07:18:37.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:37.203+0000 7f67333a4640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f672c15ea80 con 0x7f672c0b38f0 2024-04-22T07:18:37.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:37.203+0000 7f6731941640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f672c1552f0 0x7f672c1f4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:37.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:37.203+0000 7f6731941640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f672c1552f0 0x7f672c1f4120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49462/0 (socket says 172.21.15.37:49462) 2024-04-22T07:18:37.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:37.203+0000 7f6731941640 1 -- 172.21.15.37:0/2602311971 learned_addr learned my addr 172.21.15.37:0/2602311971 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:18:37.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:37.203+0000 7f6731140640 1 --2- 172.21.15.37:0/2602311971 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f672c0b38f0 0x7f672c14ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:37.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:37.203+0000 7f673093f640 1 --2- 172.21.15.37:0/2602311971 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f672c0ccd10 0x7f672c1f3be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:37.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:37.203+0000 7f6731941640 1 -- 172.21.15.37:0/2602311971 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f672c0b38f0 msgr2=0x7f672c14ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:37.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:37.203+0000 7f6731941640 1 --2- 172.21.15.37:0/2602311971 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f672c0b38f0 0x7f672c14ecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:37.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:37.203+0000 7f6731941640 1 -- 172.21.15.37:0/2602311971 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f672c0ccd10 msgr2=0x7f672c1f3be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:37.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:37.203+0000 7f6731941640 1 --2- 172.21.15.37:0/2602311971 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f672c0ccd10 0x7f672c1f3be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:37.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:37.203+0000 7f6731941640 1 -- 172.21.15.37:0/2602311971 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f672c155820 con 0x7f672c1552f0 2024-04-22T07:18:37.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:37.203+0000 7f6731941640 1 --2- 172.21.15.37:0/2602311971 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f672c1552f0 0x7f672c1f4120 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f672402c590 tx=0x7f6724004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:37.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:37.204+0000 7f6721ffb640 1 -- 172.21.15.37:0/2602311971 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6724043020 con 0x7f672c1552f0 2024-04-22T07:18:37.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:37.204+0000 7f6721ffb640 1 -- 172.21.15.37:0/2602311971 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f672403e450 con 0x7f672c1552f0 2024-04-22T07:18:37.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:37.204+0000 7f67333a4640 1 -- 172.21.15.37:0/2602311971 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f672c155ac0 con 0x7f672c1552f0 2024-04-22T07:18:37.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:37.204+0000 7f6721ffb640 1 -- 172.21.15.37:0/2602311971 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6724009510 con 0x7f672c1552f0 2024-04-22T07:18:37.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:37.204+0000 7f67333a4640 1 -- 172.21.15.37:0/2602311971 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f672c1577a0 con 0x7f672c1552f0 2024-04-22T07:18:37.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:37.205+0000 7f67333a4640 1 -- 172.21.15.37:0/2602311971 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f672c069cc0 con 0x7f672c1552f0 2024-04-22T07:18:37.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:37.205+0000 7f6721ffb640 1 -- 172.21.15.37:0/2602311971 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6724046020 con 0x7f672c1552f0 2024-04-22T07:18:37.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:37.206+0000 7f6721ffb640 1 --2- 172.21.15.37:0/2602311971 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f671006c8f0 0x7f671006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:37.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:37.206+0000 7f6721ffb640 1 -- 172.21.15.37:0/2602311971 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5709+0+0 (secure 0 0 0) 0x7f67240ae5f0 con 0x7f672c1552f0 2024-04-22T07:18:37.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:37.206+0000 7f6731140640 1 --2- 172.21.15.37:0/2602311971 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f671006c8f0 0x7f671006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:37.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:37.206+0000 7f6731140640 1 --2- 172.21.15.37:0/2602311971 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f671006c8f0 0x7f671006edb0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f672800aac0 tx=0x7f6728008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:37.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:37.210+0000 7f6721ffb640 1 -- 172.21.15.37:0/2602311971 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f672404d020 con 0x7f672c1552f0 2024-04-22T07:18:37.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:37.398+0000 7f67333a4640 1 -- 172.21.15.37:0/2602311971 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f672c0cbfe0 con 0x7f672c1552f0 2024-04-22T07:18:37.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:37.399+0000 7f6721ffb640 1 -- 172.21.15.37:0/2602311971 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) ==== 74+0+16594 (secure 0 0 0) 0x7f672407c3d0 con 0x7f672c1552f0 2024-04-22T07:18:37.397 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-22T07:18:37.397 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":19,"fsid":"10d90a41-52d3-4e09-8022-c8ac67897ad1","created":"2024-04-22T07:18:12.420756+0000","modified":"2024-04-22T07:18:36.111652+0000","last_up_change":"2024-04-22T07:18:23.649808+0000","last_in_change":"2024-04-22T07:18:14.506974+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-22T07:18:24.602243+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-22T07:18:34.673639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-22T07:18:35.055184+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e248f6e1-13ad-48e0-a8f8-ec3059995654","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":1488290385},{"type":"v1","addr":"172.21.15.37:6801","nonce":1488290385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1488290385},{"type":"v1","addr":"172.21.15.37:6803","nonce":1488290385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1488290385},{"type":"v1","addr":"172.21.15.37:6807","nonce":1488290385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1488290385},{"type":"v1","addr":"172.21.15.37:6805","nonce":1488290385}]},"public_addr":"172.21.15.37:6801/1488290385","cluster_addr":"172.21.15.37:6803/1488290385","heartbeat_back_addr":"172.21.15.37:6807/1488290385","heartbeat_front_addr":"172.21.15.37:6805/1488290385","state":["exists","up"]},{"osd":1,"uuid":"01c71ab7-1326-432b-b73a-e5847abe5132","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3918584183},{"type":"v1","addr":"172.21.15.37:6811","nonce":3918584183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6813","nonce":3918584183},{"type":"v1","addr":"172.21.15.37:6816","nonce":3918584183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":3918584183},{"type":"v1","addr":"172.21.15.37:6823","nonce":3918584183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":3918584183},{"type":"v1","addr":"172.21.15.37:6821","nonce":3918584183}]},"public_addr":"172.21.15.37:6811/3918584183","cluster_addr":"172.21.15.37:6816/3918584183","heartbeat_back_addr":"172.21.15.37:6823/3918584183","heartbeat_front_addr":"172.21.15.37:6821/3918584183","state":["exists","up"]},{"osd":2,"uuid":"33a780fd-013a-41c8-9970-136c9e080897","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1895439419},{"type":"v1","addr":"172.21.15.37:6825","nonce":1895439419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1895439419},{"type":"v1","addr":"172.21.15.37:6827","nonce":1895439419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1895439419},{"type":"v1","addr":"172.21.15.37:6831","nonce":1895439419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1895439419},{"type":"v1","addr":"172.21.15.37:6829","nonce":1895439419}]},"public_addr":"172.21.15.37:6825/1895439419","cluster_addr":"172.21.15.37:6827/1895439419","heartbeat_back_addr":"172.21.15.37:6831/1895439419","heartbeat_front_addr":"172.21.15.37:6829/1895439419","state":["exists","up"]},{"osd":3,"uuid":"b46e53c4-e5b9-4098-b243-ab5a0f1f3885","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6809","nonce":1160021017},{"type":"v1","addr":"172.21.15.37:6810","nonce":1160021017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1160021017},{"type":"v1","addr":"172.21.15.37:6814","nonce":1160021017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":1160021017},{"type":"v1","addr":"172.21.15.37:6820","nonce":1160021017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6815","nonce":1160021017},{"type":"v1","addr":"172.21.15.37:6817","nonce":1160021017}]},"public_addr":"172.21.15.37:6810/1160021017","cluster_addr":"172.21.15.37:6814/1160021017","heartbeat_back_addr":"172.21.15.37:6820/1160021017","heartbeat_front_addr":"172.21.15.37:6817/1160021017","state":["exists","up"]},{"osd":4,"uuid":"cd1032c6-6a83-4e33-b7b1-baddf92a83af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":374829049},{"type":"v1","addr":"172.21.15.196:6809","nonce":374829049}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":374829049},{"type":"v1","addr":"172.21.15.196:6811","nonce":374829049}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":374829049},{"type":"v1","addr":"172.21.15.196:6815","nonce":374829049}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":374829049},{"type":"v1","addr":"172.21.15.196:6813","nonce":374829049}]},"public_addr":"172.21.15.196:6809/374829049","cluster_addr":"172.21.15.196:6811/374829049","heartbeat_back_addr":"172.21.15.196:6815/374829049","heartbeat_front_addr":"172.21.15.196:6813/374829049","state":["exists","up"]},{"osd":5,"uuid":"f561d48a-5f2d-4deb-8681-4329aed36bae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":479311302},{"type":"v1","addr":"172.21.15.196:6801","nonce":479311302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":479311302},{"type":"v1","addr":"172.21.15.196:6803","nonce":479311302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":479311302},{"type":"v1","addr":"172.21.15.196:6807","nonce":479311302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":479311302},{"type":"v1","addr":"172.21.15.196:6805","nonce":479311302}]},"public_addr":"172.21.15.196:6801/479311302","cluster_addr":"172.21.15.196:6803/479311302","heartbeat_back_addr":"172.21.15.196:6807/479311302","heartbeat_front_addr":"172.21.15.196:6805/479311302","state":["exists","up"]},{"osd":6,"uuid":"1b239c7e-2504-42e0-b308-70f4e62519c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6817","nonce":691777224},{"type":"v1","addr":"172.21.15.196:6819","nonce":691777224}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6821","nonce":691777224},{"type":"v1","addr":"172.21.15.196:6823","nonce":691777224}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6829","nonce":691777224},{"type":"v1","addr":"172.21.15.196:6831","nonce":691777224}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6825","nonce":691777224},{"type":"v1","addr":"172.21.15.196:6827","nonce":691777224}]},"public_addr":"172.21.15.196:6819/691777224","cluster_addr":"172.21.15.196:6823/691777224","heartbeat_back_addr":"172.21.15.196:6831/691777224","heartbeat_front_addr":"172.21.15.196:6827/691777224","state":["exists","up"]},{"osd":7,"uuid":"084318d4-d1fd-4b58-8c33-b1d7856fe323","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":3106266066},{"type":"v1","addr":"172.21.15.196:6818","nonce":3106266066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":3106266066},{"type":"v1","addr":"172.21.15.196:6822","nonce":3106266066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":3106266066},{"type":"v1","addr":"172.21.15.196:6830","nonce":3106266066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":3106266066},{"type":"v1","addr":"172.21.15.196:6826","nonce":3106266066}]},"public_addr":"172.21.15.196:6818/3106266066","cluster_addr":"172.21.15.196:6822/3106266066","heartbeat_back_addr":"172.21.15.196:6830/3106266066","heartbeat_front_addr":"172.21.15.196:6826/3106266066","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:18:19.587791+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:18:19.706541+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:18:19.690674+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:18:19.648354+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:18:19.666671+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:18:19.560709+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:18:19.661412+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:18:19.770650+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-22T07:18:37.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:37.402+0000 7f67333a4640 1 -- 172.21.15.37:0/2602311971 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f671006c8f0 msgr2=0x7f671006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:37.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:37.402+0000 7f67333a4640 1 --2- 172.21.15.37:0/2602311971 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f671006c8f0 0x7f671006edb0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f672800aac0 tx=0x7f6728008040 comp rx=0 tx=0).stop 2024-04-22T07:18:37.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:37.402+0000 7f67333a4640 1 -- 172.21.15.37:0/2602311971 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f672c1552f0 msgr2=0x7f672c1f4120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:37.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:37.402+0000 7f67333a4640 1 --2- 172.21.15.37:0/2602311971 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f672c1552f0 0x7f672c1f4120 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f672402c590 tx=0x7f6724004a40 comp rx=0 tx=0).stop 2024-04-22T07:18:37.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:37.402+0000 7f67333a4640 1 -- 172.21.15.37:0/2602311971 shutdown_connections 2024-04-22T07:18:37.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:37.402+0000 7f67333a4640 1 --2- 172.21.15.37:0/2602311971 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f671006c8f0 0x7f671006edb0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:37.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:37.402+0000 7f67333a4640 1 --2- 172.21.15.37:0/2602311971 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f672c1552f0 0x7f672c1f4120 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:37.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:37.402+0000 7f67333a4640 1 --2- 172.21.15.37:0/2602311971 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f672c0ccd10 0x7f672c1f3be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:37.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:37.402+0000 7f67333a4640 1 --2- 172.21.15.37:0/2602311971 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f672c0b38f0 0x7f672c14ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:37.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:37.402+0000 7f67333a4640 1 -- 172.21.15.37:0/2602311971 >> 172.21.15.37:0/2602311971 conn(0x7f672c071f90 msgr2=0x7f672c153250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:37.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:37.402+0000 7f67333a4640 1 -- 172.21.15.37:0/2602311971 shutdown_connections 2024-04-22T07:18:37.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:37.402+0000 7f67333a4640 1 -- 172.21.15.37:0/2602311971 wait complete. 2024-04-22T07:18:37.410 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-22T07:18:37.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:37.516+0000 7f53f75b6640 1 Processor -- start 2024-04-22T07:18:37.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:37.516+0000 7f53f75b6640 1 -- start start 2024-04-22T07:18:37.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:37.517+0000 7f53f75b6640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f53f00b3190 0x7f53f00b35e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:37.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:37.517+0000 7f53f75b6640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f53f00ccd20 0x7f53f00cd170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:37.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:37.517+0000 7f53f75b6640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53f00b3bd0 con 0x7f53f0155250 2024-04-22T07:18:37.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:37.517+0000 7f53f75b6640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f53f00cb6a0 con 0x7f53f00ccd20 2024-04-22T07:18:37.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:37.517+0000 7f53f75b6640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f53f015e4b0 con 0x7f53f00b3190 2024-04-22T07:18:37.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:37.517+0000 7f53f5b53640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f53f00ccd20 0x7f53f00cd170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:37.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:37.517+0000 7f53f5b53640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f53f00ccd20 0x7f53f00cd170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49472/0 (socket says 172.21.15.37:49472) 2024-04-22T07:18:37.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:37.517+0000 7f53f5b53640 1 -- 172.21.15.37:0/2941021159 learned_addr learned my addr 172.21.15.37:0/2941021159 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:18:37.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:37.517+0000 7f53f5352640 1 --1- 172.21.15.37:0/2941021159 >> v1:172.21.15.37:6789/0 conn(0x7f53f0155250 0x7f53f015af40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:41860/0 (socket says 172.21.15.37:41860) 2024-04-22T07:18:37.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:37.517+0000 7f53f4b51640 1 --2- 172.21.15.37:0/2941021159 >> v2:172.21.15.196:3300/0 conn(0x7f53f00b3190 0x7f53f00b35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:37.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:37.517+0000 7f53f5b53640 1 -- 172.21.15.37:0/2941021159 >> v2:172.21.15.196:3300/0 conn(0x7f53f00b3190 msgr2=0x7f53f00b35e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:18:37.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:37.517+0000 7f53f5b53640 1 --2- 172.21.15.37:0/2941021159 >> v2:172.21.15.196:3300/0 conn(0x7f53f00b3190 0x7f53f00b35e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:37.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:37.517+0000 7f53f5b53640 1 -- 172.21.15.37:0/2941021159 >> v1:172.21.15.37:6789/0 conn(0x7f53f0155250 legacy=0x7f53f015af40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:37.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:37.517+0000 7f53e7fff640 1 -- 172.21.15.37:0/2941021159 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 382362159 0 0) 0x7f53f00b3bd0 con 0x7f53f0155250 2024-04-22T07:18:37.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:37.517+0000 7f53f5b53640 1 -- 172.21.15.37:0/2941021159 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53f00b3eb0 con 0x7f53f00ccd20 2024-04-22T07:18:37.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:37.517+0000 7f53f4b51640 1 --2- 172.21.15.37:0/2941021159 >> v2:172.21.15.196:3300/0 conn(0x7f53f00b3190 0x7f53f00b35e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-22T07:18:37.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:37.518+0000 7f53f5b53640 1 --2- 172.21.15.37:0/2941021159 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f53f00ccd20 0x7f53f00cd170 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f53f008ded0 tx=0x7f53e802bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4276f29614862c3 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:37.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:37.518+0000 7f53e7fff640 1 -- 172.21.15.37:0/2941021159 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53e802cb20 con 0x7f53f00ccd20 2024-04-22T07:18:37.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:37.518+0000 7f53e7fff640 1 -- 172.21.15.37:0/2941021159 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53e802ccc0 con 0x7f53f00ccd20 2024-04-22T07:18:37.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:37.518+0000 7f53e7fff640 1 -- 172.21.15.37:0/2941021159 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53e8034610 con 0x7f53f00ccd20 2024-04-22T07:18:37.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:37.519+0000 7f53f75b6640 1 -- 172.21.15.37:0/2941021159 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f53f00ccd20 msgr2=0x7f53f00cd170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:37.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:37.519+0000 7f53f75b6640 1 --2- 172.21.15.37:0/2941021159 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f53f00ccd20 0x7f53f00cd170 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f53f008ded0 tx=0x7f53e802bf80 comp rx=0 tx=0).stop 2024-04-22T07:18:37.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:37.519+0000 7f53f75b6640 1 -- 172.21.15.37:0/2941021159 shutdown_connections 2024-04-22T07:18:37.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:37.519+0000 7f53f75b6640 1 --2- 172.21.15.37:0/2941021159 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f53f00ccd20 0x7f53f00cd170 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:37.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:37.519+0000 7f53f75b6640 1 --2- 172.21.15.37:0/2941021159 >> v2:172.21.15.196:3300/0 conn(0x7f53f00b3190 0x7f53f00b35e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:37.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:37.519+0000 7f53f75b6640 1 -- 172.21.15.37:0/2941021159 >> 172.21.15.37:0/2941021159 conn(0x7f53f0071f90 msgr2=0x7f53f00723a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:37.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:37.519+0000 7f53f75b6640 1 -- 172.21.15.37:0/2941021159 shutdown_connections 2024-04-22T07:18:37.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:37.519+0000 7f53f75b6640 1 -- 172.21.15.37:0/2941021159 wait complete. 2024-04-22T07:18:37.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:37.520+0000 7f53f75b6640 1 Processor -- start 2024-04-22T07:18:37.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:37.520+0000 7f53f75b6640 1 -- start start 2024-04-22T07:18:37.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:37.520+0000 7f53f75b6640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f53f00b3190 0x7f53f01f1480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:37.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:37.521+0000 7f53f75b6640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f53f00ccd20 0x7f53f01e4520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:37.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:37.521+0000 7f53f75b6640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f53f0155250 0x7f53f01e4a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:37.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:37.521+0000 7f53f75b6640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f53f015ecc0 con 0x7f53f00b3190 2024-04-22T07:18:37.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:37.521+0000 7f53f75b6640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f53f015e9e0 con 0x7f53f0155250 2024-04-22T07:18:37.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:37.521+0000 7f53f75b6640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f53f0155630 con 0x7f53f00ccd20 2024-04-22T07:18:37.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:37.521+0000 7f53f5352640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f53f00b3190 0x7f53f01f1480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:37.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:37.521+0000 7f53f5352640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f53f00b3190 0x7f53f01f1480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49488/0 (socket says 172.21.15.37:49488) 2024-04-22T07:18:37.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:37.521+0000 7f53f5352640 1 -- 172.21.15.37:0/727824924 learned_addr learned my addr 172.21.15.37:0/727824924 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:18:37.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:37.521+0000 7f53f4b51640 1 --2- 172.21.15.37:0/727824924 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f53f00ccd20 0x7f53f01e4520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:37.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:37.521+0000 7f53f5b53640 1 --2- 172.21.15.37:0/727824924 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f53f0155250 0x7f53f01e4a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:37.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:37.521+0000 7f53f5352640 1 -- 172.21.15.37:0/727824924 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f53f00ccd20 msgr2=0x7f53f01e4520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:37.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:37.521+0000 7f53f5352640 1 --2- 172.21.15.37:0/727824924 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f53f00ccd20 0x7f53f01e4520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:37.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:37.521+0000 7f53f5352640 1 -- 172.21.15.37:0/727824924 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f53f0155250 msgr2=0x7f53f01e4a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:37.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:37.521+0000 7f53f5352640 1 --2- 172.21.15.37:0/727824924 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f53f0155250 0x7f53f01e4a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:37.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:37.521+0000 7f53f5352640 1 -- 172.21.15.37:0/727824924 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53f00c8a00 con 0x7f53f00b3190 2024-04-22T07:18:37.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:37.521+0000 7f53f5352640 1 --2- 172.21.15.37:0/727824924 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f53f00b3190 0x7f53f01f1480 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f53ec00c4d0 tx=0x7f53ec00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:37.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:37.521+0000 7f53e5ffb640 1 -- 172.21.15.37:0/727824924 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53ec018070 con 0x7f53f00b3190 2024-04-22T07:18:37.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:37.521+0000 7f53e5ffb640 1 -- 172.21.15.37:0/727824924 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53ec007500 con 0x7f53f00b3190 2024-04-22T07:18:37.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:37.521+0000 7f53f75b6640 1 -- 172.21.15.37:0/727824924 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53f01f0ca0 con 0x7f53f00b3190 2024-04-22T07:18:37.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:37.521+0000 7f53e5ffb640 1 -- 172.21.15.37:0/727824924 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53ec004a20 con 0x7f53f00b3190 2024-04-22T07:18:37.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:37.522+0000 7f53f75b6640 1 -- 172.21.15.37:0/727824924 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53f00c8030 con 0x7f53f00b3190 2024-04-22T07:18:37.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:37.522+0000 7f53f75b6640 1 -- 172.21.15.37:0/727824924 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53f00cbd20 con 0x7f53f00b3190 2024-04-22T07:18:37.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:37.523+0000 7f53e5ffb640 1 -- 172.21.15.37:0/727824924 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f53ec01b070 con 0x7f53f00b3190 2024-04-22T07:18:37.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:37.523+0000 7f53e5ffb640 1 --2- 172.21.15.37:0/727824924 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f53d406c8f0 0x7f53d406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:37.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:37.523+0000 7f53e5ffb640 1 -- 172.21.15.37:0/727824924 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5709+0+0 (secure 0 0 0) 0x7f53ec08adc0 con 0x7f53f00b3190 2024-04-22T07:18:37.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:37.523+0000 7f53f4b51640 1 --2- 172.21.15.37:0/727824924 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f53d406c8f0 0x7f53d406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:37.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:37.524+0000 7f53f4b51640 1 --2- 172.21.15.37:0/727824924 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f53d406c8f0 0x7f53d406edb0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f53f00d0660 tx=0x7f53e0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:37.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:37.527+0000 7f53e5ffb640 1 -- 172.21.15.37:0/727824924 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f53f00cbd20 con 0x7f53f00b3190 2024-04-22T07:18:37.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:37.756+0000 7f53f75b6640 1 -- 172.21.15.37:0/727824924 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f53f0069cc0 con 0x7f53f00b3190 2024-04-22T07:18:38.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:38.756+0000 7f53e5ffb640 1 -- 172.21.15.37:0/727824924 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v5) ==== 118+0+0 (secure 0 0 0) 0x7f53ec059280 con 0x7f53f00b3190 2024-04-22T07:18:38.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:38.759+0000 7f53f75b6640 1 -- 172.21.15.37:0/727824924 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f53d406c8f0 msgr2=0x7f53d406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:38.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:38.759+0000 7f53f75b6640 1 --2- 172.21.15.37:0/727824924 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f53d406c8f0 0x7f53d406edb0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f53f00d0660 tx=0x7f53e0008040 comp rx=0 tx=0).stop 2024-04-22T07:18:38.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:38.759+0000 7f53f75b6640 1 -- 172.21.15.37:0/727824924 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f53f00b3190 msgr2=0x7f53f01f1480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:38.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:38.759+0000 7f53f75b6640 1 --2- 172.21.15.37:0/727824924 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f53f00b3190 0x7f53f01f1480 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f53ec00c4d0 tx=0x7f53ec00c990 comp rx=0 tx=0).stop 2024-04-22T07:18:38.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:38.759+0000 7f53f75b6640 1 -- 172.21.15.37:0/727824924 shutdown_connections 2024-04-22T07:18:38.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:38.759+0000 7f53f75b6640 1 --2- 172.21.15.37:0/727824924 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f53d406c8f0 0x7f53d406edb0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:38.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:38.759+0000 7f53f75b6640 1 --2- 172.21.15.37:0/727824924 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f53f0155250 0x7f53f01e4a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:38.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:38.759+0000 7f53f75b6640 1 --2- 172.21.15.37:0/727824924 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f53f00ccd20 0x7f53f01e4520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:38.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:38.759+0000 7f53f75b6640 1 --2- 172.21.15.37:0/727824924 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f53f00b3190 0x7f53f01f1480 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:38.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:38.759+0000 7f53f75b6640 1 -- 172.21.15.37:0/727824924 >> 172.21.15.37:0/727824924 conn(0x7f53f0071f90 msgr2=0x7f53f0150000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:38.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:38.759+0000 7f53f75b6640 1 -- 172.21.15.37:0/727824924 shutdown_connections 2024-04-22T07:18:38.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:38.759+0000 7f53f75b6640 1 -- 172.21.15.37:0/727824924 wait complete. 2024-04-22T07:18:38.770 DEBUG:tasks.cephfs.filesystem:fs_config: {'session_timeout': 300} 2024-04-22T07:18:38.770 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-22T07:18:38.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:38.882+0000 7f2ee69b6640 1 Processor -- start 2024-04-22T07:18:38.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:38.882+0000 7f2ee69b6640 1 -- start start 2024-04-22T07:18:38.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:38.883+0000 7f2ee69b6640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2ee015b770 0x7f2ee0166600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:38.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:38.883+0000 7f2ee69b6640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ee00c9850 con 0x7f2ee0155040 2024-04-22T07:18:38.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:38.883+0000 7f2ee69b6640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ee00720f0 con 0x7f2ee015e260 2024-04-22T07:18:38.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:38.883+0000 7f2ee69b6640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f2ee015e6b0 con 0x7f2ee015b770 2024-04-22T07:18:38.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:38.883+0000 7f2edffff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f2ee0155040 0x7f2ee00c9140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:41876/0 (socket says 172.21.15.37:41876) 2024-04-22T07:18:38.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:38.883+0000 7f2edffff640 1 -- 172.21.15.37:0/1441192054 learned_addr learned my addr 172.21.15.37:0/1441192054 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-04-22T07:18:38.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:38.883+0000 7f2ee4f53640 1 --2- 172.21.15.37:0/1441192054 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2ee015b770 0x7f2ee0166600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:38.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:38.883+0000 7f2edeffd640 1 -- 172.21.15.37:0/1441192054 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3233593053 0 0) 0x7f2ee00c9850 con 0x7f2ee0155040 2024-04-22T07:18:38.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:38.884+0000 7f2edeffd640 1 -- 172.21.15.37:0/1441192054 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2ecc003520 con 0x7f2ee0155040 2024-04-22T07:18:38.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:38.884+0000 7f2edeffd640 1 -- 172.21.15.37:0/1441192054 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2095216863 0 0) 0x7f2ecc003520 con 0x7f2ee0155040 2024-04-22T07:18:38.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:38.884+0000 7f2edeffd640 1 -- 172.21.15.37:0/1441192054 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2ee015b770 msgr2=0x7f2ee0166600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:18:38.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:38.884+0000 7f2edeffd640 1 --2- 172.21.15.37:0/1441192054 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2ee015b770 0x7f2ee0166600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:38.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:38.884+0000 7f2edeffd640 1 -- 172.21.15.37:0/1441192054 >> v1:172.21.15.196:6789/0 conn(0x7f2ee015e260 legacy=0x7f2ee00c6e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:38.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:38.884+0000 7f2edeffd640 1 -- 172.21.15.37:0/1441192054 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ee0155420 con 0x7f2ee0155040 2024-04-22T07:18:38.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:38.884+0000 7f2edeffd640 1 -- 172.21.15.37:0/1441192054 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2576656170 0 0) 0x7f2ed0001690 con 0x7f2ee0155040 2024-04-22T07:18:38.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:38.884+0000 7f2ee4f53640 1 --2- 172.21.15.37:0/1441192054 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2ee015b770 0x7f2ee0166600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-22T07:18:38.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:38.884+0000 7f2edeffd640 1 -- 172.21.15.37:0/1441192054 >> v1:172.21.15.37:6789/0 conn(0x7f2ee0155040 legacy=0x7f2ee00c9140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:38.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:38.884+0000 7f2edeffd640 1 --2- 172.21.15.37:0/1441192054 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ecc0039e0 0x7f2ecc003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:38.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:38.884+0000 7f2edeffd640 1 --2- 172.21.15.37:0/1441192054 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2ecc004390 0x7f2ecc004860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:38.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:38.884+0000 7f2edeffd640 1 --2- 172.21.15.37:0/1441192054 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2ee015b770 0x7f2ecc005080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:38.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:38.884+0000 7f2edeffd640 1 -- 172.21.15.37:0/1441192054 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f2ee015e6b0 con 0x7f2ecc0039e0 2024-04-22T07:18:38.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:38.884+0000 7f2edeffd640 1 -- 172.21.15.37:0/1441192054 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f2ecc00b9c0 con 0x7f2ecc004390 2024-04-22T07:18:38.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:38.884+0000 7f2edeffd640 1 -- 172.21.15.37:0/1441192054 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f2ecc00bb70 con 0x7f2ee015b770 2024-04-22T07:18:38.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:38.884+0000 7f2edffff640 1 --2- 172.21.15.37:0/1441192054 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ecc0039e0 0x7f2ecc003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:38.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:38.884+0000 7f2edf7fe640 1 --2- 172.21.15.37:0/1441192054 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2ecc004390 0x7f2ecc004860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:38.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:38.884+0000 7f2ee4f53640 1 --2- 172.21.15.37:0/1441192054 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2ee015b770 0x7f2ecc005080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:38.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:38.884+0000 7f2edffff640 1 -- 172.21.15.37:0/1441192054 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2ee015b770 msgr2=0x7f2ecc005080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:18:38.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:38.884+0000 7f2edffff640 1 --2- 172.21.15.37:0/1441192054 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2ee015b770 0x7f2ecc005080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:38.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:38.884+0000 7f2edffff640 1 -- 172.21.15.37:0/1441192054 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2ecc004390 msgr2=0x7f2ecc004860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:18:38.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:38.884+0000 7f2edffff640 1 --2- 172.21.15.37:0/1441192054 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2ecc004390 0x7f2ecc004860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:38.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:38.884+0000 7f2edffff640 1 -- 172.21.15.37:0/1441192054 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ecc003520 con 0x7f2ecc0039e0 2024-04-22T07:18:38.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:38.884+0000 7f2edf7fe640 1 --2- 172.21.15.37:0/1441192054 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2ecc004390 0x7f2ecc004860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T07:18:38.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:38.885+0000 7f2edffff640 1 --2- 172.21.15.37:0/1441192054 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ecc0039e0 0x7f2ecc003dc0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f2ed0007fd0 tx=0x7f2ecc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc8ae0cad1304e7 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:38.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:38.885+0000 7f2edeffd640 1 -- 172.21.15.37:0/1441192054 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ed0007ce0 con 0x7f2ecc0039e0 2024-04-22T07:18:38.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:38.885+0000 7f2edeffd640 1 -- 172.21.15.37:0/1441192054 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ed0030070 con 0x7f2ecc0039e0 2024-04-22T07:18:38.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:38.885+0000 7f2edeffd640 1 -- 172.21.15.37:0/1441192054 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ed0005d10 con 0x7f2ecc0039e0 2024-04-22T07:18:38.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:38.886+0000 7f2ee69b6640 1 -- 172.21.15.37:0/1441192054 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ecc0039e0 msgr2=0x7f2ecc003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:38.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:38.886+0000 7f2ee69b6640 1 --2- 172.21.15.37:0/1441192054 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ecc0039e0 0x7f2ecc003dc0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f2ed0007fd0 tx=0x7f2ecc005830 comp rx=0 tx=0).stop 2024-04-22T07:18:38.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:38.886+0000 7f2ee4f53640 1 -- 172.21.15.37:0/1441192054 reap_dead start 2024-04-22T07:18:38.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:38.886+0000 7f2ee69b6640 1 -- 172.21.15.37:0/1441192054 shutdown_connections 2024-04-22T07:18:38.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:38.886+0000 7f2ee69b6640 1 -- 172.21.15.37:0/1441192054 >> 172.21.15.37:0/1441192054 conn(0x7f2ee006b970 msgr2=0x7f2ee006bd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:38.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:38.886+0000 7f2ee69b6640 1 -- 172.21.15.37:0/1441192054 shutdown_connections 2024-04-22T07:18:38.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:38.886+0000 7f2ee69b6640 1 -- 172.21.15.37:0/1441192054 wait complete. 2024-04-22T07:18:38.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:38.887+0000 7f2ee69b6640 1 Processor -- start 2024-04-22T07:18:38.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:38.887+0000 7f2ee69b6640 1 -- start start 2024-04-22T07:18:38.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:38.888+0000 7f2ee69b6640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2ecc0039e0 0x7f2ee01f48c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:38.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:38.888+0000 7f2ee69b6640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2ee0151480 0x7f2ee015a000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:38.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:38.888+0000 7f2ee69b6640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ee01e68c0 0x7f2ee01e74e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:38.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:38.888+0000 7f2ee69b6640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f2ee015ef40 con 0x7f2ee01e68c0 2024-04-22T07:18:38.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:38.888+0000 7f2ee69b6640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f2ee015ec60 con 0x7f2ee0151480 2024-04-22T07:18:38.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:38.888+0000 7f2ee69b6640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f2ee00c8940 con 0x7f2ecc0039e0 2024-04-22T07:18:38.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:38.888+0000 7f2ee4f53640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ee01e68c0 0x7f2ee01e74e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:38.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:38.888+0000 7f2ee4f53640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ee01e68c0 0x7f2ee01e74e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49518/0 (socket says 172.21.15.37:49518) 2024-04-22T07:18:38.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:38.888+0000 7f2ee4f53640 1 -- 172.21.15.37:0/2414663545 learned_addr learned my addr 172.21.15.37:0/2414663545 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:18:38.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:38.888+0000 7f2edf7fe640 1 --2- 172.21.15.37:0/2414663545 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2ee0151480 0x7f2ee015a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:38.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:38.888+0000 7f2edffff640 1 --2- 172.21.15.37:0/2414663545 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2ecc0039e0 0x7f2ee01f48c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:38.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:38.888+0000 7f2ee4f53640 1 -- 172.21.15.37:0/2414663545 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2ecc0039e0 msgr2=0x7f2ee01f48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:38.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:38.888+0000 7f2ee4f53640 1 --2- 172.21.15.37:0/2414663545 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2ecc0039e0 0x7f2ee01f48c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:38.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:38.888+0000 7f2ee4f53640 1 -- 172.21.15.37:0/2414663545 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2ee0151480 msgr2=0x7f2ee015a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:38.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:38.888+0000 7f2ee4f53640 1 --2- 172.21.15.37:0/2414663545 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2ee0151480 0x7f2ee015a000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:38.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:38.888+0000 7f2ee4f53640 1 -- 172.21.15.37:0/2414663545 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ee01527c0 con 0x7f2ee01e68c0 2024-04-22T07:18:38.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:38.888+0000 7f2edf7fe640 1 --2- 172.21.15.37:0/2414663545 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2ee0151480 0x7f2ee015a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T07:18:38.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:38.888+0000 7f2ee4f53640 1 --2- 172.21.15.37:0/2414663545 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ee01e68c0 0x7f2ee01e74e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f2ed8009ed0 tx=0x7f2ed80115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:38.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:38.889+0000 7f2edcff9640 1 -- 172.21.15.37:0/2414663545 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ed8011de0 con 0x7f2ee01e68c0 2024-04-22T07:18:38.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:38.889+0000 7f2edcff9640 1 -- 172.21.15.37:0/2414663545 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ed801b070 con 0x7f2ee01e68c0 2024-04-22T07:18:38.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:38.889+0000 7f2ee69b6640 1 -- 172.21.15.37:0/2414663545 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ee01f0ba0 con 0x7f2ee01e68c0 2024-04-22T07:18:38.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:38.889+0000 7f2edcff9640 1 -- 172.21.15.37:0/2414663545 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ed8003990 con 0x7f2ee01e68c0 2024-04-22T07:18:38.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:38.889+0000 7f2ee69b6640 1 -- 172.21.15.37:0/2414663545 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ee01f1160 con 0x7f2ee01e68c0 2024-04-22T07:18:38.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:38.889+0000 7f2ee69b6640 1 -- 172.21.15.37:0/2414663545 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ee0152430 con 0x7f2ee01e68c0 2024-04-22T07:18:38.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:38.890+0000 7f2edcff9640 1 -- 172.21.15.37:0/2414663545 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2ed8005d10 con 0x7f2ee01e68c0 2024-04-22T07:18:38.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:38.890+0000 7f2edcff9640 1 --2- 172.21.15.37:0/2414663545 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f2ec006c8f0 0x7f2ec006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:38.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:38.890+0000 7f2edcff9640 1 -- 172.21.15.37:0/2414663545 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f2ed808be70 con 0x7f2ee01e68c0 2024-04-22T07:18:38.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:38.891+0000 7f2edffff640 1 --2- 172.21.15.37:0/2414663545 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f2ec006c8f0 0x7f2ec006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:38.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:38.891+0000 7f2edffff640 1 --2- 172.21.15.37:0/2414663545 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f2ec006c8f0 0x7f2ec006edb0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f2ed0034000 tx=0x7f2ed0009030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:38.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:38.896+0000 7f2edcff9640 1 -- 172.21.15.37:0/2414663545 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f2ee0152430 con 0x7f2ee01e68c0 2024-04-22T07:18:39.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:39.120+0000 7f2ee69b6640 1 -- 172.21.15.37:0/2414663545 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f2ee0069cc0 con 0x7f2ee01e68c0 2024-04-22T07:18:39.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:39.778+0000 7f2edcff9640 1 -- 172.21.15.37:0/2414663545 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v6) ==== 122+0+0 (secure 0 0 0) 0x7f2ed8014350 con 0x7f2ee01e68c0 2024-04-22T07:18:39.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:39.781+0000 7f2ee69b6640 1 -- 172.21.15.37:0/2414663545 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f2ec006c8f0 msgr2=0x7f2ec006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:39.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:39.781+0000 7f2ee69b6640 1 --2- 172.21.15.37:0/2414663545 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f2ec006c8f0 0x7f2ec006edb0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f2ed0034000 tx=0x7f2ed0009030 comp rx=0 tx=0).stop 2024-04-22T07:18:39.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:39.781+0000 7f2ee69b6640 1 -- 172.21.15.37:0/2414663545 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ee01e68c0 msgr2=0x7f2ee01e74e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:39.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:39.781+0000 7f2ee69b6640 1 --2- 172.21.15.37:0/2414663545 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ee01e68c0 0x7f2ee01e74e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f2ed8009ed0 tx=0x7f2ed80115a0 comp rx=0 tx=0).stop 2024-04-22T07:18:39.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:39.781+0000 7f2ee69b6640 1 -- 172.21.15.37:0/2414663545 shutdown_connections 2024-04-22T07:18:39.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:39.781+0000 7f2ee69b6640 1 --2- 172.21.15.37:0/2414663545 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f2ec006c8f0 0x7f2ec006edb0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:39.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:39.781+0000 7f2ee69b6640 1 --2- 172.21.15.37:0/2414663545 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ee01e68c0 0x7f2ee01e74e0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:39.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:39.781+0000 7f2ee69b6640 1 --2- 172.21.15.37:0/2414663545 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2ee0151480 0x7f2ee015a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:39.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:39.781+0000 7f2ee69b6640 1 --2- 172.21.15.37:0/2414663545 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2ecc0039e0 0x7f2ee01f48c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:39.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:39.781+0000 7f2ee69b6640 1 -- 172.21.15.37:0/2414663545 >> 172.21.15.37:0/2414663545 conn(0x7f2ee006b970 msgr2=0x7f2ee006fa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:39.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:39.781+0000 7f2ee69b6640 1 -- 172.21.15.37:0/2414663545 shutdown_connections 2024-04-22T07:18:39.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:39.781+0000 7f2ee69b6640 1 -- 172.21.15.37:0/2414663545 wait complete. 2024-04-22T07:18:39.792 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs session_timeout 300 2024-04-22T07:18:39.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:39.904+0000 7f7beb031640 1 Processor -- start 2024-04-22T07:18:39.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:39.904+0000 7f7beb031640 1 -- start start 2024-04-22T07:18:39.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:39.905+0000 7f7beb031640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f7be40ccdd0 0x7f7be40cb5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:39.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:39.905+0000 7f7beb031640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7be4154b50 0x7f7be4154fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:39.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:39.905+0000 7f7beb031640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7be4155500 con 0x7f7be40cd1b0 2024-04-22T07:18:39.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:39.905+0000 7f7beb031640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f7be415e4d0 con 0x7f7be40ccdd0 2024-04-22T07:18:39.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:39.905+0000 7f7beb031640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f7be415e7b0 con 0x7f7be4154b50 2024-04-22T07:18:39.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:39.905+0000 7f7be95ce640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7be4154b50 0x7f7be4154fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:39.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:39.905+0000 7f7be8dcd640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f7be40ccdd0 0x7f7be40cb5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:39.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:39.905+0000 7f7be3fff640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7f7be40cd1b0 0x7f7be415b7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.37:54012/0 (socket says 172.21.15.37:54012) 2024-04-22T07:18:39.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:39.905+0000 7f7be3fff640 1 -- 172.21.15.37:0/880187109 learned_addr learned my addr 172.21.15.37:0/880187109 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-04-22T07:18:39.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:39.905+0000 7f7be37fe640 1 -- 172.21.15.37:0/880187109 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4253182047 0 0) 0x7f7be4155500 con 0x7f7be40cd1b0 2024-04-22T07:18:39.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:39.905+0000 7f7be37fe640 1 -- 172.21.15.37:0/880187109 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7bd4003520 con 0x7f7be40cd1b0 2024-04-22T07:18:39.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:39.905+0000 7f7be8dcd640 1 -- 172.21.15.37:0/880187109 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7be4154b50 msgr2=0x7f7be4154fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:18:39.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:39.905+0000 7f7be8dcd640 1 --2- 172.21.15.37:0/880187109 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7be4154b50 0x7f7be4154fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:39.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:39.905+0000 7f7be8dcd640 1 -- 172.21.15.37:0/880187109 >> v1:172.21.15.196:6789/0 conn(0x7f7be40cd1b0 legacy=0x7f7be415b7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:39.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:39.905+0000 7f7be8dcd640 1 -- 172.21.15.37:0/880187109 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7be415ea90 con 0x7f7be40ccdd0 2024-04-22T07:18:39.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:39.906+0000 7f7be95ce640 1 --2- 172.21.15.37:0/880187109 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7be4154b50 0x7f7be4154fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-22T07:18:39.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:39.906+0000 7f7be8dcd640 1 --2- 172.21.15.37:0/880187109 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7be40ccdd0 0x7f7be40cb5a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f7bd80097a0 tx=0x7f7bd802b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d650e437582dcade server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:39.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:39.907+0000 7f7be37fe640 1 -- 172.21.15.37:0/880187109 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bd8035020 con 0x7f7be40ccdd0 2024-04-22T07:18:39.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:39.907+0000 7f7be37fe640 1 -- 172.21.15.37:0/880187109 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7bd8031830 con 0x7f7be40ccdd0 2024-04-22T07:18:39.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:39.907+0000 7f7be37fe640 1 -- 172.21.15.37:0/880187109 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bd8031c00 con 0x7f7be40ccdd0 2024-04-22T07:18:39.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:39.907+0000 7f7beb031640 1 -- 172.21.15.37:0/880187109 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7be40ccdd0 msgr2=0x7f7be40cb5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:39.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:39.907+0000 7f7beb031640 1 --2- 172.21.15.37:0/880187109 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7be40ccdd0 0x7f7be40cb5a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f7bd80097a0 tx=0x7f7bd802b8d0 comp rx=0 tx=0).stop 2024-04-22T07:18:39.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:39.907+0000 7f7beb031640 1 -- 172.21.15.37:0/880187109 shutdown_connections 2024-04-22T07:18:39.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:39.907+0000 7f7beb031640 1 --2- 172.21.15.37:0/880187109 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7be4154b50 0x7f7be4154fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:39.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:39.907+0000 7f7beb031640 1 --2- 172.21.15.37:0/880187109 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7be40ccdd0 0x7f7be40cb5a0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:39.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:39.907+0000 7f7beb031640 1 -- 172.21.15.37:0/880187109 >> 172.21.15.37:0/880187109 conn(0x7f7be4071f90 msgr2=0x7f7be40723a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:39.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:39.907+0000 7f7beb031640 1 -- 172.21.15.37:0/880187109 shutdown_connections 2024-04-22T07:18:39.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:39.907+0000 7f7beb031640 1 -- 172.21.15.37:0/880187109 wait complete. 2024-04-22T07:18:39.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:39.908+0000 7f7beb031640 1 Processor -- start 2024-04-22T07:18:39.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:39.908+0000 7f7beb031640 1 -- start start 2024-04-22T07:18:39.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:39.909+0000 7f7beb031640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7be40ccdd0 0x7f7be40d0c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:39.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:39.909+0000 7f7beb031640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7be40cd1b0 0x7f7be4156640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:39.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:39.909+0000 7f7beb031640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7be4154b50 0x7f7be40ceb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:39.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:39.909+0000 7f7beb031640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f7be40cd810 con 0x7f7be40ccdd0 2024-04-22T07:18:39.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:39.909+0000 7f7beb031640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f7be415f050 con 0x7f7be4154b50 2024-04-22T07:18:39.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:39.909+0000 7f7beb031640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f7be40cd990 con 0x7f7be40cd1b0 2024-04-22T07:18:39.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:39.909+0000 7f7be8dcd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7be40ccdd0 0x7f7be40d0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:39.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:39.909+0000 7f7be8dcd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7be40ccdd0 0x7f7be40d0c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54416/0 (socket says 172.21.15.37:54416) 2024-04-22T07:18:39.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:39.909+0000 7f7be8dcd640 1 -- 172.21.15.37:0/3766213871 learned_addr learned my addr 172.21.15.37:0/3766213871 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:18:39.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:39.909+0000 7f7be3fff640 1 --2- 172.21.15.37:0/3766213871 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7be40cd1b0 0x7f7be4156640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:39.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:39.909+0000 7f7be95ce640 1 --2- 172.21.15.37:0/3766213871 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7be4154b50 0x7f7be40ceb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:39.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:39.910+0000 7f7be8dcd640 1 -- 172.21.15.37:0/3766213871 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7be40cd1b0 msgr2=0x7f7be4156640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:39.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:39.910+0000 7f7be8dcd640 1 --2- 172.21.15.37:0/3766213871 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7be40cd1b0 0x7f7be4156640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:39.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:39.910+0000 7f7be8dcd640 1 -- 172.21.15.37:0/3766213871 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7be4154b50 msgr2=0x7f7be40ceb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:39.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:39.910+0000 7f7be8dcd640 1 --2- 172.21.15.37:0/3766213871 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7be4154b50 0x7f7be40ceb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:39.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:39.910+0000 7f7be8dcd640 1 -- 172.21.15.37:0/3766213871 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7be40d1310 con 0x7f7be40ccdd0 2024-04-22T07:18:39.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:39.910+0000 7f7be8dcd640 1 --2- 172.21.15.37:0/3766213871 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7be40ccdd0 0x7f7be40d0c80 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f7bd802bee0 tx=0x7f7bd80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:39.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:39.910+0000 7f7be17fa640 1 -- 172.21.15.37:0/3766213871 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bd8035040 con 0x7f7be40ccdd0 2024-04-22T07:18:39.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:39.910+0000 7f7beb031640 1 -- 172.21.15.37:0/3766213871 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7be41502e0 con 0x7f7be40ccdd0 2024-04-22T07:18:39.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:39.910+0000 7f7be17fa640 1 -- 172.21.15.37:0/3766213871 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7bd803f070 con 0x7f7be40ccdd0 2024-04-22T07:18:39.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:39.910+0000 7f7be17fa640 1 -- 172.21.15.37:0/3766213871 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bd803baa0 con 0x7f7be40ccdd0 2024-04-22T07:18:39.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:39.910+0000 7f7beb031640 1 -- 172.21.15.37:0/3766213871 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7be4150860 con 0x7f7be40ccdd0 2024-04-22T07:18:39.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:39.911+0000 7f7beb031640 1 -- 172.21.15.37:0/3766213871 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7be4069cc0 con 0x7f7be40ccdd0 2024-04-22T07:18:39.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:39.912+0000 7f7be17fa640 1 -- 172.21.15.37:0/3766213871 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7bd8038020 con 0x7f7be40ccdd0 2024-04-22T07:18:39.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:39.912+0000 7f7be17fa640 1 --2- 172.21.15.37:0/3766213871 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f7bc806c8f0 0x7f7bc806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:39.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:39.912+0000 7f7be17fa640 1 -- 172.21.15.37:0/3766213871 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f7bd80ad480 con 0x7f7be40ccdd0 2024-04-22T07:18:39.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:39.912+0000 7f7be3fff640 1 --2- 172.21.15.37:0/3766213871 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f7bc806c8f0 0x7f7bc806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:39.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:39.913+0000 7f7be3fff640 1 --2- 172.21.15.37:0/3766213871 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f7bc806c8f0 0x7f7bc806edb0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f7be40b2f30 tx=0x7f7bd0007d30 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:39.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:39.916+0000 7f7be17fa640 1 -- 172.21.15.37:0/3766213871 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f7bd807b270 con 0x7f7be40ccdd0 2024-04-22T07:18:40.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:40.140+0000 7f7beb031640 1 -- 172.21.15.37:0/3766213871 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7f7be4159d00 con 0x7f7be40ccdd0 2024-04-22T07:18:40.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:40.783+0000 7f7be17fa640 1 -- 172.21.15.37:0/3766213871 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v7) ==== 115+0+0 (secure 0 0 0) 0x7f7bd807f570 con 0x7f7be40ccdd0 2024-04-22T07:18:40.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:40.786+0000 7f7beb031640 1 -- 172.21.15.37:0/3766213871 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f7bc806c8f0 msgr2=0x7f7bc806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:40.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:40.786+0000 7f7beb031640 1 --2- 172.21.15.37:0/3766213871 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f7bc806c8f0 0x7f7bc806edb0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f7be40b2f30 tx=0x7f7bd0007d30 comp rx=0 tx=0).stop 2024-04-22T07:18:40.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:40.786+0000 7f7beb031640 1 -- 172.21.15.37:0/3766213871 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7be40ccdd0 msgr2=0x7f7be40d0c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:40.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:40.786+0000 7f7beb031640 1 --2- 172.21.15.37:0/3766213871 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7be40ccdd0 0x7f7be40d0c80 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f7bd802bee0 tx=0x7f7bd80046c0 comp rx=0 tx=0).stop 2024-04-22T07:18:40.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:40.786+0000 7f7beb031640 1 -- 172.21.15.37:0/3766213871 shutdown_connections 2024-04-22T07:18:40.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:40.786+0000 7f7beb031640 1 --2- 172.21.15.37:0/3766213871 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f7bc806c8f0 0x7f7bc806edb0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:40.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:40.786+0000 7f7beb031640 1 --2- 172.21.15.37:0/3766213871 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7be4154b50 0x7f7be40ceb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:40.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:40.786+0000 7f7beb031640 1 --2- 172.21.15.37:0/3766213871 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7be40cd1b0 0x7f7be4156640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:40.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:40.786+0000 7f7beb031640 1 --2- 172.21.15.37:0/3766213871 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7be40ccdd0 0x7f7be40d0c80 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:40.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:40.786+0000 7f7beb031640 1 -- 172.21.15.37:0/3766213871 >> 172.21.15.37:0/3766213871 conn(0x7f7be4071f90 msgr2=0x7f7be40c5540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:40.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:40.786+0000 7f7beb031640 1 -- 172.21.15.37:0/3766213871 shutdown_connections 2024-04-22T07:18:40.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:40.786+0000 7f7beb031640 1 -- 172.21.15.37:0/3766213871 wait complete. 2024-04-22T07:18:40.797 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-22T07:18:40.797 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-22T07:18:40.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:40.906+0000 7ff9f5359640 1 Processor -- start 2024-04-22T07:18:40.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:40.906+0000 7ff9f5359640 1 -- start start 2024-04-22T07:18:40.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:40.907+0000 7ff9f5359640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff9f0154df0 0x7ff9f00c9210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:40.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:40.907+0000 7ff9f5359640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7ff9f0070e60 0x7ff9f00676b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:40.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:40.907+0000 7ff9f5359640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9f006d1b0 con 0x7ff9f006cbe0 2024-04-22T07:18:40.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:40.907+0000 7ff9f5359640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7ff9f006fdd0 con 0x7ff9f0154df0 2024-04-22T07:18:40.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:40.907+0000 7ff9f5359640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7ff9f00700b0 con 0x7ff9f0070e60 2024-04-22T07:18:40.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:40.907+0000 7ff9eeffd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff9f0154df0 0x7ff9f00c9210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:40.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:40.907+0000 7ff9eeffd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff9f0154df0 0x7ff9f00c9210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54430/0 (socket says 172.21.15.37:54430) 2024-04-22T07:18:40.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:40.907+0000 7ff9eeffd640 1 -- 172.21.15.37:0/1691865938 learned_addr learned my addr 172.21.15.37:0/1691865938 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:18:40.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:40.908+0000 7ff9ee7fc640 1 --2- 172.21.15.37:0/1691865938 >> v2:172.21.15.196:3300/0 conn(0x7ff9f0070e60 0x7ff9f00676b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:40.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:40.908+0000 7ff9eeffd640 1 -- 172.21.15.37:0/1691865938 >> v2:172.21.15.196:3300/0 conn(0x7ff9f0070e60 msgr2=0x7ff9f00676b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:18:40.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:40.908+0000 7ff9eeffd640 1 --2- 172.21.15.37:0/1691865938 >> v2:172.21.15.196:3300/0 conn(0x7ff9f0070e60 0x7ff9f00676b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:40.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:40.908+0000 7ff9eeffd640 1 -- 172.21.15.37:0/1691865938 >> v1:172.21.15.196:6789/0 conn(0x7ff9f006cbe0 legacy=0x7ff9f015ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:40.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:40.908+0000 7ff9eeffd640 1 -- 172.21.15.37:0/1691865938 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9f0070390 con 0x7ff9f0154df0 2024-04-22T07:18:40.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:40.908+0000 7ff9ee7fc640 1 --2- 172.21.15.37:0/1691865938 >> v2:172.21.15.196:3300/0 conn(0x7ff9f0070e60 0x7ff9f00676b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T07:18:40.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:40.908+0000 7ff9eeffd640 1 --2- 172.21.15.37:0/1691865938 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9f0154df0 0x7ff9f00c9210 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff9f0074050 tx=0x7ff9e802c010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8df226a671c8bcc6 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:40.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:40.909+0000 7ff9edffb640 1 -- 172.21.15.37:0/1691865938 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9e802cbb0 con 0x7ff9f0154df0 2024-04-22T07:18:40.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:40.909+0000 7ff9edffb640 1 -- 172.21.15.37:0/1691865938 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9e802cd50 con 0x7ff9f0154df0 2024-04-22T07:18:40.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:40.909+0000 7ff9edffb640 1 -- 172.21.15.37:0/1691865938 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9e8034610 con 0x7ff9f0154df0 2024-04-22T07:18:40.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:40.909+0000 7ff9f5359640 1 -- 172.21.15.37:0/1691865938 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9f0154df0 msgr2=0x7ff9f00c9210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:40.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:40.909+0000 7ff9f5359640 1 --2- 172.21.15.37:0/1691865938 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9f0154df0 0x7ff9f00c9210 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff9f0074050 tx=0x7ff9e802c010 comp rx=0 tx=0).stop 2024-04-22T07:18:40.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:40.909+0000 7ff9f5359640 1 -- 172.21.15.37:0/1691865938 shutdown_connections 2024-04-22T07:18:40.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:40.909+0000 7ff9f5359640 1 --2- 172.21.15.37:0/1691865938 >> v2:172.21.15.196:3300/0 conn(0x7ff9f0070e60 0x7ff9f00676b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:40.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:40.909+0000 7ff9f5359640 1 --2- 172.21.15.37:0/1691865938 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9f0154df0 0x7ff9f00c9210 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:40.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:40.909+0000 7ff9f5359640 1 -- 172.21.15.37:0/1691865938 >> 172.21.15.37:0/1691865938 conn(0x7ff9f00c9ef0 msgr2=0x7ff9f00ca2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:40.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:40.909+0000 7ff9f5359640 1 -- 172.21.15.37:0/1691865938 shutdown_connections 2024-04-22T07:18:40.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:40.909+0000 7ff9f5359640 1 -- 172.21.15.37:0/1691865938 wait complete. 2024-04-22T07:18:40.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:40.910+0000 7ff9f5359640 1 Processor -- start 2024-04-22T07:18:40.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:40.911+0000 7ff9f5359640 1 -- start start 2024-04-22T07:18:40.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:40.911+0000 7ff9f5359640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff9f006cbe0 0x7ff9f014a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:40.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:40.911+0000 7ff9f5359640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9f0070e60 0x7ff9f00cc180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:40.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:40.911+0000 7ff9f5359640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff9f0154df0 0x7ff9f0147e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:40.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:40.911+0000 7ff9f5359640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff9f01551d0 con 0x7ff9f0070e60 2024-04-22T07:18:40.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:40.911+0000 7ff9f5359640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7ff9f0070950 con 0x7ff9f006cbe0 2024-04-22T07:18:40.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:40.911+0000 7ff9f5359640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7ff9f0155350 con 0x7ff9f0154df0 2024-04-22T07:18:40.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:40.911+0000 7ff9ee7fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9f0070e60 0x7ff9f00cc180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:40.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:40.911+0000 7ff9ee7fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9f0070e60 0x7ff9f00cc180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54440/0 (socket says 172.21.15.37:54440) 2024-04-22T07:18:40.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:40.911+0000 7ff9ee7fc640 1 -- 172.21.15.37:0/4040777315 learned_addr learned my addr 172.21.15.37:0/4040777315 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:18:40.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:40.911+0000 7ff9eeffd640 1 --2- 172.21.15.37:0/4040777315 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff9f006cbe0 0x7ff9f014a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:40.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:40.911+0000 7ff9ef7fe640 1 --2- 172.21.15.37:0/4040777315 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff9f0154df0 0x7ff9f0147e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:40.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:40.912+0000 7ff9ee7fc640 1 -- 172.21.15.37:0/4040777315 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff9f0154df0 msgr2=0x7ff9f0147e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:40.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:40.912+0000 7ff9ee7fc640 1 --2- 172.21.15.37:0/4040777315 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff9f0154df0 0x7ff9f0147e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:40.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:40.912+0000 7ff9ee7fc640 1 -- 172.21.15.37:0/4040777315 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff9f006cbe0 msgr2=0x7ff9f014a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:40.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:40.912+0000 7ff9ee7fc640 1 --2- 172.21.15.37:0/4040777315 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff9f006cbe0 0x7ff9f014a720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:40.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:40.912+0000 7ff9ee7fc640 1 -- 172.21.15.37:0/4040777315 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9f014dc00 con 0x7ff9f0070e60 2024-04-22T07:18:40.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:40.912+0000 7ff9ee7fc640 1 --2- 172.21.15.37:0/4040777315 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9f0070e60 0x7ff9f00cc180 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ff9e400e7e0 tx=0x7ff9e400eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:40.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:40.912+0000 7ff9d77fe640 1 -- 172.21.15.37:0/4040777315 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9e400f040 con 0x7ff9f0070e60 2024-04-22T07:18:40.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:40.912+0000 7ff9d77fe640 1 -- 172.21.15.37:0/4040777315 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9e4004030 con 0x7ff9f0070e60 2024-04-22T07:18:40.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:40.912+0000 7ff9f5359640 1 -- 172.21.15.37:0/4040777315 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9f014ac60 con 0x7ff9f0070e60 2024-04-22T07:18:40.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:40.912+0000 7ff9d77fe640 1 -- 172.21.15.37:0/4040777315 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9e4004400 con 0x7ff9f0070e60 2024-04-22T07:18:40.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:40.912+0000 7ff9f5359640 1 -- 172.21.15.37:0/4040777315 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9f014e150 con 0x7ff9f0070e60 2024-04-22T07:18:40.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:40.913+0000 7ff9f5359640 1 -- 172.21.15.37:0/4040777315 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9f0068b20 con 0x7ff9f0070e60 2024-04-22T07:18:40.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:40.913+0000 7ff9d77fe640 1 -- 172.21.15.37:0/4040777315 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff9e400c6d0 con 0x7ff9f0070e60 2024-04-22T07:18:40.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:40.914+0000 7ff9d77fe640 1 --2- 172.21.15.37:0/4040777315 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7ff9dc06c8f0 0x7ff9dc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:40.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:40.914+0000 7ff9d77fe640 1 -- 172.21.15.37:0/4040777315 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7ff9e408b7a0 con 0x7ff9f0070e60 2024-04-22T07:18:40.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:40.914+0000 7ff9eeffd640 1 --2- 172.21.15.37:0/4040777315 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7ff9dc06c8f0 0x7ff9dc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:40.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:40.915+0000 7ff9eeffd640 1 --2- 172.21.15.37:0/4040777315 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7ff9dc06c8f0 0x7ff9dc06edb0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ff9e8035000 tx=0x7ff9e8030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:40.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:40.918+0000 7ff9d77fe640 1 -- 172.21.15.37:0/4040777315 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ff9e4017020 con 0x7ff9f0070e60 2024-04-22T07:18:41.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.141+0000 7ff9f5359640 1 -- 172.21.15.37:0/4040777315 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff9f006c9c0 con 0x7ff9f0070e60 2024-04-22T07:18:41.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.142+0000 7ff9d77fe640 1 -- 172.21.15.37:0/4040777315 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+6822 (secure 0 0 0) 0x7ff9e4059610 con 0x7ff9f0070e60 2024-04-22T07:18:41.140 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-22T07:18:41.140 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4265,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6839/671847354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6835","nonce":671847354},{"type":"v1","addr":"172.21.15.196:6839","nonce":671847354}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6833/1549427395","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1549427395},{"type":"v1","addr":"172.21.15.37:6833","nonce":1549427395}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6836/3825988951","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":3825988951},{"type":"v1","addr":"172.21.15.37:6836","nonce":3825988951}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4272,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/611771502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6835","nonce":611771502},{"type":"v1","addr":"172.21.15.37:6837","nonce":611771502}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4291,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6837/3055080225","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6834","nonce":3055080225},{"type":"v1","addr":"172.21.15.196:6837","nonce":3055080225}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-22T07:18:36.111618+0000","modified":"2024-04-22T07:18:40.141556+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"f","rank":0,"incarnation":4,"state":"up:creating","state_seq":1,"addr":"172.21.15.196:6838/3264179771","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6836","nonce":3264179771},{"type":"v1","addr":"172.21.15.196:6838","nonce":3264179771}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-04-22T07:18:41.140 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 7 2024-04-22T07:18:41.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.144+0000 7ff9f5359640 1 -- 172.21.15.37:0/4040777315 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7ff9dc06c8f0 msgr2=0x7ff9dc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:41.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.144+0000 7ff9f5359640 1 --2- 172.21.15.37:0/4040777315 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7ff9dc06c8f0 0x7ff9dc06edb0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ff9e8035000 tx=0x7ff9e8030000 comp rx=0 tx=0).stop 2024-04-22T07:18:41.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.144+0000 7ff9f5359640 1 -- 172.21.15.37:0/4040777315 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9f0070e60 msgr2=0x7ff9f00cc180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:41.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.144+0000 7ff9f5359640 1 --2- 172.21.15.37:0/4040777315 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9f0070e60 0x7ff9f00cc180 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ff9e400e7e0 tx=0x7ff9e400eca0 comp rx=0 tx=0).stop 2024-04-22T07:18:41.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.144+0000 7ff9f5359640 1 -- 172.21.15.37:0/4040777315 shutdown_connections 2024-04-22T07:18:41.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.144+0000 7ff9f5359640 1 --2- 172.21.15.37:0/4040777315 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7ff9dc06c8f0 0x7ff9dc06edb0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:41.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.144+0000 7ff9f5359640 1 --2- 172.21.15.37:0/4040777315 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff9f0154df0 0x7ff9f0147e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:41.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.144+0000 7ff9f5359640 1 --2- 172.21.15.37:0/4040777315 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9f0070e60 0x7ff9f00cc180 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:41.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.144+0000 7ff9f5359640 1 --2- 172.21.15.37:0/4040777315 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff9f006cbe0 0x7ff9f014a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:41.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.144+0000 7ff9f5359640 1 -- 172.21.15.37:0/4040777315 >> 172.21.15.37:0/4040777315 conn(0x7ff9f00c9ef0 msgr2=0x7ff9f00ca2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:41.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.144+0000 7ff9f5359640 1 -- 172.21.15.37:0/4040777315 shutdown_connections 2024-04-22T07:18:41.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.144+0000 7ff9f5359640 1 -- 172.21.15.37:0/4040777315 wait complete. 2024-04-22T07:18:41.153 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-22T07:18:41.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.255+0000 7f53695d5640 1 Processor -- start 2024-04-22T07:18:41.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.255+0000 7f53695d5640 1 -- start start 2024-04-22T07:18:41.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.256+0000 7f53695d5640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f53640b38f0 0x7f536415aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:41.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.256+0000 7f53695d5640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f536415b3f0 0x7f53640ccd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:41.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.256+0000 7f53695d5640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f536415f280 con 0x7f53641552f0 2024-04-22T07:18:41.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.256+0000 7f53695d5640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f53640b3100 con 0x7f536415b3f0 2024-04-22T07:18:41.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.256+0000 7f53695d5640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f53640cda00 con 0x7f53640b38f0 2024-04-22T07:18:41.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.256+0000 7f53627fc640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f53640b38f0 0x7f536415aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:41.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.256+0000 7f53637fe640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f536415b3f0 0x7f53640ccd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:41.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.256+0000 7f53627fc640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f53640b38f0 0x7f536415aeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.37:53842/0 (socket says 172.21.15.37:53842) 2024-04-22T07:18:41.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.256+0000 7f53627fc640 1 -- 172.21.15.37:0/2445231361 learned_addr learned my addr 172.21.15.37:0/2445231361 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:18:41.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.256+0000 7f53627fc640 1 -- 172.21.15.37:0/2445231361 >> v2:172.21.15.196:3300/0 conn(0x7f536415b3f0 msgr2=0x7f53640ccd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:18:41.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.256+0000 7f53627fc640 1 --2- 172.21.15.37:0/2445231361 >> v2:172.21.15.196:3300/0 conn(0x7f536415b3f0 0x7f53640ccd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:41.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.256+0000 7f53627fc640 1 -- 172.21.15.37:0/2445231361 >> v1:172.21.15.196:6789/0 conn(0x7f53641552f0 legacy=0x7f53640cb430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:41.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.256+0000 7f53627fc640 1 -- 172.21.15.37:0/2445231361 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53640b3350 con 0x7f53640b38f0 2024-04-22T07:18:41.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.257+0000 7f53627fc640 1 --2- 172.21.15.37:0/2445231361 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f53640b38f0 0x7f536415aeb0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f5358009870 tx=0x7f535802b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=59fe41fa9f43e677 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:41.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.257+0000 7f5361ffb640 1 -- 172.21.15.37:0/2445231361 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5358034070 con 0x7f53640b38f0 2024-04-22T07:18:41.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.257+0000 7f5361ffb640 1 -- 172.21.15.37:0/2445231361 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5358030840 con 0x7f53640b38f0 2024-04-22T07:18:41.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.258+0000 7f5361ffb640 1 -- 172.21.15.37:0/2445231361 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5358030c10 con 0x7f53640b38f0 2024-04-22T07:18:41.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.258+0000 7f53695d5640 1 -- 172.21.15.37:0/2445231361 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f53640b38f0 msgr2=0x7f536415aeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:41.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.258+0000 7f53695d5640 1 --2- 172.21.15.37:0/2445231361 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f53640b38f0 0x7f536415aeb0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f5358009870 tx=0x7f535802b980 comp rx=0 tx=0).stop 2024-04-22T07:18:41.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.258+0000 7f53695d5640 1 -- 172.21.15.37:0/2445231361 shutdown_connections 2024-04-22T07:18:41.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.258+0000 7f53695d5640 1 --2- 172.21.15.37:0/2445231361 >> v2:172.21.15.196:3300/0 conn(0x7f536415b3f0 0x7f53640ccd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:41.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.258+0000 7f53695d5640 1 --2- 172.21.15.37:0/2445231361 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f53640b38f0 0x7f536415aeb0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:41.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.258+0000 7f53695d5640 1 -- 172.21.15.37:0/2445231361 >> 172.21.15.37:0/2445231361 conn(0x7f5364071f90 msgr2=0x7f53640723a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:41.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.258+0000 7f53695d5640 1 -- 172.21.15.37:0/2445231361 shutdown_connections 2024-04-22T07:18:41.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.258+0000 7f53695d5640 1 -- 172.21.15.37:0/2445231361 wait complete. 2024-04-22T07:18:41.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.259+0000 7f53695d5640 1 Processor -- start 2024-04-22T07:18:41.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.259+0000 7f53695d5640 1 -- start start 2024-04-22T07:18:41.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.260+0000 7f53695d5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f53640b38f0 0x7f5364159d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:41.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.260+0000 7f53695d5640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f53641552f0 0x7f536415dd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:41.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.260+0000 7f53695d5640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f536415b3f0 0x7f5364157480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:41.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.260+0000 7f53695d5640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f536415e7a0 con 0x7f53640b38f0 2024-04-22T07:18:41.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.260+0000 7f53695d5640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f536415e4c0 con 0x7f53641552f0 2024-04-22T07:18:41.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.260+0000 7f53695d5640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f536415ea80 con 0x7f536415b3f0 2024-04-22T07:18:41.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.260+0000 7f5362ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f53640b38f0 0x7f5364159d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:41.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.260+0000 7f5362ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f53640b38f0 0x7f5364159d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54446/0 (socket says 172.21.15.37:54446) 2024-04-22T07:18:41.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.260+0000 7f5362ffd640 1 -- 172.21.15.37:0/76718367 learned_addr learned my addr 172.21.15.37:0/76718367 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:18:41.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.260+0000 7f53637fe640 1 --2- 172.21.15.37:0/76718367 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f536415b3f0 0x7f5364157480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:41.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.260+0000 7f53627fc640 1 --2- 172.21.15.37:0/76718367 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f53641552f0 0x7f536415dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:41.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.260+0000 7f5362ffd640 1 -- 172.21.15.37:0/76718367 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f536415b3f0 msgr2=0x7f5364157480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:41.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.260+0000 7f5362ffd640 1 --2- 172.21.15.37:0/76718367 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f536415b3f0 0x7f5364157480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:41.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.261+0000 7f5362ffd640 1 -- 172.21.15.37:0/76718367 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f53641552f0 msgr2=0x7f536415dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:41.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.261+0000 7f5362ffd640 1 --2- 172.21.15.37:0/76718367 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f53641552f0 0x7f536415dd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:41.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.261+0000 7f5362ffd640 1 -- 172.21.15.37:0/76718367 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f536415b160 con 0x7f53640b38f0 2024-04-22T07:18:41.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.261+0000 7f53627fc640 1 --2- 172.21.15.37:0/76718367 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f53641552f0 0x7f536415dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-22T07:18:41.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.261+0000 7f5362ffd640 1 --2- 172.21.15.37:0/76718367 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f53640b38f0 0x7f5364159d60 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f535400c430 tx=0x7f535400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:41.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.261+0000 7f534b7fe640 1 -- 172.21.15.37:0/76718367 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53540052d0 con 0x7f53640b38f0 2024-04-22T07:18:41.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.261+0000 7f534b7fe640 1 -- 172.21.15.37:0/76718367 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5354005490 con 0x7f53640b38f0 2024-04-22T07:18:41.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.261+0000 7f53695d5640 1 -- 172.21.15.37:0/76718367 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53640cf720 con 0x7f53640b38f0 2024-04-22T07:18:41.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.261+0000 7f534b7fe640 1 -- 172.21.15.37:0/76718367 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5354007260 con 0x7f53640b38f0 2024-04-22T07:18:41.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.261+0000 7f53695d5640 1 -- 172.21.15.37:0/76718367 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53640cfce0 con 0x7f53640b38f0 2024-04-22T07:18:41.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.262+0000 7f53695d5640 1 -- 172.21.15.37:0/76718367 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5364069cc0 con 0x7f53640b38f0 2024-04-22T07:18:41.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.262+0000 7f534b7fe640 1 -- 172.21.15.37:0/76718367 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5354007400 con 0x7f53640b38f0 2024-04-22T07:18:41.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.263+0000 7f534b7fe640 1 --2- 172.21.15.37:0/76718367 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f535006c920 0x7f535006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:41.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.263+0000 7f534b7fe640 1 -- 172.21.15.37:0/76718367 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f535408b140 con 0x7f53640b38f0 2024-04-22T07:18:41.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.263+0000 7f53627fc640 1 --2- 172.21.15.37:0/76718367 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f535006c920 0x7f535006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:41.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.264+0000 7f53627fc640 1 --2- 172.21.15.37:0/76718367 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f535006c920 0x7f535006ede0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f5358036000 tx=0x7f535803b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:41.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.267+0000 7f534b7fe640 1 -- 172.21.15.37:0/76718367 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f53540594e0 con 0x7f53640b38f0 2024-04-22T07:18:41.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.453+0000 7f53695d5640 1 -- 172.21.15.37:0/76718367 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f53640cbfe0 con 0x7f53640b38f0 2024-04-22T07:18:41.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.454+0000 7f534b7fe640 1 -- 172.21.15.37:0/76718367 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16581 (secure 0 0 0) 0x7f5354058de0 con 0x7f53640b38f0 2024-04-22T07:18:41.452 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-22T07:18:41.452 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":20,"fsid":"10d90a41-52d3-4e09-8022-c8ac67897ad1","created":"2024-04-22T07:18:12.420756+0000","modified":"2024-04-22T07:18:37.754119+0000","last_up_change":"2024-04-22T07:18:23.649808+0000","last_in_change":"2024-04-22T07:18:14.506974+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-22T07:18:24.602243+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-22T07:18:34.673639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-22T07:18:35.055184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e248f6e1-13ad-48e0-a8f8-ec3059995654","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":1488290385},{"type":"v1","addr":"172.21.15.37:6801","nonce":1488290385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1488290385},{"type":"v1","addr":"172.21.15.37:6803","nonce":1488290385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1488290385},{"type":"v1","addr":"172.21.15.37:6807","nonce":1488290385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1488290385},{"type":"v1","addr":"172.21.15.37:6805","nonce":1488290385}]},"public_addr":"172.21.15.37:6801/1488290385","cluster_addr":"172.21.15.37:6803/1488290385","heartbeat_back_addr":"172.21.15.37:6807/1488290385","heartbeat_front_addr":"172.21.15.37:6805/1488290385","state":["exists","up"]},{"osd":1,"uuid":"01c71ab7-1326-432b-b73a-e5847abe5132","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3918584183},{"type":"v1","addr":"172.21.15.37:6811","nonce":3918584183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6813","nonce":3918584183},{"type":"v1","addr":"172.21.15.37:6816","nonce":3918584183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":3918584183},{"type":"v1","addr":"172.21.15.37:6823","nonce":3918584183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":3918584183},{"type":"v1","addr":"172.21.15.37:6821","nonce":3918584183}]},"public_addr":"172.21.15.37:6811/3918584183","cluster_addr":"172.21.15.37:6816/3918584183","heartbeat_back_addr":"172.21.15.37:6823/3918584183","heartbeat_front_addr":"172.21.15.37:6821/3918584183","state":["exists","up"]},{"osd":2,"uuid":"33a780fd-013a-41c8-9970-136c9e080897","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1895439419},{"type":"v1","addr":"172.21.15.37:6825","nonce":1895439419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1895439419},{"type":"v1","addr":"172.21.15.37:6827","nonce":1895439419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1895439419},{"type":"v1","addr":"172.21.15.37:6831","nonce":1895439419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1895439419},{"type":"v1","addr":"172.21.15.37:6829","nonce":1895439419}]},"public_addr":"172.21.15.37:6825/1895439419","cluster_addr":"172.21.15.37:6827/1895439419","heartbeat_back_addr":"172.21.15.37:6831/1895439419","heartbeat_front_addr":"172.21.15.37:6829/1895439419","state":["exists","up"]},{"osd":3,"uuid":"b46e53c4-e5b9-4098-b243-ab5a0f1f3885","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6809","nonce":1160021017},{"type":"v1","addr":"172.21.15.37:6810","nonce":1160021017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1160021017},{"type":"v1","addr":"172.21.15.37:6814","nonce":1160021017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":1160021017},{"type":"v1","addr":"172.21.15.37:6820","nonce":1160021017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6815","nonce":1160021017},{"type":"v1","addr":"172.21.15.37:6817","nonce":1160021017}]},"public_addr":"172.21.15.37:6810/1160021017","cluster_addr":"172.21.15.37:6814/1160021017","heartbeat_back_addr":"172.21.15.37:6820/1160021017","heartbeat_front_addr":"172.21.15.37:6817/1160021017","state":["exists","up"]},{"osd":4,"uuid":"cd1032c6-6a83-4e33-b7b1-baddf92a83af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":374829049},{"type":"v1","addr":"172.21.15.196:6809","nonce":374829049}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":374829049},{"type":"v1","addr":"172.21.15.196:6811","nonce":374829049}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":374829049},{"type":"v1","addr":"172.21.15.196:6815","nonce":374829049}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":374829049},{"type":"v1","addr":"172.21.15.196:6813","nonce":374829049}]},"public_addr":"172.21.15.196:6809/374829049","cluster_addr":"172.21.15.196:6811/374829049","heartbeat_back_addr":"172.21.15.196:6815/374829049","heartbeat_front_addr":"172.21.15.196:6813/374829049","state":["exists","up"]},{"osd":5,"uuid":"f561d48a-5f2d-4deb-8681-4329aed36bae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":479311302},{"type":"v1","addr":"172.21.15.196:6801","nonce":479311302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":479311302},{"type":"v1","addr":"172.21.15.196:6803","nonce":479311302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":479311302},{"type":"v1","addr":"172.21.15.196:6807","nonce":479311302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":479311302},{"type":"v1","addr":"172.21.15.196:6805","nonce":479311302}]},"public_addr":"172.21.15.196:6801/479311302","cluster_addr":"172.21.15.196:6803/479311302","heartbeat_back_addr":"172.21.15.196:6807/479311302","heartbeat_front_addr":"172.21.15.196:6805/479311302","state":["exists","up"]},{"osd":6,"uuid":"1b239c7e-2504-42e0-b308-70f4e62519c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6817","nonce":691777224},{"type":"v1","addr":"172.21.15.196:6819","nonce":691777224}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6821","nonce":691777224},{"type":"v1","addr":"172.21.15.196:6823","nonce":691777224}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6829","nonce":691777224},{"type":"v1","addr":"172.21.15.196:6831","nonce":691777224}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6825","nonce":691777224},{"type":"v1","addr":"172.21.15.196:6827","nonce":691777224}]},"public_addr":"172.21.15.196:6819/691777224","cluster_addr":"172.21.15.196:6823/691777224","heartbeat_back_addr":"172.21.15.196:6831/691777224","heartbeat_front_addr":"172.21.15.196:6827/691777224","state":["exists","up"]},{"osd":7,"uuid":"084318d4-d1fd-4b58-8c33-b1d7856fe323","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":3106266066},{"type":"v1","addr":"172.21.15.196:6818","nonce":3106266066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":3106266066},{"type":"v1","addr":"172.21.15.196:6822","nonce":3106266066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":3106266066},{"type":"v1","addr":"172.21.15.196:6830","nonce":3106266066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":3106266066},{"type":"v1","addr":"172.21.15.196:6826","nonce":3106266066}]},"public_addr":"172.21.15.196:6818/3106266066","cluster_addr":"172.21.15.196:6822/3106266066","heartbeat_back_addr":"172.21.15.196:6830/3106266066","heartbeat_front_addr":"172.21.15.196:6826/3106266066","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:18:19.587791+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:18:19.706541+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:18:19.690674+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:18:19.648354+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:18:19.666671+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:18:19.560709+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:18:19.661412+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:18:19.770650+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-22T07:18:41.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.456+0000 7f53695d5640 1 -- 172.21.15.37:0/76718367 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f535006c920 msgr2=0x7f535006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:41.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.456+0000 7f53695d5640 1 --2- 172.21.15.37:0/76718367 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f535006c920 0x7f535006ede0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f5358036000 tx=0x7f535803b040 comp rx=0 tx=0).stop 2024-04-22T07:18:41.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.456+0000 7f53695d5640 1 -- 172.21.15.37:0/76718367 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f53640b38f0 msgr2=0x7f5364159d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:41.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.456+0000 7f53695d5640 1 --2- 172.21.15.37:0/76718367 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f53640b38f0 0x7f5364159d60 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f535400c430 tx=0x7f535400c8f0 comp rx=0 tx=0).stop 2024-04-22T07:18:41.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.456+0000 7f53695d5640 1 -- 172.21.15.37:0/76718367 shutdown_connections 2024-04-22T07:18:41.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.456+0000 7f53695d5640 1 --2- 172.21.15.37:0/76718367 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f535006c920 0x7f535006ede0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:41.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.456+0000 7f53695d5640 1 --2- 172.21.15.37:0/76718367 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f536415b3f0 0x7f5364157480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:41.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.456+0000 7f53695d5640 1 --2- 172.21.15.37:0/76718367 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f53641552f0 0x7f536415dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:41.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.456+0000 7f53695d5640 1 --2- 172.21.15.37:0/76718367 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f53640b38f0 0x7f5364159d60 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:41.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.456+0000 7f53695d5640 1 -- 172.21.15.37:0/76718367 >> 172.21.15.37:0/76718367 conn(0x7f5364071f90 msgr2=0x7f53640b4ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:41.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.456+0000 7f53695d5640 1 -- 172.21.15.37:0/76718367 shutdown_connections 2024-04-22T07:18:41.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.456+0000 7f53695d5640 1 -- 172.21.15.37:0/76718367 wait complete. 2024-04-22T07:18:41.465 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-22T07:18:41.465 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-22T07:18:41.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.567+0000 7f502e9c7640 1 Processor -- start 2024-04-22T07:18:41.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.567+0000 7f502e9c7640 1 -- start start 2024-04-22T07:18:41.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.568+0000 7f502e9c7640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f5028152eb0 0x7f50280728c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:41.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.568+0000 7f502e9c7640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f502806b970 0x7f50280c6b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:41.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.568+0000 7f502e9c7640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50280c7e90 con 0x7f50280c7040 2024-04-22T07:18:41.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.568+0000 7f502e9c7640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f50280c84a0 con 0x7f5028152eb0 2024-04-22T07:18:41.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.568+0000 7f502e9c7640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f5028153290 con 0x7f502806b970 2024-04-22T07:18:41.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.568+0000 7f502cf64640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f50280c7040 0x7f5028158d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:56478/0 (socket says 172.21.15.37:56478) 2024-04-22T07:18:41.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.568+0000 7f502cf64640 1 -- 172.21.15.37:0/2462033665 learned_addr learned my addr 172.21.15.37:0/2462033665 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-04-22T07:18:41.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.568+0000 7f50277fe640 1 --2- 172.21.15.37:0/2462033665 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f502806b970 0x7f50280c6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:41.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.568+0000 7f5027fff640 1 --2- 172.21.15.37:0/2462033665 >> v2:172.21.15.196:3300/0 conn(0x7f5028152eb0 0x7f50280728c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:41.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.568+0000 7f5026ffd640 1 -- 172.21.15.37:0/2462033665 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1882148820 0 0) 0x7f50280c7e90 con 0x7f50280c7040 2024-04-22T07:18:41.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.568+0000 7f5026ffd640 1 -- 172.21.15.37:0/2462033665 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5014003520 con 0x7f50280c7040 2024-04-22T07:18:41.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.568+0000 7f5026ffd640 1 -- 172.21.15.37:0/2462033665 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3528345604 0 0) 0x7f5014003520 con 0x7f50280c7040 2024-04-22T07:18:41.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.568+0000 7f5026ffd640 1 -- 172.21.15.37:0/2462033665 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f502806b970 msgr2=0x7f50280c6b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:18:41.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.568+0000 7f5026ffd640 1 --2- 172.21.15.37:0/2462033665 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f502806b970 0x7f50280c6b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:41.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.568+0000 7f5026ffd640 1 -- 172.21.15.37:0/2462033665 >> v2:172.21.15.196:3300/0 conn(0x7f5028152eb0 msgr2=0x7f50280728c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:18:41.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.568+0000 7f5026ffd640 1 --2- 172.21.15.37:0/2462033665 >> v2:172.21.15.196:3300/0 conn(0x7f5028152eb0 0x7f50280728c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:41.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.568+0000 7f5026ffd640 1 -- 172.21.15.37:0/2462033665 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50280735d0 con 0x7f50280c7040 2024-04-22T07:18:41.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.568+0000 7f5026ffd640 1 -- 172.21.15.37:0/2462033665 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2576656170 0 0) 0x7f5020001a10 con 0x7f50280c7040 2024-04-22T07:18:41.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.569+0000 7f5026ffd640 1 -- 172.21.15.37:0/2462033665 >> v1:172.21.15.37:6789/0 conn(0x7f50280c7040 legacy=0x7f5028158d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:41.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.569+0000 7f5026ffd640 1 --2- 172.21.15.37:0/2462033665 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f50140039b0 0x7f5014003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:41.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.569+0000 7f5026ffd640 1 --2- 172.21.15.37:0/2462033665 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f502806b970 0x7f5014004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:41.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.569+0000 7f5026ffd640 1 --2- 172.21.15.37:0/2462033665 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5014004d40 0x7f50140051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:41.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.569+0000 7f5026ffd640 1 -- 172.21.15.37:0/2462033665 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f50280c84a0 con 0x7f5014004d40 2024-04-22T07:18:41.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.569+0000 7f5026ffd640 1 -- 172.21.15.37:0/2462033665 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f5028153290 con 0x7f50140039b0 2024-04-22T07:18:41.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.569+0000 7f5026ffd640 1 -- 172.21.15.37:0/2462033665 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f501400b9c0 con 0x7f502806b970 2024-04-22T07:18:41.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.569+0000 7f502cf64640 1 --2- 172.21.15.37:0/2462033665 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5014004d40 0x7f50140051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:41.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.569+0000 7f50277fe640 1 --2- 172.21.15.37:0/2462033665 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f502806b970 0x7f5014004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:41.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.569+0000 7f5027fff640 1 --2- 172.21.15.37:0/2462033665 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f50140039b0 0x7f5014003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:41.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.569+0000 7f502cf64640 1 -- 172.21.15.37:0/2462033665 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f502806b970 msgr2=0x7f5014004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:18:41.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.569+0000 7f502cf64640 1 --2- 172.21.15.37:0/2462033665 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f502806b970 0x7f5014004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:41.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.569+0000 7f502cf64640 1 -- 172.21.15.37:0/2462033665 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f50140039b0 msgr2=0x7f5014003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:18:41.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.569+0000 7f502cf64640 1 --2- 172.21.15.37:0/2462033665 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f50140039b0 0x7f5014003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:41.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.569+0000 7f502cf64640 1 -- 172.21.15.37:0/2462033665 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5014003520 con 0x7f5014004d40 2024-04-22T07:18:41.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.569+0000 7f50277fe640 1 --2- 172.21.15.37:0/2462033665 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f502806b970 0x7f5014004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-22T07:18:41.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.570+0000 7f502cf64640 1 --2- 172.21.15.37:0/2462033665 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5014004d40 0x7f50140051c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f50280c7ab0 tx=0x7f5014005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e532800f183ccb3 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:41.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.570+0000 7f5026ffd640 1 -- 172.21.15.37:0/2462033665 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f502000a500 con 0x7f5014004d40 2024-04-22T07:18:41.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.570+0000 7f5026ffd640 1 -- 172.21.15.37:0/2462033665 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50200072d0 con 0x7f5014004d40 2024-04-22T07:18:41.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.570+0000 7f5026ffd640 1 -- 172.21.15.37:0/2462033665 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50200076c0 con 0x7f5014004d40 2024-04-22T07:18:41.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.570+0000 7f502e9c7640 1 -- 172.21.15.37:0/2462033665 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5014004d40 msgr2=0x7f50140051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:41.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.570+0000 7f502e9c7640 1 --2- 172.21.15.37:0/2462033665 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5014004d40 0x7f50140051c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f50280c7ab0 tx=0x7f5014005830 comp rx=0 tx=0).stop 2024-04-22T07:18:41.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.570+0000 7f502cf64640 1 -- 172.21.15.37:0/2462033665 reap_dead start 2024-04-22T07:18:41.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.570+0000 7f502e9c7640 1 -- 172.21.15.37:0/2462033665 shutdown_connections 2024-04-22T07:18:41.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.570+0000 7f502e9c7640 1 -- 172.21.15.37:0/2462033665 >> 172.21.15.37:0/2462033665 conn(0x7f5028070a00 msgr2=0x7f50280cd3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:41.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.570+0000 7f502e9c7640 1 -- 172.21.15.37:0/2462033665 shutdown_connections 2024-04-22T07:18:41.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.571+0000 7f502e9c7640 1 -- 172.21.15.37:0/2462033665 wait complete. 2024-04-22T07:18:41.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.572+0000 7f502e9c7640 1 Processor -- start 2024-04-22T07:18:41.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.572+0000 7f502e9c7640 1 -- start start 2024-04-22T07:18:41.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.572+0000 7f502e9c7640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50280ca570 0x7f50280cb2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:41.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.573+0000 7f502e9c7640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f50280ca950 0x7f50280cb830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:41.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.573+0000 7f502e9c7640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f50281ef5e0 0x7f50281557c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:41.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.573+0000 7f502e9c7640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f5028073b90 con 0x7f50280ca570 2024-04-22T07:18:41.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.573+0000 7f502e9c7640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f50280c8130 con 0x7f50281ef5e0 2024-04-22T07:18:41.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.573+0000 7f502e9c7640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f5028072ff0 con 0x7f50280ca950 2024-04-22T07:18:41.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.573+0000 7f5027fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50280ca570 0x7f50280cb2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:41.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.573+0000 7f5027fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50280ca570 0x7f50280cb2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54462/0 (socket says 172.21.15.37:54462) 2024-04-22T07:18:41.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.573+0000 7f5027fff640 1 -- 172.21.15.37:0/2450902219 learned_addr learned my addr 172.21.15.37:0/2450902219 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:18:41.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.573+0000 7f50277fe640 1 --2- 172.21.15.37:0/2450902219 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f50280ca950 0x7f50280cb830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:41.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.573+0000 7f502cf64640 1 --2- 172.21.15.37:0/2450902219 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f50281ef5e0 0x7f50281557c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:41.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.573+0000 7f5027fff640 1 -- 172.21.15.37:0/2450902219 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f50280ca950 msgr2=0x7f50280cb830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:41.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.573+0000 7f5027fff640 1 --2- 172.21.15.37:0/2450902219 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f50280ca950 0x7f50280cb830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:41.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.573+0000 7f5027fff640 1 -- 172.21.15.37:0/2450902219 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f50281ef5e0 msgr2=0x7f50281557c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:41.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.573+0000 7f5027fff640 1 --2- 172.21.15.37:0/2450902219 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f50281ef5e0 0x7f50281557c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:41.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.573+0000 7f5027fff640 1 -- 172.21.15.37:0/2450902219 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50281e32b0 con 0x7f50280ca570 2024-04-22T07:18:41.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.573+0000 7f5027fff640 1 --2- 172.21.15.37:0/2450902219 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50280ca570 0x7f50280cb2f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f5010011960 tx=0x7f5010011d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:41.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.573+0000 7f5024ff9640 1 -- 172.21.15.37:0/2450902219 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f501000f9d0 con 0x7f50280ca570 2024-04-22T07:18:41.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.573+0000 7f5024ff9640 1 -- 172.21.15.37:0/2450902219 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f501000fb70 con 0x7f50280ca570 2024-04-22T07:18:41.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.573+0000 7f502e9c7640 1 -- 172.21.15.37:0/2450902219 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50281e3550 con 0x7f50280ca570 2024-04-22T07:18:41.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.573+0000 7f5024ff9640 1 -- 172.21.15.37:0/2450902219 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5010014440 con 0x7f50280ca570 2024-04-22T07:18:41.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.573+0000 7f502e9c7640 1 -- 172.21.15.37:0/2450902219 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50281e3b10 con 0x7f50280ca570 2024-04-22T07:18:41.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.574+0000 7f502e9c7640 1 -- 172.21.15.37:0/2450902219 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5028068b20 con 0x7f50280ca570 2024-04-22T07:18:41.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.575+0000 7f5024ff9640 1 -- 172.21.15.37:0/2450902219 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5010012040 con 0x7f50280ca570 2024-04-22T07:18:41.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.575+0000 7f5024ff9640 1 --2- 172.21.15.37:0/2450902219 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f500806c8f0 0x7f500806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:41.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.575+0000 7f5024ff9640 1 -- 172.21.15.37:0/2450902219 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f501008c060 con 0x7f50280ca570 2024-04-22T07:18:41.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.575+0000 7f50277fe640 1 --2- 172.21.15.37:0/2450902219 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f500806c8f0 0x7f500806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:41.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.576+0000 7f50277fe640 1 --2- 172.21.15.37:0/2450902219 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f500806c8f0 0x7f500806edb0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f50281e41f0 tx=0x7f5018009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:41.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.580+0000 7f5024ff9640 1 -- 172.21.15.37:0/2450902219 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f5010019030 con 0x7f50280ca570 2024-04-22T07:18:41.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.763+0000 7f502e9c7640 1 -- 172.21.15.37:0/2450902219 --> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f502806c530 con 0x7f500806c8f0 2024-04-22T07:18:41.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.771+0000 7f5024ff9640 1 -- 172.21.15.37:0/2450902219 <== mgr.4103 v2:172.21.15.196:6832/321987173 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251849 (secure 0 0 0) 0x7f502806c530 con 0x7f500806c8f0 2024-04-22T07:18:41.773 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-22T07:18:41.774 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-04-22T07:18:41.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.774+0000 7f502e9c7640 1 -- 172.21.15.37:0/2450902219 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f500806c8f0 msgr2=0x7f500806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:41.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.774+0000 7f502e9c7640 1 --2- 172.21.15.37:0/2450902219 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f500806c8f0 0x7f500806edb0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f50281e41f0 tx=0x7f5018009190 comp rx=0 tx=0).stop 2024-04-22T07:18:41.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.774+0000 7f502e9c7640 1 -- 172.21.15.37:0/2450902219 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50280ca570 msgr2=0x7f50280cb2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:41.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.774+0000 7f502e9c7640 1 --2- 172.21.15.37:0/2450902219 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50280ca570 0x7f50280cb2f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f5010011960 tx=0x7f5010011d60 comp rx=0 tx=0).stop 2024-04-22T07:18:41.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.775+0000 7f502e9c7640 1 -- 172.21.15.37:0/2450902219 shutdown_connections 2024-04-22T07:18:41.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.775+0000 7f502e9c7640 1 --2- 172.21.15.37:0/2450902219 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f500806c8f0 0x7f500806edb0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:41.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.775+0000 7f502e9c7640 1 --2- 172.21.15.37:0/2450902219 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f50281ef5e0 0x7f50281557c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:41.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.775+0000 7f502e9c7640 1 --2- 172.21.15.37:0/2450902219 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f50280ca950 0x7f50280cb830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:41.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.775+0000 7f502e9c7640 1 --2- 172.21.15.37:0/2450902219 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50280ca570 0x7f50280cb2f0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:41.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.775+0000 7f502e9c7640 1 -- 172.21.15.37:0/2450902219 >> 172.21.15.37:0/2450902219 conn(0x7f5028070a00 msgr2=0x7f5028067f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:41.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.775+0000 7f502e9c7640 1 -- 172.21.15.37:0/2450902219 shutdown_connections 2024-04-22T07:18:41.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.775+0000 7f502e9c7640 1 -- 172.21.15.37:0/2450902219 wait complete. 2024-04-22T07:18:41.783 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-04-22T07:18:40.586362+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":169,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218932,"kb_used_data":2748,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755788,"statfs":{"total":773094113280,"available":772869926912,"internally_reserved":0,"allocated":2813952,"data_stored":1741908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.856712"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.937242+0000","last_change":"2024-04-22T07:18:36.765825+0000","last_active":"2024-04-22T07:18:37.937242+0000","last_peered":"2024-04-22T07:18:37.937242+0000","last_clean":"2024-04-22T07:18:37.937242+0000","last_became_active":"2024-04-22T07:18:36.765306+0000","last_became_peered":"2024-04-22T07:18:36.765306+0000","last_unstale":"2024-04-22T07:18:37.937242+0000","last_undegraded":"2024-04-22T07:18:37.937242+0000","last_fullsized":"2024-04-22T07:18:37.937242+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:00:45.046782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.757437+0000","last_change":"2024-04-22T07:18:36.772829+0000","last_active":"2024-04-22T07:18:37.757437+0000","last_peered":"2024-04-22T07:18:37.757437+0000","last_clean":"2024-04-22T07:18:37.757437+0000","last_became_active":"2024-04-22T07:18:36.772464+0000","last_became_peered":"2024-04-22T07:18:36.772464+0000","last_unstale":"2024-04-22T07:18:37.757437+0000","last_undegraded":"2024-04-22T07:18:37.757437+0000","last_fullsized":"2024-04-22T07:18:37.757437+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:09:08.040513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:38.894883+0000","last_change":"2024-04-22T07:18:36.760613+0000","last_active":"2024-04-22T07:18:38.894883+0000","last_peered":"2024-04-22T07:18:38.894883+0000","last_clean":"2024-04-22T07:18:38.894883+0000","last_became_active":"2024-04-22T07:18:36.760313+0000","last_became_peered":"2024-04-22T07:18:36.760313+0000","last_unstale":"2024-04-22T07:18:38.894883+0000","last_undegraded":"2024-04-22T07:18:38.894883+0000","last_fullsized":"2024-04-22T07:18:38.894883+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:51:10.038201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.763484+0000","last_change":"2024-04-22T07:18:36.767969+0000","last_active":"2024-04-22T07:18:37.763484+0000","last_peered":"2024-04-22T07:18:37.763484+0000","last_clean":"2024-04-22T07:18:37.763484+0000","last_became_active":"2024-04-22T07:18:36.767713+0000","last_became_peered":"2024-04-22T07:18:36.767713+0000","last_unstale":"2024-04-22T07:18:37.763484+0000","last_undegraded":"2024-04-22T07:18:37.763484+0000","last_fullsized":"2024-04-22T07:18:37.763484+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:36:53.716397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.936961+0000","last_change":"2024-04-22T07:18:36.764361+0000","last_active":"2024-04-22T07:18:37.936961+0000","last_peered":"2024-04-22T07:18:37.936961+0000","last_clean":"2024-04-22T07:18:37.936961+0000","last_became_active":"2024-04-22T07:18:36.763812+0000","last_became_peered":"2024-04-22T07:18:36.763812+0000","last_unstale":"2024-04-22T07:18:37.936961+0000","last_undegraded":"2024-04-22T07:18:37.936961+0000","last_fullsized":"2024-04-22T07:18:37.936961+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:18:59.298766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.763087+0000","last_change":"2024-04-22T07:18:36.762804+0000","last_active":"2024-04-22T07:18:37.763087+0000","last_peered":"2024-04-22T07:18:37.763087+0000","last_clean":"2024-04-22T07:18:37.763087+0000","last_became_active":"2024-04-22T07:18:36.762508+0000","last_became_peered":"2024-04-22T07:18:36.762508+0000","last_unstale":"2024-04-22T07:18:37.763087+0000","last_undegraded":"2024-04-22T07:18:37.763087+0000","last_fullsized":"2024-04-22T07:18:37.763087+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:09:08.040513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.936807+0000","last_change":"2024-04-22T07:18:36.771774+0000","last_active":"2024-04-22T07:18:37.936807+0000","last_peered":"2024-04-22T07:18:37.936807+0000","last_clean":"2024-04-22T07:18:37.936807+0000","last_became_active":"2024-04-22T07:18:36.771425+0000","last_became_peered":"2024-04-22T07:18:36.771425+0000","last_unstale":"2024-04-22T07:18:37.936807+0000","last_undegraded":"2024-04-22T07:18:37.936807+0000","last_fullsized":"2024-04-22T07:18:37.936807+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:45:27.464772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.767379+0000","last_change":"2024-04-22T07:18:36.773631+0000","last_active":"2024-04-22T07:18:37.767379+0000","last_peered":"2024-04-22T07:18:37.767379+0000","last_clean":"2024-04-22T07:18:37.767379+0000","last_became_active":"2024-04-22T07:18:36.773347+0000","last_became_peered":"2024-04-22T07:18:36.773347+0000","last_unstale":"2024-04-22T07:18:37.767379+0000","last_undegraded":"2024-04-22T07:18:37.767379+0000","last_fullsized":"2024-04-22T07:18:37.767379+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:23:03.787574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.937320+0000","last_change":"2024-04-22T07:18:36.773325+0000","last_active":"2024-04-22T07:18:37.937320+0000","last_peered":"2024-04-22T07:18:37.937320+0000","last_clean":"2024-04-22T07:18:37.937320+0000","last_became_active":"2024-04-22T07:18:36.773023+0000","last_became_peered":"2024-04-22T07:18:36.773023+0000","last_unstale":"2024-04-22T07:18:37.937320+0000","last_undegraded":"2024-04-22T07:18:37.937320+0000","last_fullsized":"2024-04-22T07:18:37.937320+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:11:55.496104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:38.394196+0000","last_change":"2024-04-22T07:18:36.769834+0000","last_active":"2024-04-22T07:18:38.394196+0000","last_peered":"2024-04-22T07:18:38.394196+0000","last_clean":"2024-04-22T07:18:38.394196+0000","last_became_active":"2024-04-22T07:18:36.769544+0000","last_became_peered":"2024-04-22T07:18:36.769544+0000","last_unstale":"2024-04-22T07:18:38.394196+0000","last_undegraded":"2024-04-22T07:18:38.394196+0000","last_fullsized":"2024-04-22T07:18:38.394196+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:30:36.755201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:38.394021+0000","last_change":"2024-04-22T07:18:36.762325+0000","last_active":"2024-04-22T07:18:38.394021+0000","last_peered":"2024-04-22T07:18:38.394021+0000","last_clean":"2024-04-22T07:18:38.394021+0000","last_became_active":"2024-04-22T07:18:36.762059+0000","last_became_peered":"2024-04-22T07:18:36.762059+0000","last_unstale":"2024-04-22T07:18:38.394021+0000","last_undegraded":"2024-04-22T07:18:38.394021+0000","last_fullsized":"2024-04-22T07:18:38.394021+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:51:10.038201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.763612+0000","last_change":"2024-04-22T07:18:36.761961+0000","last_active":"2024-04-22T07:18:37.763612+0000","last_peered":"2024-04-22T07:18:37.763612+0000","last_clean":"2024-04-22T07:18:37.763612+0000","last_became_active":"2024-04-22T07:18:36.761389+0000","last_became_peered":"2024-04-22T07:18:36.761389+0000","last_unstale":"2024-04-22T07:18:37.763612+0000","last_undegraded":"2024-04-22T07:18:37.763612+0000","last_fullsized":"2024-04-22T07:18:37.763612+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T19:09:21.533739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.767566+0000","last_change":"2024-04-22T07:18:36.767665+0000","last_active":"2024-04-22T07:18:37.767566+0000","last_peered":"2024-04-22T07:18:37.767566+0000","last_clean":"2024-04-22T07:18:37.767566+0000","last_became_active":"2024-04-22T07:18:36.767386+0000","last_became_peered":"2024-04-22T07:18:36.767386+0000","last_unstale":"2024-04-22T07:18:37.767566+0000","last_undegraded":"2024-04-22T07:18:37.767566+0000","last_fullsized":"2024-04-22T07:18:37.767566+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:09:08.040513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:38.894526+0000","last_change":"2024-04-22T07:18:36.770591+0000","last_active":"2024-04-22T07:18:38.894526+0000","last_peered":"2024-04-22T07:18:38.894526+0000","last_clean":"2024-04-22T07:18:38.894526+0000","last_became_active":"2024-04-22T07:18:36.768507+0000","last_became_peered":"2024-04-22T07:18:36.768507+0000","last_unstale":"2024-04-22T07:18:38.894526+0000","last_undegraded":"2024-04-22T07:18:38.894526+0000","last_fullsized":"2024-04-22T07:18:38.894526+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:00:52.151755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.757456+0000","last_change":"2024-04-22T07:18:36.769407+0000","last_active":"2024-04-22T07:18:37.757456+0000","last_peered":"2024-04-22T07:18:37.757456+0000","last_clean":"2024-04-22T07:18:37.757456+0000","last_became_active":"2024-04-22T07:18:36.769114+0000","last_became_peered":"2024-04-22T07:18:36.769114+0000","last_unstale":"2024-04-22T07:18:37.757456+0000","last_undegraded":"2024-04-22T07:18:37.757456+0000","last_fullsized":"2024-04-22T07:18:37.757456+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:30:36.755201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.763835+0000","last_change":"2024-04-22T07:18:36.766539+0000","last_active":"2024-04-22T07:18:37.763835+0000","last_peered":"2024-04-22T07:18:37.763835+0000","last_clean":"2024-04-22T07:18:37.763835+0000","last_became_active":"2024-04-22T07:18:36.764865+0000","last_became_peered":"2024-04-22T07:18:36.764865+0000","last_unstale":"2024-04-22T07:18:37.763835+0000","last_undegraded":"2024-04-22T07:18:37.763835+0000","last_fullsized":"2024-04-22T07:18:37.763835+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:45:27.464772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.764360+0000","last_change":"2024-04-22T07:18:36.767174+0000","last_active":"2024-04-22T07:18:37.764360+0000","last_peered":"2024-04-22T07:18:37.764360+0000","last_clean":"2024-04-22T07:18:37.764360+0000","last_became_active":"2024-04-22T07:18:36.766083+0000","last_became_peered":"2024-04-22T07:18:36.766083+0000","last_unstale":"2024-04-22T07:18:37.764360+0000","last_undegraded":"2024-04-22T07:18:37.764360+0000","last_fullsized":"2024-04-22T07:18:37.764360+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:00:45.046782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:38.894453+0000","last_change":"2024-04-22T07:18:36.764432+0000","last_active":"2024-04-22T07:18:38.894453+0000","last_peered":"2024-04-22T07:18:38.894453+0000","last_clean":"2024-04-22T07:18:38.894453+0000","last_became_active":"2024-04-22T07:18:36.764113+0000","last_became_peered":"2024-04-22T07:18:36.764113+0000","last_unstale":"2024-04-22T07:18:38.894453+0000","last_undegraded":"2024-04-22T07:18:38.894453+0000","last_fullsized":"2024-04-22T07:18:38.894453+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:32:48.474033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.937223+0000","last_change":"2024-04-22T07:18:36.772138+0000","last_active":"2024-04-22T07:18:37.937223+0000","last_peered":"2024-04-22T07:18:37.937223+0000","last_clean":"2024-04-22T07:18:37.937223+0000","last_became_active":"2024-04-22T07:18:36.771878+0000","last_became_peered":"2024-04-22T07:18:36.771878+0000","last_unstale":"2024-04-22T07:18:37.937223+0000","last_undegraded":"2024-04-22T07:18:37.937223+0000","last_fullsized":"2024-04-22T07:18:37.937223+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:36:27.097452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:38.394042+0000","last_change":"2024-04-22T07:18:36.769528+0000","last_active":"2024-04-22T07:18:38.394042+0000","last_peered":"2024-04-22T07:18:38.394042+0000","last_clean":"2024-04-22T07:18:38.394042+0000","last_became_active":"2024-04-22T07:18:36.769240+0000","last_became_peered":"2024-04-22T07:18:36.769240+0000","last_unstale":"2024-04-22T07:18:38.394042+0000","last_undegraded":"2024-04-22T07:18:38.394042+0000","last_fullsized":"2024-04-22T07:18:38.394042+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:09:08.040513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:38.894747+0000","last_change":"2024-04-22T07:18:36.766049+0000","last_active":"2024-04-22T07:18:38.894747+0000","last_peered":"2024-04-22T07:18:38.894747+0000","last_clean":"2024-04-22T07:18:38.894747+0000","last_became_active":"2024-04-22T07:18:36.765724+0000","last_became_peered":"2024-04-22T07:18:36.765724+0000","last_unstale":"2024-04-22T07:18:38.894747+0000","last_undegraded":"2024-04-22T07:18:38.894747+0000","last_fullsized":"2024-04-22T07:18:38.894747+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:32:20.374856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.763238+0000","last_change":"2024-04-22T07:18:36.765850+0000","last_active":"2024-04-22T07:18:37.763238+0000","last_peered":"2024-04-22T07:18:37.763238+0000","last_clean":"2024-04-22T07:18:37.763238+0000","last_became_active":"2024-04-22T07:18:36.765560+0000","last_became_peered":"2024-04-22T07:18:36.765560+0000","last_unstale":"2024-04-22T07:18:37.763238+0000","last_undegraded":"2024-04-22T07:18:37.763238+0000","last_fullsized":"2024-04-22T07:18:37.763238+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:30:36.755201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.767520+0000","last_change":"2024-04-22T07:18:36.769465+0000","last_active":"2024-04-22T07:18:37.767520+0000","last_peered":"2024-04-22T07:18:37.767520+0000","last_clean":"2024-04-22T07:18:37.767520+0000","last_became_active":"2024-04-22T07:18:36.769181+0000","last_became_peered":"2024-04-22T07:18:36.769181+0000","last_unstale":"2024-04-22T07:18:37.767520+0000","last_undegraded":"2024-04-22T07:18:37.767520+0000","last_fullsized":"2024-04-22T07:18:37.767520+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:51:10.038201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.764013+0000","last_change":"2024-04-22T07:18:36.763439+0000","last_active":"2024-04-22T07:18:37.764013+0000","last_peered":"2024-04-22T07:18:37.764013+0000","last_clean":"2024-04-22T07:18:37.764013+0000","last_became_active":"2024-04-22T07:18:36.763146+0000","last_became_peered":"2024-04-22T07:18:36.763146+0000","last_unstale":"2024-04-22T07:18:37.764013+0000","last_undegraded":"2024-04-22T07:18:37.764013+0000","last_fullsized":"2024-04-22T07:18:37.764013+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:18:59.298766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.768027+0000","last_change":"2024-04-22T07:18:36.769533+0000","last_active":"2024-04-22T07:18:37.768027+0000","last_peered":"2024-04-22T07:18:37.768027+0000","last_clean":"2024-04-22T07:18:37.768027+0000","last_became_active":"2024-04-22T07:18:36.769274+0000","last_became_peered":"2024-04-22T07:18:36.769274+0000","last_unstale":"2024-04-22T07:18:37.768027+0000","last_undegraded":"2024-04-22T07:18:37.768027+0000","last_fullsized":"2024-04-22T07:18:37.768027+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:03:50.228822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:38.394207+0000","last_change":"2024-04-22T07:18:36.763931+0000","last_active":"2024-04-22T07:18:38.394207+0000","last_peered":"2024-04-22T07:18:38.394207+0000","last_clean":"2024-04-22T07:18:38.394207+0000","last_became_active":"2024-04-22T07:18:36.763656+0000","last_became_peered":"2024-04-22T07:18:36.763656+0000","last_unstale":"2024-04-22T07:18:38.394207+0000","last_undegraded":"2024-04-22T07:18:38.394207+0000","last_fullsized":"2024-04-22T07:18:38.394207+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:22:58.884168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.757432+0000","last_change":"2024-04-22T07:18:36.767158+0000","last_active":"2024-04-22T07:18:37.757432+0000","last_peered":"2024-04-22T07:18:37.757432+0000","last_clean":"2024-04-22T07:18:37.757432+0000","last_became_active":"2024-04-22T07:18:36.766614+0000","last_became_peered":"2024-04-22T07:18:36.766614+0000","last_unstale":"2024-04-22T07:18:37.757432+0000","last_undegraded":"2024-04-22T07:18:37.757432+0000","last_fullsized":"2024-04-22T07:18:37.757432+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:44:30.785178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.767721+0000","last_change":"2024-04-22T07:18:36.773129+0000","last_active":"2024-04-22T07:18:37.767721+0000","last_peered":"2024-04-22T07:18:37.767721+0000","last_clean":"2024-04-22T07:18:37.767721+0000","last_became_active":"2024-04-22T07:18:36.772827+0000","last_became_peered":"2024-04-22T07:18:36.772827+0000","last_unstale":"2024-04-22T07:18:37.767721+0000","last_undegraded":"2024-04-22T07:18:37.767721+0000","last_fullsized":"2024-04-22T07:18:37.767721+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:45:27.464772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:38.894815+0000","last_change":"2024-04-22T07:18:36.763716+0000","last_active":"2024-04-22T07:18:38.894815+0000","last_peered":"2024-04-22T07:18:38.894815+0000","last_clean":"2024-04-22T07:18:38.894815+0000","last_became_active":"2024-04-22T07:18:36.762270+0000","last_became_peered":"2024-04-22T07:18:36.762270+0000","last_unstale":"2024-04-22T07:18:38.894815+0000","last_undegraded":"2024-04-22T07:18:38.894815+0000","last_fullsized":"2024-04-22T07:18:38.894815+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:23:03.787574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.763390+0000","last_change":"2024-04-22T07:18:36.764152+0000","last_active":"2024-04-22T07:18:37.763390+0000","last_peered":"2024-04-22T07:18:37.763390+0000","last_clean":"2024-04-22T07:18:37.763390+0000","last_became_active":"2024-04-22T07:18:36.763770+0000","last_became_peered":"2024-04-22T07:18:36.763770+0000","last_unstale":"2024-04-22T07:18:37.763390+0000","last_undegraded":"2024-04-22T07:18:37.763390+0000","last_fullsized":"2024-04-22T07:18:37.763390+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:22:58.884168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:38.894313+0000","last_change":"2024-04-22T07:18:36.771121+0000","last_active":"2024-04-22T07:18:38.894313+0000","last_peered":"2024-04-22T07:18:38.894313+0000","last_clean":"2024-04-22T07:18:38.894313+0000","last_became_active":"2024-04-22T07:18:36.770786+0000","last_became_peered":"2024-04-22T07:18:36.770786+0000","last_unstale":"2024-04-22T07:18:38.894313+0000","last_undegraded":"2024-04-22T07:18:38.894313+0000","last_fullsized":"2024-04-22T07:18:38.894313+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:45:15.213668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:38.393831+0000","last_change":"2024-04-22T07:18:36.765462+0000","last_active":"2024-04-22T07:18:38.393831+0000","last_peered":"2024-04-22T07:18:38.393831+0000","last_clean":"2024-04-22T07:18:38.393831+0000","last_became_active":"2024-04-22T07:18:36.765142+0000","last_became_peered":"2024-04-22T07:18:36.765142+0000","last_unstale":"2024-04-22T07:18:38.393831+0000","last_undegraded":"2024-04-22T07:18:38.393831+0000","last_fullsized":"2024-04-22T07:18:38.393831+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:32:20.374856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.763051+0000","last_change":"2024-04-22T07:18:36.768234+0000","last_active":"2024-04-22T07:18:37.763051+0000","last_peered":"2024-04-22T07:18:37.763051+0000","last_clean":"2024-04-22T07:18:37.763051+0000","last_became_active":"2024-04-22T07:18:36.767951+0000","last_became_peered":"2024-04-22T07:18:36.767951+0000","last_unstale":"2024-04-22T07:18:37.763051+0000","last_undegraded":"2024-04-22T07:18:37.763051+0000","last_fullsized":"2024-04-22T07:18:37.763051+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:08:05.611868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.767692+0000","last_change":"2024-04-22T07:18:35.751538+0000","last_active":"2024-04-22T07:18:37.767692+0000","last_peered":"2024-04-22T07:18:37.767692+0000","last_clean":"2024-04-22T07:18:37.767692+0000","last_became_active":"2024-04-22T07:18:35.751219+0000","last_became_peered":"2024-04-22T07:18:35.751219+0000","last_unstale":"2024-04-22T07:18:37.767692+0000","last_undegraded":"2024-04-22T07:18:37.767692+0000","last_fullsized":"2024-04-22T07:18:37.767692+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:00:10.289974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:38.894909+0000","last_change":"2024-04-22T07:18:36.757337+0000","last_active":"2024-04-22T07:18:38.894909+0000","last_peered":"2024-04-22T07:18:38.894909+0000","last_clean":"2024-04-22T07:18:38.894909+0000","last_became_active":"2024-04-22T07:18:36.757039+0000","last_became_peered":"2024-04-22T07:18:36.757039+0000","last_unstale":"2024-04-22T07:18:38.894909+0000","last_undegraded":"2024-04-22T07:18:38.894909+0000","last_fullsized":"2024-04-22T07:18:38.894909+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:09:08.040513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:38.393864+0000","last_change":"2024-04-22T07:18:35.746515+0000","last_active":"2024-04-22T07:18:38.393864+0000","last_peered":"2024-04-22T07:18:38.393864+0000","last_clean":"2024-04-22T07:18:38.393864+0000","last_became_active":"2024-04-22T07:18:35.746198+0000","last_became_peered":"2024-04-22T07:18:35.746198+0000","last_unstale":"2024-04-22T07:18:38.393864+0000","last_undegraded":"2024-04-22T07:18:38.393864+0000","last_fullsized":"2024-04-22T07:18:38.393864+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:43:54.682673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.767496+0000","last_change":"2024-04-22T07:18:35.752307+0000","last_active":"2024-04-22T07:18:37.767496+0000","last_peered":"2024-04-22T07:18:37.767496+0000","last_clean":"2024-04-22T07:18:37.767496+0000","last_became_active":"2024-04-22T07:18:35.751545+0000","last_became_peered":"2024-04-22T07:18:35.751545+0000","last_unstale":"2024-04-22T07:18:37.767496+0000","last_undegraded":"2024-04-22T07:18:37.767496+0000","last_fullsized":"2024-04-22T07:18:37.767496+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:21:55.316649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.767511+0000","last_change":"2024-04-22T07:18:36.772372+0000","last_active":"2024-04-22T07:18:37.767511+0000","last_peered":"2024-04-22T07:18:37.767511+0000","last_clean":"2024-04-22T07:18:37.767511+0000","last_became_active":"2024-04-22T07:18:36.772067+0000","last_became_peered":"2024-04-22T07:18:36.772067+0000","last_unstale":"2024-04-22T07:18:37.767511+0000","last_undegraded":"2024-04-22T07:18:37.767511+0000","last_fullsized":"2024-04-22T07:18:37.767511+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:44:30.785178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.764151+0000","last_change":"2024-04-22T07:18:35.740989+0000","last_active":"2024-04-22T07:18:37.764151+0000","last_peered":"2024-04-22T07:18:37.764151+0000","last_clean":"2024-04-22T07:18:37.764151+0000","last_became_active":"2024-04-22T07:18:35.740665+0000","last_became_peered":"2024-04-22T07:18:35.740665+0000","last_unstale":"2024-04-22T07:18:37.764151+0000","last_undegraded":"2024-04-22T07:18:37.764151+0000","last_fullsized":"2024-04-22T07:18:37.764151+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:00:10.289974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.757377+0000","last_change":"2024-04-22T07:18:36.767022+0000","last_active":"2024-04-22T07:18:37.757377+0000","last_peered":"2024-04-22T07:18:37.757377+0000","last_clean":"2024-04-22T07:18:37.757377+0000","last_became_active":"2024-04-22T07:18:36.766609+0000","last_became_peered":"2024-04-22T07:18:36.766609+0000","last_unstale":"2024-04-22T07:18:37.757377+0000","last_undegraded":"2024-04-22T07:18:37.757377+0000","last_fullsized":"2024-04-22T07:18:37.757377+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:32:20.374856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:38.394098+0000","last_change":"2024-04-22T07:18:35.752081+0000","last_active":"2024-04-22T07:18:38.394098+0000","last_peered":"2024-04-22T07:18:38.394098+0000","last_clean":"2024-04-22T07:18:38.394098+0000","last_became_active":"2024-04-22T07:18:35.751757+0000","last_became_peered":"2024-04-22T07:18:35.751757+0000","last_unstale":"2024-04-22T07:18:38.394098+0000","last_undegraded":"2024-04-22T07:18:38.394098+0000","last_fullsized":"2024-04-22T07:18:38.394098+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:21:55.316649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.764165+0000","last_change":"2024-04-22T07:18:36.765937+0000","last_active":"2024-04-22T07:18:37.764165+0000","last_peered":"2024-04-22T07:18:37.764165+0000","last_clean":"2024-04-22T07:18:37.764165+0000","last_became_active":"2024-04-22T07:18:36.765647+0000","last_became_peered":"2024-04-22T07:18:36.765647+0000","last_unstale":"2024-04-22T07:18:37.764165+0000","last_undegraded":"2024-04-22T07:18:37.764165+0000","last_fullsized":"2024-04-22T07:18:37.764165+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:59:57.688417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.763996+0000","last_change":"2024-04-22T07:18:35.747309+0000","last_active":"2024-04-22T07:18:37.763996+0000","last_peered":"2024-04-22T07:18:37.763996+0000","last_clean":"2024-04-22T07:18:37.763996+0000","last_became_active":"2024-04-22T07:18:35.747019+0000","last_became_peered":"2024-04-22T07:18:35.747019+0000","last_unstale":"2024-04-22T07:18:37.763996+0000","last_undegraded":"2024-04-22T07:18:37.763996+0000","last_fullsized":"2024-04-22T07:18:37.763996+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:21:55.316649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:38.895019+0000","last_change":"2024-04-22T07:18:36.763436+0000","last_active":"2024-04-22T07:18:38.895019+0000","last_peered":"2024-04-22T07:18:38.895019+0000","last_clean":"2024-04-22T07:18:38.895019+0000","last_became_active":"2024-04-22T07:18:36.763068+0000","last_became_peered":"2024-04-22T07:18:36.763068+0000","last_unstale":"2024-04-22T07:18:38.895019+0000","last_undegraded":"2024-04-22T07:18:38.895019+0000","last_fullsized":"2024-04-22T07:18:38.895019+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:22:58.884168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.757301+0000","last_change":"2024-04-22T07:18:35.750769+0000","last_active":"2024-04-22T07:18:37.757301+0000","last_peered":"2024-04-22T07:18:37.757301+0000","last_clean":"2024-04-22T07:18:37.757301+0000","last_became_active":"2024-04-22T07:18:35.750406+0000","last_became_peered":"2024-04-22T07:18:35.750406+0000","last_unstale":"2024-04-22T07:18:37.757301+0000","last_undegraded":"2024-04-22T07:18:37.757301+0000","last_fullsized":"2024-04-22T07:18:37.757301+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T19:09:20.529889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.763680+0000","last_change":"2024-04-22T07:18:36.767426+0000","last_active":"2024-04-22T07:18:37.763680+0000","last_peered":"2024-04-22T07:18:37.763680+0000","last_clean":"2024-04-22T07:18:37.763680+0000","last_became_active":"2024-04-22T07:18:36.767159+0000","last_became_peered":"2024-04-22T07:18:36.767159+0000","last_unstale":"2024-04-22T07:18:37.763680+0000","last_undegraded":"2024-04-22T07:18:37.763680+0000","last_fullsized":"2024-04-22T07:18:37.763680+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:19:49.652644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:38.394172+0000","last_change":"2024-04-22T07:18:35.752996+0000","last_active":"2024-04-22T07:18:38.394172+0000","last_peered":"2024-04-22T07:18:38.394172+0000","last_clean":"2024-04-22T07:18:38.394172+0000","last_became_active":"2024-04-22T07:18:35.752686+0000","last_became_peered":"2024-04-22T07:18:35.752686+0000","last_unstale":"2024-04-22T07:18:38.394172+0000","last_undegraded":"2024-04-22T07:18:38.394172+0000","last_fullsized":"2024-04-22T07:18:38.394172+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:36:55.684427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.937011+0000","last_change":"2024-04-22T07:18:36.767539+0000","last_active":"2024-04-22T07:18:37.937011+0000","last_peered":"2024-04-22T07:18:37.937011+0000","last_clean":"2024-04-22T07:18:37.937011+0000","last_became_active":"2024-04-22T07:18:36.767273+0000","last_became_peered":"2024-04-22T07:18:36.767273+0000","last_unstale":"2024-04-22T07:18:37.937011+0000","last_undegraded":"2024-04-22T07:18:37.937011+0000","last_fullsized":"2024-04-22T07:18:37.937011+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:03:50.228822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:38.894909+0000","last_change":"2024-04-22T07:18:35.752382+0000","last_active":"2024-04-22T07:18:38.894909+0000","last_peered":"2024-04-22T07:18:38.894909+0000","last_clean":"2024-04-22T07:18:38.894909+0000","last_became_active":"2024-04-22T07:18:35.752060+0000","last_became_peered":"2024-04-22T07:18:35.752060+0000","last_unstale":"2024-04-22T07:18:38.894909+0000","last_undegraded":"2024-04-22T07:18:38.894909+0000","last_fullsized":"2024-04-22T07:18:38.894909+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:31:33.559251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:38.894534+0000","last_change":"2024-04-22T07:18:36.764670+0000","last_active":"2024-04-22T07:18:38.894534+0000","last_peered":"2024-04-22T07:18:38.894534+0000","last_clean":"2024-04-22T07:18:38.894534+0000","last_became_active":"2024-04-22T07:18:36.763834+0000","last_became_peered":"2024-04-22T07:18:36.763834+0000","last_unstale":"2024-04-22T07:18:38.894534+0000","last_undegraded":"2024-04-22T07:18:38.894534+0000","last_fullsized":"2024-04-22T07:18:38.894534+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:41:20.703226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.763489+0000","last_change":"2024-04-22T07:18:35.752856+0000","last_active":"2024-04-22T07:18:37.763489+0000","last_peered":"2024-04-22T07:18:37.763489+0000","last_clean":"2024-04-22T07:18:37.763489+0000","last_became_active":"2024-04-22T07:18:35.752527+0000","last_became_peered":"2024-04-22T07:18:35.752527+0000","last_unstale":"2024-04-22T07:18:37.763489+0000","last_undegraded":"2024-04-22T07:18:37.763489+0000","last_fullsized":"2024-04-22T07:18:37.763489+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:40:59.305769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.937073+0000","last_change":"2024-04-22T07:18:36.769174+0000","last_active":"2024-04-22T07:18:37.937073+0000","last_peered":"2024-04-22T07:18:37.937073+0000","last_clean":"2024-04-22T07:18:37.937073+0000","last_became_active":"2024-04-22T07:18:36.768913+0000","last_became_peered":"2024-04-22T07:18:36.768913+0000","last_unstale":"2024-04-22T07:18:37.937073+0000","last_undegraded":"2024-04-22T07:18:37.937073+0000","last_fullsized":"2024-04-22T07:18:37.937073+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:45:42.674989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:38.393752+0000","last_change":"2024-04-22T07:18:35.749740+0000","last_active":"2024-04-22T07:18:38.393752+0000","last_peered":"2024-04-22T07:18:38.393752+0000","last_clean":"2024-04-22T07:18:38.393752+0000","last_became_active":"2024-04-22T07:18:35.749453+0000","last_became_peered":"2024-04-22T07:18:35.749453+0000","last_unstale":"2024-04-22T07:18:38.393752+0000","last_undegraded":"2024-04-22T07:18:38.393752+0000","last_fullsized":"2024-04-22T07:18:38.393752+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:08:04.608018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:38.393952+0000","last_change":"2024-04-22T07:18:36.771940+0000","last_active":"2024-04-22T07:18:38.393952+0000","last_peered":"2024-04-22T07:18:38.393952+0000","last_clean":"2024-04-22T07:18:38.393952+0000","last_became_active":"2024-04-22T07:18:36.771548+0000","last_became_peered":"2024-04-22T07:18:36.771548+0000","last_unstale":"2024-04-22T07:18:38.393952+0000","last_undegraded":"2024-04-22T07:18:38.393952+0000","last_fullsized":"2024-04-22T07:18:38.393952+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:23:03.787574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:38.894061+0000","last_change":"2024-04-22T07:18:35.749047+0000","last_active":"2024-04-22T07:18:38.894061+0000","last_peered":"2024-04-22T07:18:38.894061+0000","last_clean":"2024-04-22T07:18:38.894061+0000","last_became_active":"2024-04-22T07:18:35.748757+0000","last_became_peered":"2024-04-22T07:18:35.748757+0000","last_unstale":"2024-04-22T07:18:38.894061+0000","last_undegraded":"2024-04-22T07:18:38.894061+0000","last_fullsized":"2024-04-22T07:18:38.894061+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:40:59.305769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.936788+0000","last_change":"2024-04-22T07:18:36.769894+0000","last_active":"2024-04-22T07:18:37.936788+0000","last_peered":"2024-04-22T07:18:37.936788+0000","last_clean":"2024-04-22T07:18:37.936788+0000","last_became_active":"2024-04-22T07:18:36.768702+0000","last_became_peered":"2024-04-22T07:18:36.768702+0000","last_unstale":"2024-04-22T07:18:37.936788+0000","last_undegraded":"2024-04-22T07:18:37.936788+0000","last_fullsized":"2024-04-22T07:18:37.936788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:36:53.716397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.763463+0000","last_change":"2024-04-22T07:18:35.747536+0000","last_active":"2024-04-22T07:18:37.763463+0000","last_peered":"2024-04-22T07:18:37.763463+0000","last_clean":"2024-04-22T07:18:37.763463+0000","last_became_active":"2024-04-22T07:18:35.747271+0000","last_became_peered":"2024-04-22T07:18:35.747271+0000","last_unstale":"2024-04-22T07:18:37.763463+0000","last_undegraded":"2024-04-22T07:18:37.763463+0000","last_fullsized":"2024-04-22T07:18:37.763463+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:51:11.593642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.937304+0000","last_change":"2024-04-22T07:18:36.773033+0000","last_active":"2024-04-22T07:18:37.937304+0000","last_peered":"2024-04-22T07:18:37.937304+0000","last_clean":"2024-04-22T07:18:37.937304+0000","last_became_active":"2024-04-22T07:18:36.772537+0000","last_became_peered":"2024-04-22T07:18:36.772537+0000","last_unstale":"2024-04-22T07:18:37.937304+0000","last_undegraded":"2024-04-22T07:18:37.937304+0000","last_fullsized":"2024-04-22T07:18:37.937304+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:58:41.509248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:38.894457+0000","last_change":"2024-04-22T07:18:35.747533+0000","last_active":"2024-04-22T07:18:38.894457+0000","last_peered":"2024-04-22T07:18:38.894457+0000","last_clean":"2024-04-22T07:18:38.894457+0000","last_became_active":"2024-04-22T07:18:35.746881+0000","last_became_peered":"2024-04-22T07:18:35.746881+0000","last_unstale":"2024-04-22T07:18:38.894457+0000","last_undegraded":"2024-04-22T07:18:38.894457+0000","last_fullsized":"2024-04-22T07:18:38.894457+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:43:54.682673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.937347+0000","last_change":"2024-04-22T07:18:36.773723+0000","last_active":"2024-04-22T07:18:37.937347+0000","last_peered":"2024-04-22T07:18:37.937347+0000","last_clean":"2024-04-22T07:18:37.937347+0000","last_became_active":"2024-04-22T07:18:36.773466+0000","last_became_peered":"2024-04-22T07:18:36.773466+0000","last_unstale":"2024-04-22T07:18:37.937347+0000","last_undegraded":"2024-04-22T07:18:37.937347+0000","last_fullsized":"2024-04-22T07:18:37.937347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:42:20.611744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.757415+0000","last_change":"2024-04-22T07:18:35.750360+0000","last_active":"2024-04-22T07:18:37.757415+0000","last_peered":"2024-04-22T07:18:37.757415+0000","last_clean":"2024-04-22T07:18:37.757415+0000","last_became_active":"2024-04-22T07:18:35.749984+0000","last_became_peered":"2024-04-22T07:18:35.749984+0000","last_unstale":"2024-04-22T07:18:37.757415+0000","last_undegraded":"2024-04-22T07:18:37.757415+0000","last_fullsized":"2024-04-22T07:18:37.757415+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:19:48.648793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.764298+0000","last_change":"2024-04-22T07:18:36.765767+0000","last_active":"2024-04-22T07:18:37.764298+0000","last_peered":"2024-04-22T07:18:37.764298+0000","last_clean":"2024-04-22T07:18:37.764298+0000","last_became_active":"2024-04-22T07:18:36.764218+0000","last_became_peered":"2024-04-22T07:18:36.764218+0000","last_unstale":"2024-04-22T07:18:37.764298+0000","last_undegraded":"2024-04-22T07:18:37.764298+0000","last_fullsized":"2024-04-22T07:18:37.764298+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:45:42.674989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:38.894330+0000","last_change":"2024-04-22T07:18:35.743323+0000","last_active":"2024-04-22T07:18:38.894330+0000","last_peered":"2024-04-22T07:18:38.894330+0000","last_clean":"2024-04-22T07:18:38.894330+0000","last_became_active":"2024-04-22T07:18:35.743023+0000","last_became_peered":"2024-04-22T07:18:35.743023+0000","last_unstale":"2024-04-22T07:18:38.894330+0000","last_undegraded":"2024-04-22T07:18:38.894330+0000","last_fullsized":"2024-04-22T07:18:38.894330+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:08:04.608018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.937037+0000","last_change":"2024-04-22T07:18:36.771073+0000","last_active":"2024-04-22T07:18:37.937037+0000","last_peered":"2024-04-22T07:18:37.937037+0000","last_clean":"2024-04-22T07:18:37.937037+0000","last_became_active":"2024-04-22T07:18:36.770678+0000","last_became_peered":"2024-04-22T07:18:36.770678+0000","last_unstale":"2024-04-22T07:18:37.937037+0000","last_undegraded":"2024-04-22T07:18:37.937037+0000","last_fullsized":"2024-04-22T07:18:37.937037+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:59:57.688417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":170,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.936801+0000","last_change":"2024-04-22T07:18:26.518190+0000","last_active":"2024-04-22T07:18:37.936801+0000","last_peered":"2024-04-22T07:18:37.936801+0000","last_clean":"2024-04-22T07:18:37.936801+0000","last_became_active":"2024-04-22T07:18:26.515489+0000","last_became_peered":"2024-04-22T07:18:26.515489+0000","last_unstale":"2024-04-22T07:18:37.936801+0000","last_undegraded":"2024-04-22T07:18:37.936801+0000","last_fullsized":"2024-04-22T07:18:37.936801+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:24.652061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:24.652061+0000","last_clean_scrub_stamp":"2024-04-22T07:18:24.652061+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:32:54.875706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.762947+0000","last_change":"2024-04-22T07:18:35.748477+0000","last_active":"2024-04-22T07:18:37.762947+0000","last_peered":"2024-04-22T07:18:37.762947+0000","last_clean":"2024-04-22T07:18:37.762947+0000","last_became_active":"2024-04-22T07:18:35.748176+0000","last_became_peered":"2024-04-22T07:18:35.748176+0000","last_unstale":"2024-04-22T07:18:37.762947+0000","last_undegraded":"2024-04-22T07:18:37.762947+0000","last_fullsized":"2024-04-22T07:18:37.762947+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:36:55.684427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.767642+0000","last_change":"2024-04-22T07:18:36.771870+0000","last_active":"2024-04-22T07:18:37.767642+0000","last_peered":"2024-04-22T07:18:37.767642+0000","last_clean":"2024-04-22T07:18:37.767642+0000","last_became_active":"2024-04-22T07:18:36.771583+0000","last_became_peered":"2024-04-22T07:18:36.771583+0000","last_unstale":"2024-04-22T07:18:37.767642+0000","last_undegraded":"2024-04-22T07:18:37.767642+0000","last_fullsized":"2024-04-22T07:18:37.767642+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:22:58.884168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.936652+0000","last_change":"2024-04-22T07:18:35.755668+0000","last_active":"2024-04-22T07:18:37.936652+0000","last_peered":"2024-04-22T07:18:37.936652+0000","last_clean":"2024-04-22T07:18:37.936652+0000","last_became_active":"2024-04-22T07:18:35.755471+0000","last_became_peered":"2024-04-22T07:18:35.755471+0000","last_unstale":"2024-04-22T07:18:37.936652+0000","last_undegraded":"2024-04-22T07:18:37.936652+0000","last_fullsized":"2024-04-22T07:18:37.936652+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:36:55.684427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:38.894300+0000","last_change":"2024-04-22T07:18:36.758204+0000","last_active":"2024-04-22T07:18:38.894300+0000","last_peered":"2024-04-22T07:18:38.894300+0000","last_clean":"2024-04-22T07:18:38.894300+0000","last_became_active":"2024-04-22T07:18:36.757841+0000","last_became_peered":"2024-04-22T07:18:36.757841+0000","last_unstale":"2024-04-22T07:18:38.894300+0000","last_undegraded":"2024-04-22T07:18:38.894300+0000","last_fullsized":"2024-04-22T07:18:38.894300+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:43:09.058016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:38.894236+0000","last_change":"2024-04-22T07:18:35.746686+0000","last_active":"2024-04-22T07:18:38.894236+0000","last_peered":"2024-04-22T07:18:38.894236+0000","last_clean":"2024-04-22T07:18:38.894236+0000","last_became_active":"2024-04-22T07:18:35.746371+0000","last_became_peered":"2024-04-22T07:18:35.746371+0000","last_unstale":"2024-04-22T07:18:38.894236+0000","last_undegraded":"2024-04-22T07:18:38.894236+0000","last_fullsized":"2024-04-22T07:18:38.894236+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:36:55.684427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.757383+0000","last_change":"2024-04-22T07:18:36.765985+0000","last_active":"2024-04-22T07:18:37.757383+0000","last_peered":"2024-04-22T07:18:37.757383+0000","last_clean":"2024-04-22T07:18:37.757383+0000","last_became_active":"2024-04-22T07:18:36.765661+0000","last_became_peered":"2024-04-22T07:18:36.765661+0000","last_unstale":"2024-04-22T07:18:37.757383+0000","last_undegraded":"2024-04-22T07:18:37.757383+0000","last_fullsized":"2024-04-22T07:18:37.757383+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:23:03.787574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.763585+0000","last_change":"2024-04-22T07:18:35.754160+0000","last_active":"2024-04-22T07:18:37.763585+0000","last_peered":"2024-04-22T07:18:37.763585+0000","last_clean":"2024-04-22T07:18:37.763585+0000","last_became_active":"2024-04-22T07:18:35.753860+0000","last_became_peered":"2024-04-22T07:18:35.753860+0000","last_unstale":"2024-04-22T07:18:37.763585+0000","last_undegraded":"2024-04-22T07:18:37.763585+0000","last_fullsized":"2024-04-22T07:18:37.763585+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:08:04.608018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.763400+0000","last_change":"2024-04-22T07:18:36.762349+0000","last_active":"2024-04-22T07:18:37.763400+0000","last_peered":"2024-04-22T07:18:37.763400+0000","last_clean":"2024-04-22T07:18:37.763400+0000","last_became_active":"2024-04-22T07:18:36.762097+0000","last_became_peered":"2024-04-22T07:18:36.762097+0000","last_unstale":"2024-04-22T07:18:37.763400+0000","last_undegraded":"2024-04-22T07:18:37.763400+0000","last_fullsized":"2024-04-22T07:18:37.763400+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:43:55.686523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.757304+0000","last_change":"2024-04-22T07:18:35.758810+0000","last_active":"2024-04-22T07:18:37.757304+0000","last_peered":"2024-04-22T07:18:37.757304+0000","last_clean":"2024-04-22T07:18:37.757304+0000","last_became_active":"2024-04-22T07:18:35.758521+0000","last_became_peered":"2024-04-22T07:18:35.758521+0000","last_unstale":"2024-04-22T07:18:37.757304+0000","last_undegraded":"2024-04-22T07:18:37.757304+0000","last_fullsized":"2024-04-22T07:18:37.757304+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:40:59.305769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.764371+0000","last_change":"2024-04-22T07:18:36.764448+0000","last_active":"2024-04-22T07:18:37.764371+0000","last_peered":"2024-04-22T07:18:37.764371+0000","last_clean":"2024-04-22T07:18:37.764371+0000","last_became_active":"2024-04-22T07:18:36.763728+0000","last_became_peered":"2024-04-22T07:18:36.763728+0000","last_unstale":"2024-04-22T07:18:37.764371+0000","last_undegraded":"2024-04-22T07:18:37.764371+0000","last_fullsized":"2024-04-22T07:18:37.764371+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:58:41.509248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.937270+0000","last_change":"2024-04-22T07:18:35.758980+0000","last_active":"2024-04-22T07:18:37.937270+0000","last_peered":"2024-04-22T07:18:37.937270+0000","last_clean":"2024-04-22T07:18:37.937270+0000","last_became_active":"2024-04-22T07:18:35.758674+0000","last_became_peered":"2024-04-22T07:18:35.758674+0000","last_unstale":"2024-04-22T07:18:37.937270+0000","last_undegraded":"2024-04-22T07:18:37.937270+0000","last_fullsized":"2024-04-22T07:18:37.937270+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:45:14.209818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.757443+0000","last_change":"2024-04-22T07:18:36.772908+0000","last_active":"2024-04-22T07:18:37.757443+0000","last_peered":"2024-04-22T07:18:37.757443+0000","last_clean":"2024-04-22T07:18:37.757443+0000","last_became_active":"2024-04-22T07:18:36.772636+0000","last_became_peered":"2024-04-22T07:18:36.772636+0000","last_unstale":"2024-04-22T07:18:37.757443+0000","last_undegraded":"2024-04-22T07:18:37.757443+0000","last_fullsized":"2024-04-22T07:18:37.757443+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:51:10.038201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.757474+0000","last_change":"2024-04-22T07:18:35.753595+0000","last_active":"2024-04-22T07:18:37.757474+0000","last_peered":"2024-04-22T07:18:37.757474+0000","last_clean":"2024-04-22T07:18:37.757474+0000","last_became_active":"2024-04-22T07:18:35.753295+0000","last_became_peered":"2024-04-22T07:18:35.753295+0000","last_unstale":"2024-04-22T07:18:37.757474+0000","last_undegraded":"2024-04-22T07:18:37.757474+0000","last_fullsized":"2024-04-22T07:18:37.757474+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:08:04.608018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.768028+0000","last_change":"2024-04-22T07:18:36.768580+0000","last_active":"2024-04-22T07:18:37.768028+0000","last_peered":"2024-04-22T07:18:37.768028+0000","last_clean":"2024-04-22T07:18:37.768028+0000","last_became_active":"2024-04-22T07:18:36.767702+0000","last_became_peered":"2024-04-22T07:18:36.767702+0000","last_unstale":"2024-04-22T07:18:37.768028+0000","last_undegraded":"2024-04-22T07:18:37.768028+0000","last_fullsized":"2024-04-22T07:18:37.768028+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:59:57.688417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:38.394128+0000","last_change":"2024-04-22T07:18:35.751692+0000","last_active":"2024-04-22T07:18:38.394128+0000","last_peered":"2024-04-22T07:18:38.394128+0000","last_clean":"2024-04-22T07:18:38.394128+0000","last_became_active":"2024-04-22T07:18:35.751393+0000","last_became_peered":"2024-04-22T07:18:35.751393+0000","last_unstale":"2024-04-22T07:18:38.394128+0000","last_undegraded":"2024-04-22T07:18:38.394128+0000","last_fullsized":"2024-04-22T07:18:38.394128+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:40:59.305769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:38.894956+0000","last_change":"2024-04-22T07:18:36.768532+0000","last_active":"2024-04-22T07:18:38.894956+0000","last_peered":"2024-04-22T07:18:38.894956+0000","last_clean":"2024-04-22T07:18:38.894956+0000","last_became_active":"2024-04-22T07:18:36.768253+0000","last_became_peered":"2024-04-22T07:18:36.768253+0000","last_unstale":"2024-04-22T07:18:38.894956+0000","last_undegraded":"2024-04-22T07:18:38.894956+0000","last_fullsized":"2024-04-22T07:18:38.894956+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:30:36.755201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.936651+0000","last_change":"2024-04-22T07:18:35.758702+0000","last_active":"2024-04-22T07:18:37.936651+0000","last_peered":"2024-04-22T07:18:37.936651+0000","last_clean":"2024-04-22T07:18:37.936651+0000","last_became_active":"2024-04-22T07:18:35.758415+0000","last_became_peered":"2024-04-22T07:18:35.758415+0000","last_unstale":"2024-04-22T07:18:37.936651+0000","last_undegraded":"2024-04-22T07:18:37.936651+0000","last_fullsized":"2024-04-22T07:18:37.936651+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:08:04.608018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.763191+0000","last_change":"2024-04-22T07:18:36.763053+0000","last_active":"2024-04-22T07:18:37.763191+0000","last_peered":"2024-04-22T07:18:37.763191+0000","last_clean":"2024-04-22T07:18:37.763191+0000","last_became_active":"2024-04-22T07:18:36.762546+0000","last_became_peered":"2024-04-22T07:18:36.762546+0000","last_unstale":"2024-04-22T07:18:37.763191+0000","last_undegraded":"2024-04-22T07:18:37.763191+0000","last_fullsized":"2024-04-22T07:18:37.763191+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:36:56.688277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.757534+0000","last_change":"2024-04-22T07:18:35.748837+0000","last_active":"2024-04-22T07:18:37.757534+0000","last_peered":"2024-04-22T07:18:37.757534+0000","last_clean":"2024-04-22T07:18:37.757534+0000","last_became_active":"2024-04-22T07:18:35.748080+0000","last_became_peered":"2024-04-22T07:18:35.748080+0000","last_unstale":"2024-04-22T07:18:37.757534+0000","last_undegraded":"2024-04-22T07:18:37.757534+0000","last_fullsized":"2024-04-22T07:18:37.757534+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:36:55.684427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.767568+0000","last_change":"2024-04-22T07:18:36.769911+0000","last_active":"2024-04-22T07:18:37.767568+0000","last_peered":"2024-04-22T07:18:37.767568+0000","last_clean":"2024-04-22T07:18:37.767568+0000","last_became_active":"2024-04-22T07:18:36.768682+0000","last_became_peered":"2024-04-22T07:18:36.768682+0000","last_unstale":"2024-04-22T07:18:37.767568+0000","last_undegraded":"2024-04-22T07:18:37.767568+0000","last_fullsized":"2024-04-22T07:18:37.767568+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:30:36.755201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.757319+0000","last_change":"2024-04-22T07:18:35.753066+0000","last_active":"2024-04-22T07:18:37.757319+0000","last_peered":"2024-04-22T07:18:37.757319+0000","last_clean":"2024-04-22T07:18:37.757319+0000","last_became_active":"2024-04-22T07:18:35.752804+0000","last_became_peered":"2024-04-22T07:18:35.752804+0000","last_unstale":"2024-04-22T07:18:37.757319+0000","last_undegraded":"2024-04-22T07:18:37.757319+0000","last_fullsized":"2024-04-22T07:18:37.757319+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:43:54.682673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.767652+0000","last_change":"2024-04-22T07:18:36.774790+0000","last_active":"2024-04-22T07:18:37.767652+0000","last_peered":"2024-04-22T07:18:37.767652+0000","last_clean":"2024-04-22T07:18:37.767652+0000","last_became_active":"2024-04-22T07:18:36.774479+0000","last_became_peered":"2024-04-22T07:18:36.774479+0000","last_unstale":"2024-04-22T07:18:37.767652+0000","last_undegraded":"2024-04-22T07:18:37.767652+0000","last_fullsized":"2024-04-22T07:18:37.767652+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:36:53.716397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.937094+0000","last_change":"2024-04-22T07:18:35.754440+0000","last_active":"2024-04-22T07:18:37.937094+0000","last_peered":"2024-04-22T07:18:37.937094+0000","last_clean":"2024-04-22T07:18:37.937094+0000","last_became_active":"2024-04-22T07:18:35.754137+0000","last_became_peered":"2024-04-22T07:18:35.754137+0000","last_unstale":"2024-04-22T07:18:37.937094+0000","last_undegraded":"2024-04-22T07:18:37.937094+0000","last_fullsized":"2024-04-22T07:18:37.937094+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T19:09:20.529889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:38.393947+0000","last_change":"2024-04-22T07:18:36.759585+0000","last_active":"2024-04-22T07:18:38.393947+0000","last_peered":"2024-04-22T07:18:38.393947+0000","last_clean":"2024-04-22T07:18:38.393947+0000","last_became_active":"2024-04-22T07:18:36.759342+0000","last_became_peered":"2024-04-22T07:18:36.759342+0000","last_unstale":"2024-04-22T07:18:38.393947+0000","last_undegraded":"2024-04-22T07:18:38.393947+0000","last_fullsized":"2024-04-22T07:18:38.393947+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:44:30.785178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.764337+0000","last_change":"2024-04-22T07:18:36.762665+0000","last_active":"2024-04-22T07:18:37.764337+0000","last_peered":"2024-04-22T07:18:37.764337+0000","last_clean":"2024-04-22T07:18:37.764337+0000","last_became_active":"2024-04-22T07:18:36.762392+0000","last_became_peered":"2024-04-22T07:18:36.762392+0000","last_unstale":"2024-04-22T07:18:37.764337+0000","last_undegraded":"2024-04-22T07:18:37.764337+0000","last_fullsized":"2024-04-22T07:18:37.764337+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:36:27.097452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.936925+0000","last_change":"2024-04-22T07:18:35.755160+0000","last_active":"2024-04-22T07:18:37.936925+0000","last_peered":"2024-04-22T07:18:37.936925+0000","last_clean":"2024-04-22T07:18:37.936925+0000","last_became_active":"2024-04-22T07:18:35.754877+0000","last_became_peered":"2024-04-22T07:18:35.754877+0000","last_unstale":"2024-04-22T07:18:37.936925+0000","last_undegraded":"2024-04-22T07:18:37.936925+0000","last_fullsized":"2024-04-22T07:18:37.936925+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:43:54.682673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.764098+0000","last_change":"2024-04-22T07:18:36.761534+0000","last_active":"2024-04-22T07:18:37.764098+0000","last_peered":"2024-04-22T07:18:37.764098+0000","last_clean":"2024-04-22T07:18:37.764098+0000","last_became_active":"2024-04-22T07:18:36.761181+0000","last_became_peered":"2024-04-22T07:18:36.761181+0000","last_unstale":"2024-04-22T07:18:37.764098+0000","last_undegraded":"2024-04-22T07:18:37.764098+0000","last_fullsized":"2024-04-22T07:18:37.764098+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:03:50.228822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.937140+0000","last_change":"2024-04-22T07:18:35.752282+0000","last_active":"2024-04-22T07:18:37.937140+0000","last_peered":"2024-04-22T07:18:37.937140+0000","last_clean":"2024-04-22T07:18:37.937140+0000","last_became_active":"2024-04-22T07:18:35.751866+0000","last_became_peered":"2024-04-22T07:18:35.751866+0000","last_unstale":"2024-04-22T07:18:37.937140+0000","last_undegraded":"2024-04-22T07:18:37.937140+0000","last_fullsized":"2024-04-22T07:18:37.937140+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:19:48.648793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:38.894862+0000","last_change":"2024-04-22T07:18:36.763229+0000","last_active":"2024-04-22T07:18:38.894862+0000","last_peered":"2024-04-22T07:18:38.894862+0000","last_clean":"2024-04-22T07:18:38.894862+0000","last_became_active":"2024-04-22T07:18:36.762882+0000","last_became_peered":"2024-04-22T07:18:36.762882+0000","last_unstale":"2024-04-22T07:18:38.894862+0000","last_undegraded":"2024-04-22T07:18:38.894862+0000","last_fullsized":"2024-04-22T07:18:38.894862+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:44:30.785178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.767964+0000","last_change":"2024-04-22T07:18:35.758820+0000","last_active":"2024-04-22T07:18:37.767964+0000","last_peered":"2024-04-22T07:18:37.767964+0000","last_clean":"2024-04-22T07:18:37.767964+0000","last_became_active":"2024-04-22T07:18:35.758514+0000","last_became_peered":"2024-04-22T07:18:35.758514+0000","last_unstale":"2024-04-22T07:18:37.767964+0000","last_undegraded":"2024-04-22T07:18:37.767964+0000","last_fullsized":"2024-04-22T07:18:37.767964+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:40:59.305769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.767960+0000","last_change":"2024-04-22T07:18:36.768383+0000","last_active":"2024-04-22T07:18:37.767960+0000","last_peered":"2024-04-22T07:18:37.767960+0000","last_clean":"2024-04-22T07:18:37.767960+0000","last_became_active":"2024-04-22T07:18:36.767779+0000","last_became_peered":"2024-04-22T07:18:36.767779+0000","last_unstale":"2024-04-22T07:18:37.767960+0000","last_undegraded":"2024-04-22T07:18:37.767960+0000","last_fullsized":"2024-04-22T07:18:37.767960+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:18:59.298766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:38.895004+0000","last_change":"2024-04-22T07:18:35.754117+0000","last_active":"2024-04-22T07:18:38.895004+0000","last_peered":"2024-04-22T07:18:38.895004+0000","last_clean":"2024-04-22T07:18:38.895004+0000","last_became_active":"2024-04-22T07:18:35.753833+0000","last_became_peered":"2024-04-22T07:18:35.753833+0000","last_unstale":"2024-04-22T07:18:38.895004+0000","last_undegraded":"2024-04-22T07:18:38.895004+0000","last_fullsized":"2024-04-22T07:18:38.895004+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:54:03.123665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27800,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344040,"statfs":{"total":96636764160,"available":96608296960,"internally_reserved":0,"allocated":798720,"data_stored":661302,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":204800,"data_stored":70934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":204800,"data_stored":70934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":204800,"data_stored":70934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":204800,"data_stored":70934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27208,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":192512,"data_stored":64634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":204800,"data_stored":70934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27804,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344036,"statfs":{"total":96636764160,"available":96608292864,"internally_reserved":0,"allocated":798720,"data_stored":661302,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-22T07:18:41.788 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-22T07:18:41.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.926+0000 7fa763d04640 1 Processor -- start 2024-04-22T07:18:41.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.926+0000 7fa763d04640 1 -- start start 2024-04-22T07:18:41.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.927+0000 7fa763d04640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa75c0ccd10 0x7fa75c0cd150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:41.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.927+0000 7fa763d04640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa75c15f280 con 0x7fa75c1552f0 2024-04-22T07:18:41.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.927+0000 7fa763d04640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa75c0cda00 con 0x7fa75c0b38f0 2024-04-22T07:18:41.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.927+0000 7fa763d04640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fa75c0b3100 con 0x7fa75c0ccd10 2024-04-22T07:18:41.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.927+0000 7fa7622a1640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa75c0ccd10 0x7fa75c0cd150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:41.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.927+0000 7fa761aa0640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fa75c1552f0 0x7fa75c0cb430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:56482/0 (socket says 172.21.15.37:56482) 2024-04-22T07:18:41.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.927+0000 7fa7622a1640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa75c0ccd10 0x7fa75c0cd150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54472/0 (socket says 172.21.15.37:54472) 2024-04-22T07:18:41.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.927+0000 7fa761aa0640 1 -- 172.21.15.37:0/2465538146 learned_addr learned my addr 172.21.15.37:0/2465538146 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-04-22T07:18:41.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.927+0000 7fa7622a1640 1 -- 172.21.15.37:0/2465538146 >> v1:172.21.15.196:6789/0 conn(0x7fa75c0b38f0 legacy=0x7fa75c15aeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:18:41.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.927+0000 7fa7622a1640 1 -- 172.21.15.37:0/2465538146 >> v1:172.21.15.37:6789/0 conn(0x7fa75c1552f0 legacy=0x7fa75c0cb430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:41.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.927+0000 7fa7622a1640 1 -- 172.21.15.37:0/2465538146 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa75c0b3350 con 0x7fa75c0ccd10 2024-04-22T07:18:41.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.927+0000 7fa760a9e640 1 -- 172.21.15.37:0/2465538146 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1277279110 0 0) 0x7fa75c15f280 con 0x7fa75c1552f0 2024-04-22T07:18:41.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.928+0000 7fa7622a1640 1 --2- 172.21.15.37:0/2465538146 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa75c0ccd10 0x7fa75c0cd150 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fa754009d90 tx=0x7fa75402beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90b387d1b267d707 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:41.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.928+0000 7fa760a9e640 1 -- 172.21.15.37:0/2465538146 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa754039070 con 0x7fa75c0ccd10 2024-04-22T07:18:41.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.928+0000 7fa760a9e640 1 -- 172.21.15.37:0/2465538146 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa75402cc60 con 0x7fa75c0ccd10 2024-04-22T07:18:41.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.928+0000 7fa760a9e640 1 -- 172.21.15.37:0/2465538146 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa754034660 con 0x7fa75c0ccd10 2024-04-22T07:18:41.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.929+0000 7fa763d04640 1 -- 172.21.15.37:0/2465538146 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa75c0ccd10 msgr2=0x7fa75c0cd150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:41.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.929+0000 7fa763d04640 1 --2- 172.21.15.37:0/2465538146 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa75c0ccd10 0x7fa75c0cd150 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fa754009d90 tx=0x7fa75402beb0 comp rx=0 tx=0).stop 2024-04-22T07:18:41.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.929+0000 7fa763d04640 1 -- 172.21.15.37:0/2465538146 shutdown_connections 2024-04-22T07:18:41.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.929+0000 7fa763d04640 1 --2- 172.21.15.37:0/2465538146 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa75c0ccd10 0x7fa75c0cd150 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:41.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.929+0000 7fa763d04640 1 -- 172.21.15.37:0/2465538146 >> 172.21.15.37:0/2465538146 conn(0x7fa75c071f90 msgr2=0x7fa75c0723a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:41.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.929+0000 7fa763d04640 1 -- 172.21.15.37:0/2465538146 shutdown_connections 2024-04-22T07:18:41.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.929+0000 7fa763d04640 1 -- 172.21.15.37:0/2465538146 wait complete. 2024-04-22T07:18:41.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.930+0000 7fa763d04640 1 Processor -- start 2024-04-22T07:18:41.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.930+0000 7fa763d04640 1 -- start start 2024-04-22T07:18:41.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.931+0000 7fa763d04640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa75c0b38f0 0x7fa75c0c5f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:41.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.931+0000 7fa763d04640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa75c0ccd10 0x7fa75c0c48d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:41.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.931+0000 7fa763d04640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa75c1552f0 0x7fa75c15c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:41.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.931+0000 7fa763d04640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa75c15e7a0 con 0x7fa75c0b38f0 2024-04-22T07:18:41.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.931+0000 7fa763d04640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fa75c15e4c0 con 0x7fa75c0ccd10 2024-04-22T07:18:41.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.931+0000 7fa763d04640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fa75c15ea80 con 0x7fa75c1552f0 2024-04-22T07:18:41.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.931+0000 7fa761aa0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa75c0b38f0 0x7fa75c0c5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:41.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.931+0000 7fa761aa0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa75c0b38f0 0x7fa75c0c5f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54480/0 (socket says 172.21.15.37:54480) 2024-04-22T07:18:41.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.931+0000 7fa761aa0640 1 -- 172.21.15.37:0/4135321015 learned_addr learned my addr 172.21.15.37:0/4135321015 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:18:41.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.931+0000 7fa761aa0640 1 -- 172.21.15.37:0/4135321015 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa75c1552f0 msgr2=0x7fa75c15c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:41.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.931+0000 7fa7622a1640 1 --2- 172.21.15.37:0/4135321015 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa75c1552f0 0x7fa75c15c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:41.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.931+0000 7fa761aa0640 1 --2- 172.21.15.37:0/4135321015 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa75c1552f0 0x7fa75c15c6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:41.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.931+0000 7fa761aa0640 1 -- 172.21.15.37:0/4135321015 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa75c0ccd10 msgr2=0x7fa75c0c48d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:41.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.931+0000 7fa76129f640 1 --2- 172.21.15.37:0/4135321015 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa75c0ccd10 0x7fa75c0c48d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:41.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.931+0000 7fa761aa0640 1 --2- 172.21.15.37:0/4135321015 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa75c0ccd10 0x7fa75c0c48d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:41.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.931+0000 7fa761aa0640 1 -- 172.21.15.37:0/4135321015 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa75c14fc20 con 0x7fa75c0b38f0 2024-04-22T07:18:41.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.931+0000 7fa761aa0640 1 --2- 172.21.15.37:0/4135321015 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa75c0b38f0 0x7fa75c0c5f80 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fa75800c430 tx=0x7fa75800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:41.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.931+0000 7fa7527fc640 1 -- 172.21.15.37:0/4135321015 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7580074e0 con 0x7fa75c0b38f0 2024-04-22T07:18:41.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.931+0000 7fa7527fc640 1 -- 172.21.15.37:0/4135321015 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7580047e0 con 0x7fa75c0b38f0 2024-04-22T07:18:41.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.931+0000 7fa763d04640 1 -- 172.21.15.37:0/4135321015 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa75c14fee0 con 0x7fa75c0b38f0 2024-04-22T07:18:41.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.931+0000 7fa7527fc640 1 -- 172.21.15.37:0/4135321015 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa758004bd0 con 0x7fa75c0b38f0 2024-04-22T07:18:41.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.931+0000 7fa763d04640 1 -- 172.21.15.37:0/4135321015 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa75c1504a0 con 0x7fa75c0b38f0 2024-04-22T07:18:41.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.933+0000 7fa763d04640 1 -- 172.21.15.37:0/4135321015 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa75c069cc0 con 0x7fa75c0b38f0 2024-04-22T07:18:41.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.933+0000 7fa7527fc640 1 -- 172.21.15.37:0/4135321015 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa758011070 con 0x7fa75c0b38f0 2024-04-22T07:18:41.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.934+0000 7fa7527fc640 1 --2- 172.21.15.37:0/4135321015 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fa74006c8f0 0x7fa74006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:41.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.934+0000 7fa7527fc640 1 -- 172.21.15.37:0/4135321015 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fa75808b770 con 0x7fa75c0b38f0 2024-04-22T07:18:41.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.934+0000 7fa76129f640 1 --2- 172.21.15.37:0/4135321015 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fa74006c8f0 0x7fa74006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:41.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.934+0000 7fa76129f640 1 --2- 172.21.15.37:0/4135321015 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fa74006c8f0 0x7fa74006edb0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fa75c0b3070 tx=0x7fa74c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:41.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:41.938+0000 7fa7527fc640 1 -- 172.21.15.37:0/4135321015 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fa75800e280 con 0x7fa75c0b38f0 2024-04-22T07:18:42.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.120+0000 7fa763d04640 1 -- 172.21.15.37:0/4135321015 --> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa75c15c520 con 0x7fa74006c8f0 2024-04-22T07:18:42.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.127+0000 7fa7527fc640 1 -- 172.21.15.37:0/4135321015 <== mgr.4103 v2:172.21.15.196:6832/321987173 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251849 (secure 0 0 0) 0x7fa74c0567e0 con 0x7fa74006c8f0 2024-04-22T07:18:42.127 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-22T07:18:42.128 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-04-22T07:18:42.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.130+0000 7fa763d04640 1 -- 172.21.15.37:0/4135321015 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fa74006c8f0 msgr2=0x7fa74006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:42.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.130+0000 7fa763d04640 1 --2- 172.21.15.37:0/4135321015 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fa74006c8f0 0x7fa74006edb0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fa75c0b3070 tx=0x7fa74c009040 comp rx=0 tx=0).stop 2024-04-22T07:18:42.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.130+0000 7fa763d04640 1 -- 172.21.15.37:0/4135321015 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa75c0b38f0 msgr2=0x7fa75c0c5f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:42.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.130+0000 7fa763d04640 1 --2- 172.21.15.37:0/4135321015 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa75c0b38f0 0x7fa75c0c5f80 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fa75800c430 tx=0x7fa75800c8f0 comp rx=0 tx=0).stop 2024-04-22T07:18:42.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.130+0000 7fa763d04640 1 -- 172.21.15.37:0/4135321015 shutdown_connections 2024-04-22T07:18:42.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.130+0000 7fa763d04640 1 --2- 172.21.15.37:0/4135321015 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fa74006c8f0 0x7fa74006edb0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:42.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.130+0000 7fa763d04640 1 --2- 172.21.15.37:0/4135321015 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa75c1552f0 0x7fa75c15c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:42.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.130+0000 7fa763d04640 1 --2- 172.21.15.37:0/4135321015 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa75c0ccd10 0x7fa75c0c48d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:42.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.130+0000 7fa763d04640 1 --2- 172.21.15.37:0/4135321015 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa75c0b38f0 0x7fa75c0c5f80 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:42.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.130+0000 7fa763d04640 1 -- 172.21.15.37:0/4135321015 >> 172.21.15.37:0/4135321015 conn(0x7fa75c071f90 msgr2=0x7fa75c151f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:42.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.130+0000 7fa763d04640 1 -- 172.21.15.37:0/4135321015 shutdown_connections 2024-04-22T07:18:42.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.130+0000 7fa763d04640 1 -- 172.21.15.37:0/4135321015 wait complete. 2024-04-22T07:18:42.138 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-04-22T07:18:40.586362+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":169,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218932,"kb_used_data":2748,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755788,"statfs":{"total":773094113280,"available":772869926912,"internally_reserved":0,"allocated":2813952,"data_stored":1741908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.856712"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.937242+0000","last_change":"2024-04-22T07:18:36.765825+0000","last_active":"2024-04-22T07:18:37.937242+0000","last_peered":"2024-04-22T07:18:37.937242+0000","last_clean":"2024-04-22T07:18:37.937242+0000","last_became_active":"2024-04-22T07:18:36.765306+0000","last_became_peered":"2024-04-22T07:18:36.765306+0000","last_unstale":"2024-04-22T07:18:37.937242+0000","last_undegraded":"2024-04-22T07:18:37.937242+0000","last_fullsized":"2024-04-22T07:18:37.937242+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:00:45.046782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.757437+0000","last_change":"2024-04-22T07:18:36.772829+0000","last_active":"2024-04-22T07:18:37.757437+0000","last_peered":"2024-04-22T07:18:37.757437+0000","last_clean":"2024-04-22T07:18:37.757437+0000","last_became_active":"2024-04-22T07:18:36.772464+0000","last_became_peered":"2024-04-22T07:18:36.772464+0000","last_unstale":"2024-04-22T07:18:37.757437+0000","last_undegraded":"2024-04-22T07:18:37.757437+0000","last_fullsized":"2024-04-22T07:18:37.757437+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:09:08.040513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:38.894883+0000","last_change":"2024-04-22T07:18:36.760613+0000","last_active":"2024-04-22T07:18:38.894883+0000","last_peered":"2024-04-22T07:18:38.894883+0000","last_clean":"2024-04-22T07:18:38.894883+0000","last_became_active":"2024-04-22T07:18:36.760313+0000","last_became_peered":"2024-04-22T07:18:36.760313+0000","last_unstale":"2024-04-22T07:18:38.894883+0000","last_undegraded":"2024-04-22T07:18:38.894883+0000","last_fullsized":"2024-04-22T07:18:38.894883+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:51:10.038201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.763484+0000","last_change":"2024-04-22T07:18:36.767969+0000","last_active":"2024-04-22T07:18:37.763484+0000","last_peered":"2024-04-22T07:18:37.763484+0000","last_clean":"2024-04-22T07:18:37.763484+0000","last_became_active":"2024-04-22T07:18:36.767713+0000","last_became_peered":"2024-04-22T07:18:36.767713+0000","last_unstale":"2024-04-22T07:18:37.763484+0000","last_undegraded":"2024-04-22T07:18:37.763484+0000","last_fullsized":"2024-04-22T07:18:37.763484+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:36:53.716397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.936961+0000","last_change":"2024-04-22T07:18:36.764361+0000","last_active":"2024-04-22T07:18:37.936961+0000","last_peered":"2024-04-22T07:18:37.936961+0000","last_clean":"2024-04-22T07:18:37.936961+0000","last_became_active":"2024-04-22T07:18:36.763812+0000","last_became_peered":"2024-04-22T07:18:36.763812+0000","last_unstale":"2024-04-22T07:18:37.936961+0000","last_undegraded":"2024-04-22T07:18:37.936961+0000","last_fullsized":"2024-04-22T07:18:37.936961+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:18:59.298766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.763087+0000","last_change":"2024-04-22T07:18:36.762804+0000","last_active":"2024-04-22T07:18:37.763087+0000","last_peered":"2024-04-22T07:18:37.763087+0000","last_clean":"2024-04-22T07:18:37.763087+0000","last_became_active":"2024-04-22T07:18:36.762508+0000","last_became_peered":"2024-04-22T07:18:36.762508+0000","last_unstale":"2024-04-22T07:18:37.763087+0000","last_undegraded":"2024-04-22T07:18:37.763087+0000","last_fullsized":"2024-04-22T07:18:37.763087+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:09:08.040513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.936807+0000","last_change":"2024-04-22T07:18:36.771774+0000","last_active":"2024-04-22T07:18:37.936807+0000","last_peered":"2024-04-22T07:18:37.936807+0000","last_clean":"2024-04-22T07:18:37.936807+0000","last_became_active":"2024-04-22T07:18:36.771425+0000","last_became_peered":"2024-04-22T07:18:36.771425+0000","last_unstale":"2024-04-22T07:18:37.936807+0000","last_undegraded":"2024-04-22T07:18:37.936807+0000","last_fullsized":"2024-04-22T07:18:37.936807+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:45:27.464772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.767379+0000","last_change":"2024-04-22T07:18:36.773631+0000","last_active":"2024-04-22T07:18:37.767379+0000","last_peered":"2024-04-22T07:18:37.767379+0000","last_clean":"2024-04-22T07:18:37.767379+0000","last_became_active":"2024-04-22T07:18:36.773347+0000","last_became_peered":"2024-04-22T07:18:36.773347+0000","last_unstale":"2024-04-22T07:18:37.767379+0000","last_undegraded":"2024-04-22T07:18:37.767379+0000","last_fullsized":"2024-04-22T07:18:37.767379+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:23:03.787574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.937320+0000","last_change":"2024-04-22T07:18:36.773325+0000","last_active":"2024-04-22T07:18:37.937320+0000","last_peered":"2024-04-22T07:18:37.937320+0000","last_clean":"2024-04-22T07:18:37.937320+0000","last_became_active":"2024-04-22T07:18:36.773023+0000","last_became_peered":"2024-04-22T07:18:36.773023+0000","last_unstale":"2024-04-22T07:18:37.937320+0000","last_undegraded":"2024-04-22T07:18:37.937320+0000","last_fullsized":"2024-04-22T07:18:37.937320+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:11:55.496104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:38.394196+0000","last_change":"2024-04-22T07:18:36.769834+0000","last_active":"2024-04-22T07:18:38.394196+0000","last_peered":"2024-04-22T07:18:38.394196+0000","last_clean":"2024-04-22T07:18:38.394196+0000","last_became_active":"2024-04-22T07:18:36.769544+0000","last_became_peered":"2024-04-22T07:18:36.769544+0000","last_unstale":"2024-04-22T07:18:38.394196+0000","last_undegraded":"2024-04-22T07:18:38.394196+0000","last_fullsized":"2024-04-22T07:18:38.394196+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:30:36.755201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:38.394021+0000","last_change":"2024-04-22T07:18:36.762325+0000","last_active":"2024-04-22T07:18:38.394021+0000","last_peered":"2024-04-22T07:18:38.394021+0000","last_clean":"2024-04-22T07:18:38.394021+0000","last_became_active":"2024-04-22T07:18:36.762059+0000","last_became_peered":"2024-04-22T07:18:36.762059+0000","last_unstale":"2024-04-22T07:18:38.394021+0000","last_undegraded":"2024-04-22T07:18:38.394021+0000","last_fullsized":"2024-04-22T07:18:38.394021+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:51:10.038201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.763612+0000","last_change":"2024-04-22T07:18:36.761961+0000","last_active":"2024-04-22T07:18:37.763612+0000","last_peered":"2024-04-22T07:18:37.763612+0000","last_clean":"2024-04-22T07:18:37.763612+0000","last_became_active":"2024-04-22T07:18:36.761389+0000","last_became_peered":"2024-04-22T07:18:36.761389+0000","last_unstale":"2024-04-22T07:18:37.763612+0000","last_undegraded":"2024-04-22T07:18:37.763612+0000","last_fullsized":"2024-04-22T07:18:37.763612+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T19:09:21.533739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.767566+0000","last_change":"2024-04-22T07:18:36.767665+0000","last_active":"2024-04-22T07:18:37.767566+0000","last_peered":"2024-04-22T07:18:37.767566+0000","last_clean":"2024-04-22T07:18:37.767566+0000","last_became_active":"2024-04-22T07:18:36.767386+0000","last_became_peered":"2024-04-22T07:18:36.767386+0000","last_unstale":"2024-04-22T07:18:37.767566+0000","last_undegraded":"2024-04-22T07:18:37.767566+0000","last_fullsized":"2024-04-22T07:18:37.767566+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:09:08.040513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:38.894526+0000","last_change":"2024-04-22T07:18:36.770591+0000","last_active":"2024-04-22T07:18:38.894526+0000","last_peered":"2024-04-22T07:18:38.894526+0000","last_clean":"2024-04-22T07:18:38.894526+0000","last_became_active":"2024-04-22T07:18:36.768507+0000","last_became_peered":"2024-04-22T07:18:36.768507+0000","last_unstale":"2024-04-22T07:18:38.894526+0000","last_undegraded":"2024-04-22T07:18:38.894526+0000","last_fullsized":"2024-04-22T07:18:38.894526+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:00:52.151755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.757456+0000","last_change":"2024-04-22T07:18:36.769407+0000","last_active":"2024-04-22T07:18:37.757456+0000","last_peered":"2024-04-22T07:18:37.757456+0000","last_clean":"2024-04-22T07:18:37.757456+0000","last_became_active":"2024-04-22T07:18:36.769114+0000","last_became_peered":"2024-04-22T07:18:36.769114+0000","last_unstale":"2024-04-22T07:18:37.757456+0000","last_undegraded":"2024-04-22T07:18:37.757456+0000","last_fullsized":"2024-04-22T07:18:37.757456+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:30:36.755201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.763835+0000","last_change":"2024-04-22T07:18:36.766539+0000","last_active":"2024-04-22T07:18:37.763835+0000","last_peered":"2024-04-22T07:18:37.763835+0000","last_clean":"2024-04-22T07:18:37.763835+0000","last_became_active":"2024-04-22T07:18:36.764865+0000","last_became_peered":"2024-04-22T07:18:36.764865+0000","last_unstale":"2024-04-22T07:18:37.763835+0000","last_undegraded":"2024-04-22T07:18:37.763835+0000","last_fullsized":"2024-04-22T07:18:37.763835+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:45:27.464772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.764360+0000","last_change":"2024-04-22T07:18:36.767174+0000","last_active":"2024-04-22T07:18:37.764360+0000","last_peered":"2024-04-22T07:18:37.764360+0000","last_clean":"2024-04-22T07:18:37.764360+0000","last_became_active":"2024-04-22T07:18:36.766083+0000","last_became_peered":"2024-04-22T07:18:36.766083+0000","last_unstale":"2024-04-22T07:18:37.764360+0000","last_undegraded":"2024-04-22T07:18:37.764360+0000","last_fullsized":"2024-04-22T07:18:37.764360+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:00:45.046782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:38.894453+0000","last_change":"2024-04-22T07:18:36.764432+0000","last_active":"2024-04-22T07:18:38.894453+0000","last_peered":"2024-04-22T07:18:38.894453+0000","last_clean":"2024-04-22T07:18:38.894453+0000","last_became_active":"2024-04-22T07:18:36.764113+0000","last_became_peered":"2024-04-22T07:18:36.764113+0000","last_unstale":"2024-04-22T07:18:38.894453+0000","last_undegraded":"2024-04-22T07:18:38.894453+0000","last_fullsized":"2024-04-22T07:18:38.894453+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:32:48.474033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.937223+0000","last_change":"2024-04-22T07:18:36.772138+0000","last_active":"2024-04-22T07:18:37.937223+0000","last_peered":"2024-04-22T07:18:37.937223+0000","last_clean":"2024-04-22T07:18:37.937223+0000","last_became_active":"2024-04-22T07:18:36.771878+0000","last_became_peered":"2024-04-22T07:18:36.771878+0000","last_unstale":"2024-04-22T07:18:37.937223+0000","last_undegraded":"2024-04-22T07:18:37.937223+0000","last_fullsized":"2024-04-22T07:18:37.937223+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:36:27.097452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:38.394042+0000","last_change":"2024-04-22T07:18:36.769528+0000","last_active":"2024-04-22T07:18:38.394042+0000","last_peered":"2024-04-22T07:18:38.394042+0000","last_clean":"2024-04-22T07:18:38.394042+0000","last_became_active":"2024-04-22T07:18:36.769240+0000","last_became_peered":"2024-04-22T07:18:36.769240+0000","last_unstale":"2024-04-22T07:18:38.394042+0000","last_undegraded":"2024-04-22T07:18:38.394042+0000","last_fullsized":"2024-04-22T07:18:38.394042+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:09:08.040513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:38.894747+0000","last_change":"2024-04-22T07:18:36.766049+0000","last_active":"2024-04-22T07:18:38.894747+0000","last_peered":"2024-04-22T07:18:38.894747+0000","last_clean":"2024-04-22T07:18:38.894747+0000","last_became_active":"2024-04-22T07:18:36.765724+0000","last_became_peered":"2024-04-22T07:18:36.765724+0000","last_unstale":"2024-04-22T07:18:38.894747+0000","last_undegraded":"2024-04-22T07:18:38.894747+0000","last_fullsized":"2024-04-22T07:18:38.894747+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:32:20.374856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.763238+0000","last_change":"2024-04-22T07:18:36.765850+0000","last_active":"2024-04-22T07:18:37.763238+0000","last_peered":"2024-04-22T07:18:37.763238+0000","last_clean":"2024-04-22T07:18:37.763238+0000","last_became_active":"2024-04-22T07:18:36.765560+0000","last_became_peered":"2024-04-22T07:18:36.765560+0000","last_unstale":"2024-04-22T07:18:37.763238+0000","last_undegraded":"2024-04-22T07:18:37.763238+0000","last_fullsized":"2024-04-22T07:18:37.763238+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:30:36.755201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.767520+0000","last_change":"2024-04-22T07:18:36.769465+0000","last_active":"2024-04-22T07:18:37.767520+0000","last_peered":"2024-04-22T07:18:37.767520+0000","last_clean":"2024-04-22T07:18:37.767520+0000","last_became_active":"2024-04-22T07:18:36.769181+0000","last_became_peered":"2024-04-22T07:18:36.769181+0000","last_unstale":"2024-04-22T07:18:37.767520+0000","last_undegraded":"2024-04-22T07:18:37.767520+0000","last_fullsized":"2024-04-22T07:18:37.767520+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:51:10.038201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.764013+0000","last_change":"2024-04-22T07:18:36.763439+0000","last_active":"2024-04-22T07:18:37.764013+0000","last_peered":"2024-04-22T07:18:37.764013+0000","last_clean":"2024-04-22T07:18:37.764013+0000","last_became_active":"2024-04-22T07:18:36.763146+0000","last_became_peered":"2024-04-22T07:18:36.763146+0000","last_unstale":"2024-04-22T07:18:37.764013+0000","last_undegraded":"2024-04-22T07:18:37.764013+0000","last_fullsized":"2024-04-22T07:18:37.764013+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:18:59.298766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.768027+0000","last_change":"2024-04-22T07:18:36.769533+0000","last_active":"2024-04-22T07:18:37.768027+0000","last_peered":"2024-04-22T07:18:37.768027+0000","last_clean":"2024-04-22T07:18:37.768027+0000","last_became_active":"2024-04-22T07:18:36.769274+0000","last_became_peered":"2024-04-22T07:18:36.769274+0000","last_unstale":"2024-04-22T07:18:37.768027+0000","last_undegraded":"2024-04-22T07:18:37.768027+0000","last_fullsized":"2024-04-22T07:18:37.768027+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:03:50.228822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:38.394207+0000","last_change":"2024-04-22T07:18:36.763931+0000","last_active":"2024-04-22T07:18:38.394207+0000","last_peered":"2024-04-22T07:18:38.394207+0000","last_clean":"2024-04-22T07:18:38.394207+0000","last_became_active":"2024-04-22T07:18:36.763656+0000","last_became_peered":"2024-04-22T07:18:36.763656+0000","last_unstale":"2024-04-22T07:18:38.394207+0000","last_undegraded":"2024-04-22T07:18:38.394207+0000","last_fullsized":"2024-04-22T07:18:38.394207+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:22:58.884168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.757432+0000","last_change":"2024-04-22T07:18:36.767158+0000","last_active":"2024-04-22T07:18:37.757432+0000","last_peered":"2024-04-22T07:18:37.757432+0000","last_clean":"2024-04-22T07:18:37.757432+0000","last_became_active":"2024-04-22T07:18:36.766614+0000","last_became_peered":"2024-04-22T07:18:36.766614+0000","last_unstale":"2024-04-22T07:18:37.757432+0000","last_undegraded":"2024-04-22T07:18:37.757432+0000","last_fullsized":"2024-04-22T07:18:37.757432+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:44:30.785178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.767721+0000","last_change":"2024-04-22T07:18:36.773129+0000","last_active":"2024-04-22T07:18:37.767721+0000","last_peered":"2024-04-22T07:18:37.767721+0000","last_clean":"2024-04-22T07:18:37.767721+0000","last_became_active":"2024-04-22T07:18:36.772827+0000","last_became_peered":"2024-04-22T07:18:36.772827+0000","last_unstale":"2024-04-22T07:18:37.767721+0000","last_undegraded":"2024-04-22T07:18:37.767721+0000","last_fullsized":"2024-04-22T07:18:37.767721+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:45:27.464772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:38.894815+0000","last_change":"2024-04-22T07:18:36.763716+0000","last_active":"2024-04-22T07:18:38.894815+0000","last_peered":"2024-04-22T07:18:38.894815+0000","last_clean":"2024-04-22T07:18:38.894815+0000","last_became_active":"2024-04-22T07:18:36.762270+0000","last_became_peered":"2024-04-22T07:18:36.762270+0000","last_unstale":"2024-04-22T07:18:38.894815+0000","last_undegraded":"2024-04-22T07:18:38.894815+0000","last_fullsized":"2024-04-22T07:18:38.894815+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:23:03.787574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.763390+0000","last_change":"2024-04-22T07:18:36.764152+0000","last_active":"2024-04-22T07:18:37.763390+0000","last_peered":"2024-04-22T07:18:37.763390+0000","last_clean":"2024-04-22T07:18:37.763390+0000","last_became_active":"2024-04-22T07:18:36.763770+0000","last_became_peered":"2024-04-22T07:18:36.763770+0000","last_unstale":"2024-04-22T07:18:37.763390+0000","last_undegraded":"2024-04-22T07:18:37.763390+0000","last_fullsized":"2024-04-22T07:18:37.763390+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:22:58.884168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:38.894313+0000","last_change":"2024-04-22T07:18:36.771121+0000","last_active":"2024-04-22T07:18:38.894313+0000","last_peered":"2024-04-22T07:18:38.894313+0000","last_clean":"2024-04-22T07:18:38.894313+0000","last_became_active":"2024-04-22T07:18:36.770786+0000","last_became_peered":"2024-04-22T07:18:36.770786+0000","last_unstale":"2024-04-22T07:18:38.894313+0000","last_undegraded":"2024-04-22T07:18:38.894313+0000","last_fullsized":"2024-04-22T07:18:38.894313+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:45:15.213668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:38.393831+0000","last_change":"2024-04-22T07:18:36.765462+0000","last_active":"2024-04-22T07:18:38.393831+0000","last_peered":"2024-04-22T07:18:38.393831+0000","last_clean":"2024-04-22T07:18:38.393831+0000","last_became_active":"2024-04-22T07:18:36.765142+0000","last_became_peered":"2024-04-22T07:18:36.765142+0000","last_unstale":"2024-04-22T07:18:38.393831+0000","last_undegraded":"2024-04-22T07:18:38.393831+0000","last_fullsized":"2024-04-22T07:18:38.393831+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:32:20.374856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.763051+0000","last_change":"2024-04-22T07:18:36.768234+0000","last_active":"2024-04-22T07:18:37.763051+0000","last_peered":"2024-04-22T07:18:37.763051+0000","last_clean":"2024-04-22T07:18:37.763051+0000","last_became_active":"2024-04-22T07:18:36.767951+0000","last_became_peered":"2024-04-22T07:18:36.767951+0000","last_unstale":"2024-04-22T07:18:37.763051+0000","last_undegraded":"2024-04-22T07:18:37.763051+0000","last_fullsized":"2024-04-22T07:18:37.763051+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:08:05.611868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.767692+0000","last_change":"2024-04-22T07:18:35.751538+0000","last_active":"2024-04-22T07:18:37.767692+0000","last_peered":"2024-04-22T07:18:37.767692+0000","last_clean":"2024-04-22T07:18:37.767692+0000","last_became_active":"2024-04-22T07:18:35.751219+0000","last_became_peered":"2024-04-22T07:18:35.751219+0000","last_unstale":"2024-04-22T07:18:37.767692+0000","last_undegraded":"2024-04-22T07:18:37.767692+0000","last_fullsized":"2024-04-22T07:18:37.767692+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:00:10.289974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:38.894909+0000","last_change":"2024-04-22T07:18:36.757337+0000","last_active":"2024-04-22T07:18:38.894909+0000","last_peered":"2024-04-22T07:18:38.894909+0000","last_clean":"2024-04-22T07:18:38.894909+0000","last_became_active":"2024-04-22T07:18:36.757039+0000","last_became_peered":"2024-04-22T07:18:36.757039+0000","last_unstale":"2024-04-22T07:18:38.894909+0000","last_undegraded":"2024-04-22T07:18:38.894909+0000","last_fullsized":"2024-04-22T07:18:38.894909+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:09:08.040513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:38.393864+0000","last_change":"2024-04-22T07:18:35.746515+0000","last_active":"2024-04-22T07:18:38.393864+0000","last_peered":"2024-04-22T07:18:38.393864+0000","last_clean":"2024-04-22T07:18:38.393864+0000","last_became_active":"2024-04-22T07:18:35.746198+0000","last_became_peered":"2024-04-22T07:18:35.746198+0000","last_unstale":"2024-04-22T07:18:38.393864+0000","last_undegraded":"2024-04-22T07:18:38.393864+0000","last_fullsized":"2024-04-22T07:18:38.393864+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:43:54.682673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.767496+0000","last_change":"2024-04-22T07:18:35.752307+0000","last_active":"2024-04-22T07:18:37.767496+0000","last_peered":"2024-04-22T07:18:37.767496+0000","last_clean":"2024-04-22T07:18:37.767496+0000","last_became_active":"2024-04-22T07:18:35.751545+0000","last_became_peered":"2024-04-22T07:18:35.751545+0000","last_unstale":"2024-04-22T07:18:37.767496+0000","last_undegraded":"2024-04-22T07:18:37.767496+0000","last_fullsized":"2024-04-22T07:18:37.767496+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:21:55.316649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.767511+0000","last_change":"2024-04-22T07:18:36.772372+0000","last_active":"2024-04-22T07:18:37.767511+0000","last_peered":"2024-04-22T07:18:37.767511+0000","last_clean":"2024-04-22T07:18:37.767511+0000","last_became_active":"2024-04-22T07:18:36.772067+0000","last_became_peered":"2024-04-22T07:18:36.772067+0000","last_unstale":"2024-04-22T07:18:37.767511+0000","last_undegraded":"2024-04-22T07:18:37.767511+0000","last_fullsized":"2024-04-22T07:18:37.767511+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:44:30.785178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.764151+0000","last_change":"2024-04-22T07:18:35.740989+0000","last_active":"2024-04-22T07:18:37.764151+0000","last_peered":"2024-04-22T07:18:37.764151+0000","last_clean":"2024-04-22T07:18:37.764151+0000","last_became_active":"2024-04-22T07:18:35.740665+0000","last_became_peered":"2024-04-22T07:18:35.740665+0000","last_unstale":"2024-04-22T07:18:37.764151+0000","last_undegraded":"2024-04-22T07:18:37.764151+0000","last_fullsized":"2024-04-22T07:18:37.764151+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:00:10.289974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.757377+0000","last_change":"2024-04-22T07:18:36.767022+0000","last_active":"2024-04-22T07:18:37.757377+0000","last_peered":"2024-04-22T07:18:37.757377+0000","last_clean":"2024-04-22T07:18:37.757377+0000","last_became_active":"2024-04-22T07:18:36.766609+0000","last_became_peered":"2024-04-22T07:18:36.766609+0000","last_unstale":"2024-04-22T07:18:37.757377+0000","last_undegraded":"2024-04-22T07:18:37.757377+0000","last_fullsized":"2024-04-22T07:18:37.757377+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:32:20.374856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:38.394098+0000","last_change":"2024-04-22T07:18:35.752081+0000","last_active":"2024-04-22T07:18:38.394098+0000","last_peered":"2024-04-22T07:18:38.394098+0000","last_clean":"2024-04-22T07:18:38.394098+0000","last_became_active":"2024-04-22T07:18:35.751757+0000","last_became_peered":"2024-04-22T07:18:35.751757+0000","last_unstale":"2024-04-22T07:18:38.394098+0000","last_undegraded":"2024-04-22T07:18:38.394098+0000","last_fullsized":"2024-04-22T07:18:38.394098+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:21:55.316649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.764165+0000","last_change":"2024-04-22T07:18:36.765937+0000","last_active":"2024-04-22T07:18:37.764165+0000","last_peered":"2024-04-22T07:18:37.764165+0000","last_clean":"2024-04-22T07:18:37.764165+0000","last_became_active":"2024-04-22T07:18:36.765647+0000","last_became_peered":"2024-04-22T07:18:36.765647+0000","last_unstale":"2024-04-22T07:18:37.764165+0000","last_undegraded":"2024-04-22T07:18:37.764165+0000","last_fullsized":"2024-04-22T07:18:37.764165+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:59:57.688417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.763996+0000","last_change":"2024-04-22T07:18:35.747309+0000","last_active":"2024-04-22T07:18:37.763996+0000","last_peered":"2024-04-22T07:18:37.763996+0000","last_clean":"2024-04-22T07:18:37.763996+0000","last_became_active":"2024-04-22T07:18:35.747019+0000","last_became_peered":"2024-04-22T07:18:35.747019+0000","last_unstale":"2024-04-22T07:18:37.763996+0000","last_undegraded":"2024-04-22T07:18:37.763996+0000","last_fullsized":"2024-04-22T07:18:37.763996+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:21:55.316649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:38.895019+0000","last_change":"2024-04-22T07:18:36.763436+0000","last_active":"2024-04-22T07:18:38.895019+0000","last_peered":"2024-04-22T07:18:38.895019+0000","last_clean":"2024-04-22T07:18:38.895019+0000","last_became_active":"2024-04-22T07:18:36.763068+0000","last_became_peered":"2024-04-22T07:18:36.763068+0000","last_unstale":"2024-04-22T07:18:38.895019+0000","last_undegraded":"2024-04-22T07:18:38.895019+0000","last_fullsized":"2024-04-22T07:18:38.895019+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:22:58.884168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.757301+0000","last_change":"2024-04-22T07:18:35.750769+0000","last_active":"2024-04-22T07:18:37.757301+0000","last_peered":"2024-04-22T07:18:37.757301+0000","last_clean":"2024-04-22T07:18:37.757301+0000","last_became_active":"2024-04-22T07:18:35.750406+0000","last_became_peered":"2024-04-22T07:18:35.750406+0000","last_unstale":"2024-04-22T07:18:37.757301+0000","last_undegraded":"2024-04-22T07:18:37.757301+0000","last_fullsized":"2024-04-22T07:18:37.757301+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T19:09:20.529889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.763680+0000","last_change":"2024-04-22T07:18:36.767426+0000","last_active":"2024-04-22T07:18:37.763680+0000","last_peered":"2024-04-22T07:18:37.763680+0000","last_clean":"2024-04-22T07:18:37.763680+0000","last_became_active":"2024-04-22T07:18:36.767159+0000","last_became_peered":"2024-04-22T07:18:36.767159+0000","last_unstale":"2024-04-22T07:18:37.763680+0000","last_undegraded":"2024-04-22T07:18:37.763680+0000","last_fullsized":"2024-04-22T07:18:37.763680+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:19:49.652644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:38.394172+0000","last_change":"2024-04-22T07:18:35.752996+0000","last_active":"2024-04-22T07:18:38.394172+0000","last_peered":"2024-04-22T07:18:38.394172+0000","last_clean":"2024-04-22T07:18:38.394172+0000","last_became_active":"2024-04-22T07:18:35.752686+0000","last_became_peered":"2024-04-22T07:18:35.752686+0000","last_unstale":"2024-04-22T07:18:38.394172+0000","last_undegraded":"2024-04-22T07:18:38.394172+0000","last_fullsized":"2024-04-22T07:18:38.394172+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:36:55.684427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.937011+0000","last_change":"2024-04-22T07:18:36.767539+0000","last_active":"2024-04-22T07:18:37.937011+0000","last_peered":"2024-04-22T07:18:37.937011+0000","last_clean":"2024-04-22T07:18:37.937011+0000","last_became_active":"2024-04-22T07:18:36.767273+0000","last_became_peered":"2024-04-22T07:18:36.767273+0000","last_unstale":"2024-04-22T07:18:37.937011+0000","last_undegraded":"2024-04-22T07:18:37.937011+0000","last_fullsized":"2024-04-22T07:18:37.937011+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:03:50.228822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:38.894909+0000","last_change":"2024-04-22T07:18:35.752382+0000","last_active":"2024-04-22T07:18:38.894909+0000","last_peered":"2024-04-22T07:18:38.894909+0000","last_clean":"2024-04-22T07:18:38.894909+0000","last_became_active":"2024-04-22T07:18:35.752060+0000","last_became_peered":"2024-04-22T07:18:35.752060+0000","last_unstale":"2024-04-22T07:18:38.894909+0000","last_undegraded":"2024-04-22T07:18:38.894909+0000","last_fullsized":"2024-04-22T07:18:38.894909+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:31:33.559251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:38.894534+0000","last_change":"2024-04-22T07:18:36.764670+0000","last_active":"2024-04-22T07:18:38.894534+0000","last_peered":"2024-04-22T07:18:38.894534+0000","last_clean":"2024-04-22T07:18:38.894534+0000","last_became_active":"2024-04-22T07:18:36.763834+0000","last_became_peered":"2024-04-22T07:18:36.763834+0000","last_unstale":"2024-04-22T07:18:38.894534+0000","last_undegraded":"2024-04-22T07:18:38.894534+0000","last_fullsized":"2024-04-22T07:18:38.894534+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:41:20.703226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.763489+0000","last_change":"2024-04-22T07:18:35.752856+0000","last_active":"2024-04-22T07:18:37.763489+0000","last_peered":"2024-04-22T07:18:37.763489+0000","last_clean":"2024-04-22T07:18:37.763489+0000","last_became_active":"2024-04-22T07:18:35.752527+0000","last_became_peered":"2024-04-22T07:18:35.752527+0000","last_unstale":"2024-04-22T07:18:37.763489+0000","last_undegraded":"2024-04-22T07:18:37.763489+0000","last_fullsized":"2024-04-22T07:18:37.763489+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:40:59.305769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.937073+0000","last_change":"2024-04-22T07:18:36.769174+0000","last_active":"2024-04-22T07:18:37.937073+0000","last_peered":"2024-04-22T07:18:37.937073+0000","last_clean":"2024-04-22T07:18:37.937073+0000","last_became_active":"2024-04-22T07:18:36.768913+0000","last_became_peered":"2024-04-22T07:18:36.768913+0000","last_unstale":"2024-04-22T07:18:37.937073+0000","last_undegraded":"2024-04-22T07:18:37.937073+0000","last_fullsized":"2024-04-22T07:18:37.937073+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:45:42.674989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:38.393752+0000","last_change":"2024-04-22T07:18:35.749740+0000","last_active":"2024-04-22T07:18:38.393752+0000","last_peered":"2024-04-22T07:18:38.393752+0000","last_clean":"2024-04-22T07:18:38.393752+0000","last_became_active":"2024-04-22T07:18:35.749453+0000","last_became_peered":"2024-04-22T07:18:35.749453+0000","last_unstale":"2024-04-22T07:18:38.393752+0000","last_undegraded":"2024-04-22T07:18:38.393752+0000","last_fullsized":"2024-04-22T07:18:38.393752+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:08:04.608018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:38.393952+0000","last_change":"2024-04-22T07:18:36.771940+0000","last_active":"2024-04-22T07:18:38.393952+0000","last_peered":"2024-04-22T07:18:38.393952+0000","last_clean":"2024-04-22T07:18:38.393952+0000","last_became_active":"2024-04-22T07:18:36.771548+0000","last_became_peered":"2024-04-22T07:18:36.771548+0000","last_unstale":"2024-04-22T07:18:38.393952+0000","last_undegraded":"2024-04-22T07:18:38.393952+0000","last_fullsized":"2024-04-22T07:18:38.393952+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:23:03.787574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:38.894061+0000","last_change":"2024-04-22T07:18:35.749047+0000","last_active":"2024-04-22T07:18:38.894061+0000","last_peered":"2024-04-22T07:18:38.894061+0000","last_clean":"2024-04-22T07:18:38.894061+0000","last_became_active":"2024-04-22T07:18:35.748757+0000","last_became_peered":"2024-04-22T07:18:35.748757+0000","last_unstale":"2024-04-22T07:18:38.894061+0000","last_undegraded":"2024-04-22T07:18:38.894061+0000","last_fullsized":"2024-04-22T07:18:38.894061+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:40:59.305769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.936788+0000","last_change":"2024-04-22T07:18:36.769894+0000","last_active":"2024-04-22T07:18:37.936788+0000","last_peered":"2024-04-22T07:18:37.936788+0000","last_clean":"2024-04-22T07:18:37.936788+0000","last_became_active":"2024-04-22T07:18:36.768702+0000","last_became_peered":"2024-04-22T07:18:36.768702+0000","last_unstale":"2024-04-22T07:18:37.936788+0000","last_undegraded":"2024-04-22T07:18:37.936788+0000","last_fullsized":"2024-04-22T07:18:37.936788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:36:53.716397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.763463+0000","last_change":"2024-04-22T07:18:35.747536+0000","last_active":"2024-04-22T07:18:37.763463+0000","last_peered":"2024-04-22T07:18:37.763463+0000","last_clean":"2024-04-22T07:18:37.763463+0000","last_became_active":"2024-04-22T07:18:35.747271+0000","last_became_peered":"2024-04-22T07:18:35.747271+0000","last_unstale":"2024-04-22T07:18:37.763463+0000","last_undegraded":"2024-04-22T07:18:37.763463+0000","last_fullsized":"2024-04-22T07:18:37.763463+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:51:11.593642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.937304+0000","last_change":"2024-04-22T07:18:36.773033+0000","last_active":"2024-04-22T07:18:37.937304+0000","last_peered":"2024-04-22T07:18:37.937304+0000","last_clean":"2024-04-22T07:18:37.937304+0000","last_became_active":"2024-04-22T07:18:36.772537+0000","last_became_peered":"2024-04-22T07:18:36.772537+0000","last_unstale":"2024-04-22T07:18:37.937304+0000","last_undegraded":"2024-04-22T07:18:37.937304+0000","last_fullsized":"2024-04-22T07:18:37.937304+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:58:41.509248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:38.894457+0000","last_change":"2024-04-22T07:18:35.747533+0000","last_active":"2024-04-22T07:18:38.894457+0000","last_peered":"2024-04-22T07:18:38.894457+0000","last_clean":"2024-04-22T07:18:38.894457+0000","last_became_active":"2024-04-22T07:18:35.746881+0000","last_became_peered":"2024-04-22T07:18:35.746881+0000","last_unstale":"2024-04-22T07:18:38.894457+0000","last_undegraded":"2024-04-22T07:18:38.894457+0000","last_fullsized":"2024-04-22T07:18:38.894457+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:43:54.682673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.937347+0000","last_change":"2024-04-22T07:18:36.773723+0000","last_active":"2024-04-22T07:18:37.937347+0000","last_peered":"2024-04-22T07:18:37.937347+0000","last_clean":"2024-04-22T07:18:37.937347+0000","last_became_active":"2024-04-22T07:18:36.773466+0000","last_became_peered":"2024-04-22T07:18:36.773466+0000","last_unstale":"2024-04-22T07:18:37.937347+0000","last_undegraded":"2024-04-22T07:18:37.937347+0000","last_fullsized":"2024-04-22T07:18:37.937347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:42:20.611744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.757415+0000","last_change":"2024-04-22T07:18:35.750360+0000","last_active":"2024-04-22T07:18:37.757415+0000","last_peered":"2024-04-22T07:18:37.757415+0000","last_clean":"2024-04-22T07:18:37.757415+0000","last_became_active":"2024-04-22T07:18:35.749984+0000","last_became_peered":"2024-04-22T07:18:35.749984+0000","last_unstale":"2024-04-22T07:18:37.757415+0000","last_undegraded":"2024-04-22T07:18:37.757415+0000","last_fullsized":"2024-04-22T07:18:37.757415+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:19:48.648793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.764298+0000","last_change":"2024-04-22T07:18:36.765767+0000","last_active":"2024-04-22T07:18:37.764298+0000","last_peered":"2024-04-22T07:18:37.764298+0000","last_clean":"2024-04-22T07:18:37.764298+0000","last_became_active":"2024-04-22T07:18:36.764218+0000","last_became_peered":"2024-04-22T07:18:36.764218+0000","last_unstale":"2024-04-22T07:18:37.764298+0000","last_undegraded":"2024-04-22T07:18:37.764298+0000","last_fullsized":"2024-04-22T07:18:37.764298+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:45:42.674989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:38.894330+0000","last_change":"2024-04-22T07:18:35.743323+0000","last_active":"2024-04-22T07:18:38.894330+0000","last_peered":"2024-04-22T07:18:38.894330+0000","last_clean":"2024-04-22T07:18:38.894330+0000","last_became_active":"2024-04-22T07:18:35.743023+0000","last_became_peered":"2024-04-22T07:18:35.743023+0000","last_unstale":"2024-04-22T07:18:38.894330+0000","last_undegraded":"2024-04-22T07:18:38.894330+0000","last_fullsized":"2024-04-22T07:18:38.894330+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:08:04.608018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.937037+0000","last_change":"2024-04-22T07:18:36.771073+0000","last_active":"2024-04-22T07:18:37.937037+0000","last_peered":"2024-04-22T07:18:37.937037+0000","last_clean":"2024-04-22T07:18:37.937037+0000","last_became_active":"2024-04-22T07:18:36.770678+0000","last_became_peered":"2024-04-22T07:18:36.770678+0000","last_unstale":"2024-04-22T07:18:37.937037+0000","last_undegraded":"2024-04-22T07:18:37.937037+0000","last_fullsized":"2024-04-22T07:18:37.937037+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:59:57.688417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":170,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.936801+0000","last_change":"2024-04-22T07:18:26.518190+0000","last_active":"2024-04-22T07:18:37.936801+0000","last_peered":"2024-04-22T07:18:37.936801+0000","last_clean":"2024-04-22T07:18:37.936801+0000","last_became_active":"2024-04-22T07:18:26.515489+0000","last_became_peered":"2024-04-22T07:18:26.515489+0000","last_unstale":"2024-04-22T07:18:37.936801+0000","last_undegraded":"2024-04-22T07:18:37.936801+0000","last_fullsized":"2024-04-22T07:18:37.936801+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:24.652061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:24.652061+0000","last_clean_scrub_stamp":"2024-04-22T07:18:24.652061+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:32:54.875706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.762947+0000","last_change":"2024-04-22T07:18:35.748477+0000","last_active":"2024-04-22T07:18:37.762947+0000","last_peered":"2024-04-22T07:18:37.762947+0000","last_clean":"2024-04-22T07:18:37.762947+0000","last_became_active":"2024-04-22T07:18:35.748176+0000","last_became_peered":"2024-04-22T07:18:35.748176+0000","last_unstale":"2024-04-22T07:18:37.762947+0000","last_undegraded":"2024-04-22T07:18:37.762947+0000","last_fullsized":"2024-04-22T07:18:37.762947+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:36:55.684427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.767642+0000","last_change":"2024-04-22T07:18:36.771870+0000","last_active":"2024-04-22T07:18:37.767642+0000","last_peered":"2024-04-22T07:18:37.767642+0000","last_clean":"2024-04-22T07:18:37.767642+0000","last_became_active":"2024-04-22T07:18:36.771583+0000","last_became_peered":"2024-04-22T07:18:36.771583+0000","last_unstale":"2024-04-22T07:18:37.767642+0000","last_undegraded":"2024-04-22T07:18:37.767642+0000","last_fullsized":"2024-04-22T07:18:37.767642+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:22:58.884168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.936652+0000","last_change":"2024-04-22T07:18:35.755668+0000","last_active":"2024-04-22T07:18:37.936652+0000","last_peered":"2024-04-22T07:18:37.936652+0000","last_clean":"2024-04-22T07:18:37.936652+0000","last_became_active":"2024-04-22T07:18:35.755471+0000","last_became_peered":"2024-04-22T07:18:35.755471+0000","last_unstale":"2024-04-22T07:18:37.936652+0000","last_undegraded":"2024-04-22T07:18:37.936652+0000","last_fullsized":"2024-04-22T07:18:37.936652+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:36:55.684427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:38.894300+0000","last_change":"2024-04-22T07:18:36.758204+0000","last_active":"2024-04-22T07:18:38.894300+0000","last_peered":"2024-04-22T07:18:38.894300+0000","last_clean":"2024-04-22T07:18:38.894300+0000","last_became_active":"2024-04-22T07:18:36.757841+0000","last_became_peered":"2024-04-22T07:18:36.757841+0000","last_unstale":"2024-04-22T07:18:38.894300+0000","last_undegraded":"2024-04-22T07:18:38.894300+0000","last_fullsized":"2024-04-22T07:18:38.894300+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:43:09.058016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:38.894236+0000","last_change":"2024-04-22T07:18:35.746686+0000","last_active":"2024-04-22T07:18:38.894236+0000","last_peered":"2024-04-22T07:18:38.894236+0000","last_clean":"2024-04-22T07:18:38.894236+0000","last_became_active":"2024-04-22T07:18:35.746371+0000","last_became_peered":"2024-04-22T07:18:35.746371+0000","last_unstale":"2024-04-22T07:18:38.894236+0000","last_undegraded":"2024-04-22T07:18:38.894236+0000","last_fullsized":"2024-04-22T07:18:38.894236+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:36:55.684427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.757383+0000","last_change":"2024-04-22T07:18:36.765985+0000","last_active":"2024-04-22T07:18:37.757383+0000","last_peered":"2024-04-22T07:18:37.757383+0000","last_clean":"2024-04-22T07:18:37.757383+0000","last_became_active":"2024-04-22T07:18:36.765661+0000","last_became_peered":"2024-04-22T07:18:36.765661+0000","last_unstale":"2024-04-22T07:18:37.757383+0000","last_undegraded":"2024-04-22T07:18:37.757383+0000","last_fullsized":"2024-04-22T07:18:37.757383+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:23:03.787574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.763585+0000","last_change":"2024-04-22T07:18:35.754160+0000","last_active":"2024-04-22T07:18:37.763585+0000","last_peered":"2024-04-22T07:18:37.763585+0000","last_clean":"2024-04-22T07:18:37.763585+0000","last_became_active":"2024-04-22T07:18:35.753860+0000","last_became_peered":"2024-04-22T07:18:35.753860+0000","last_unstale":"2024-04-22T07:18:37.763585+0000","last_undegraded":"2024-04-22T07:18:37.763585+0000","last_fullsized":"2024-04-22T07:18:37.763585+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:08:04.608018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.763400+0000","last_change":"2024-04-22T07:18:36.762349+0000","last_active":"2024-04-22T07:18:37.763400+0000","last_peered":"2024-04-22T07:18:37.763400+0000","last_clean":"2024-04-22T07:18:37.763400+0000","last_became_active":"2024-04-22T07:18:36.762097+0000","last_became_peered":"2024-04-22T07:18:36.762097+0000","last_unstale":"2024-04-22T07:18:37.763400+0000","last_undegraded":"2024-04-22T07:18:37.763400+0000","last_fullsized":"2024-04-22T07:18:37.763400+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:43:55.686523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.757304+0000","last_change":"2024-04-22T07:18:35.758810+0000","last_active":"2024-04-22T07:18:37.757304+0000","last_peered":"2024-04-22T07:18:37.757304+0000","last_clean":"2024-04-22T07:18:37.757304+0000","last_became_active":"2024-04-22T07:18:35.758521+0000","last_became_peered":"2024-04-22T07:18:35.758521+0000","last_unstale":"2024-04-22T07:18:37.757304+0000","last_undegraded":"2024-04-22T07:18:37.757304+0000","last_fullsized":"2024-04-22T07:18:37.757304+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:40:59.305769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.764371+0000","last_change":"2024-04-22T07:18:36.764448+0000","last_active":"2024-04-22T07:18:37.764371+0000","last_peered":"2024-04-22T07:18:37.764371+0000","last_clean":"2024-04-22T07:18:37.764371+0000","last_became_active":"2024-04-22T07:18:36.763728+0000","last_became_peered":"2024-04-22T07:18:36.763728+0000","last_unstale":"2024-04-22T07:18:37.764371+0000","last_undegraded":"2024-04-22T07:18:37.764371+0000","last_fullsized":"2024-04-22T07:18:37.764371+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:58:41.509248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.937270+0000","last_change":"2024-04-22T07:18:35.758980+0000","last_active":"2024-04-22T07:18:37.937270+0000","last_peered":"2024-04-22T07:18:37.937270+0000","last_clean":"2024-04-22T07:18:37.937270+0000","last_became_active":"2024-04-22T07:18:35.758674+0000","last_became_peered":"2024-04-22T07:18:35.758674+0000","last_unstale":"2024-04-22T07:18:37.937270+0000","last_undegraded":"2024-04-22T07:18:37.937270+0000","last_fullsized":"2024-04-22T07:18:37.937270+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:45:14.209818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.757443+0000","last_change":"2024-04-22T07:18:36.772908+0000","last_active":"2024-04-22T07:18:37.757443+0000","last_peered":"2024-04-22T07:18:37.757443+0000","last_clean":"2024-04-22T07:18:37.757443+0000","last_became_active":"2024-04-22T07:18:36.772636+0000","last_became_peered":"2024-04-22T07:18:36.772636+0000","last_unstale":"2024-04-22T07:18:37.757443+0000","last_undegraded":"2024-04-22T07:18:37.757443+0000","last_fullsized":"2024-04-22T07:18:37.757443+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:51:10.038201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.757474+0000","last_change":"2024-04-22T07:18:35.753595+0000","last_active":"2024-04-22T07:18:37.757474+0000","last_peered":"2024-04-22T07:18:37.757474+0000","last_clean":"2024-04-22T07:18:37.757474+0000","last_became_active":"2024-04-22T07:18:35.753295+0000","last_became_peered":"2024-04-22T07:18:35.753295+0000","last_unstale":"2024-04-22T07:18:37.757474+0000","last_undegraded":"2024-04-22T07:18:37.757474+0000","last_fullsized":"2024-04-22T07:18:37.757474+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:08:04.608018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.768028+0000","last_change":"2024-04-22T07:18:36.768580+0000","last_active":"2024-04-22T07:18:37.768028+0000","last_peered":"2024-04-22T07:18:37.768028+0000","last_clean":"2024-04-22T07:18:37.768028+0000","last_became_active":"2024-04-22T07:18:36.767702+0000","last_became_peered":"2024-04-22T07:18:36.767702+0000","last_unstale":"2024-04-22T07:18:37.768028+0000","last_undegraded":"2024-04-22T07:18:37.768028+0000","last_fullsized":"2024-04-22T07:18:37.768028+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:59:57.688417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:38.394128+0000","last_change":"2024-04-22T07:18:35.751692+0000","last_active":"2024-04-22T07:18:38.394128+0000","last_peered":"2024-04-22T07:18:38.394128+0000","last_clean":"2024-04-22T07:18:38.394128+0000","last_became_active":"2024-04-22T07:18:35.751393+0000","last_became_peered":"2024-04-22T07:18:35.751393+0000","last_unstale":"2024-04-22T07:18:38.394128+0000","last_undegraded":"2024-04-22T07:18:38.394128+0000","last_fullsized":"2024-04-22T07:18:38.394128+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:40:59.305769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:38.894956+0000","last_change":"2024-04-22T07:18:36.768532+0000","last_active":"2024-04-22T07:18:38.894956+0000","last_peered":"2024-04-22T07:18:38.894956+0000","last_clean":"2024-04-22T07:18:38.894956+0000","last_became_active":"2024-04-22T07:18:36.768253+0000","last_became_peered":"2024-04-22T07:18:36.768253+0000","last_unstale":"2024-04-22T07:18:38.894956+0000","last_undegraded":"2024-04-22T07:18:38.894956+0000","last_fullsized":"2024-04-22T07:18:38.894956+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:30:36.755201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.936651+0000","last_change":"2024-04-22T07:18:35.758702+0000","last_active":"2024-04-22T07:18:37.936651+0000","last_peered":"2024-04-22T07:18:37.936651+0000","last_clean":"2024-04-22T07:18:37.936651+0000","last_became_active":"2024-04-22T07:18:35.758415+0000","last_became_peered":"2024-04-22T07:18:35.758415+0000","last_unstale":"2024-04-22T07:18:37.936651+0000","last_undegraded":"2024-04-22T07:18:37.936651+0000","last_fullsized":"2024-04-22T07:18:37.936651+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:08:04.608018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.763191+0000","last_change":"2024-04-22T07:18:36.763053+0000","last_active":"2024-04-22T07:18:37.763191+0000","last_peered":"2024-04-22T07:18:37.763191+0000","last_clean":"2024-04-22T07:18:37.763191+0000","last_became_active":"2024-04-22T07:18:36.762546+0000","last_became_peered":"2024-04-22T07:18:36.762546+0000","last_unstale":"2024-04-22T07:18:37.763191+0000","last_undegraded":"2024-04-22T07:18:37.763191+0000","last_fullsized":"2024-04-22T07:18:37.763191+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:36:56.688277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.757534+0000","last_change":"2024-04-22T07:18:35.748837+0000","last_active":"2024-04-22T07:18:37.757534+0000","last_peered":"2024-04-22T07:18:37.757534+0000","last_clean":"2024-04-22T07:18:37.757534+0000","last_became_active":"2024-04-22T07:18:35.748080+0000","last_became_peered":"2024-04-22T07:18:35.748080+0000","last_unstale":"2024-04-22T07:18:37.757534+0000","last_undegraded":"2024-04-22T07:18:37.757534+0000","last_fullsized":"2024-04-22T07:18:37.757534+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:36:55.684427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.767568+0000","last_change":"2024-04-22T07:18:36.769911+0000","last_active":"2024-04-22T07:18:37.767568+0000","last_peered":"2024-04-22T07:18:37.767568+0000","last_clean":"2024-04-22T07:18:37.767568+0000","last_became_active":"2024-04-22T07:18:36.768682+0000","last_became_peered":"2024-04-22T07:18:36.768682+0000","last_unstale":"2024-04-22T07:18:37.767568+0000","last_undegraded":"2024-04-22T07:18:37.767568+0000","last_fullsized":"2024-04-22T07:18:37.767568+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:30:36.755201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.757319+0000","last_change":"2024-04-22T07:18:35.753066+0000","last_active":"2024-04-22T07:18:37.757319+0000","last_peered":"2024-04-22T07:18:37.757319+0000","last_clean":"2024-04-22T07:18:37.757319+0000","last_became_active":"2024-04-22T07:18:35.752804+0000","last_became_peered":"2024-04-22T07:18:35.752804+0000","last_unstale":"2024-04-22T07:18:37.757319+0000","last_undegraded":"2024-04-22T07:18:37.757319+0000","last_fullsized":"2024-04-22T07:18:37.757319+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:43:54.682673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.767652+0000","last_change":"2024-04-22T07:18:36.774790+0000","last_active":"2024-04-22T07:18:37.767652+0000","last_peered":"2024-04-22T07:18:37.767652+0000","last_clean":"2024-04-22T07:18:37.767652+0000","last_became_active":"2024-04-22T07:18:36.774479+0000","last_became_peered":"2024-04-22T07:18:36.774479+0000","last_unstale":"2024-04-22T07:18:37.767652+0000","last_undegraded":"2024-04-22T07:18:37.767652+0000","last_fullsized":"2024-04-22T07:18:37.767652+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:36:53.716397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.937094+0000","last_change":"2024-04-22T07:18:35.754440+0000","last_active":"2024-04-22T07:18:37.937094+0000","last_peered":"2024-04-22T07:18:37.937094+0000","last_clean":"2024-04-22T07:18:37.937094+0000","last_became_active":"2024-04-22T07:18:35.754137+0000","last_became_peered":"2024-04-22T07:18:35.754137+0000","last_unstale":"2024-04-22T07:18:37.937094+0000","last_undegraded":"2024-04-22T07:18:37.937094+0000","last_fullsized":"2024-04-22T07:18:37.937094+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T19:09:20.529889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:38.393947+0000","last_change":"2024-04-22T07:18:36.759585+0000","last_active":"2024-04-22T07:18:38.393947+0000","last_peered":"2024-04-22T07:18:38.393947+0000","last_clean":"2024-04-22T07:18:38.393947+0000","last_became_active":"2024-04-22T07:18:36.759342+0000","last_became_peered":"2024-04-22T07:18:36.759342+0000","last_unstale":"2024-04-22T07:18:38.393947+0000","last_undegraded":"2024-04-22T07:18:38.393947+0000","last_fullsized":"2024-04-22T07:18:38.393947+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:44:30.785178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.764337+0000","last_change":"2024-04-22T07:18:36.762665+0000","last_active":"2024-04-22T07:18:37.764337+0000","last_peered":"2024-04-22T07:18:37.764337+0000","last_clean":"2024-04-22T07:18:37.764337+0000","last_became_active":"2024-04-22T07:18:36.762392+0000","last_became_peered":"2024-04-22T07:18:36.762392+0000","last_unstale":"2024-04-22T07:18:37.764337+0000","last_undegraded":"2024-04-22T07:18:37.764337+0000","last_fullsized":"2024-04-22T07:18:37.764337+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:36:27.097452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.936925+0000","last_change":"2024-04-22T07:18:35.755160+0000","last_active":"2024-04-22T07:18:37.936925+0000","last_peered":"2024-04-22T07:18:37.936925+0000","last_clean":"2024-04-22T07:18:37.936925+0000","last_became_active":"2024-04-22T07:18:35.754877+0000","last_became_peered":"2024-04-22T07:18:35.754877+0000","last_unstale":"2024-04-22T07:18:37.936925+0000","last_undegraded":"2024-04-22T07:18:37.936925+0000","last_fullsized":"2024-04-22T07:18:37.936925+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:43:54.682673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.764098+0000","last_change":"2024-04-22T07:18:36.761534+0000","last_active":"2024-04-22T07:18:37.764098+0000","last_peered":"2024-04-22T07:18:37.764098+0000","last_clean":"2024-04-22T07:18:37.764098+0000","last_became_active":"2024-04-22T07:18:36.761181+0000","last_became_peered":"2024-04-22T07:18:36.761181+0000","last_unstale":"2024-04-22T07:18:37.764098+0000","last_undegraded":"2024-04-22T07:18:37.764098+0000","last_fullsized":"2024-04-22T07:18:37.764098+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:03:50.228822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.937140+0000","last_change":"2024-04-22T07:18:35.752282+0000","last_active":"2024-04-22T07:18:37.937140+0000","last_peered":"2024-04-22T07:18:37.937140+0000","last_clean":"2024-04-22T07:18:37.937140+0000","last_became_active":"2024-04-22T07:18:35.751866+0000","last_became_peered":"2024-04-22T07:18:35.751866+0000","last_unstale":"2024-04-22T07:18:37.937140+0000","last_undegraded":"2024-04-22T07:18:37.937140+0000","last_fullsized":"2024-04-22T07:18:37.937140+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:19:48.648793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:38.894862+0000","last_change":"2024-04-22T07:18:36.763229+0000","last_active":"2024-04-22T07:18:38.894862+0000","last_peered":"2024-04-22T07:18:38.894862+0000","last_clean":"2024-04-22T07:18:38.894862+0000","last_became_active":"2024-04-22T07:18:36.762882+0000","last_became_peered":"2024-04-22T07:18:36.762882+0000","last_unstale":"2024-04-22T07:18:38.894862+0000","last_undegraded":"2024-04-22T07:18:38.894862+0000","last_fullsized":"2024-04-22T07:18:38.894862+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:44:30.785178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.767964+0000","last_change":"2024-04-22T07:18:35.758820+0000","last_active":"2024-04-22T07:18:37.767964+0000","last_peered":"2024-04-22T07:18:37.767964+0000","last_clean":"2024-04-22T07:18:37.767964+0000","last_became_active":"2024-04-22T07:18:35.758514+0000","last_became_peered":"2024-04-22T07:18:35.758514+0000","last_unstale":"2024-04-22T07:18:37.767964+0000","last_undegraded":"2024-04-22T07:18:37.767964+0000","last_fullsized":"2024-04-22T07:18:37.767964+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:40:59.305769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.767960+0000","last_change":"2024-04-22T07:18:36.768383+0000","last_active":"2024-04-22T07:18:37.767960+0000","last_peered":"2024-04-22T07:18:37.767960+0000","last_clean":"2024-04-22T07:18:37.767960+0000","last_became_active":"2024-04-22T07:18:36.767779+0000","last_became_peered":"2024-04-22T07:18:36.767779+0000","last_unstale":"2024-04-22T07:18:37.767960+0000","last_undegraded":"2024-04-22T07:18:37.767960+0000","last_fullsized":"2024-04-22T07:18:37.767960+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:18:59.298766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:38.895004+0000","last_change":"2024-04-22T07:18:35.754117+0000","last_active":"2024-04-22T07:18:38.895004+0000","last_peered":"2024-04-22T07:18:38.895004+0000","last_clean":"2024-04-22T07:18:38.895004+0000","last_became_active":"2024-04-22T07:18:35.753833+0000","last_became_peered":"2024-04-22T07:18:35.753833+0000","last_unstale":"2024-04-22T07:18:38.895004+0000","last_undegraded":"2024-04-22T07:18:38.895004+0000","last_fullsized":"2024-04-22T07:18:38.895004+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:54:03.123665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27800,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344040,"statfs":{"total":96636764160,"available":96608296960,"internally_reserved":0,"allocated":798720,"data_stored":661302,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":204800,"data_stored":70934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":204800,"data_stored":70934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":204800,"data_stored":70934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":204800,"data_stored":70934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27208,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":192512,"data_stored":64634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":204800,"data_stored":70934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27804,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344036,"statfs":{"total":96636764160,"available":96608292864,"internally_reserved":0,"allocated":798720,"data_stored":661302,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-22T07:18:42.142 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-22T07:18:42.143 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-04-22T07:18:42.143 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-04-22T07:18:42.143 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-04-22T07:18:42.143 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-04-22T07:18:42.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.281+0000 7fa8c79b6640 1 Processor -- start 2024-04-22T07:18:42.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.281+0000 7fa8c79b6640 1 -- start start 2024-04-22T07:18:42.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.282+0000 7fa8c79b6640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fa8c00c9210 0x7fa8c00c95f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:42.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.282+0000 7fa8c79b6640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa8c00c8b60 0x7fa8c01657b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:42.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.282+0000 7fa8c79b6640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8c00c7bd0 con 0x7fa8c00c72a0 2024-04-22T07:18:42.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.282+0000 7fa8c79b6640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7fa8c015b400 con 0x7fa8c00c9210 2024-04-22T07:18:42.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.282+0000 7fa8c79b6640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fa8c015b6e0 con 0x7fa8c00c8b60 2024-04-22T07:18:42.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.282+0000 7fa8c5f53640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa8c00c8b60 0x7fa8c01657b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:42.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.282+0000 7fa8c5752640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fa8c00c9210 0x7fa8c00c95f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:42.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.282+0000 7fa8c5f53640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa8c00c8b60 0x7fa8c01657b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.37:53900/0 (socket says 172.21.15.37:53900) 2024-04-22T07:18:42.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.282+0000 7fa8c5f53640 1 -- 172.21.15.37:0/3861132262 learned_addr learned my addr 172.21.15.37:0/3861132262 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:18:42.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.282+0000 7fa8c4f51640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7fa8c00c72a0 0x7fa8c015ec20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.37:54050/0 (socket says 172.21.15.37:54050) 2024-04-22T07:18:42.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.282+0000 7fa8c5f53640 1 -- 172.21.15.37:0/3861132262 >> v2:172.21.15.196:3300/0 conn(0x7fa8c00c9210 msgr2=0x7fa8c00c95f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:18:42.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.282+0000 7fa8c5f53640 1 --2- 172.21.15.37:0/3861132262 >> v2:172.21.15.196:3300/0 conn(0x7fa8c00c9210 0x7fa8c00c95f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:42.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.282+0000 7fa8c5f53640 1 -- 172.21.15.37:0/3861132262 >> v1:172.21.15.196:6789/0 conn(0x7fa8c00c72a0 legacy=0x7fa8c015ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:42.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.282+0000 7fa8c5f53640 1 -- 172.21.15.37:0/3861132262 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8c015b9c0 con 0x7fa8c00c8b60 2024-04-22T07:18:42.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.282+0000 7fa8c5752640 1 --2- 172.21.15.37:0/3861132262 >> v2:172.21.15.196:3300/0 conn(0x7fa8c00c9210 0x7fa8c00c95f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-22T07:18:42.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.283+0000 7fa8c5f53640 1 --2- 172.21.15.37:0/3861132262 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa8c00c8b60 0x7fa8c01657b0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fa8b8009e50 tx=0x7fa8b802bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2fdc5f871a96666a server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:42.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.283+0000 7fa8b7fff640 1 -- 172.21.15.37:0/3861132262 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8b802cb00 con 0x7fa8c00c8b60 2024-04-22T07:18:42.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.283+0000 7fa8b7fff640 1 -- 172.21.15.37:0/3861132262 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8b802cca0 con 0x7fa8c00c8b60 2024-04-22T07:18:42.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.283+0000 7fa8b7fff640 1 -- 172.21.15.37:0/3861132262 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8b8034610 con 0x7fa8c00c8b60 2024-04-22T07:18:42.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.284+0000 7fa8c79b6640 1 -- 172.21.15.37:0/3861132262 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa8c00c8b60 msgr2=0x7fa8c01657b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:42.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.284+0000 7fa8c79b6640 1 --2- 172.21.15.37:0/3861132262 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa8c00c8b60 0x7fa8c01657b0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fa8b8009e50 tx=0x7fa8b802bf60 comp rx=0 tx=0).stop 2024-04-22T07:18:42.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.284+0000 7fa8c79b6640 1 -- 172.21.15.37:0/3861132262 shutdown_connections 2024-04-22T07:18:42.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.284+0000 7fa8c79b6640 1 --2- 172.21.15.37:0/3861132262 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa8c00c8b60 0x7fa8c01657b0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:42.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.284+0000 7fa8c79b6640 1 --2- 172.21.15.37:0/3861132262 >> v2:172.21.15.196:3300/0 conn(0x7fa8c00c9210 0x7fa8c00c95f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:42.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.284+0000 7fa8c79b6640 1 -- 172.21.15.37:0/3861132262 >> 172.21.15.37:0/3861132262 conn(0x7fa8c006b970 msgr2=0x7fa8c006bd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:42.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.284+0000 7fa8c79b6640 1 -- 172.21.15.37:0/3861132262 shutdown_connections 2024-04-22T07:18:42.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.284+0000 7fa8c79b6640 1 -- 172.21.15.37:0/3861132262 wait complete. 2024-04-22T07:18:42.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.285+0000 7fa8c79b6640 1 Processor -- start 2024-04-22T07:18:42.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.285+0000 7fa8c79b6640 1 -- start start 2024-04-22T07:18:42.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.286+0000 7fa8c79b6640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa8c00c72a0 0x7fa8c00c6350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:42.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.286+0000 7fa8c79b6640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa8c00c8b60 0x7fa8c00c5460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:42.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.286+0000 7fa8c79b6640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa8c00c9210 0x7fa8c01e7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:42.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.286+0000 7fa8c79b6640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa8c015e700 con 0x7fa8c00c72a0 2024-04-22T07:18:42.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.286+0000 7fa8c79b6640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fa8c015e420 con 0x7fa8c00c9210 2024-04-22T07:18:42.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.286+0000 7fa8c79b6640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fa8c015f330 con 0x7fa8c00c8b60 2024-04-22T07:18:42.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.286+0000 7fa8c5752640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa8c00c72a0 0x7fa8c00c6350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:42.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.286+0000 7fa8c5752640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa8c00c72a0 0x7fa8c00c6350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54486/0 (socket says 172.21.15.37:54486) 2024-04-22T07:18:42.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.286+0000 7fa8c5752640 1 -- 172.21.15.37:0/1835293858 learned_addr learned my addr 172.21.15.37:0/1835293858 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:18:42.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.286+0000 7fa8c4f51640 1 --2- 172.21.15.37:0/1835293858 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa8c00c8b60 0x7fa8c00c5460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:42.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.286+0000 7fa8c5f53640 1 --2- 172.21.15.37:0/1835293858 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa8c00c9210 0x7fa8c01e7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:42.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.286+0000 7fa8c5752640 1 -- 172.21.15.37:0/1835293858 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa8c00c8b60 msgr2=0x7fa8c00c5460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:42.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.286+0000 7fa8c5752640 1 --2- 172.21.15.37:0/1835293858 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa8c00c8b60 0x7fa8c00c5460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:42.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.286+0000 7fa8c5752640 1 -- 172.21.15.37:0/1835293858 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa8c00c9210 msgr2=0x7fa8c01e7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:42.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.286+0000 7fa8c5752640 1 --2- 172.21.15.37:0/1835293858 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa8c00c9210 0x7fa8c01e7bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:42.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.286+0000 7fa8c5752640 1 -- 172.21.15.37:0/1835293858 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8c014b780 con 0x7fa8c00c72a0 2024-04-22T07:18:42.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.286+0000 7fa8c5f53640 1 --2- 172.21.15.37:0/1835293858 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa8c00c9210 0x7fa8c01e7bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T07:18:42.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.287+0000 7fa8c5752640 1 --2- 172.21.15.37:0/1835293858 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa8c00c72a0 0x7fa8c00c6350 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa8bc00e990 tx=0x7fa8bc00ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:42.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.287+0000 7fa8b5ffb640 1 -- 172.21.15.37:0/1835293858 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8bc017070 con 0x7fa8c00c72a0 2024-04-22T07:18:42.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.287+0000 7fa8b5ffb640 1 -- 172.21.15.37:0/1835293858 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8bc00c9e0 con 0x7fa8c00c72a0 2024-04-22T07:18:42.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.287+0000 7fa8c79b6640 1 -- 172.21.15.37:0/1835293858 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8c0149b70 con 0x7fa8c00c72a0 2024-04-22T07:18:42.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.287+0000 7fa8b5ffb640 1 -- 172.21.15.37:0/1835293858 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8bc00cdb0 con 0x7fa8c00c72a0 2024-04-22T07:18:42.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.287+0000 7fa8c79b6640 1 -- 172.21.15.37:0/1835293858 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8c014a130 con 0x7fa8c00c72a0 2024-04-22T07:18:42.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.288+0000 7fa8c79b6640 1 -- 172.21.15.37:0/1835293858 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8c0149900 con 0x7fa8c00c72a0 2024-04-22T07:18:42.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.288+0000 7fa8b5ffb640 1 -- 172.21.15.37:0/1835293858 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa8bc01a070 con 0x7fa8c00c72a0 2024-04-22T07:18:42.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.289+0000 7fa8b5ffb640 1 --2- 172.21.15.37:0/1835293858 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fa8a406c8f0 0x7fa8a406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:42.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.289+0000 7fa8b5ffb640 1 -- 172.21.15.37:0/1835293858 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fa8bc08bd70 con 0x7fa8c00c72a0 2024-04-22T07:18:42.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.289+0000 7fa8c4f51640 1 --2- 172.21.15.37:0/1835293858 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fa8a406c8f0 0x7fa8a406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:42.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.289+0000 7fa8c4f51640 1 --2- 172.21.15.37:0/1835293858 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fa8a406c8f0 0x7fa8a406edb0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa8c014b0a0 tx=0x7fa8b0007c40 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:42.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.293+0000 7fa8b5ffb640 1 -- 172.21.15.37:0/1835293858 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fa8bc05a1b0 con 0x7fa8c00c72a0 2024-04-22T07:18:42.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.528+0000 7fa8c79b6640 1 -- 172.21.15.37:0/1835293858 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7fa8c0069cc0 con 0x7fa8c00c72a0 2024-04-22T07:18:42.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.531+0000 7fa8b5ffb640 1 -- 172.21.15.37:0/1835293858 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+174140 (secure 0 0 0) 0x7fa8bc059ab0 con 0x7fa8c00c72a0 2024-04-22T07:18:42.531 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-22T07:18:42.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.534+0000 7fa8c79b6640 1 -- 172.21.15.37:0/1835293858 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fa8a406c8f0 msgr2=0x7fa8a406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:42.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.534+0000 7fa8c79b6640 1 --2- 172.21.15.37:0/1835293858 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fa8a406c8f0 0x7fa8a406edb0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa8c014b0a0 tx=0x7fa8b0007c40 comp rx=0 tx=0).stop 2024-04-22T07:18:42.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.534+0000 7fa8c79b6640 1 -- 172.21.15.37:0/1835293858 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa8c00c72a0 msgr2=0x7fa8c00c6350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:42.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.534+0000 7fa8c79b6640 1 --2- 172.21.15.37:0/1835293858 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa8c00c72a0 0x7fa8c00c6350 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa8bc00e990 tx=0x7fa8bc00ee50 comp rx=0 tx=0).stop 2024-04-22T07:18:42.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.534+0000 7fa8c79b6640 1 -- 172.21.15.37:0/1835293858 shutdown_connections 2024-04-22T07:18:42.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.534+0000 7fa8c79b6640 1 --2- 172.21.15.37:0/1835293858 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fa8a406c8f0 0x7fa8a406edb0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:42.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.534+0000 7fa8c79b6640 1 --2- 172.21.15.37:0/1835293858 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa8c00c9210 0x7fa8c01e7bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:42.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.534+0000 7fa8c79b6640 1 --2- 172.21.15.37:0/1835293858 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa8c00c8b60 0x7fa8c00c5460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:42.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.534+0000 7fa8c79b6640 1 --2- 172.21.15.37:0/1835293858 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa8c00c72a0 0x7fa8c00c6350 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:42.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.534+0000 7fa8c79b6640 1 -- 172.21.15.37:0/1835293858 >> 172.21.15.37:0/1835293858 conn(0x7fa8c006b970 msgr2=0x7fa8c0073180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:42.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.534+0000 7fa8c79b6640 1 -- 172.21.15.37:0/1835293858 shutdown_connections 2024-04-22T07:18:42.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.534+0000 7fa8c79b6640 1 -- 172.21.15.37:0/1835293858 wait complete. 2024-04-22T07:18:42.542 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":5,"flags":0,"active_gid":4103,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6832","nonce":321987173},{"type":"v1","addr":"172.21.15.196:6833","nonce":321987173}]},"active_addr":"172.21.15.196:6833/321987173","active_change":"2024-04-22T07:18:16.574509+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4107,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.196:0","nonce":3995095600}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.196:0","nonce":202737382}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.196:0","nonce":2438636527}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.196:0","nonce":2510764503}]}]} 2024-04-22T07:18:42.546 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-04-22T07:18:42.546 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-04-22T07:18:42.546 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-22T07:18:42.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.649+0000 7f0ab82f2640 1 Processor -- start 2024-04-22T07:18:42.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.649+0000 7f0ab82f2640 1 -- start start 2024-04-22T07:18:42.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.650+0000 7f0ab82f2640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0ab00b38f0 0x7f0ab015aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:42.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.650+0000 7f0ab82f2640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f0ab015b3f0 0x7f0ab00ccd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:42.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.650+0000 7f0ab82f2640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ab015f280 con 0x7f0ab01552f0 2024-04-22T07:18:42.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.650+0000 7f0ab82f2640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f0ab00b3100 con 0x7f0ab015b3f0 2024-04-22T07:18:42.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.650+0000 7f0ab82f2640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f0ab00cda00 con 0x7f0ab00b38f0 2024-04-22T07:18:42.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.650+0000 7f0ab588d640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0ab00b38f0 0x7f0ab015aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:42.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.650+0000 7f0ab688f640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f0ab015b3f0 0x7f0ab00ccd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:42.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.650+0000 7f0ab608e640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7f0ab01552f0 0x7f0ab00cb430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.37:54056/0 (socket says 172.21.15.37:54056) 2024-04-22T07:18:42.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.650+0000 7f0ab608e640 1 -- 172.21.15.37:0/899267004 learned_addr learned my addr 172.21.15.37:0/899267004 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-04-22T07:18:42.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.650+0000 7f0ab588d640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0ab00b38f0 0x7f0ab015aeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.37:53922/0 (socket says 172.21.15.37:53922) 2024-04-22T07:18:42.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.650+0000 7f0ab688f640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f0ab015b3f0 0x7f0ab00ccd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.37:34468/0 (socket says 172.21.15.37:34468) 2024-04-22T07:18:42.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.650+0000 7f0ab508c640 1 -- 172.21.15.37:0/899267004 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4022142678 0 0) 0x7f0ab015f280 con 0x7f0ab01552f0 2024-04-22T07:18:42.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.650+0000 7f0ab588d640 1 -- 172.21.15.37:0/899267004 >> v2:172.21.15.196:3300/0 conn(0x7f0ab015b3f0 msgr2=0x7f0ab00ccd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:18:42.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.650+0000 7f0ab588d640 1 --2- 172.21.15.37:0/899267004 >> v2:172.21.15.196:3300/0 conn(0x7f0ab015b3f0 0x7f0ab00ccd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:42.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.650+0000 7f0ab588d640 1 -- 172.21.15.37:0/899267004 >> v1:172.21.15.196:6789/0 conn(0x7f0ab01552f0 legacy=0x7f0ab00cb430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:42.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.650+0000 7f0ab588d640 1 -- 172.21.15.37:0/899267004 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ab00b3350 con 0x7f0ab00b38f0 2024-04-22T07:18:42.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.651+0000 7f0ab588d640 1 --2- 172.21.15.37:0/899267004 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0ab00b38f0 0x7f0ab015aeb0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f0aa00097a0 tx=0x7f0aa002b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d7f72f36eaa038ea server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:42.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.651+0000 7f0ab508c640 1 -- 172.21.15.37:0/899267004 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0aa0035020 con 0x7f0ab00b38f0 2024-04-22T07:18:42.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.651+0000 7f0ab508c640 1 -- 172.21.15.37:0/899267004 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0aa0031830 con 0x7f0ab00b38f0 2024-04-22T07:18:42.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.651+0000 7f0ab508c640 1 -- 172.21.15.37:0/899267004 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0aa0031c00 con 0x7f0ab00b38f0 2024-04-22T07:18:42.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.652+0000 7f0ab82f2640 1 -- 172.21.15.37:0/899267004 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0ab00b38f0 msgr2=0x7f0ab015aeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:42.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.652+0000 7f0ab82f2640 1 --2- 172.21.15.37:0/899267004 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0ab00b38f0 0x7f0ab015aeb0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f0aa00097a0 tx=0x7f0aa002b8d0 comp rx=0 tx=0).stop 2024-04-22T07:18:42.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.652+0000 7f0ab82f2640 1 -- 172.21.15.37:0/899267004 shutdown_connections 2024-04-22T07:18:42.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.652+0000 7f0ab82f2640 1 --2- 172.21.15.37:0/899267004 >> v2:172.21.15.196:3300/0 conn(0x7f0ab015b3f0 0x7f0ab00ccd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:42.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.652+0000 7f0ab82f2640 1 --2- 172.21.15.37:0/899267004 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0ab00b38f0 0x7f0ab015aeb0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:42.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.652+0000 7f0ab82f2640 1 -- 172.21.15.37:0/899267004 >> 172.21.15.37:0/899267004 conn(0x7f0ab0071f90 msgr2=0x7f0ab00723a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:42.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.652+0000 7f0ab82f2640 1 -- 172.21.15.37:0/899267004 shutdown_connections 2024-04-22T07:18:42.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.652+0000 7f0ab82f2640 1 -- 172.21.15.37:0/899267004 wait complete. 2024-04-22T07:18:42.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.653+0000 7f0ab82f2640 1 Processor -- start 2024-04-22T07:18:42.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.653+0000 7f0ab82f2640 1 -- start start 2024-04-22T07:18:42.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.654+0000 7f0ab82f2640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ab00b38f0 0x7f0ab015dd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:42.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.654+0000 7f0ab82f2640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0ab01552f0 0x7f0ab014c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:42.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.654+0000 7f0ab82f2640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0ab015b3f0 0x7f0ab014ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:42.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.654+0000 7f0ab82f2640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0ab015e7a0 con 0x7f0ab00b38f0 2024-04-22T07:18:42.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.654+0000 7f0ab82f2640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f0ab015e4c0 con 0x7f0ab015b3f0 2024-04-22T07:18:42.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.654+0000 7f0ab82f2640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f0ab015ea80 con 0x7f0ab01552f0 2024-04-22T07:18:42.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.654+0000 7f0ab608e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ab00b38f0 0x7f0ab015dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:42.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.654+0000 7f0ab608e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ab00b38f0 0x7f0ab015dd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54492/0 (socket says 172.21.15.37:54492) 2024-04-22T07:18:42.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.654+0000 7f0ab608e640 1 -- 172.21.15.37:0/3201949749 learned_addr learned my addr 172.21.15.37:0/3201949749 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:18:42.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.654+0000 7f0ab588d640 1 --2- 172.21.15.37:0/3201949749 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0ab01552f0 0x7f0ab014c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:42.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.654+0000 7f0ab688f640 1 --2- 172.21.15.37:0/3201949749 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0ab015b3f0 0x7f0ab014ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:42.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.654+0000 7f0ab608e640 1 -- 172.21.15.37:0/3201949749 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0ab01552f0 msgr2=0x7f0ab014c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:42.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.654+0000 7f0ab608e640 1 --2- 172.21.15.37:0/3201949749 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0ab01552f0 0x7f0ab014c790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:42.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.654+0000 7f0ab608e640 1 -- 172.21.15.37:0/3201949749 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0ab015b3f0 msgr2=0x7f0ab014ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:42.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.654+0000 7f0ab608e640 1 --2- 172.21.15.37:0/3201949749 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0ab015b3f0 0x7f0ab014ec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:42.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.654+0000 7f0ab608e640 1 -- 172.21.15.37:0/3201949749 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ab015cfd0 con 0x7f0ab00b38f0 2024-04-22T07:18:42.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.654+0000 7f0ab588d640 1 --2- 172.21.15.37:0/3201949749 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0ab01552f0 0x7f0ab014c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-22T07:18:42.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.655+0000 7f0ab608e640 1 --2- 172.21.15.37:0/3201949749 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ab00b38f0 0x7f0ab015dd30 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f0aac00c500 tx=0x7f0aac00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:42.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.655+0000 7f0aa6ffd640 1 -- 172.21.15.37:0/3201949749 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0aac018070 con 0x7f0ab00b38f0 2024-04-22T07:18:42.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.655+0000 7f0aa6ffd640 1 -- 172.21.15.37:0/3201949749 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0aac007580 con 0x7f0ab00b38f0 2024-04-22T07:18:42.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.655+0000 7f0ab82f2640 1 -- 172.21.15.37:0/3201949749 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ab015e270 con 0x7f0ab00b38f0 2024-04-22T07:18:42.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.655+0000 7f0aa6ffd640 1 -- 172.21.15.37:0/3201949749 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0aac004a20 con 0x7f0ab00b38f0 2024-04-22T07:18:42.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.655+0000 7f0ab82f2640 1 -- 172.21.15.37:0/3201949749 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ab01f4d30 con 0x7f0ab00b38f0 2024-04-22T07:18:42.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.656+0000 7f0ab82f2640 1 -- 172.21.15.37:0/3201949749 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ab006d030 con 0x7f0ab00b38f0 2024-04-22T07:18:42.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.656+0000 7f0aa6ffd640 1 -- 172.21.15.37:0/3201949749 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0aac01b070 con 0x7f0ab00b38f0 2024-04-22T07:18:42.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.657+0000 7f0aa6ffd640 1 --2- 172.21.15.37:0/3201949749 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f0a9406c8f0 0x7f0a9406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:42.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.657+0000 7f0aa6ffd640 1 -- 172.21.15.37:0/3201949749 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f0aac08ada0 con 0x7f0ab00b38f0 2024-04-22T07:18:42.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.657+0000 7f0ab588d640 1 --2- 172.21.15.37:0/3201949749 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f0a9406c8f0 0x7f0a9406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:42.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.657+0000 7f0ab588d640 1 --2- 172.21.15.37:0/3201949749 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f0a9406c8f0 0x7f0a9406edb0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f0aa0036000 tx=0x7f0aa0008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:42.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.661+0000 7f0aa6ffd640 1 -- 172.21.15.37:0/3201949749 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f0ab006d030 con 0x7f0ab00b38f0 2024-04-22T07:18:42.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.849+0000 7f0ab82f2640 1 -- 172.21.15.37:0/3201949749 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0ab0069520 con 0x7f0ab00b38f0 2024-04-22T07:18:42.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.850+0000 7f0aa6ffd640 1 -- 172.21.15.37:0/3201949749 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16581 (secure 0 0 0) 0x7f0ab0069520 con 0x7f0ab00b38f0 2024-04-22T07:18:42.848 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-22T07:18:42.848 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":20,"fsid":"10d90a41-52d3-4e09-8022-c8ac67897ad1","created":"2024-04-22T07:18:12.420756+0000","modified":"2024-04-22T07:18:37.754119+0000","last_up_change":"2024-04-22T07:18:23.649808+0000","last_in_change":"2024-04-22T07:18:14.506974+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-22T07:18:24.602243+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-22T07:18:34.673639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-22T07:18:35.055184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e248f6e1-13ad-48e0-a8f8-ec3059995654","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":1488290385},{"type":"v1","addr":"172.21.15.37:6801","nonce":1488290385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1488290385},{"type":"v1","addr":"172.21.15.37:6803","nonce":1488290385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1488290385},{"type":"v1","addr":"172.21.15.37:6807","nonce":1488290385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1488290385},{"type":"v1","addr":"172.21.15.37:6805","nonce":1488290385}]},"public_addr":"172.21.15.37:6801/1488290385","cluster_addr":"172.21.15.37:6803/1488290385","heartbeat_back_addr":"172.21.15.37:6807/1488290385","heartbeat_front_addr":"172.21.15.37:6805/1488290385","state":["exists","up"]},{"osd":1,"uuid":"01c71ab7-1326-432b-b73a-e5847abe5132","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3918584183},{"type":"v1","addr":"172.21.15.37:6811","nonce":3918584183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6813","nonce":3918584183},{"type":"v1","addr":"172.21.15.37:6816","nonce":3918584183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":3918584183},{"type":"v1","addr":"172.21.15.37:6823","nonce":3918584183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":3918584183},{"type":"v1","addr":"172.21.15.37:6821","nonce":3918584183}]},"public_addr":"172.21.15.37:6811/3918584183","cluster_addr":"172.21.15.37:6816/3918584183","heartbeat_back_addr":"172.21.15.37:6823/3918584183","heartbeat_front_addr":"172.21.15.37:6821/3918584183","state":["exists","up"]},{"osd":2,"uuid":"33a780fd-013a-41c8-9970-136c9e080897","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1895439419},{"type":"v1","addr":"172.21.15.37:6825","nonce":1895439419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1895439419},{"type":"v1","addr":"172.21.15.37:6827","nonce":1895439419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1895439419},{"type":"v1","addr":"172.21.15.37:6831","nonce":1895439419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1895439419},{"type":"v1","addr":"172.21.15.37:6829","nonce":1895439419}]},"public_addr":"172.21.15.37:6825/1895439419","cluster_addr":"172.21.15.37:6827/1895439419","heartbeat_back_addr":"172.21.15.37:6831/1895439419","heartbeat_front_addr":"172.21.15.37:6829/1895439419","state":["exists","up"]},{"osd":3,"uuid":"b46e53c4-e5b9-4098-b243-ab5a0f1f3885","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6809","nonce":1160021017},{"type":"v1","addr":"172.21.15.37:6810","nonce":1160021017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1160021017},{"type":"v1","addr":"172.21.15.37:6814","nonce":1160021017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":1160021017},{"type":"v1","addr":"172.21.15.37:6820","nonce":1160021017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6815","nonce":1160021017},{"type":"v1","addr":"172.21.15.37:6817","nonce":1160021017}]},"public_addr":"172.21.15.37:6810/1160021017","cluster_addr":"172.21.15.37:6814/1160021017","heartbeat_back_addr":"172.21.15.37:6820/1160021017","heartbeat_front_addr":"172.21.15.37:6817/1160021017","state":["exists","up"]},{"osd":4,"uuid":"cd1032c6-6a83-4e33-b7b1-baddf92a83af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":374829049},{"type":"v1","addr":"172.21.15.196:6809","nonce":374829049}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":374829049},{"type":"v1","addr":"172.21.15.196:6811","nonce":374829049}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":374829049},{"type":"v1","addr":"172.21.15.196:6815","nonce":374829049}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":374829049},{"type":"v1","addr":"172.21.15.196:6813","nonce":374829049}]},"public_addr":"172.21.15.196:6809/374829049","cluster_addr":"172.21.15.196:6811/374829049","heartbeat_back_addr":"172.21.15.196:6815/374829049","heartbeat_front_addr":"172.21.15.196:6813/374829049","state":["exists","up"]},{"osd":5,"uuid":"f561d48a-5f2d-4deb-8681-4329aed36bae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":479311302},{"type":"v1","addr":"172.21.15.196:6801","nonce":479311302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":479311302},{"type":"v1","addr":"172.21.15.196:6803","nonce":479311302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":479311302},{"type":"v1","addr":"172.21.15.196:6807","nonce":479311302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":479311302},{"type":"v1","addr":"172.21.15.196:6805","nonce":479311302}]},"public_addr":"172.21.15.196:6801/479311302","cluster_addr":"172.21.15.196:6803/479311302","heartbeat_back_addr":"172.21.15.196:6807/479311302","heartbeat_front_addr":"172.21.15.196:6805/479311302","state":["exists","up"]},{"osd":6,"uuid":"1b239c7e-2504-42e0-b308-70f4e62519c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6817","nonce":691777224},{"type":"v1","addr":"172.21.15.196:6819","nonce":691777224}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6821","nonce":691777224},{"type":"v1","addr":"172.21.15.196:6823","nonce":691777224}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6829","nonce":691777224},{"type":"v1","addr":"172.21.15.196:6831","nonce":691777224}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6825","nonce":691777224},{"type":"v1","addr":"172.21.15.196:6827","nonce":691777224}]},"public_addr":"172.21.15.196:6819/691777224","cluster_addr":"172.21.15.196:6823/691777224","heartbeat_back_addr":"172.21.15.196:6831/691777224","heartbeat_front_addr":"172.21.15.196:6827/691777224","state":["exists","up"]},{"osd":7,"uuid":"084318d4-d1fd-4b58-8c33-b1d7856fe323","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":3106266066},{"type":"v1","addr":"172.21.15.196:6818","nonce":3106266066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":3106266066},{"type":"v1","addr":"172.21.15.196:6822","nonce":3106266066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":3106266066},{"type":"v1","addr":"172.21.15.196:6830","nonce":3106266066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":3106266066},{"type":"v1","addr":"172.21.15.196:6826","nonce":3106266066}]},"public_addr":"172.21.15.196:6818/3106266066","cluster_addr":"172.21.15.196:6822/3106266066","heartbeat_back_addr":"172.21.15.196:6830/3106266066","heartbeat_front_addr":"172.21.15.196:6826/3106266066","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:18:19.587791+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:18:19.706541+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:18:19.690674+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:18:19.648354+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:18:19.666671+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:18:19.560709+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:18:19.661412+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:18:19.770650+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-22T07:18:42.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.852+0000 7f0ab82f2640 1 -- 172.21.15.37:0/3201949749 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f0a9406c8f0 msgr2=0x7f0a9406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:42.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.852+0000 7f0ab82f2640 1 --2- 172.21.15.37:0/3201949749 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f0a9406c8f0 0x7f0a9406edb0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f0aa0036000 tx=0x7f0aa0008030 comp rx=0 tx=0).stop 2024-04-22T07:18:42.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.852+0000 7f0ab82f2640 1 -- 172.21.15.37:0/3201949749 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ab00b38f0 msgr2=0x7f0ab015dd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:42.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.852+0000 7f0ab82f2640 1 --2- 172.21.15.37:0/3201949749 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ab00b38f0 0x7f0ab015dd30 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f0aac00c500 tx=0x7f0aac00c9c0 comp rx=0 tx=0).stop 2024-04-22T07:18:42.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.852+0000 7f0ab82f2640 1 -- 172.21.15.37:0/3201949749 shutdown_connections 2024-04-22T07:18:42.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.852+0000 7f0ab82f2640 1 --2- 172.21.15.37:0/3201949749 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f0a9406c8f0 0x7f0a9406edb0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:42.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.852+0000 7f0ab82f2640 1 --2- 172.21.15.37:0/3201949749 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0ab015b3f0 0x7f0ab014ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:42.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.852+0000 7f0ab82f2640 1 --2- 172.21.15.37:0/3201949749 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0ab01552f0 0x7f0ab014c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:42.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.852+0000 7f0ab82f2640 1 --2- 172.21.15.37:0/3201949749 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ab00b38f0 0x7f0ab015dd30 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:42.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.852+0000 7f0ab82f2640 1 -- 172.21.15.37:0/3201949749 >> 172.21.15.37:0/3201949749 conn(0x7f0ab0071f90 msgr2=0x7f0ab01528e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:42.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.852+0000 7f0ab82f2640 1 -- 172.21.15.37:0/3201949749 shutdown_connections 2024-04-22T07:18:42.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.852+0000 7f0ab82f2640 1 -- 172.21.15.37:0/3201949749 wait complete. 2024-04-22T07:18:42.861 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-04-22T07:18:42.861 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-22T07:18:42.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.963+0000 7fc78c5ce640 1 Processor -- start 2024-04-22T07:18:42.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.963+0000 7fc78c5ce640 1 -- start start 2024-04-22T07:18:42.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.964+0000 7fc78c5ce640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc7840b38f0 0x7fc78415aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:42.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.964+0000 7fc78c5ce640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc78415b3f0 0x7fc7840ccd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:42.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.964+0000 7fc78c5ce640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc78415f280 con 0x7fc7841552f0 2024-04-22T07:18:42.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.964+0000 7fc78c5ce640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fc7840b3100 con 0x7fc78415b3f0 2024-04-22T07:18:42.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.964+0000 7fc78c5ce640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fc7840cda00 con 0x7fc7840b38f0 2024-04-22T07:18:42.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.964+0000 7fc78ab6b640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc78415b3f0 0x7fc7840ccd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:42.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.964+0000 7fc78ab6b640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc78415b3f0 0x7fc7840ccd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54498/0 (socket says 172.21.15.37:54498) 2024-04-22T07:18:42.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.964+0000 7fc78ab6b640 1 -- 172.21.15.37:0/1074582949 learned_addr learned my addr 172.21.15.37:0/1074582949 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:18:42.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.964+0000 7fc789b69640 1 --2- 172.21.15.37:0/1074582949 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc7840b38f0 0x7fc78415aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:42.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.964+0000 7fc78ab6b640 1 -- 172.21.15.37:0/1074582949 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc7840b38f0 msgr2=0x7fc78415aeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:18:42.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.964+0000 7fc78ab6b640 1 --2- 172.21.15.37:0/1074582949 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc7840b38f0 0x7fc78415aeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:42.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.964+0000 7fc78ab6b640 1 -- 172.21.15.37:0/1074582949 >> v1:172.21.15.196:6789/0 conn(0x7fc7841552f0 legacy=0x7fc7840cb430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:18:42.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.964+0000 7fc78ab6b640 1 -- 172.21.15.37:0/1074582949 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7840b3350 con 0x7fc78415b3f0 2024-04-22T07:18:42.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.965+0000 7fc78ab6b640 1 --2- 172.21.15.37:0/1074582949 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc78415b3f0 0x7fc7840ccd10 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fc77c009870 tx=0x7fc77c02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76091a4b4717fda5 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:42.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.965+0000 7fc789368640 1 -- 172.21.15.37:0/1074582949 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc77c035020 con 0x7fc78415b3f0 2024-04-22T07:18:42.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.965+0000 7fc789368640 1 -- 172.21.15.37:0/1074582949 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc77c031640 con 0x7fc78415b3f0 2024-04-22T07:18:42.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.965+0000 7fc789368640 1 -- 172.21.15.37:0/1074582949 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc77c02d040 con 0x7fc78415b3f0 2024-04-22T07:18:42.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.966+0000 7fc78c5ce640 1 -- 172.21.15.37:0/1074582949 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc78415b3f0 msgr2=0x7fc7840ccd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:42.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.966+0000 7fc78c5ce640 1 --2- 172.21.15.37:0/1074582949 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc78415b3f0 0x7fc7840ccd10 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fc77c009870 tx=0x7fc77c02b8f0 comp rx=0 tx=0).stop 2024-04-22T07:18:42.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.966+0000 7fc78c5ce640 1 -- 172.21.15.37:0/1074582949 shutdown_connections 2024-04-22T07:18:42.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.966+0000 7fc78c5ce640 1 --2- 172.21.15.37:0/1074582949 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc78415b3f0 0x7fc7840ccd10 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:42.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.966+0000 7fc78c5ce640 1 --2- 172.21.15.37:0/1074582949 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc7840b38f0 0x7fc78415aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:42.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.966+0000 7fc78c5ce640 1 -- 172.21.15.37:0/1074582949 >> 172.21.15.37:0/1074582949 conn(0x7fc784071f90 msgr2=0x7fc7840723a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:42.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.966+0000 7fc78c5ce640 1 -- 172.21.15.37:0/1074582949 shutdown_connections 2024-04-22T07:18:42.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.966+0000 7fc78c5ce640 1 -- 172.21.15.37:0/1074582949 wait complete. 2024-04-22T07:18:42.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.967+0000 7fc78c5ce640 1 Processor -- start 2024-04-22T07:18:42.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.967+0000 7fc78c5ce640 1 -- start start 2024-04-22T07:18:42.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.968+0000 7fc78c5ce640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc7840b38f0 0x7fc78415a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:42.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.968+0000 7fc78c5ce640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7841552f0 0x7fc78415c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:42.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.968+0000 7fc78c5ce640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc78415b3f0 0x7fc784157c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:42.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.968+0000 7fc78c5ce640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc78415e7a0 con 0x7fc7841552f0 2024-04-22T07:18:42.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.968+0000 7fc78c5ce640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fc78415e4c0 con 0x7fc7840b38f0 2024-04-22T07:18:42.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.968+0000 7fc78c5ce640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fc78415ea80 con 0x7fc78415b3f0 2024-04-22T07:18:42.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.968+0000 7fc789b69640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7841552f0 0x7fc78415c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:42.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.968+0000 7fc789b69640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7841552f0 0x7fc78415c010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54506/0 (socket says 172.21.15.37:54506) 2024-04-22T07:18:42.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.968+0000 7fc789b69640 1 -- 172.21.15.37:0/533676144 learned_addr learned my addr 172.21.15.37:0/533676144 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:18:42.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.968+0000 7fc78ab6b640 1 --2- 172.21.15.37:0/533676144 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc78415b3f0 0x7fc784157c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:42.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.968+0000 7fc78a36a640 1 --2- 172.21.15.37:0/533676144 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc7840b38f0 0x7fc78415a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:42.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.968+0000 7fc789b69640 1 -- 172.21.15.37:0/533676144 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc78415b3f0 msgr2=0x7fc784157c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:42.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.968+0000 7fc789b69640 1 --2- 172.21.15.37:0/533676144 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc78415b3f0 0x7fc784157c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:42.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.968+0000 7fc789b69640 1 -- 172.21.15.37:0/533676144 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc7840b38f0 msgr2=0x7fc78415a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:42.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.968+0000 7fc789b69640 1 --2- 172.21.15.37:0/533676144 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc7840b38f0 0x7fc78415a850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:42.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.968+0000 7fc789b69640 1 -- 172.21.15.37:0/533676144 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc784150f50 con 0x7fc7841552f0 2024-04-22T07:18:42.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.969+0000 7fc789b69640 1 --2- 172.21.15.37:0/533676144 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7841552f0 0x7fc78415c010 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fc77800d830 tx=0x7fc77800dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:42.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.969+0000 7fc782ffd640 1 -- 172.21.15.37:0/533676144 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc77800b6c0 con 0x7fc7841552f0 2024-04-22T07:18:42.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.969+0000 7fc782ffd640 1 -- 172.21.15.37:0/533676144 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc778019070 con 0x7fc7841552f0 2024-04-22T07:18:42.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.969+0000 7fc78c5ce640 1 -- 172.21.15.37:0/533676144 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc784151230 con 0x7fc7841552f0 2024-04-22T07:18:42.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.969+0000 7fc782ffd640 1 -- 172.21.15.37:0/533676144 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc77800ba80 con 0x7fc7841552f0 2024-04-22T07:18:42.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.969+0000 7fc78c5ce640 1 -- 172.21.15.37:0/533676144 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7841502d0 con 0x7fc7841552f0 2024-04-22T07:18:42.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.970+0000 7fc78c5ce640 1 -- 172.21.15.37:0/533676144 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc784069cc0 con 0x7fc7841552f0 2024-04-22T07:18:42.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.970+0000 7fc782ffd640 1 -- 172.21.15.37:0/533676144 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc77800bc20 con 0x7fc7841552f0 2024-04-22T07:18:42.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.971+0000 7fc782ffd640 1 --2- 172.21.15.37:0/533676144 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fc77006c8f0 0x7fc77006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:42.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.971+0000 7fc782ffd640 1 -- 172.21.15.37:0/533676144 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fc77808bf30 con 0x7fc7841552f0 2024-04-22T07:18:42.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.971+0000 7fc78a36a640 1 --2- 172.21.15.37:0/533676144 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fc77006c8f0 0x7fc77006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:42.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.971+0000 7fc78a36a640 1 --2- 172.21.15.37:0/533676144 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fc77006c8f0 0x7fc77006edb0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc774005660 tx=0x7fc774003d90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:42.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:42.975+0000 7fc782ffd640 1 -- 172.21.15.37:0/533676144 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc778059c70 con 0x7fc7841552f0 2024-04-22T07:18:43.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.160+0000 7fc78c5ce640 1 -- 172.21.15.37:0/533676144 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc7840cbfe0 con 0x7fc7841552f0 2024-04-22T07:18:43.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.161+0000 7fc782ffd640 1 -- 172.21.15.37:0/533676144 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16581 (secure 0 0 0) 0x7fc77805df70 con 0x7fc7841552f0 2024-04-22T07:18:43.159 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-22T07:18:43.160 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":20,"fsid":"10d90a41-52d3-4e09-8022-c8ac67897ad1","created":"2024-04-22T07:18:12.420756+0000","modified":"2024-04-22T07:18:37.754119+0000","last_up_change":"2024-04-22T07:18:23.649808+0000","last_in_change":"2024-04-22T07:18:14.506974+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-22T07:18:24.602243+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-22T07:18:34.673639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-22T07:18:35.055184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e248f6e1-13ad-48e0-a8f8-ec3059995654","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":1488290385},{"type":"v1","addr":"172.21.15.37:6801","nonce":1488290385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1488290385},{"type":"v1","addr":"172.21.15.37:6803","nonce":1488290385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1488290385},{"type":"v1","addr":"172.21.15.37:6807","nonce":1488290385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1488290385},{"type":"v1","addr":"172.21.15.37:6805","nonce":1488290385}]},"public_addr":"172.21.15.37:6801/1488290385","cluster_addr":"172.21.15.37:6803/1488290385","heartbeat_back_addr":"172.21.15.37:6807/1488290385","heartbeat_front_addr":"172.21.15.37:6805/1488290385","state":["exists","up"]},{"osd":1,"uuid":"01c71ab7-1326-432b-b73a-e5847abe5132","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3918584183},{"type":"v1","addr":"172.21.15.37:6811","nonce":3918584183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6813","nonce":3918584183},{"type":"v1","addr":"172.21.15.37:6816","nonce":3918584183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":3918584183},{"type":"v1","addr":"172.21.15.37:6823","nonce":3918584183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":3918584183},{"type":"v1","addr":"172.21.15.37:6821","nonce":3918584183}]},"public_addr":"172.21.15.37:6811/3918584183","cluster_addr":"172.21.15.37:6816/3918584183","heartbeat_back_addr":"172.21.15.37:6823/3918584183","heartbeat_front_addr":"172.21.15.37:6821/3918584183","state":["exists","up"]},{"osd":2,"uuid":"33a780fd-013a-41c8-9970-136c9e080897","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1895439419},{"type":"v1","addr":"172.21.15.37:6825","nonce":1895439419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1895439419},{"type":"v1","addr":"172.21.15.37:6827","nonce":1895439419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1895439419},{"type":"v1","addr":"172.21.15.37:6831","nonce":1895439419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1895439419},{"type":"v1","addr":"172.21.15.37:6829","nonce":1895439419}]},"public_addr":"172.21.15.37:6825/1895439419","cluster_addr":"172.21.15.37:6827/1895439419","heartbeat_back_addr":"172.21.15.37:6831/1895439419","heartbeat_front_addr":"172.21.15.37:6829/1895439419","state":["exists","up"]},{"osd":3,"uuid":"b46e53c4-e5b9-4098-b243-ab5a0f1f3885","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6809","nonce":1160021017},{"type":"v1","addr":"172.21.15.37:6810","nonce":1160021017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1160021017},{"type":"v1","addr":"172.21.15.37:6814","nonce":1160021017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":1160021017},{"type":"v1","addr":"172.21.15.37:6820","nonce":1160021017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6815","nonce":1160021017},{"type":"v1","addr":"172.21.15.37:6817","nonce":1160021017}]},"public_addr":"172.21.15.37:6810/1160021017","cluster_addr":"172.21.15.37:6814/1160021017","heartbeat_back_addr":"172.21.15.37:6820/1160021017","heartbeat_front_addr":"172.21.15.37:6817/1160021017","state":["exists","up"]},{"osd":4,"uuid":"cd1032c6-6a83-4e33-b7b1-baddf92a83af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":374829049},{"type":"v1","addr":"172.21.15.196:6809","nonce":374829049}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":374829049},{"type":"v1","addr":"172.21.15.196:6811","nonce":374829049}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":374829049},{"type":"v1","addr":"172.21.15.196:6815","nonce":374829049}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":374829049},{"type":"v1","addr":"172.21.15.196:6813","nonce":374829049}]},"public_addr":"172.21.15.196:6809/374829049","cluster_addr":"172.21.15.196:6811/374829049","heartbeat_back_addr":"172.21.15.196:6815/374829049","heartbeat_front_addr":"172.21.15.196:6813/374829049","state":["exists","up"]},{"osd":5,"uuid":"f561d48a-5f2d-4deb-8681-4329aed36bae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":479311302},{"type":"v1","addr":"172.21.15.196:6801","nonce":479311302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":479311302},{"type":"v1","addr":"172.21.15.196:6803","nonce":479311302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":479311302},{"type":"v1","addr":"172.21.15.196:6807","nonce":479311302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":479311302},{"type":"v1","addr":"172.21.15.196:6805","nonce":479311302}]},"public_addr":"172.21.15.196:6801/479311302","cluster_addr":"172.21.15.196:6803/479311302","heartbeat_back_addr":"172.21.15.196:6807/479311302","heartbeat_front_addr":"172.21.15.196:6805/479311302","state":["exists","up"]},{"osd":6,"uuid":"1b239c7e-2504-42e0-b308-70f4e62519c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6817","nonce":691777224},{"type":"v1","addr":"172.21.15.196:6819","nonce":691777224}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6821","nonce":691777224},{"type":"v1","addr":"172.21.15.196:6823","nonce":691777224}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6829","nonce":691777224},{"type":"v1","addr":"172.21.15.196:6831","nonce":691777224}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6825","nonce":691777224},{"type":"v1","addr":"172.21.15.196:6827","nonce":691777224}]},"public_addr":"172.21.15.196:6819/691777224","cluster_addr":"172.21.15.196:6823/691777224","heartbeat_back_addr":"172.21.15.196:6831/691777224","heartbeat_front_addr":"172.21.15.196:6827/691777224","state":["exists","up"]},{"osd":7,"uuid":"084318d4-d1fd-4b58-8c33-b1d7856fe323","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":3106266066},{"type":"v1","addr":"172.21.15.196:6818","nonce":3106266066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":3106266066},{"type":"v1","addr":"172.21.15.196:6822","nonce":3106266066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":3106266066},{"type":"v1","addr":"172.21.15.196:6830","nonce":3106266066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":3106266066},{"type":"v1","addr":"172.21.15.196:6826","nonce":3106266066}]},"public_addr":"172.21.15.196:6818/3106266066","cluster_addr":"172.21.15.196:6822/3106266066","heartbeat_back_addr":"172.21.15.196:6830/3106266066","heartbeat_front_addr":"172.21.15.196:6826/3106266066","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:18:19.587791+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:18:19.706541+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:18:19.690674+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:18:19.648354+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:18:19.666671+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:18:19.560709+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:18:19.661412+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:18:19.770650+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-22T07:18:43.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.163+0000 7fc78c5ce640 1 -- 172.21.15.37:0/533676144 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fc77006c8f0 msgr2=0x7fc77006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:43.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.163+0000 7fc78c5ce640 1 --2- 172.21.15.37:0/533676144 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fc77006c8f0 0x7fc77006edb0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc774005660 tx=0x7fc774003d90 comp rx=0 tx=0).stop 2024-04-22T07:18:43.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.163+0000 7fc78c5ce640 1 -- 172.21.15.37:0/533676144 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7841552f0 msgr2=0x7fc78415c010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:43.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.163+0000 7fc78c5ce640 1 --2- 172.21.15.37:0/533676144 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7841552f0 0x7fc78415c010 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fc77800d830 tx=0x7fc77800dcf0 comp rx=0 tx=0).stop 2024-04-22T07:18:43.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.163+0000 7fc78c5ce640 1 -- 172.21.15.37:0/533676144 shutdown_connections 2024-04-22T07:18:43.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.163+0000 7fc78c5ce640 1 --2- 172.21.15.37:0/533676144 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fc77006c8f0 0x7fc77006edb0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:43.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.163+0000 7fc78c5ce640 1 --2- 172.21.15.37:0/533676144 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc78415b3f0 0x7fc784157c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:43.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.163+0000 7fc78c5ce640 1 --2- 172.21.15.37:0/533676144 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7841552f0 0x7fc78415c010 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:43.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.163+0000 7fc78c5ce640 1 --2- 172.21.15.37:0/533676144 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc7840b38f0 0x7fc78415a850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:43.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.163+0000 7fc78c5ce640 1 -- 172.21.15.37:0/533676144 >> 172.21.15.37:0/533676144 conn(0x7fc784071f90 msgr2=0x7fc7841531f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:43.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.163+0000 7fc78c5ce640 1 -- 172.21.15.37:0/533676144 shutdown_connections 2024-04-22T07:18:43.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.163+0000 7fc78c5ce640 1 -- 172.21.15.37:0/533676144 wait complete. 2024-04-22T07:18:43.175 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-04-22T07:18:43.176 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-04-22T07:18:43.176 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-04-22T07:18:43.177 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-04-22T07:18:43.177 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-04-22T07:18:43.177 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-04-22T07:18:43.178 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-04-22T07:18:43.178 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-04-22T07:18:43.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.354+0000 7f980e02a640 1 Processor -- start 2024-04-22T07:18:43.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.354+0000 7f980e02a640 1 -- start start 2024-04-22T07:18:43.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.354+0000 7fb17ca81640 1 Processor -- start 2024-04-22T07:18:43.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.354+0000 7efe27fe6640 1 Processor -- start 2024-04-22T07:18:43.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.355+0000 7f980e02a640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f980004c470 0x7f98000e00c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:43.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.354+0000 7efe27fe6640 1 -- start start 2024-04-22T07:18:43.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.356+0000 7efe27fe6640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7efe1804b500 0x7efe180dac60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:43.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.356+0000 7efe27fe6640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7efe1804b8e0 0x7efe18005e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:43.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.356+0000 7efe27fe6640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe18007710 con 0x7efe180063d0 2024-04-22T07:18:43.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.356+0000 7efe27fe6640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7efe180068b0 con 0x7efe1804b8e0 2024-04-22T07:18:43.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.356+0000 7efe27fe6640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7efe18006b90 con 0x7efe1804b500 2024-04-22T07:18:43.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.357+0000 7efe26583640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7efe180063d0 0x7efe18034a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.37:54090/0 (socket says 172.21.15.37:54090) 2024-04-22T07:18:43.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.357+0000 7efe26583640 1 -- 172.21.15.37:0/1444627971 learned_addr learned my addr 172.21.15.37:0/1444627971 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-04-22T07:18:43.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.355+0000 7f3fad50b640 1 Processor -- start 2024-04-22T07:18:43.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.356+0000 7f3fad50b640 1 -- start start 2024-04-22T07:18:43.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.355+0000 7f980e02a640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f98000d71b0 con 0x7f98000d6dd0 2024-04-22T07:18:43.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.355+0000 7f980e02a640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9800007700 con 0x7f98000e0600 2024-04-22T07:18:43.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.355+0000 7f980e02a640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f980004b580 con 0x7f980004c470 2024-04-22T07:18:43.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.356+0000 7f980d028640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f98000d6dd0 0x7f98000332b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:56504/0 (socket says 172.21.15.37:56504) 2024-04-22T07:18:43.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.356+0000 7f980d028640 1 -- 172.21.15.37:0/1036874749 learned_addr learned my addr 172.21.15.37:0/1036874749 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-04-22T07:18:43.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.356+0000 7f980c827640 1 --2- 172.21.15.37:0/1036874749 >> v2:172.21.15.196:3300/0 conn(0x7f980004c470 0x7f98000e00c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:43.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.357+0000 7f980c827640 1 -- 172.21.15.37:0/1036874749 >> v1:172.21.15.196:6789/0 conn(0x7f98000e0600 legacy=0x7f98000e0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:18:43.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.357+0000 7f97fffff640 1 -- 172.21.15.37:0/1036874749 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3405230514 0 0) 0x7f98000d71b0 con 0x7f98000d6dd0 2024-04-22T07:18:43.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.357+0000 7f980c827640 1 -- 172.21.15.37:0/1036874749 >> v1:172.21.15.37:6789/0 conn(0x7f98000d6dd0 legacy=0x7f98000332b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:43.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.355+0000 7f4ac8a32640 1 Processor -- start 2024-04-22T07:18:43.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.357+0000 7fd00e392640 1 Processor -- start 2024-04-22T07:18:43.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.354+0000 7fb17ca81640 1 -- start start 2024-04-22T07:18:43.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.355+0000 7fb17ca81640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fb17004ba60 0x7fb17004be80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:43.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.355+0000 7fb17ca81640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb1700e3090 0x7fb1700e3500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:43.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.355+0000 7fb17ca81640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb170046b70 con 0x7fb1700dd3c0 2024-04-22T07:18:43.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.355+0000 7fb17ca81640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7fb170045450 con 0x7fb17004ba60 2024-04-22T07:18:43.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.355+0000 7fb17ca81640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fb170045fd0 con 0x7fb1700e3090 2024-04-22T07:18:43.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.356+0000 7fb17659c640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fb1700dd3c0 0x7fb170046460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:56490/0 (socket says 172.21.15.37:56490) 2024-04-22T07:18:43.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.356+0000 7fb17659c640 1 -- 172.21.15.37:0/1337048759 learned_addr learned my addr 172.21.15.37:0/1337048759 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-04-22T07:18:43.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.356+0000 7fb175d9b640 1 --2- 172.21.15.37:0/1337048759 >> v2:172.21.15.196:3300/0 conn(0x7fb17004ba60 0x7fb17004be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:43.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.356+0000 7fb176d9d640 1 --2- 172.21.15.37:0/1337048759 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb1700e3090 0x7fb1700e3500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:43.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.356+0000 7fb175d9b640 1 -- 172.21.15.37:0/1337048759 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb1700e3090 msgr2=0x7fb1700e3500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:18:43.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.356+0000 7fb175d9b640 1 --2- 172.21.15.37:0/1337048759 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb1700e3090 0x7fb1700e3500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:43.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.356+0000 7fb175d9b640 1 -- 172.21.15.37:0/1337048759 >> v1:172.21.15.37:6789/0 conn(0x7fb1700dd3c0 legacy=0x7fb170046460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:43.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.356+0000 7fb175d9b640 1 -- 172.21.15.37:0/1337048759 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1700dd7a0 con 0x7fb17004ba60 2024-04-22T07:18:43.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.356+0000 7fb176d9d640 1 --2- 172.21.15.37:0/1337048759 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb1700e3090 0x7fb1700e3500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T07:18:43.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.356+0000 7fc7fd855640 1 Processor -- start 2024-04-22T07:18:43.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.356+0000 7fc7fd855640 1 -- start start 2024-04-22T07:18:43.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.357+0000 7f3fad50b640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f3fa80cc890 0x7f3fa80d06a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:43.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.357+0000 7f3fad50b640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3fa80d0f70 con 0x7f3fa8155270 2024-04-22T07:18:43.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.357+0000 7f3fad50b640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3fa815b040 con 0x7f3fa80ccc70 2024-04-22T07:18:43.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.357+0000 7f3fad50b640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f3fa815b320 con 0x7f3fa80cc890 2024-04-22T07:18:43.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.357+0000 7f3facd0a640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f3fa8155270 0x7f3fa815e520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:56512/0 (socket says 172.21.15.37:56512) 2024-04-22T07:18:43.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.357+0000 7f3facd0a640 1 -- 172.21.15.37:0/1796450945 learned_addr learned my addr 172.21.15.37:0/1796450945 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-04-22T07:18:43.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.357+0000 7efe25581640 1 --2- 172.21.15.37:0/1444627971 >> v2:172.21.15.37:3300/0 conn(0x7efe1804b8e0 0x7efe18005e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:43.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.357+0000 7f3fa7fff640 1 --2- 172.21.15.37:0/1796450945 >> v2:172.21.15.37:3300/0 conn(0x7f3fa80cc890 0x7f3fa80d06a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:43.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.356+0000 7f4ac8a32640 1 -- start start 2024-04-22T07:18:43.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.357+0000 7f4ac8a32640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f4ac4154f60 0x7f4ac40cd7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:43.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.357+0000 7f4ac8a32640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f4ac40c5800 0x7f4ac40d0530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:43.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.357+0000 7f4ac8a32640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4ac40d0a70 0x7f4ac415e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:43.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.357+0000 7f4ac8a32640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f4ac415ee40 con 0x7f4ac4154f60 2024-04-22T07:18:43.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.357+0000 7f4ac8a32640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f4ac415f120 con 0x7f4ac40c5800 2024-04-22T07:18:43.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.357+0000 7f4ac8a32640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f4ac40cca20 con 0x7f4ac40d0a70 2024-04-22T07:18:43.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.357+0000 7efe25d82640 1 --2- 172.21.15.37:0/1444627971 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7efe1804b500 0x7efe180dac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:43.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.358+0000 7fc7fd855640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc7f80ca360 0x7fc7f80ca740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:43.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.358+0000 7fb175d9b640 1 --2- 172.21.15.37:0/1337048759 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb17004ba60 0x7fb17004be80 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb16c0097a0 tx=0x7fb16c02b8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4bf1aa721e14ef73 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:43.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.358+0000 7f4ac2d9d640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4ac40d0a70 0x7f4ac415e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:43.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.358+0000 7f4ac2d9d640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4ac40d0a70 0x7f4ac415e2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.37:53960/0 (socket says 172.21.15.37:53960) 2024-04-22T07:18:43.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.358+0000 7f4ac2d9d640 1 -- 172.21.15.37:0/2451317889 learned_addr learned my addr 172.21.15.37:0/2451317889 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:18:43.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.358+0000 7f3fa7fff640 1 -- 172.21.15.37:0/1796450945 >> v1:172.21.15.196:6789/0 conn(0x7f3fa80ccc70 legacy=0x7f3fa8154b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:43.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.358+0000 7f3fa7fff640 1 -- 172.21.15.37:0/1796450945 >> v1:172.21.15.37:6789/0 conn(0x7f3fa8155270 legacy=0x7f3fa815e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:43.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.358+0000 7f3fa7fff640 1 -- 172.21.15.37:0/1796450945 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fa815b600 con 0x7f3fa80cc890 2024-04-22T07:18:43.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.357+0000 7f980c827640 1 -- 172.21.15.37:0/1036874749 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f980004b860 con 0x7f980004c470 2024-04-22T07:18:43.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.358+0000 7efe25581640 1 -- 172.21.15.37:0/1444627971 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7efe1804b500 msgr2=0x7efe180dac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:18:43.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.358+0000 7efe25581640 1 --2- 172.21.15.37:0/1444627971 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7efe1804b500 0x7efe180dac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:43.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.358+0000 7efe25581640 1 -- 172.21.15.37:0/1444627971 >> v1:172.21.15.196:6789/0 conn(0x7efe180063d0 legacy=0x7efe18034a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:43.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.358+0000 7efe25581640 1 -- 172.21.15.37:0/1444627971 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe18006e70 con 0x7efe1804b8e0 2024-04-22T07:18:43.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.357+0000 7fd00e392640 1 -- start start 2024-04-22T07:18:43.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.358+0000 7f4ac259c640 1 --2- 172.21.15.37:0/2451317889 >> v2:172.21.15.37:3300/0 conn(0x7f4ac4154f60 0x7f4ac40cd7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:43.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.358+0000 7fd00e392640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fd0080b3180 0x7fd0080c9eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:43.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.358+0000 7fd00e392640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0080b3750 con 0x7fd00815fc80 2024-04-22T07:18:43.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.358+0000 7fd00e392640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0080c8e10 con 0x7fd008160060 2024-04-22T07:18:43.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.358+0000 7fd00e392640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7fd0080c90f0 con 0x7fd0080b3180 2024-04-22T07:18:43.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.359+0000 7fd00db91640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fd0080b3180 0x7fd0080c9eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:43.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.359+0000 7fd00db91640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fd0080b3180 0x7fd0080c9eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.37:34508/0 (socket says 172.21.15.37:34508) 2024-04-22T07:18:43.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.359+0000 7fd00db91640 1 -- 172.21.15.37:0/582878019 learned_addr learned my addr 172.21.15.37:0/582878019 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:18:43.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.358+0000 7fc7f6ffd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc7f80ca360 0x7fc7f80ca740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:43.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.358+0000 7fc7f6ffd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc7f80ca360 0x7fc7f80ca740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54554/0 (socket says 172.21.15.37:54554) 2024-04-22T07:18:43.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.358+0000 7fc7fd855640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fc7f815f9e0 0x7fc7f8162f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:43.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.358+0000 7fc7fd855640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc7f8159730 con 0x7fc7f806dd10 2024-04-22T07:18:43.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.358+0000 7fc7fd855640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fc7f8163490 con 0x7fc7f80ca360 2024-04-22T07:18:43.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.358+0000 7fc7fd855640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7fc7f8162500 con 0x7fc7f815f9e0 2024-04-22T07:18:43.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.358+0000 7fc7f6ffd640 1 -- 172.21.15.37:0/509233317 learned_addr learned my addr 172.21.15.37:0/509233317 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:18:43.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.359+0000 7fc7f7fff640 1 --2- 172.21.15.37:0/509233317 >> v2:172.21.15.196:3300/0 conn(0x7fc7f815f9e0 0x7fc7f8162f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:43.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.359+0000 7fb17559a640 1 -- 172.21.15.37:0/1337048759 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb16c035020 con 0x7fb17004ba60 2024-04-22T07:18:43.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.359+0000 7fb17559a640 1 -- 172.21.15.37:0/1337048759 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb16c031810 con 0x7fb17004ba60 2024-04-22T07:18:43.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.359+0000 7fb17559a640 1 -- 172.21.15.37:0/1337048759 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb16c031be0 con 0x7fb17004ba60 2024-04-22T07:18:43.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.359+0000 7fc7f6ffd640 1 -- 172.21.15.37:0/509233317 >> v2:172.21.15.196:3300/0 conn(0x7fc7f815f9e0 msgr2=0x7fc7f8162f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:18:43.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.359+0000 7fc7f6ffd640 1 --2- 172.21.15.37:0/509233317 >> v2:172.21.15.196:3300/0 conn(0x7fc7f815f9e0 0x7fc7f8162f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:43.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.359+0000 7fc7f6ffd640 1 -- 172.21.15.37:0/509233317 >> v1:172.21.15.196:6789/0 conn(0x7fc7f806dd10 legacy=0x7fc7f8070970 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T07:18:43.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.359+0000 7fc7f6ffd640 1 -- 172.21.15.37:0/509233317 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7f815ff20 con 0x7fc7f80ca360 2024-04-22T07:18:43.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.359+0000 7fc7f7fff640 1 --2- 172.21.15.37:0/509233317 >> v2:172.21.15.196:3300/0 conn(0x7fc7f815f9e0 0x7fc7f8162f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T07:18:43.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.359+0000 7f1a71006640 1 Processor -- start 2024-04-22T07:18:43.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.359+0000 7f980c827640 1 --2- 172.21.15.37:0/1036874749 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f980004c470 0x7f98000e00c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f9808050f50 tx=0x7f98080a7bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b9f6afd97d4ded50 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:43.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.359+0000 7fd00db91640 1 -- 172.21.15.37:0/582878019 >> v1:172.21.15.196:6789/0 conn(0x7fd008160060 legacy=0x7fd00806b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:43.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.359+0000 7f1a71006640 1 -- start start 2024-04-22T07:18:43.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.359+0000 7f97fffff640 1 -- 172.21.15.37:0/1036874749 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98080b5070 con 0x7f980004c470 2024-04-22T07:18:43.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.358+0000 7f4ac2d9d640 1 -- 172.21.15.37:0/2451317889 >> v2:172.21.15.196:3300/0 conn(0x7f4ac40c5800 msgr2=0x7f4ac40d0530 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-22T07:18:43.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.359+0000 7efe25581640 1 --2- 172.21.15.37:0/1444627971 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efe1804b8e0 0x7efe18005e90 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7efe100097a0 tx=0x7efe1002ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb61cc8535f03c7d server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:43.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.359+0000 7f97fffff640 1 -- 172.21.15.37:0/1036874749 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98080a8a80 con 0x7f980004c470 2024-04-22T07:18:43.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.358+0000 7f4ac2d9d640 1 --2- 172.21.15.37:0/2451317889 >> v2:172.21.15.196:3300/0 conn(0x7f4ac40c5800 0x7f4ac40d0530 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:43.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.358+0000 7f4ac2d9d640 1 -- 172.21.15.37:0/2451317889 >> v2:172.21.15.37:3300/0 conn(0x7f4ac4154f60 msgr2=0x7f4ac40cd7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:18:43.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.358+0000 7f4ac2d9d640 1 --2- 172.21.15.37:0/2451317889 >> v2:172.21.15.37:3300/0 conn(0x7f4ac4154f60 0x7f4ac40cd7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:43.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.358+0000 7f4ac2d9d640 1 -- 172.21.15.37:0/2451317889 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ac40ccd00 con 0x7f4ac40d0a70 2024-04-22T07:18:43.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.359+0000 7fd00db91640 1 -- 172.21.15.37:0/582878019 >> v1:172.21.15.37:6789/0 conn(0x7fd00815fc80 legacy=0x7fd0080cb870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:43.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.359+0000 7fd00db91640 1 -- 172.21.15.37:0/582878019 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0080c93d0 con 0x7fd0080b3180 2024-04-22T07:18:43.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.359+0000 7fd007fff640 1 -- 172.21.15.37:0/582878019 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3496694745 0 0) 0x7fd0080c8e10 con 0x7fd008160060 2024-04-22T07:18:43.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.360+0000 7f97fffff640 1 -- 172.21.15.37:0/1036874749 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98080b0440 con 0x7f980004c470 2024-04-22T07:18:43.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.360+0000 7efe24d80640 1 -- 172.21.15.37:0/1444627971 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe10030830 con 0x7efe1804b8e0 2024-04-22T07:18:43.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.360+0000 7fb17ca81640 1 -- 172.21.15.37:0/1337048759 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb17004ba60 msgr2=0x7fb17004be80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:43.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.360+0000 7fb17ca81640 1 --2- 172.21.15.37:0/1337048759 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb17004ba60 0x7fb17004be80 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb16c0097a0 tx=0x7fb16c02b8b0 comp rx=0 tx=0).stop 2024-04-22T07:18:43.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.360+0000 7f4ac2d9d640 1 --2- 172.21.15.37:0/2451317889 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4ac40d0a70 0x7f4ac415e2b0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f4ac40ce450 tx=0x7f4abc02bf00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3fdb3a8d24561a34 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:43.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.360+0000 7fc7f6ffd640 1 --2- 172.21.15.37:0/509233317 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7f80ca360 0x7fc7f80ca740 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fc7f8072f10 tx=0x7fc7ec02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfdbc5998bda13 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:43.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.360+0000 7f3fa7fff640 1 --2- 172.21.15.37:0/1796450945 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3fa80cc890 0x7f3fa80d06a0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f3f98009720 tx=0x7f3f9802b7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25cbad2aa67d77da server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:43.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.360+0000 7fb17ca81640 1 -- 172.21.15.37:0/1337048759 shutdown_connections 2024-04-22T07:18:43.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.360+0000 7fb17ca81640 1 --2- 172.21.15.37:0/1337048759 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb1700e3090 0x7fb1700e3500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:43.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.360+0000 7fd00db91640 1 --2- 172.21.15.37:0/582878019 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd0080b3180 0x7fd0080c9eb0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd000009e50 tx=0x7fd00002c010 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bfb69ca95cf6d756 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:43.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.360+0000 7f4ac159a640 1 -- 172.21.15.37:0/2451317889 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4abc02caa0 con 0x7f4ac40d0a70 2024-04-22T07:18:43.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.360+0000 7f4ac159a640 1 -- 172.21.15.37:0/2451317889 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4abc02cc40 con 0x7f4ac40d0a70 2024-04-22T07:18:43.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.360+0000 7f4ac159a640 1 -- 172.21.15.37:0/2451317889 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4abc0343f0 con 0x7f4ac40d0a70 2024-04-22T07:18:43.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.360+0000 7fb17ca81640 1 --2- 172.21.15.37:0/1337048759 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb17004ba60 0x7fb17004be80 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:43.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.360+0000 7efe24d80640 1 -- 172.21.15.37:0/1444627971 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe100309d0 con 0x7efe1804b8e0 2024-04-22T07:18:43.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.361+0000 7efe24d80640 1 -- 172.21.15.37:0/1444627971 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe10030da0 con 0x7efe1804b8e0 2024-04-22T07:18:43.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.360+0000 7fb17ca81640 1 -- 172.21.15.37:0/1337048759 >> 172.21.15.37:0/1337048759 conn(0x7fb170050180 msgr2=0x7fb170050590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:43.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.360+0000 7f1a71006640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1a6c152c00 0x7f1a6c0c2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:43.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.361+0000 7fc7f5ffb640 1 -- 172.21.15.37:0/509233317 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7ec035020 con 0x7fc7f80ca360 2024-04-22T07:18:43.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.361+0000 7fc7f5ffb640 1 -- 172.21.15.37:0/509233317 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7ec031870 con 0x7fc7f80ca360 2024-04-22T07:18:43.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.361+0000 7fc7f5ffb640 1 -- 172.21.15.37:0/509233317 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7ec031c40 con 0x7fc7f80ca360 2024-04-22T07:18:43.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.360+0000 7f1a71006640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f1a6c0c4980 0x7f1a6c0c7fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:43.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.360+0000 7f1a71006640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1a6c0c62e0 0x7f1a6c0c84e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:43.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.360+0000 7fb17ca81640 1 -- 172.21.15.37:0/1337048759 shutdown_connections 2024-04-22T07:18:43.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.360+0000 7fb17ca81640 1 -- 172.21.15.37:0/1337048759 wait complete. 2024-04-22T07:18:43.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.360+0000 7f1a71006640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f1a6c0c6a60 con 0x7f1a6c0c62e0 2024-04-22T07:18:43.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.361+0000 7f3fa6ffd640 1 -- 172.21.15.37:0/1796450945 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f98038070 con 0x7f3fa80cc890 2024-04-22T07:18:43.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.361+0000 7f3fa6ffd640 1 -- 172.21.15.37:0/1796450945 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f98031520 con 0x7f3fa80cc890 2024-04-22T07:18:43.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.361+0000 7f3fa6ffd640 1 -- 172.21.15.37:0/1796450945 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f980318f0 con 0x7f3fa80cc890 2024-04-22T07:18:43.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.361+0000 7f980e02a640 1 -- 172.21.15.37:0/1036874749 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f980004c470 msgr2=0x7f98000e00c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:43.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.361+0000 7f980e02a640 1 --2- 172.21.15.37:0/1036874749 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f980004c470 0x7f98000e00c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f9808050f50 tx=0x7f98080a7bd0 comp rx=0 tx=0).stop 2024-04-22T07:18:43.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.361+0000 7f980e02a640 1 -- 172.21.15.37:0/1036874749 shutdown_connections 2024-04-22T07:18:43.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.361+0000 7f980e02a640 1 --2- 172.21.15.37:0/1036874749 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f980004c470 0x7f98000e00c0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:43.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.361+0000 7f980e02a640 1 -- 172.21.15.37:0/1036874749 >> 172.21.15.37:0/1036874749 conn(0x7f9800050180 msgr2=0x7f9800050590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:43.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.361+0000 7f1a71006640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f1a6c0c3b70 con 0x7f1a6c0c4980 2024-04-22T07:18:43.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.361+0000 7f1a71006640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f1a6c0c3560 con 0x7f1a6c152c00 2024-04-22T07:18:43.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.361+0000 7f1a6a59c640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f1a6c0c4980 0x7f1a6c0c7fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:43.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.361+0000 7f1a6a59c640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f1a6c0c4980 0x7f1a6c0c7fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.37:34532/0 (socket says 172.21.15.37:34532) 2024-04-22T07:18:43.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.361+0000 7f1a6a59c640 1 -- 172.21.15.37:0/2992033335 learned_addr learned my addr 172.21.15.37:0/2992033335 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:18:43.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.361+0000 7f1a6b59e640 1 --2- 172.21.15.37:0/2992033335 >> v2:172.21.15.37:3300/0 conn(0x7f1a6c0c62e0 0x7f1a6c0c84e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:43.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.361+0000 7f980e02a640 1 -- 172.21.15.37:0/1036874749 shutdown_connections 2024-04-22T07:18:43.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.361+0000 7f4ac8a32640 1 -- 172.21.15.37:0/2451317889 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4ac40d0a70 msgr2=0x7f4ac415e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:43.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.361+0000 7f4ac8a32640 1 --2- 172.21.15.37:0/2451317889 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4ac40d0a70 0x7f4ac415e2b0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f4ac40ce450 tx=0x7f4abc02bf00 comp rx=0 tx=0).stop 2024-04-22T07:18:43.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.361+0000 7efe27fe6640 1 -- 172.21.15.37:0/1444627971 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efe1804b8e0 msgr2=0x7efe18005e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:43.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.361+0000 7efe27fe6640 1 --2- 172.21.15.37:0/1444627971 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efe1804b8e0 0x7efe18005e90 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7efe100097a0 tx=0x7efe1002ca90 comp rx=0 tx=0).stop 2024-04-22T07:18:43.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.362+0000 7f980e02a640 1 -- 172.21.15.37:0/1036874749 wait complete. 2024-04-22T07:18:43.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.362+0000 7f4ac8a32640 1 -- 172.21.15.37:0/2451317889 shutdown_connections 2024-04-22T07:18:43.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.362+0000 7efe27fe6640 1 -- 172.21.15.37:0/1444627971 shutdown_connections 2024-04-22T07:18:43.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.362+0000 7efe27fe6640 1 --2- 172.21.15.37:0/1444627971 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efe1804b8e0 0x7efe18005e90 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:43.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.362+0000 7efe27fe6640 1 --2- 172.21.15.37:0/1444627971 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7efe1804b500 0x7efe180dac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:43.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.362+0000 7efe27fe6640 1 -- 172.21.15.37:0/1444627971 >> 172.21.15.37:0/1444627971 conn(0x7efe18050180 msgr2=0x7efe18050590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:43.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.362+0000 7f4ac8a32640 1 --2- 172.21.15.37:0/2451317889 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4ac40d0a70 0x7f4ac415e2b0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:43.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.362+0000 7f4ac8a32640 1 --2- 172.21.15.37:0/2451317889 >> v2:172.21.15.196:3300/0 conn(0x7f4ac40c5800 0x7f4ac40d0530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:43.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.362+0000 7f4ac8a32640 1 --2- 172.21.15.37:0/2451317889 >> v2:172.21.15.37:3300/0 conn(0x7f4ac4154f60 0x7f4ac40cd7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:43.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.362+0000 7f4ac8a32640 1 -- 172.21.15.37:0/2451317889 >> 172.21.15.37:0/2451317889 conn(0x7f4ac4067aa0 msgr2=0x7f4ac4073440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:43.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.361+0000 7fd007fff640 1 -- 172.21.15.37:0/582878019 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd00002cbb0 con 0x7fd0080b3180 2024-04-22T07:18:43.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.361+0000 7fd007fff640 1 -- 172.21.15.37:0/582878019 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd00002cd50 con 0x7fd0080b3180 2024-04-22T07:18:43.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.361+0000 7fd007fff640 1 -- 172.21.15.37:0/582878019 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd000034610 con 0x7fd0080b3180 2024-04-22T07:18:43.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.361+0000 7f1a6ad9d640 1 --2- 172.21.15.37:0/2992033335 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1a6c152c00 0x7f1a6c0c2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:43.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.361+0000 7f1a6a59c640 1 -- 172.21.15.37:0/2992033335 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1a6c152c00 msgr2=0x7f1a6c0c2ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:18:43.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.361+0000 7f1a6a59c640 1 --2- 172.21.15.37:0/2992033335 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1a6c152c00 0x7f1a6c0c2ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:43.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.361+0000 7f1a6a59c640 1 -- 172.21.15.37:0/2992033335 >> v2:172.21.15.37:3300/0 conn(0x7f1a6c0c62e0 msgr2=0x7f1a6c0c84e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:18:43.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.361+0000 7f1a6a59c640 1 --2- 172.21.15.37:0/2992033335 >> v2:172.21.15.37:3300/0 conn(0x7f1a6c0c62e0 0x7f1a6c0c84e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:43.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.361+0000 7f1a6a59c640 1 -- 172.21.15.37:0/2992033335 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a6c0c6cb0 con 0x7f1a6c0c4980 2024-04-22T07:18:43.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.362+0000 7fc7fd855640 1 -- 172.21.15.37:0/509233317 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7f80ca360 msgr2=0x7fc7f80ca740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:43.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.362+0000 7fc7fd855640 1 --2- 172.21.15.37:0/509233317 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7f80ca360 0x7fc7f80ca740 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fc7f8072f10 tx=0x7fc7ec02b910 comp rx=0 tx=0).stop 2024-04-22T07:18:43.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.362+0000 7fc7fd855640 1 -- 172.21.15.37:0/509233317 shutdown_connections 2024-04-22T07:18:43.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.362+0000 7fc7fd855640 1 --2- 172.21.15.37:0/509233317 >> v2:172.21.15.196:3300/0 conn(0x7fc7f815f9e0 0x7fc7f8162f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:43.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.362+0000 7fc7fd855640 1 --2- 172.21.15.37:0/509233317 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7f80ca360 0x7fc7f80ca740 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:43.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.362+0000 7fc7fd855640 1 -- 172.21.15.37:0/509233317 >> 172.21.15.37:0/509233317 conn(0x7fc7f8067b90 msgr2=0x7fc7f80733b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:43.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.362+0000 7fc7fd855640 1 -- 172.21.15.37:0/509233317 shutdown_connections 2024-04-22T07:18:43.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.362+0000 7fd00e392640 1 -- 172.21.15.37:0/582878019 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd0080b3180 msgr2=0x7fd0080c9eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:43.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.362+0000 7fd00e392640 1 --2- 172.21.15.37:0/582878019 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd0080b3180 0x7fd0080c9eb0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd000009e50 tx=0x7fd00002c010 comp rx=0 tx=0).stop 2024-04-22T07:18:43.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.362+0000 7f3fad50b640 1 -- 172.21.15.37:0/1796450945 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3fa80cc890 msgr2=0x7f3fa80d06a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:43.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.362+0000 7f3fad50b640 1 --2- 172.21.15.37:0/1796450945 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3fa80cc890 0x7f3fa80d06a0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f3f98009720 tx=0x7f3f9802b7c0 comp rx=0 tx=0).stop 2024-04-22T07:18:43.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.362+0000 7fd00e392640 1 -- 172.21.15.37:0/582878019 shutdown_connections 2024-04-22T07:18:43.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.362+0000 7fd00e392640 1 --2- 172.21.15.37:0/582878019 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd0080b3180 0x7fd0080c9eb0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:43.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.362+0000 7fd00e392640 1 -- 172.21.15.37:0/582878019 >> 172.21.15.37:0/582878019 conn(0x7fd0080d04e0 msgr2=0x7fd0080d08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:43.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.362+0000 7fb17ca81640 1 Processor -- start 2024-04-22T07:18:43.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.362+0000 7fc7fd855640 1 -- 172.21.15.37:0/509233317 wait complete. 2024-04-22T07:18:43.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.362+0000 7f3fad50b640 1 -- 172.21.15.37:0/1796450945 shutdown_connections 2024-04-22T07:18:43.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.362+0000 7f3fad50b640 1 --2- 172.21.15.37:0/1796450945 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3fa80cc890 0x7f3fa80d06a0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:43.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.362+0000 7f3fad50b640 1 -- 172.21.15.37:0/1796450945 >> 172.21.15.37:0/1796450945 conn(0x7f3fa806bb50 msgr2=0x7f3fa8073250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:43.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.362+0000 7f4ac8a32640 1 -- 172.21.15.37:0/2451317889 shutdown_connections 2024-04-22T07:18:43.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.362+0000 7f1a6b59e640 1 --2- 172.21.15.37:0/2992033335 >> v2:172.21.15.37:3300/0 conn(0x7f1a6c0c62e0 0x7f1a6c0c84e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T07:18:43.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.362+0000 7f4ac8a32640 1 -- 172.21.15.37:0/2451317889 wait complete. 2024-04-22T07:18:43.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.363+0000 7fd00e392640 1 -- 172.21.15.37:0/582878019 shutdown_connections 2024-04-22T07:18:43.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.363+0000 7f3fad50b640 1 -- 172.21.15.37:0/1796450945 shutdown_connections 2024-04-22T07:18:43.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.363+0000 7efe27fe6640 1 -- 172.21.15.37:0/1444627971 shutdown_connections 2024-04-22T07:18:43.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.363+0000 7fd00e392640 1 -- 172.21.15.37:0/582878019 wait complete. 2024-04-22T07:18:43.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.363+0000 7f3fad50b640 1 -- 172.21.15.37:0/1796450945 wait complete. 2024-04-22T07:18:43.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.363+0000 7f980e02a640 1 Processor -- start 2024-04-22T07:18:43.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.363+0000 7f980e02a640 1 -- start start 2024-04-22T07:18:43.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.362+0000 7fb17ca81640 1 -- start start 2024-04-22T07:18:43.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.363+0000 7fb17ca81640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb17004ba60 0x7fb1700b4f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:43.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.364+0000 7fb17ca81640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb1700dd3c0 0x7fb1700e23c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:43.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.364+0000 7fb17ca81640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1700e3090 0x7fb1700e2900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:43.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.364+0000 7fb17ca81640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fb170045980 con 0x7fb1700e3090 2024-04-22T07:18:43.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.364+0000 7fb17ca81640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fb1700456a0 con 0x7fb17004ba60 2024-04-22T07:18:43.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.364+0000 7fb17ca81640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fb170045c60 con 0x7fb1700dd3c0 2024-04-22T07:18:43.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.364+0000 7fb17659c640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb17004ba60 0x7fb1700b4f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:43.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.364+0000 7fb17659c640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb17004ba60 0x7fb1700b4f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.37:34536/0 (socket says 172.21.15.37:34536) 2024-04-22T07:18:43.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.364+0000 7fb17659c640 1 -- 172.21.15.37:0/2489057901 learned_addr learned my addr 172.21.15.37:0/2489057901 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:18:43.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.364+0000 7fb176d9d640 1 --2- 172.21.15.37:0/2489057901 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1700e3090 0x7fb1700e2900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:43.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.364+0000 7fc7fd855640 1 Processor -- start 2024-04-22T07:18:43.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.364+0000 7fb17659c640 1 -- 172.21.15.37:0/2489057901 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb1700dd3c0 msgr2=0x7fb1700e23c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-22T07:18:43.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.364+0000 7fb17659c640 1 --2- 172.21.15.37:0/2489057901 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb1700dd3c0 0x7fb1700e23c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:43.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.364+0000 7fb17659c640 1 -- 172.21.15.37:0/2489057901 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1700e3090 msgr2=0x7fb1700e2900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:43.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.364+0000 7f4ac8a32640 1 Processor -- start 2024-04-22T07:18:43.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.364+0000 7fc7fd855640 1 -- start start 2024-04-22T07:18:43.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.364+0000 7f3fad50b640 1 Processor -- start 2024-04-22T07:18:43.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.363+0000 7efe27fe6640 1 -- 172.21.15.37:0/1444627971 wait complete. 2024-04-22T07:18:43.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.364+0000 7fb17659c640 1 --2- 172.21.15.37:0/2489057901 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1700e3090 0x7fb1700e2900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:43.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.364+0000 7fb17659c640 1 -- 172.21.15.37:0/2489057901 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb17004b5d0 con 0x7fb17004ba60 2024-04-22T07:18:43.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.365+0000 7efe27fe6640 1 Processor -- start 2024-04-22T07:18:43.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.365+0000 7fb176d9d640 1 --2- 172.21.15.37:0/2489057901 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1700e3090 0x7fb1700e2900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-22T07:18:43.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.365+0000 7f3fad50b640 1 -- start start 2024-04-22T07:18:43.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.365+0000 7f4ac8a32640 1 -- start start 2024-04-22T07:18:43.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.365+0000 7efe27fe6640 1 -- start start 2024-04-22T07:18:43.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.364+0000 7f980e02a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f980004c470 0x7f9800173020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:43.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.365+0000 7f980d028640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f980004c470 0x7f9800173020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:43.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.365+0000 7f980d028640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f980004c470 0x7f9800173020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54590/0 (socket says 172.21.15.37:54590) 2024-04-22T07:18:43.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.365+0000 7f980d028640 1 -- 172.21.15.37:0/607369718 learned_addr learned my addr 172.21.15.37:0/607369718 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:18:43.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.365+0000 7f980e02a640 1 --2- 172.21.15.37:0/607369718 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f98000d6dd0 0x7f98001677e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:43.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.365+0000 7f980e02a640 1 --2- 172.21.15.37:0/607369718 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f98000e0600 0x7f98000d1290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:43.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.365+0000 7f980e02a640 1 -- 172.21.15.37:0/607369718 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f9800006f00 con 0x7f980004c470 2024-04-22T07:18:43.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.365+0000 7f980e02a640 1 -- 172.21.15.37:0/607369718 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f9800006c20 con 0x7f98000e0600 2024-04-22T07:18:43.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.365+0000 7f980e02a640 1 -- 172.21.15.37:0/607369718 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f98000071e0 con 0x7f98000d6dd0 2024-04-22T07:18:43.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.365+0000 7f980d829640 1 --2- 172.21.15.37:0/607369718 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f98000e0600 0x7f98000d1290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:43.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.365+0000 7fb17659c640 1 --2- 172.21.15.37:0/2489057901 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb17004ba60 0x7fb1700b4f20 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fb178051230 tx=0x7fb178068fb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:43.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.365+0000 7f980c827640 1 --2- 172.21.15.37:0/607369718 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f98000d6dd0 0x7f98001677e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:43.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.365+0000 7fb166ffd640 1 -- 172.21.15.37:0/2489057901 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb178094400 con 0x7fb17004ba60 2024-04-22T07:18:43.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.365+0000 7fb166ffd640 1 -- 172.21.15.37:0/2489057901 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1780945a0 con 0x7fb17004ba60 2024-04-22T07:18:43.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.366+0000 7fb166ffd640 1 -- 172.21.15.37:0/2489057901 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb178094970 con 0x7fb17004ba60 2024-04-22T07:18:43.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.365+0000 7f980d028640 1 -- 172.21.15.37:0/607369718 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f98000d6dd0 msgr2=0x7f98001677e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:43.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.365+0000 7f980d028640 1 --2- 172.21.15.37:0/607369718 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f98000d6dd0 0x7f98001677e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:43.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.365+0000 7f980d028640 1 -- 172.21.15.37:0/607369718 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f98000e0600 msgr2=0x7f98000d1290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:43.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.365+0000 7f980d028640 1 --2- 172.21.15.37:0/607369718 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f98000e0600 0x7f98000d1290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:43.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.365+0000 7f980d028640 1 -- 172.21.15.37:0/607369718 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9800166d70 con 0x7f980004c470 2024-04-22T07:18:43.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.365+0000 7f1a6a59c640 1 --2- 172.21.15.37:0/2992033335 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1a6c0c4980 0x7f1a6c0c7fa0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f1a6c073d90 tx=0x7f1a5402b940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4ba8220ee808d98a server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:43.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.365+0000 7f1a69d9b640 1 -- 172.21.15.37:0/2992033335 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a54034070 con 0x7f1a6c0c4980 2024-04-22T07:18:43.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.365+0000 7f1a69d9b640 1 -- 172.21.15.37:0/2992033335 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a54030800 con 0x7f1a6c0c4980 2024-04-22T07:18:43.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.365+0000 7f1a69d9b640 1 -- 172.21.15.37:0/2992033335 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a54030c10 con 0x7f1a6c0c4980 2024-04-22T07:18:43.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.366+0000 7f980d028640 1 --2- 172.21.15.37:0/607369718 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f980004c470 0x7f9800173020 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f980400c4a0 tx=0x7f980400c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:43.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.366+0000 7fc7fd855640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc7f806dd10 0x7fc7f8151e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:43.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.366+0000 7f3fad50b640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3fa80cc890 0x7f3fa814a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:43.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.366+0000 7fc7fd855640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7f80ca360 0x7fc7f81e8320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:43.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.366+0000 7fc7fd855640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc7f815f9e0 0x7fc7f80cbea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:43.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.366+0000 7f3fad50b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3fa80ccc70 0x7f3fa8141f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:43.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.366+0000 7f97fdffb640 1 -- 172.21.15.37:0/607369718 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9804018070 con 0x7f980004c470 2024-04-22T07:18:43.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.366+0000 7f3fad50b640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3fa8155270 0x7f3fa81424c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:43.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.366+0000 7efe27fe6640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efe180063d0 0x7efe18170eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:43.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.366+0000 7f3fad50b640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3fa815ad30 con 0x7f3fa80ccc70 2024-04-22T07:18:43.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.366+0000 7f4ac8a32640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ac40c5800 0x7f4ac414d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:43.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.366+0000 7f3fad50b640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f3fa815bbc0 con 0x7f3fa80cc890 2024-04-22T07:18:43.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.366+0000 7f3facd0a640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3fa8155270 0x7f3fa81424c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:43.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.366+0000 7fc7fd855640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc7f80c9b10 con 0x7fc7f80ca360 2024-04-22T07:18:43.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.366+0000 7fc7fd855640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fc7f80c9590 con 0x7fc7f806dd10 2024-04-22T07:18:43.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.366+0000 7f4ac8a32640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4ac40d0a70 0x7f4ac41f8810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:43.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.366+0000 7fc7f7fff640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc7f815f9e0 0x7fc7f80cbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:43.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.367+0000 7fc7f7fff640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc7f815f9e0 0x7fc7f80cbea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.37:53980/0 (socket says 172.21.15.37:53980) 2024-04-22T07:18:43.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.367+0000 7fc7f7fff640 1 -- 172.21.15.37:0/3835843626 learned_addr learned my addr 172.21.15.37:0/3835843626 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:18:43.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.366+0000 7fc7fd855640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fc7f8162750 con 0x7fc7f815f9e0 2024-04-22T07:18:43.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.367+0000 7f3facd0a640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3fa8155270 0x7f3fa81424c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.37:53974/0 (socket says 172.21.15.37:53974) 2024-04-22T07:18:43.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.366+0000 7f1a71006640 1 -- 172.21.15.37:0/2992033335 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1a6c0c4980 msgr2=0x7f1a6c0c7fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:43.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.366+0000 7f1a71006640 1 --2- 172.21.15.37:0/2992033335 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1a6c0c4980 0x7f1a6c0c7fa0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f1a6c073d90 tx=0x7f1a5402b940 comp rx=0 tx=0).stop 2024-04-22T07:18:43.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.367+0000 7f3facd0a640 1 -- 172.21.15.37:0/1702177955 learned_addr learned my addr 172.21.15.37:0/1702177955 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:18:43.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.367+0000 7f3fad50b640 1 -- 172.21.15.37:0/1702177955 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f3fa80d0be0 con 0x7f3fa8155270 2024-04-22T07:18:43.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.367+0000 7f1a71006640 1 -- 172.21.15.37:0/2992033335 shutdown_connections 2024-04-22T07:18:43.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.367+0000 7f1a71006640 1 --2- 172.21.15.37:0/2992033335 >> v2:172.21.15.37:3300/0 conn(0x7f1a6c0c62e0 0x7f1a6c0c84e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:43.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.367+0000 7f1a71006640 1 --2- 172.21.15.37:0/2992033335 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1a6c0c4980 0x7f1a6c0c7fa0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:43.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.367+0000 7f1a71006640 1 --2- 172.21.15.37:0/2992033335 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1a6c152c00 0x7f1a6c0c2ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:43.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.367+0000 7f1a71006640 1 -- 172.21.15.37:0/2992033335 >> 172.21.15.37:0/2992033335 conn(0x7f1a6c0cc060 msgr2=0x7f1a6c0cc470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:43.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.366+0000 7efe27fe6640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7efe1804b500 0x7efe181742e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:43.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.366+0000 7efe27fe6640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efe1804b8e0 0x7efe180d0be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:43.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.366+0000 7efe27fe6640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7efe1804bd00 con 0x7efe180063d0 2024-04-22T07:18:43.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.366+0000 7efe27fe6640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7efe18007430 con 0x7efe1804b8e0 2024-04-22T07:18:43.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.366+0000 7efe27fe6640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7efe180d5000 con 0x7efe1804b500 2024-04-22T07:18:43.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.366+0000 7f980e02a640 1 -- 172.21.15.37:0/607369718 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9800034f30 con 0x7f980004c470 2024-04-22T07:18:43.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.367+0000 7f980e02a640 1 -- 172.21.15.37:0/607369718 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9800166fe0 con 0x7f980004c470 2024-04-22T07:18:43.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.364+0000 7fd00e392640 1 Processor -- start 2024-04-22T07:18:43.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.364+0000 7fd00e392640 1 -- start start 2024-04-22T07:18:43.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.366+0000 7fd00e392640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd0080b3180 0x7fd008163330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:43.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.366+0000 7fd00e392640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd00815fc80 0x7fd0080cee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:43.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.366+0000 7fd00e392640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd008160060 0x7fd0081e9fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:43.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.366+0000 7fd00e392640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd0080cc7b0 con 0x7fd008160060 2024-04-22T07:18:43.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.366+0000 7fd00e392640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fd0080c9990 con 0x7fd0080b3180 2024-04-22T07:18:43.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.366+0000 7fd00e392640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fd00806c080 con 0x7fd00815fc80 2024-04-22T07:18:43.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.366+0000 7fd00cb8f640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd00815fc80 0x7fd0080cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:43.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.366+0000 7fd00cb8f640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd00815fc80 0x7fd0080cee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.37:53968/0 (socket says 172.21.15.37:53968) 2024-04-22T07:18:43.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.366+0000 7fd00cb8f640 1 -- 172.21.15.37:0/3272826320 learned_addr learned my addr 172.21.15.37:0/3272826320 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:18:43.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.366+0000 7fd00d390640 1 --2- 172.21.15.37:0/3272826320 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd0080b3180 0x7fd008163330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:43.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.366+0000 7fd00db91640 1 --2- 172.21.15.37:0/3272826320 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd008160060 0x7fd0081e9fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:43.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.367+0000 7efe25d82640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efe180063d0 0x7efe18170eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:43.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.367+0000 7efe25581640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7efe1804b500 0x7efe181742e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:43.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.367+0000 7f97fdffb640 1 -- 172.21.15.37:0/607369718 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98040075a0 con 0x7f980004c470 2024-04-22T07:18:43.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.367+0000 7f97fdffb640 1 -- 172.21.15.37:0/607369718 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98040049e0 con 0x7f980004c470 2024-04-22T07:18:43.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.367+0000 7efe26583640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efe1804b8e0 0x7efe180d0be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:43.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.367+0000 7fc7f7fff640 1 -- 172.21.15.37:0/3835843626 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc7f806dd10 msgr2=0x7fc7f8151e80 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-22T07:18:43.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.367+0000 7fc7f7fff640 1 --2- 172.21.15.37:0/3835843626 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc7f806dd10 0x7fc7f8151e80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:43.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.367+0000 7f1a71006640 1 -- 172.21.15.37:0/2992033335 shutdown_connections 2024-04-22T07:18:43.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.367+0000 7f4ac8a32640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4ac4154f60 0x7f4ac41f8d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:43.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.367+0000 7fc7f7fff640 1 -- 172.21.15.37:0/3835843626 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7f80ca360 msgr2=0x7fc7f81e8320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:43.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.367+0000 7f4ac8a32640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f4ac4155340 con 0x7f4ac40c5800 2024-04-22T07:18:43.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.367+0000 7fd00cb8f640 1 -- 172.21.15.37:0/3272826320 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd0080b3180 msgr2=0x7fd008163330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:43.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.367+0000 7fd00cb8f640 1 --2- 172.21.15.37:0/3272826320 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd0080b3180 0x7fd008163330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:43.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.367+0000 7fd00cb8f640 1 -- 172.21.15.37:0/3272826320 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd008160060 msgr2=0x7fd0081e9fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:43.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.367+0000 7fd00cb8f640 1 --2- 172.21.15.37:0/3272826320 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd008160060 0x7fd0081e9fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:43.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.367+0000 7fd00cb8f640 1 -- 172.21.15.37:0/3272826320 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0081e9810 con 0x7fd00815fc80 2024-04-22T07:18:43.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.366+0000 7fb17ca81640 1 -- 172.21.15.37:0/2489057901 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1700b94c0 con 0x7fb17004ba60 2024-04-22T07:18:43.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.367+0000 7fb17ca81640 1 -- 172.21.15.37:0/2489057901 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1700b4740 con 0x7fb17004ba60 2024-04-22T07:18:43.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.367+0000 7fc7f67fc640 1 --2- 172.21.15.37:0/3835843626 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7f80ca360 0x7fc7f81e8320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:43.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.368+0000 7fc7f7fff640 1 --2- 172.21.15.37:0/3835843626 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7f80ca360 0x7fc7f81e8320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:43.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.368+0000 7fc7f7fff640 1 -- 172.21.15.37:0/3835843626 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7f81ea380 con 0x7fc7f815f9e0 2024-04-22T07:18:43.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.368+0000 7fc7f67fc640 1 --2- 172.21.15.37:0/3835843626 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7f80ca360 0x7fc7f81e8320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-22T07:18:43.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.367+0000 7efe25d82640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efe180063d0 0x7efe18170eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54596/0 (socket says 172.21.15.37:54596) 2024-04-22T07:18:43.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.368+0000 7efe25d82640 1 -- 172.21.15.37:0/456546767 learned_addr learned my addr 172.21.15.37:0/456546767 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:18:43.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.367+0000 7efe26583640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efe1804b8e0 0x7efe180d0be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.37:34568/0 (socket says 172.21.15.37:34568) 2024-04-22T07:18:43.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.368+0000 7fb17ca81640 1 -- 172.21.15.37:0/2489057901 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb15c001030 con 0x7fb17004ba60 2024-04-22T07:18:43.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.367+0000 7f3fa77fe640 1 --2- 172.21.15.37:0/1702177955 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3fa80ccc70 0x7f3fa8141f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:43.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.367+0000 7f3fa7fff640 1 --2- 172.21.15.37:0/1702177955 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3fa80cc890 0x7f3fa814a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:43.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.367+0000 7f3fa77fe640 1 -- 172.21.15.37:0/1702177955 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3fa8155270 msgr2=0x7f3fa81424c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:43.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.367+0000 7f3fa77fe640 1 --2- 172.21.15.37:0/1702177955 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3fa8155270 0x7f3fa81424c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:43.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.367+0000 7f3fa77fe640 1 -- 172.21.15.37:0/1702177955 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3fa80cc890 msgr2=0x7f3fa814a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:43.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.367+0000 7f3fa77fe640 1 --2- 172.21.15.37:0/1702177955 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3fa80cc890 0x7f3fa814a9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:43.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.367+0000 7f3fa77fe640 1 -- 172.21.15.37:0/1702177955 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fa80c89f0 con 0x7f3fa80ccc70 2024-04-22T07:18:43.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.368+0000 7fd00cb8f640 1 --2- 172.21.15.37:0/3272826320 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd00815fc80 0x7fd0080cee30 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fcffc00c4e0 tx=0x7fcffc00c9a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:43.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.368+0000 7efe25d82640 1 -- 172.21.15.37:0/456546767 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7efe1804b500 msgr2=0x7efe181742e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:43.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.368+0000 7efe25d82640 1 --2- 172.21.15.37:0/456546767 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7efe1804b500 0x7efe181742e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:43.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.368+0000 7efe25d82640 1 -- 172.21.15.37:0/456546767 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efe1804b8e0 msgr2=0x7efe180d0be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:43.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.368+0000 7efe25d82640 1 --2- 172.21.15.37:0/456546767 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efe1804b8e0 0x7efe180d0be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:43.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.368+0000 7efe25d82640 1 -- 172.21.15.37:0/456546767 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe180db4b0 con 0x7efe180063d0 2024-04-22T07:18:43.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.367+0000 7f4ac259c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ac40c5800 0x7f4ac414d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:43.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.367+0000 7f4ac259c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ac40c5800 0x7f4ac414d1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54632/0 (socket says 172.21.15.37:54632) 2024-04-22T07:18:43.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.367+0000 7f4ac259c640 1 -- 172.21.15.37:0/1689343280 learned_addr learned my addr 172.21.15.37:0/1689343280 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:18:43.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.368+0000 7f4ac1d9b640 1 --2- 172.21.15.37:0/1689343280 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4ac40d0a70 0x7f4ac41f8810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:43.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.368+0000 7f4ac8a32640 1 -- 172.21.15.37:0/1689343280 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f4ac40cd2c0 con 0x7f4ac4154f60 2024-04-22T07:18:43.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.368+0000 7f4ac8a32640 1 -- 172.21.15.37:0/1689343280 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f4ac41554c0 con 0x7f4ac40d0a70 2024-04-22T07:18:43.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.368+0000 7f4ac2d9d640 1 --2- 172.21.15.37:0/1689343280 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4ac4154f60 0x7f4ac41f8d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:43.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.368+0000 7fd005ffb640 1 -- 172.21.15.37:0/3272826320 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcffc017070 con 0x7fd00815fc80 2024-04-22T07:18:43.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.368+0000 7f4ac259c640 1 -- 172.21.15.37:0/1689343280 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4ac40d0a70 msgr2=0x7f4ac41f8810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:43.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.369+0000 7f4ac259c640 1 --2- 172.21.15.37:0/1689343280 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4ac40d0a70 0x7f4ac41f8810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:43.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.369+0000 7fc7f7fff640 1 --2- 172.21.15.37:0/3835843626 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc7f815f9e0 0x7fc7f80cbea0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fc7f0007ef0 tx=0x7fc7f000d4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:43.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.369+0000 7f4ac259c640 1 -- 172.21.15.37:0/1689343280 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4ac4154f60 msgr2=0x7f4ac41f8d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:43.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.369+0000 7f4ac259c640 1 --2- 172.21.15.37:0/1689343280 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4ac4154f60 0x7f4ac41f8d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:43.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.368+0000 7fd00e392640 1 -- 172.21.15.37:0/3272826320 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0080c5d90 con 0x7fd00815fc80 2024-04-22T07:18:43.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.369+0000 7fd005ffb640 1 -- 172.21.15.37:0/3272826320 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcffc0035f0 con 0x7fd00815fc80 2024-04-22T07:18:43.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.369+0000 7f4ac259c640 1 -- 172.21.15.37:0/1689343280 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ac4158180 con 0x7f4ac40c5800 2024-04-22T07:18:43.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.369+0000 7f980e02a640 1 -- 172.21.15.37:0/607369718 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f97e8001030 con 0x7f980004c470 2024-04-22T07:18:43.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.369+0000 7fb166ffd640 1 -- 172.21.15.37:0/2489057901 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb178094b10 con 0x7fb17004ba60 2024-04-22T07:18:43.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.368+0000 7efe25d82640 1 --2- 172.21.15.37:0/456546767 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efe180063d0 0x7efe18170eb0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7efe1c00e870 tx=0x7efe1c00ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:43.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.369+0000 7fc7dffff640 1 -- 172.21.15.37:0/3835843626 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7f001a070 con 0x7fc7f815f9e0 2024-04-22T07:18:43.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.369+0000 7efe167fc640 1 -- 172.21.15.37:0/456546767 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe1c017070 con 0x7efe180063d0 2024-04-22T07:18:43.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.369+0000 7f3fa77fe640 1 --2- 172.21.15.37:0/1702177955 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3fa80ccc70 0x7f3fa8141f80 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f3f9c00c750 tx=0x7f3f9c00cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:43.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.369+0000 7fc7fd855640 1 -- 172.21.15.37:0/3835843626 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7f81ea660 con 0x7fc7f815f9e0 2024-04-22T07:18:43.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.369+0000 7efe27fe6640 1 -- 172.21.15.37:0/456546767 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe180db790 con 0x7efe180063d0 2024-04-22T07:18:43.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.369+0000 7efe27fe6640 1 -- 172.21.15.37:0/456546767 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe18185ef0 con 0x7efe180063d0 2024-04-22T07:18:43.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.369+0000 7fc7fd855640 1 -- 172.21.15.37:0/3835843626 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7f81eac20 con 0x7fc7f815f9e0 2024-04-22T07:18:43.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.369+0000 7efe167fc640 1 -- 172.21.15.37:0/456546767 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe1c00c8e0 con 0x7efe180063d0 2024-04-22T07:18:43.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.369+0000 7efe167fc640 1 -- 172.21.15.37:0/456546767 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe1c00ccd0 con 0x7efe180063d0 2024-04-22T07:18:43.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.370+0000 7fc7dffff640 1 -- 172.21.15.37:0/3835843626 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7f0003b90 con 0x7fc7f815f9e0 2024-04-22T07:18:43.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.370+0000 7f4ac259c640 1 --2- 172.21.15.37:0/1689343280 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ac40c5800 0x7f4ac414d1c0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f4ab800d800 tx=0x7f4ab800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:43.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.370+0000 7fb166ffd640 1 --2- 172.21.15.37:0/2489057901 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fb15806c9c0 0x7fb15806ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:43.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.369+0000 7fd00e392640 1 -- 172.21.15.37:0/3272826320 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0080c6350 con 0x7fd00815fc80 2024-04-22T07:18:43.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.370+0000 7fd005ffb640 1 -- 172.21.15.37:0/3272826320 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcffc0039e0 con 0x7fd00815fc80 2024-04-22T07:18:43.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.370+0000 7fd00e392640 1 -- 172.21.15.37:0/3272826320 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd00806b970 con 0x7fd00815fc80 2024-04-22T07:18:43.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.370+0000 7f4ac2d9d640 1 --2- 172.21.15.37:0/1689343280 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4ac4154f60 0x7f4ac41f8d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T07:18:43.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.370+0000 7fb166ffd640 1 -- 172.21.15.37:0/2489057901 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fb178107490 con 0x7fb17004ba60 2024-04-22T07:18:43.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.370+0000 7fb166ffd640 1 --2- 172.21.15.37:0/2489057901 >> [v2:172.21.15.196:6800/479311302,v1:172.21.15.196:6801/479311302] conn(0x7fb158074c40 0x7fb158077060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:43.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.370+0000 7fb166ffd640 1 -- 172.21.15.37:0/2489057901 --> [v2:172.21.15.196:6800/479311302,v1:172.21.15.196:6801/479311302] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb17806ee50 con 0x7fb158074c40 2024-04-22T07:18:43.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.370+0000 7fb166ffd640 1 -- 172.21.15.37:0/2489057901 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fb17810e050 con 0x7fb17004ba60 2024-04-22T07:18:43.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.370+0000 7f4ab2ffd640 1 -- 172.21.15.37:0/1689343280 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ab800b660 con 0x7f4ac40c5800 2024-04-22T07:18:43.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.370+0000 7f4ab2ffd640 1 -- 172.21.15.37:0/1689343280 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ab8019070 con 0x7f4ac40c5800 2024-04-22T07:18:43.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.370+0000 7f4ab2ffd640 1 -- 172.21.15.37:0/1689343280 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ab800b660 con 0x7f4ac40c5800 2024-04-22T07:18:43.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.370+0000 7f4ac8a32640 1 -- 172.21.15.37:0/1689343280 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ac4158460 con 0x7f4ac40c5800 2024-04-22T07:18:43.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.370+0000 7f4ac8a32640 1 -- 172.21.15.37:0/1689343280 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ac415e240 con 0x7f4ac40c5800 2024-04-22T07:18:43.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.371+0000 7fc7dffff640 1 -- 172.21.15.37:0/3835843626 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7f000de80 con 0x7fc7f815f9e0 2024-04-22T07:18:43.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.371+0000 7fb175d9b640 1 --2- 172.21.15.37:0/2489057901 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fb15806c9c0 0x7fb15806ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:43.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.371+0000 7f97fdffb640 1 -- 172.21.15.37:0/607369718 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f980401b070 con 0x7f980004c470 2024-04-22T07:18:43.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.367+0000 7f1a71006640 1 -- 172.21.15.37:0/2992033335 wait complete. 2024-04-22T07:18:43.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.369+0000 7f1a71006640 1 Processor -- start 2024-04-22T07:18:43.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.369+0000 7f1a71006640 1 -- start start 2024-04-22T07:18:43.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.370+0000 7f1a71006640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1a6c0c4980 0x7f1a6c12dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:43.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.371+0000 7f1a71006640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1a6c0c62e0 0x7f1a6c156920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:43.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.371+0000 7f1a71006640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a6c152c00 0x7f1a6c13e530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:43.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.371+0000 7f1a71006640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f1a6c152fe0 con 0x7f1a6c152c00 2024-04-22T07:18:43.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.371+0000 7f1a71006640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f1a6c0c3800 con 0x7f1a6c0c62e0 2024-04-22T07:18:43.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.371+0000 7f1a71006640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f1a6c0c3150 con 0x7f1a6c0c4980 2024-04-22T07:18:43.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.371+0000 7f1a6a59c640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1a6c0c62e0 0x7f1a6c156920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:43.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.371+0000 7f1a6a59c640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1a6c0c62e0 0x7f1a6c156920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.37:34606/0 (socket says 172.21.15.37:34606) 2024-04-22T07:18:43.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.371+0000 7f1a6a59c640 1 -- 172.21.15.37:0/1668326270 learned_addr learned my addr 172.21.15.37:0/1668326270 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:18:43.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.371+0000 7f1a6ad9d640 1 --2- 172.21.15.37:0/1668326270 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1a6c0c4980 0x7f1a6c12dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:43.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.371+0000 7f1a6b59e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a6c152c00 0x7f1a6c13e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:43.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.372+0000 7fb175d9b640 1 --2- 172.21.15.37:0/2489057901 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fb15806c9c0 0x7fb15806ee80 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb16c036000 tx=0x7fb16c008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:43.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.372+0000 7f4ac8a32640 1 -- 172.21.15.37:0/1689343280 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f4ac41f9390 con 0x7f4ac40c5800 2024-04-22T07:18:43.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.372+0000 7fc7fd855640 1 -- 172.21.15.37:0/3835843626 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc7d8001030 con 0x7fc7f815f9e0 2024-04-22T07:18:43.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.372+0000 7f1a6b59e640 1 -- 172.21.15.37:0/1668326270 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1a6c0c4980 msgr2=0x7f1a6c12dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:43.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.372+0000 7f1a6b59e640 1 --2- 172.21.15.37:0/1668326270 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1a6c0c4980 0x7f1a6c12dfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:43.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.372+0000 7f1a6b59e640 1 -- 172.21.15.37:0/1668326270 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1a6c0c62e0 msgr2=0x7f1a6c156920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:43.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.372+0000 7f1a6b59e640 1 --2- 172.21.15.37:0/1668326270 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1a6c0c62e0 0x7f1a6c156920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:43.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.372+0000 7f1a6b59e640 1 -- 172.21.15.37:0/1668326270 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a6c13cc00 con 0x7f1a6c152c00 2024-04-22T07:18:43.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.371+0000 7efe27fe6640 1 -- 172.21.15.37:0/456546767 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7efe08001030 con 0x7efe180063d0 2024-04-22T07:18:43.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.372+0000 7fc7dffff640 1 -- 172.21.15.37:0/3835843626 <== mon.2 v2:172.21.15.196:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc7f001d070 con 0x7fc7f815f9e0 2024-04-22T07:18:43.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.372+0000 7f3fa4ff9640 1 -- 172.21.15.37:0/1702177955 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f9c017070 con 0x7f3fa80ccc70 2024-04-22T07:18:43.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.372+0000 7f3fad50b640 1 -- 172.21.15.37:0/1702177955 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3fa81f4370 con 0x7f3fa80ccc70 2024-04-22T07:18:43.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.372+0000 7f3fad50b640 1 -- 172.21.15.37:0/1702177955 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3fa81f4910 con 0x7f3fa80ccc70 2024-04-22T07:18:43.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.372+0000 7f3fa4ff9640 1 -- 172.21.15.37:0/1702177955 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f9c005270 con 0x7f3fa80ccc70 2024-04-22T07:18:43.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.372+0000 7f3fa4ff9640 1 -- 172.21.15.37:0/1702177955 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f9c00a860 con 0x7f3fa80ccc70 2024-04-22T07:18:43.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.372+0000 7fd005ffb640 1 -- 172.21.15.37:0/3272826320 <== mon.2 v2:172.21.15.196:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fcffc01a070 con 0x7fd00815fc80 2024-04-22T07:18:43.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.373+0000 7fd005ffb640 1 --2- 172.21.15.37:0/3272826320 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fcff406c9c0 0x7fcff406ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:43.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.372+0000 7f97fdffb640 1 --2- 172.21.15.37:0/607369718 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f97f406c9e0 0x7f97f406eea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:43.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.372+0000 7f97fdffb640 1 -- 172.21.15.37:0/607369718 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f980408b0d0 con 0x7f980004c470 2024-04-22T07:18:43.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.373+0000 7f97fdffb640 1 --2- 172.21.15.37:0/607369718 >> [v2:172.21.15.37:6824/1895439419,v1:172.21.15.37:6825/1895439419] conn(0x7f97f4074c60 0x7f97f4077080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:43.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.373+0000 7f97fdffb640 1 -- 172.21.15.37:0/607369718 --> [v2:172.21.15.37:6824/1895439419,v1:172.21.15.37:6825/1895439419] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f97f4077730 con 0x7f97f4074c60 2024-04-22T07:18:43.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.373+0000 7f97fdffb640 1 -- 172.21.15.37:0/607369718 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f9804092050 con 0x7f980004c470 2024-04-22T07:18:43.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.373+0000 7fd005ffb640 1 -- 172.21.15.37:0/3272826320 <== mon.2 v2:172.21.15.196:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fcffc08aee0 con 0x7fd00815fc80 2024-04-22T07:18:43.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.373+0000 7fd005ffb640 1 --2- 172.21.15.37:0/3272826320 >> [v2:172.21.15.196:6808/374829049,v1:172.21.15.196:6809/374829049] conn(0x7fcff4074c40 0x7fcff4077060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:43.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.373+0000 7f1a6b59e640 1 --2- 172.21.15.37:0/1668326270 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a6c152c00 0x7f1a6c13e530 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f1a64007db0 tx=0x7f1a6400d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:43.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.373+0000 7f1a6ad9d640 1 --2- 172.21.15.37:0/1668326270 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1a6c0c4980 0x7f1a6c12dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T07:18:43.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.373+0000 7f1a637fe640 1 -- 172.21.15.37:0/1668326270 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a6401a070 con 0x7f1a6c152c00 2024-04-22T07:18:43.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.373+0000 7f1a637fe640 1 -- 172.21.15.37:0/1668326270 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a64015400 con 0x7f1a6c152c00 2024-04-22T07:18:43.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.373+0000 7f1a71006640 1 -- 172.21.15.37:0/1668326270 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a6c12d520 con 0x7f1a6c152c00 2024-04-22T07:18:43.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.373+0000 7fd005ffb640 1 -- 172.21.15.37:0/3272826320 --> [v2:172.21.15.196:6808/374829049,v1:172.21.15.196:6809/374829049] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fcffc016ec0 con 0x7fcff4074c40 2024-04-22T07:18:43.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.373+0000 7fd005ffb640 1 -- 172.21.15.37:0/3272826320 <== mon.2 v2:172.21.15.196:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fcffc08d540 con 0x7fd00815fc80 2024-04-22T07:18:43.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.373+0000 7f1a71006640 1 -- 172.21.15.37:0/1668326270 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a6c13c920 con 0x7f1a6c152c00 2024-04-22T07:18:43.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.373+0000 7fb176d9d640 1 --2- 172.21.15.37:0/2489057901 >> [v2:172.21.15.196:6800/479311302,v1:172.21.15.196:6801/479311302] conn(0x7fb158074c40 0x7fb158077060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:43.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.373+0000 7fc7dffff640 1 --2- 172.21.15.37:0/3835843626 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fc7e406c9c0 0x7fc7e406ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:43.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.373+0000 7f980c827640 1 --2- 172.21.15.37:0/607369718 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f97f406c9e0 0x7f97f406eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:43.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.373+0000 7f1a6a59c640 1 --2- 172.21.15.37:0/1668326270 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1a6c0c62e0 0x7f1a6c156920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-22T07:18:43.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.373+0000 7f1a637fe640 1 -- 172.21.15.37:0/1668326270 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a640157d0 con 0x7f1a6c152c00 2024-04-22T07:18:43.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.373+0000 7fc7dffff640 1 -- 172.21.15.37:0/3835843626 <== mon.2 v2:172.21.15.196:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fc7f008bd20 con 0x7fc7f815f9e0 2024-04-22T07:18:43.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.373+0000 7fc7dffff640 1 --2- 172.21.15.37:0/3835843626 >> [v2:172.21.15.196:6817/691777224,v1:172.21.15.196:6819/691777224] conn(0x7fc7e4074b60 0x7fc7e4076f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:43.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.373+0000 7fc7dffff640 1 -- 172.21.15.37:0/3835843626 --> [v2:172.21.15.196:6817/691777224,v1:172.21.15.196:6819/691777224] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc7f000ee50 con 0x7fc7e4074b60 2024-04-22T07:18:43.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.374+0000 7fc7dffff640 1 -- 172.21.15.37:0/3835843626 <== mon.2 v2:172.21.15.196:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fc7f0055bb0 con 0x7fc7f815f9e0 2024-04-22T07:18:43.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.374+0000 7fb176d9d640 1 --2- 172.21.15.37:0/2489057901 >> [v2:172.21.15.196:6800/479311302,v1:172.21.15.196:6801/479311302] conn(0x7fb158074c40 0x7fb158077060 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:43.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.373+0000 7f980d829640 1 --2- 172.21.15.37:0/607369718 >> [v2:172.21.15.37:6824/1895439419,v1:172.21.15.37:6825/1895439419] conn(0x7f97f4074c60 0x7f97f4077080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:43.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.374+0000 7fc7f67fc640 1 --2- 172.21.15.37:0/3835843626 >> [v2:172.21.15.196:6817/691777224,v1:172.21.15.196:6819/691777224] conn(0x7fc7e4074b60 0x7fc7e4076f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:43.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.373+0000 7fd00d390640 1 --2- 172.21.15.37:0/3272826320 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fcff406c9c0 0x7fcff406ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:43.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.374+0000 7efe167fc640 1 -- 172.21.15.37:0/456546767 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7efe1c01a070 con 0x7efe180063d0 2024-04-22T07:18:43.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.373+0000 7f4ab2ffd640 1 -- 172.21.15.37:0/1689343280 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4ab800b800 con 0x7f4ac40c5800 2024-04-22T07:18:43.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.374+0000 7f4ab2ffd640 1 --2- 172.21.15.37:0/1689343280 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f4aa406cd20 0x7f4aa406f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:43.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.375+0000 7efe167fc640 1 --2- 172.21.15.37:0/456546767 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7efe0406c9f0 0x7efe0406eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:43.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.375+0000 7efe167fc640 1 -- 172.21.15.37:0/456546767 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7efe1c08bc60 con 0x7efe180063d0 2024-04-22T07:18:43.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.374+0000 7f980d829640 1 --2- 172.21.15.37:0/607369718 >> [v2:172.21.15.37:6824/1895439419,v1:172.21.15.37:6825/1895439419] conn(0x7f97f4074c60 0x7f97f4077080 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:43.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.374+0000 7f4ab2ffd640 1 -- 172.21.15.37:0/1689343280 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f4ab800f040 con 0x7f4ac40c5800 2024-04-22T07:18:43.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.374+0000 7f4ab2ffd640 1 --2- 172.21.15.37:0/1689343280 >> [v2:172.21.15.37:6809/1160021017,v1:172.21.15.37:6810/1160021017] conn(0x7f4aa4074ec0 0x7f4aa40772e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:43.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.374+0000 7f4ab2ffd640 1 -- 172.21.15.37:0/1689343280 --> [v2:172.21.15.37:6809/1160021017,v1:172.21.15.37:6810/1160021017] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4ab8001d30 con 0x7f4aa4074ec0 2024-04-22T07:18:43.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.375+0000 7f4ac1d9b640 1 --2- 172.21.15.37:0/1689343280 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f4aa406cd20 0x7f4aa406f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:43.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.375+0000 7f4ac2d9d640 1 --2- 172.21.15.37:0/1689343280 >> [v2:172.21.15.37:6809/1160021017,v1:172.21.15.37:6810/1160021017] conn(0x7f4aa4074ec0 0x7f4aa40772e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:43.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.375+0000 7f4ab2ffd640 1 -- 172.21.15.37:0/1689343280 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f4ab8092050 con 0x7f4ac40c5800 2024-04-22T07:18:43.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.374+0000 7fd00db91640 1 --2- 172.21.15.37:0/3272826320 >> [v2:172.21.15.196:6808/374829049,v1:172.21.15.196:6809/374829049] conn(0x7fcff4074c40 0x7fcff4077060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:43.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.375+0000 7fd00d390640 1 --2- 172.21.15.37:0/3272826320 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fcff406c9c0 0x7fcff406ee80 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fcff8000f60 tx=0x7fcff8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:43.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.375+0000 7fb166ffd640 1 -- 172.21.15.37:0/2489057901 <== osd.5 v2:172.21.15.196:6800/479311302 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb17806ee50 con 0x7fb158074c40 2024-04-22T07:18:43.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.374+0000 7fc7f6ffd640 1 --2- 172.21.15.37:0/3835843626 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fc7e406c9c0 0x7fc7e406ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:43.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.374+0000 7fc7f67fc640 1 --2- 172.21.15.37:0/3835843626 >> [v2:172.21.15.196:6817/691777224,v1:172.21.15.196:6819/691777224] conn(0x7fc7e4074b60 0x7fc7e4076f80 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:43.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.375+0000 7f1a71006640 1 -- 172.21.15.37:0/1668326270 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1a6c04fdc0 con 0x7f1a6c152c00 2024-04-22T07:18:43.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.375+0000 7efe167fc640 1 --2- 172.21.15.37:0/456546767 >> [v2:172.21.15.37:6800/1488290385,v1:172.21.15.37:6801/1488290385] conn(0x7efe04074bf0 0x7efe04077010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:43.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.375+0000 7efe167fc640 1 -- 172.21.15.37:0/456546767 --> [v2:172.21.15.37:6800/1488290385,v1:172.21.15.37:6801/1488290385] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7efe040776c0 con 0x7efe04074bf0 2024-04-22T07:18:43.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.375+0000 7f4ac2d9d640 1 --2- 172.21.15.37:0/1689343280 >> [v2:172.21.15.37:6809/1160021017,v1:172.21.15.37:6810/1160021017] conn(0x7f4aa4074ec0 0x7f4aa40772e0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:43.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.375+0000 7efe167fc640 1 -- 172.21.15.37:0/456546767 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7efe1c055ca0 con 0x7efe180063d0 2024-04-22T07:18:43.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.375+0000 7efe26583640 1 --2- 172.21.15.37:0/456546767 >> [v2:172.21.15.37:6800/1488290385,v1:172.21.15.37:6801/1488290385] conn(0x7efe04074bf0 0x7efe04077010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:43.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.375+0000 7efe25581640 1 --2- 172.21.15.37:0/456546767 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7efe0406c9f0 0x7efe0406eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:43.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.376+0000 7efe26583640 1 --2- 172.21.15.37:0/456546767 >> [v2:172.21.15.37:6800/1488290385,v1:172.21.15.37:6801/1488290385] conn(0x7efe04074bf0 0x7efe04077010 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:43.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.375+0000 7f3fad50b640 1 -- 172.21.15.37:0/1702177955 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3f88001030 con 0x7f3fa80ccc70 2024-04-22T07:18:43.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.375+0000 7f97fdffb640 1 -- 172.21.15.37:0/607369718 <== osd.2 v2:172.21.15.37:6824/1895439419 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f97f4077730 con 0x7f97f4074c60 2024-04-22T07:18:43.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.376+0000 7f980c827640 1 --2- 172.21.15.37:0/607369718 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f97f406c9e0 0x7f97f406eea0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f980000dbb0 tx=0x7f98080ac000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:43.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.376+0000 7f4ac1d9b640 1 --2- 172.21.15.37:0/1689343280 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f4aa406cd20 0x7f4aa406f1e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f4ac40b5bd0 tx=0x7f4ab4009060 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:43.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.375+0000 7fd00db91640 1 --2- 172.21.15.37:0/3272826320 >> [v2:172.21.15.196:6808/374829049,v1:172.21.15.196:6809/374829049] conn(0x7fcff4074c40 0x7fcff4077060 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:43.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.375+0000 7fc7dffff640 1 -- 172.21.15.37:0/3835843626 <== osd.6 v2:172.21.15.196:6817/691777224 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc7f000ee50 con 0x7fc7e4074b60 2024-04-22T07:18:43.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.376+0000 7f1a637fe640 1 -- 172.21.15.37:0/1668326270 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1a6401d070 con 0x7f1a6c152c00 2024-04-22T07:18:43.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.376+0000 7f1a637fe640 1 --2- 172.21.15.37:0/1668326270 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f1a4c06c920 0x7f1a4c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:43.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.377+0000 7f3fa4ff9640 1 -- 172.21.15.37:0/1702177955 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3f9c01a070 con 0x7f3fa80ccc70 2024-04-22T07:18:43.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.377+0000 7f1a637fe640 1 -- 172.21.15.37:0/1668326270 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f1a6408bc80 con 0x7f1a6c152c00 2024-04-22T07:18:43.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.377+0000 7f1a637fe640 1 --2- 172.21.15.37:0/1668326270 >> [v2:172.21.15.196:6816/3106266066,v1:172.21.15.196:6818/3106266066] conn(0x7f1a4c074b20 0x7f1a4c076f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:43.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.376+0000 7fd005ffb640 1 -- 172.21.15.37:0/3272826320 <== osd.4 v2:172.21.15.196:6808/374829049 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fcffc016ec0 con 0x7fcff4074c40 2024-04-22T07:18:43.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.377+0000 7f1a637fe640 1 -- 172.21.15.37:0/1668326270 --> [v2:172.21.15.196:6816/3106266066,v1:172.21.15.196:6818/3106266066] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1a4c0775f0 con 0x7f1a4c074b20 2024-04-22T07:18:43.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.377+0000 7f1a637fe640 1 -- 172.21.15.37:0/1668326270 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f1a6408e380 con 0x7f1a6c152c00 2024-04-22T07:18:43.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.377+0000 7f4ab2ffd640 1 -- 172.21.15.37:0/1689343280 <== osd.3 v2:172.21.15.37:6809/1160021017 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f4ab8001d30 con 0x7f4aa4074ec0 2024-04-22T07:18:43.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.377+0000 7efe25581640 1 --2- 172.21.15.37:0/456546767 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7efe0406c9f0 0x7efe0406eeb0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7efe10037000 tx=0x7efe10008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:43.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.377+0000 7efe167fc640 1 -- 172.21.15.37:0/456546767 <== osd.0 v2:172.21.15.37:6800/1488290385 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7efe040776c0 con 0x7efe04074bf0 2024-04-22T07:18:43.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.376+0000 7fc7f6ffd640 1 --2- 172.21.15.37:0/3835843626 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fc7e406c9c0 0x7fc7e406ee80 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc7ec036000 tx=0x7fc7ec008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:43.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.377+0000 7f1a6a59c640 1 --2- 172.21.15.37:0/1668326270 >> [v2:172.21.15.196:6816/3106266066,v1:172.21.15.196:6818/3106266066] conn(0x7f1a4c074b20 0x7f1a4c076f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:43.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.378+0000 7f3fa4ff9640 1 --2- 172.21.15.37:0/1702177955 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f3f9406c9f0 0x7f3f9406eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:43.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.378+0000 7f3fa4ff9640 1 -- 172.21.15.37:0/1702177955 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f3f9c08b660 con 0x7f3fa80ccc70 2024-04-22T07:18:43.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.378+0000 7f3fa4ff9640 1 --2- 172.21.15.37:0/1702177955 >> [v2:172.21.15.37:6808/3918584183,v1:172.21.15.37:6811/3918584183] conn(0x7f3f94074c70 0x7f3f94077090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:43.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.378+0000 7f3fa7fff640 1 --2- 172.21.15.37:0/1702177955 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f3f9406c9f0 0x7f3f9406eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:43.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.378+0000 7f3facd0a640 1 --2- 172.21.15.37:0/1702177955 >> [v2:172.21.15.37:6808/3918584183,v1:172.21.15.37:6811/3918584183] conn(0x7f3f94074c70 0x7f3f94077090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:43.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.378+0000 7f3fa4ff9640 1 -- 172.21.15.37:0/1702177955 --> [v2:172.21.15.37:6808/3918584183,v1:172.21.15.37:6811/3918584183] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3f94077740 con 0x7f3f94074c70 2024-04-22T07:18:43.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.378+0000 7f3fa4ff9640 1 -- 172.21.15.37:0/1702177955 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f3f9c08ba50 con 0x7f3fa80ccc70 2024-04-22T07:18:43.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.378+0000 7f1a6ad9d640 1 --2- 172.21.15.37:0/1668326270 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f1a4c06c920 0x7f1a4c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:43.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.379+0000 7f1a6a59c640 1 --2- 172.21.15.37:0/1668326270 >> [v2:172.21.15.196:6816/3106266066,v1:172.21.15.196:6818/3106266066] conn(0x7f1a4c074b20 0x7f1a4c076f40 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:43.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.379+0000 7f3facd0a640 1 --2- 172.21.15.37:0/1702177955 >> [v2:172.21.15.37:6808/3918584183,v1:172.21.15.37:6811/3918584183] conn(0x7f3f94074c70 0x7f3f94077090 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:43.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.379+0000 7f3fa7fff640 1 --2- 172.21.15.37:0/1702177955 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f3f9406c9f0 0x7f3f9406eeb0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f3f98035000 tx=0x7f3f98030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:43.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.379+0000 7f1a6ad9d640 1 --2- 172.21.15.37:0/1668326270 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f1a4c06c920 0x7f1a4c06ede0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f1a5c006fd0 tx=0x7f1a5c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:43.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.380+0000 7f1a637fe640 1 -- 172.21.15.37:0/1668326270 <== osd.7 v2:172.21.15.196:6816/3106266066 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f1a4c0775f0 con 0x7f1a4c074b20 2024-04-22T07:18:43.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.380+0000 7f3fa4ff9640 1 -- 172.21.15.37:0/1702177955 <== osd.1 v2:172.21.15.37:6808/3918584183 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3f94077740 con 0x7f3f94074c70 2024-04-22T07:18:43.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.409+0000 7f980e02a640 1 -- 172.21.15.37:0/607369718 --> [v2:172.21.15.37:6824/1895439419,v1:172.21.15.37:6825/1895439419] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f97e8002dd0 con 0x7f97f4074c60 2024-04-22T07:18:43.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.409+0000 7fc7fd855640 1 -- 172.21.15.37:0/3835843626 --> [v2:172.21.15.196:6817/691777224,v1:172.21.15.196:6819/691777224] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fc7d8002dd0 con 0x7fc7e4074b60 2024-04-22T07:18:43.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.409+0000 7fb17ca81640 1 -- 172.21.15.37:0/2489057901 --> [v2:172.21.15.196:6800/479311302,v1:172.21.15.196:6801/479311302] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fb15c002dd0 con 0x7fb158074c40 2024-04-22T07:18:43.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.409+0000 7fd00e392640 1 -- 172.21.15.37:0/3272826320 --> [v2:172.21.15.196:6808/374829049,v1:172.21.15.196:6809/374829049] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fd00804fd50 con 0x7fcff4074c40 2024-04-22T07:18:43.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.410+0000 7fc7dffff640 1 -- 172.21.15.37:0/3835843626 <== osd.6 v2:172.21.15.196:6817/691777224 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fc7d8002dd0 con 0x7fc7e4074b60 2024-04-22T07:18:43.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.410+0000 7f97fdffb640 1 -- 172.21.15.37:0/607369718 <== osd.2 v2:172.21.15.37:6824/1895439419 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f97e8002dd0 con 0x7f97f4074c60 2024-04-22T07:18:43.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.410+0000 7fb166ffd640 1 -- 172.21.15.37:0/2489057901 <== osd.5 v2:172.21.15.196:6800/479311302 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fb15c002dd0 con 0x7fb158074c40 2024-04-22T07:18:43.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.410+0000 7fd005ffb640 1 -- 172.21.15.37:0/3272826320 <== osd.4 v2:172.21.15.196:6808/374829049 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fd00804fd50 con 0x7fcff4074c40 2024-04-22T07:18:43.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.410+0000 7f980e02a640 1 -- 172.21.15.37:0/607369718 >> [v2:172.21.15.37:6824/1895439419,v1:172.21.15.37:6825/1895439419] conn(0x7f97f4074c60 msgr2=0x7f97f4077080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:43.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.410+0000 7f980e02a640 1 --2- 172.21.15.37:0/607369718 >> [v2:172.21.15.37:6824/1895439419,v1:172.21.15.37:6825/1895439419] conn(0x7f97f4074c60 0x7f97f4077080 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:43.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.410+0000 7f4ac8a32640 1 -- 172.21.15.37:0/1689343280 --> [v2:172.21.15.37:6809/1160021017,v1:172.21.15.37:6810/1160021017] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f4ac4068b20 con 0x7f4aa4074ec0 2024-04-22T07:18:43.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.410+0000 7fc7ddffb640 1 -- 172.21.15.37:0/3835843626 >> [v2:172.21.15.196:6817/691777224,v1:172.21.15.196:6819/691777224] conn(0x7fc7e4074b60 msgr2=0x7fc7e4076f80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:43.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.410+0000 7fc7ddffb640 1 --2- 172.21.15.37:0/3835843626 >> [v2:172.21.15.196:6817/691777224,v1:172.21.15.196:6819/691777224] conn(0x7fc7e4074b60 0x7fc7e4076f80 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:43.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.411+0000 7fc7ddffb640 1 -- 172.21.15.37:0/3835843626 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fc7e406c9c0 msgr2=0x7fc7e406ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:43.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.411+0000 7f980e02a640 1 -- 172.21.15.37:0/607369718 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f97f406c9e0 msgr2=0x7f97f406eea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:43.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.411+0000 7fc7ddffb640 1 --2- 172.21.15.37:0/3835843626 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fc7e406c9c0 0x7fc7e406ee80 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc7ec036000 tx=0x7fc7ec008030 comp rx=0 tx=0).stop 2024-04-22T07:18:43.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.411+0000 7f980e02a640 1 --2- 172.21.15.37:0/607369718 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f97f406c9e0 0x7f97f406eea0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f980000dbb0 tx=0x7f98080ac000 comp rx=0 tx=0).stop 2024-04-22T07:18:43.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.411+0000 7fc7ddffb640 1 -- 172.21.15.37:0/3835843626 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc7f815f9e0 msgr2=0x7fc7f80cbea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:43.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.411+0000 7fc7ddffb640 1 --2- 172.21.15.37:0/3835843626 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc7f815f9e0 0x7fc7f80cbea0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fc7f0007ef0 tx=0x7fc7f000d4a0 comp rx=0 tx=0).stop 2024-04-22T07:18:43.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.411+0000 7f980e02a640 1 -- 172.21.15.37:0/607369718 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f980004c470 msgr2=0x7f9800173020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:43.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.411+0000 7f980e02a640 1 --2- 172.21.15.37:0/607369718 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f980004c470 0x7f9800173020 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f980400c4a0 tx=0x7f980400c960 comp rx=0 tx=0).stop 2024-04-22T07:18:43.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.411+0000 7fb164ff9640 1 -- 172.21.15.37:0/2489057901 >> [v2:172.21.15.196:6800/479311302,v1:172.21.15.196:6801/479311302] conn(0x7fb158074c40 msgr2=0x7fb158077060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:43.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.411+0000 7fb164ff9640 1 --2- 172.21.15.37:0/2489057901 >> [v2:172.21.15.196:6800/479311302,v1:172.21.15.196:6801/479311302] conn(0x7fb158074c40 0x7fb158077060 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:43.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.411+0000 7f980d829640 1 -- 172.21.15.37:0/607369718 reap_dead start 2024-04-22T07:18:43.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.411+0000 7fc7f7fff640 1 -- 172.21.15.37:0/3835843626 reap_dead start 2024-04-22T07:18:43.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.411+0000 7efe27fe6640 1 -- 172.21.15.37:0/456546767 --> [v2:172.21.15.37:6800/1488290385,v1:172.21.15.37:6801/1488290385] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7efe08002dd0 con 0x7efe04074bf0 2024-04-22T07:18:43.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.411+0000 7fc7ddffb640 1 -- 172.21.15.37:0/3835843626 shutdown_connections 2024-04-22T07:18:43.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.411+0000 7fc7ddffb640 1 -- 172.21.15.37:0/3835843626 >> 172.21.15.37:0/3835843626 conn(0x7fc7f8067b90 msgr2=0x7fc7f80733b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:43.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.411+0000 7f980e02a640 1 -- 172.21.15.37:0/607369718 shutdown_connections 2024-04-22T07:18:43.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.411+0000 7f980e02a640 1 -- 172.21.15.37:0/607369718 >> 172.21.15.37:0/607369718 conn(0x7f9800050180 msgr2=0x7f980004f880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:43.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.411+0000 7f4ab2ffd640 1 -- 172.21.15.37:0/1689343280 <== osd.3 v2:172.21.15.37:6809/1160021017 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f4ac4068b20 con 0x7f4aa4074ec0 2024-04-22T07:18:43.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.411+0000 7f980e02a640 1 -- 172.21.15.37:0/607369718 shutdown_connections 2024-04-22T07:18:43.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.411+0000 7f980e02a640 1 -- 172.21.15.37:0/607369718 wait complete. 2024-04-22T07:18:43.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.411+0000 7fb164ff9640 1 -- 172.21.15.37:0/2489057901 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fb15806c9c0 msgr2=0x7fb15806ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:43.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.411+0000 7fb164ff9640 1 --2- 172.21.15.37:0/2489057901 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fb15806c9c0 0x7fb15806ee80 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb16c036000 tx=0x7fb16c008030 comp rx=0 tx=0).stop 2024-04-22T07:18:43.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.411+0000 7fb164ff9640 1 -- 172.21.15.37:0/2489057901 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb17004ba60 msgr2=0x7fb1700b4f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:43.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.411+0000 7fb164ff9640 1 --2- 172.21.15.37:0/2489057901 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb17004ba60 0x7fb1700b4f20 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fb178051230 tx=0x7fb178068fb0 comp rx=0 tx=0).stop 2024-04-22T07:18:43.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.411+0000 7fb176d9d640 1 -- 172.21.15.37:0/2489057901 reap_dead start 2024-04-22T07:18:43.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.411+0000 7fc7ddffb640 1 -- 172.21.15.37:0/3835843626 shutdown_connections 2024-04-22T07:18:43.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.411+0000 7efe167fc640 1 -- 172.21.15.37:0/456546767 <== osd.0 v2:172.21.15.37:6800/1488290385 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7efe08002dd0 con 0x7efe04074bf0 2024-04-22T07:18:43.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.411+0000 7fd00e392640 1 -- 172.21.15.37:0/3272826320 >> [v2:172.21.15.196:6808/374829049,v1:172.21.15.196:6809/374829049] conn(0x7fcff4074c40 msgr2=0x7fcff4077060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:43.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.411+0000 7fd00e392640 1 --2- 172.21.15.37:0/3272826320 >> [v2:172.21.15.196:6808/374829049,v1:172.21.15.196:6809/374829049] conn(0x7fcff4074c40 0x7fcff4077060 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:43.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.411+0000 7fc7ddffb640 1 -- 172.21.15.37:0/3835843626 wait complete. 2024-04-22T07:18:43.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.412+0000 7f4ac8a32640 1 -- 172.21.15.37:0/1689343280 >> [v2:172.21.15.37:6809/1160021017,v1:172.21.15.37:6810/1160021017] conn(0x7f4aa4074ec0 msgr2=0x7f4aa40772e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:43.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.412+0000 7f4ac8a32640 1 --2- 172.21.15.37:0/1689343280 >> [v2:172.21.15.37:6809/1160021017,v1:172.21.15.37:6810/1160021017] conn(0x7f4aa4074ec0 0x7f4aa40772e0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:43.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.411+0000 7fb164ff9640 1 -- 172.21.15.37:0/2489057901 shutdown_connections 2024-04-22T07:18:43.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.411+0000 7fb164ff9640 1 -- 172.21.15.37:0/2489057901 >> 172.21.15.37:0/2489057901 conn(0x7fb170050180 msgr2=0x7fb170005e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:43.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.412+0000 7fb164ff9640 1 -- 172.21.15.37:0/2489057901 shutdown_connections 2024-04-22T07:18:43.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.412+0000 7fd00e392640 1 -- 172.21.15.37:0/3272826320 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fcff406c9c0 msgr2=0x7fcff406ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:43.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.412+0000 7fd00e392640 1 --2- 172.21.15.37:0/3272826320 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fcff406c9c0 0x7fcff406ee80 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fcff8000f60 tx=0x7fcff8009040 comp rx=0 tx=0).stop 2024-04-22T07:18:43.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.412+0000 7fd00e392640 1 -- 172.21.15.37:0/3272826320 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd00815fc80 msgr2=0x7fd0080cee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:43.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.412+0000 7fd00e392640 1 --2- 172.21.15.37:0/3272826320 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd00815fc80 0x7fd0080cee30 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fcffc00c4e0 tx=0x7fcffc00c9a0 comp rx=0 tx=0).stop 2024-04-22T07:18:43.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.412+0000 7efe27fe6640 1 -- 172.21.15.37:0/456546767 >> [v2:172.21.15.37:6800/1488290385,v1:172.21.15.37:6801/1488290385] conn(0x7efe04074bf0 msgr2=0x7efe04077010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:43.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.412+0000 7efe27fe6640 1 --2- 172.21.15.37:0/456546767 >> [v2:172.21.15.37:6800/1488290385,v1:172.21.15.37:6801/1488290385] conn(0x7efe04074bf0 0x7efe04077010 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:43.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.412+0000 7fd00db91640 1 -- 172.21.15.37:0/3272826320 reap_dead start 2024-04-22T07:18:43.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.412+0000 7fb164ff9640 1 -- 172.21.15.37:0/2489057901 wait complete. 2024-04-22T07:18:43.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.412+0000 7efe27fe6640 1 -- 172.21.15.37:0/456546767 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7efe0406c9f0 msgr2=0x7efe0406eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:43.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.412+0000 7efe27fe6640 1 --2- 172.21.15.37:0/456546767 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7efe0406c9f0 0x7efe0406eeb0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7efe10037000 tx=0x7efe10008030 comp rx=0 tx=0).stop 2024-04-22T07:18:43.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.412+0000 7fd00e392640 1 -- 172.21.15.37:0/3272826320 shutdown_connections 2024-04-22T07:18:43.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.412+0000 7fd00e392640 1 -- 172.21.15.37:0/3272826320 >> 172.21.15.37:0/3272826320 conn(0x7fd0080d04e0 msgr2=0x7fd0080d08c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:43.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.412+0000 7efe27fe6640 1 -- 172.21.15.37:0/456546767 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efe180063d0 msgr2=0x7efe18170eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:43.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.412+0000 7efe27fe6640 1 --2- 172.21.15.37:0/456546767 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efe180063d0 0x7efe18170eb0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7efe1c00e870 tx=0x7efe1c00ed30 comp rx=0 tx=0).stop 2024-04-22T07:18:43.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.412+0000 7efe26583640 1 -- 172.21.15.37:0/456546767 reap_dead start 2024-04-22T07:18:43.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.412+0000 7f4ac8a32640 1 -- 172.21.15.37:0/1689343280 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f4aa406cd20 msgr2=0x7f4aa406f1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:43.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.412+0000 7f4ac8a32640 1 --2- 172.21.15.37:0/1689343280 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f4aa406cd20 0x7f4aa406f1e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f4ac40b5bd0 tx=0x7f4ab4009060 comp rx=0 tx=0).stop 2024-04-22T07:18:43.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.412+0000 7f4ac8a32640 1 -- 172.21.15.37:0/1689343280 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ac40c5800 msgr2=0x7f4ac414d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:43.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.412+0000 7f4ac8a32640 1 --2- 172.21.15.37:0/1689343280 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ac40c5800 0x7f4ac414d1c0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f4ab800d800 tx=0x7f4ab800dcc0 comp rx=0 tx=0).stop 2024-04-22T07:18:43.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.412+0000 7f4ac2d9d640 1 -- 172.21.15.37:0/1689343280 reap_dead start 2024-04-22T07:18:43.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.412+0000 7efe27fe6640 1 -- 172.21.15.37:0/456546767 shutdown_connections 2024-04-22T07:18:43.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.412+0000 7efe27fe6640 1 -- 172.21.15.37:0/456546767 >> 172.21.15.37:0/456546767 conn(0x7efe18050180 msgr2=0x7efe1804cb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:43.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.412+0000 7f4ac8a32640 1 -- 172.21.15.37:0/1689343280 shutdown_connections 2024-04-22T07:18:43.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.412+0000 7f4ac8a32640 1 -- 172.21.15.37:0/1689343280 >> 172.21.15.37:0/1689343280 conn(0x7f4ac4067aa0 msgr2=0x7f4ac41540f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:43.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.413+0000 7fd00e392640 1 -- 172.21.15.37:0/3272826320 shutdown_connections 2024-04-22T07:18:43.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.413+0000 7f4ac8a32640 1 -- 172.21.15.37:0/1689343280 shutdown_connections 2024-04-22T07:18:43.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.413+0000 7fd00e392640 1 -- 172.21.15.37:0/3272826320 wait complete. 2024-04-22T07:18:43.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.413+0000 7efe27fe6640 1 -- 172.21.15.37:0/456546767 shutdown_connections 2024-04-22T07:18:43.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.413+0000 7f3fad50b640 1 -- 172.21.15.37:0/1702177955 --> [v2:172.21.15.37:6808/3918584183,v1:172.21.15.37:6811/3918584183] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f3f88002dd0 con 0x7f3f94074c70 2024-04-22T07:18:43.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.413+0000 7f1a71006640 1 -- 172.21.15.37:0/1668326270 --> [v2:172.21.15.196:6816/3106266066,v1:172.21.15.196:6818/3106266066] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f1a6c0c74e0 con 0x7f1a4c074b20 2024-04-22T07:18:43.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.413+0000 7f3fa4ff9640 1 -- 172.21.15.37:0/1702177955 <== osd.1 v2:172.21.15.37:6808/3918584183 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f3f88002dd0 con 0x7f3f94074c70 2024-04-22T07:18:43.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.413+0000 7efe27fe6640 1 -- 172.21.15.37:0/456546767 wait complete. 2024-04-22T07:18:43.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.413+0000 7f4ac8a32640 1 -- 172.21.15.37:0/1689343280 wait complete. 2024-04-22T07:18:43.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.414+0000 7f1a637fe640 1 -- 172.21.15.37:0/1668326270 <== osd.7 v2:172.21.15.196:6816/3106266066 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f1a6c0c74e0 con 0x7f1a4c074b20 2024-04-22T07:18:43.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.414+0000 7f3fad50b640 1 -- 172.21.15.37:0/1702177955 >> [v2:172.21.15.37:6808/3918584183,v1:172.21.15.37:6811/3918584183] conn(0x7f3f94074c70 msgr2=0x7f3f94077090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:43.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.414+0000 7f3fad50b640 1 --2- 172.21.15.37:0/1702177955 >> [v2:172.21.15.37:6808/3918584183,v1:172.21.15.37:6811/3918584183] conn(0x7f3f94074c70 0x7f3f94077090 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:43.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.414+0000 7f3fad50b640 1 -- 172.21.15.37:0/1702177955 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f3f9406c9f0 msgr2=0x7f3f9406eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:43.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.414+0000 7f3fad50b640 1 --2- 172.21.15.37:0/1702177955 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f3f9406c9f0 0x7f3f9406eeb0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f3f98035000 tx=0x7f3f98030000 comp rx=0 tx=0).stop 2024-04-22T07:18:43.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.414+0000 7f3fad50b640 1 -- 172.21.15.37:0/1702177955 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3fa80ccc70 msgr2=0x7f3fa8141f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:43.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.414+0000 7f3fad50b640 1 --2- 172.21.15.37:0/1702177955 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3fa80ccc70 0x7f3fa8141f80 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f3f9c00c750 tx=0x7f3f9c00cc10 comp rx=0 tx=0).stop 2024-04-22T07:18:43.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.414+0000 7f3facd0a640 1 -- 172.21.15.37:0/1702177955 reap_dead start 2024-04-22T07:18:43.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.414+0000 7f1a71006640 1 -- 172.21.15.37:0/1668326270 >> [v2:172.21.15.196:6816/3106266066,v1:172.21.15.196:6818/3106266066] conn(0x7f1a4c074b20 msgr2=0x7f1a4c076f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:43.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.414+0000 7f1a71006640 1 --2- 172.21.15.37:0/1668326270 >> [v2:172.21.15.196:6816/3106266066,v1:172.21.15.196:6818/3106266066] conn(0x7f1a4c074b20 0x7f1a4c076f40 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:43.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.414+0000 7f3fad50b640 1 -- 172.21.15.37:0/1702177955 shutdown_connections 2024-04-22T07:18:43.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.414+0000 7f3fad50b640 1 -- 172.21.15.37:0/1702177955 >> 172.21.15.37:0/1702177955 conn(0x7f3fa806bb50 msgr2=0x7f3fa8158d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:43.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.414+0000 7f1a71006640 1 -- 172.21.15.37:0/1668326270 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f1a4c06c920 msgr2=0x7f1a4c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:43.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.415+0000 7f1a71006640 1 --2- 172.21.15.37:0/1668326270 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f1a4c06c920 0x7f1a4c06ede0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f1a5c006fd0 tx=0x7f1a5c008040 comp rx=0 tx=0).stop 2024-04-22T07:18:43.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.415+0000 7f1a71006640 1 -- 172.21.15.37:0/1668326270 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a6c152c00 msgr2=0x7f1a6c13e530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:43.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.415+0000 7f1a71006640 1 --2- 172.21.15.37:0/1668326270 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a6c152c00 0x7f1a6c13e530 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f1a64007db0 tx=0x7f1a6400d4a0 comp rx=0 tx=0).stop 2024-04-22T07:18:43.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.415+0000 7f3fad50b640 1 -- 172.21.15.37:0/1702177955 shutdown_connections 2024-04-22T07:18:43.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.415+0000 7f3fad50b640 1 -- 172.21.15.37:0/1702177955 wait complete. 2024-04-22T07:18:43.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.415+0000 7f1a6b59e640 1 -- 172.21.15.37:0/1668326270 reap_dead start 2024-04-22T07:18:43.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.415+0000 7f1a71006640 1 -- 172.21.15.37:0/1668326270 shutdown_connections 2024-04-22T07:18:43.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.415+0000 7f1a71006640 1 -- 172.21.15.37:0/1668326270 >> 172.21.15.37:0/1668326270 conn(0x7f1a6c0cc060 msgr2=0x7f1a6c0c7700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:43.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.415+0000 7f1a71006640 1 -- 172.21.15.37:0/1668326270 shutdown_connections 2024-04-22T07:18:43.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.415+0000 7f1a71006640 1 -- 172.21.15.37:0/1668326270 wait complete. 2024-04-22T07:18:43.489 INFO:teuthology.orchestra.run.smithi037.stdout:55834574855 2024-04-22T07:18:43.490 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-22T07:18:43.491 INFO:teuthology.orchestra.run.smithi037.stdout:55834574855 2024-04-22T07:18:43.491 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-22T07:18:43.492 INFO:teuthology.orchestra.run.smithi037.stdout:55834574855 2024-04-22T07:18:43.492 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-22T07:18:43.493 INFO:teuthology.orchestra.run.smithi037.stdout:55834574855 2024-04-22T07:18:43.493 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-22T07:18:43.494 INFO:teuthology.orchestra.run.smithi037.stdout:55834574856 2024-04-22T07:18:43.494 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-22T07:18:43.495 INFO:teuthology.orchestra.run.smithi037.stdout:55834574856 2024-04-22T07:18:43.495 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-22T07:18:43.496 INFO:teuthology.orchestra.run.smithi037.stdout:55834574855 2024-04-22T07:18:43.496 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-22T07:18:43.497 INFO:teuthology.orchestra.run.smithi037.stdout:55834574856 2024-04-22T07:18:43.497 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-22T07:18:43.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.707+0000 7fb78bbf4640 1 Processor -- start 2024-04-22T07:18:43.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.706+0000 7f3926be1640 1 Processor -- start 2024-04-22T07:18:43.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.707+0000 7f3926be1640 1 -- start start 2024-04-22T07:18:43.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.707+0000 7f16486c1640 1 Processor -- start 2024-04-22T07:18:43.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.707+0000 7fb78bbf4640 1 -- start start 2024-04-22T07:18:43.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.707+0000 7f16486c1640 1 -- start start 2024-04-22T07:18:43.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.708+0000 7f231d504640 1 Processor -- start 2024-04-22T07:18:43.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.708+0000 7f231d504640 1 -- start start 2024-04-22T07:18:43.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.708+0000 7f3926be1640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f392006b970 0x7f392015e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:43.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.708+0000 7f3926be1640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3920073d40 con 0x7f39200c9110 2024-04-22T07:18:43.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.708+0000 7f3926be1640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f392006cbf0 con 0x7f3920154f30 2024-04-22T07:18:43.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.708+0000 7f3926be1640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f3920073780 con 0x7f392006b970 2024-04-22T07:18:43.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.708+0000 7f39263e0640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f39200c9110 0x7f3920165670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:56534/0 (socket says 172.21.15.37:56534) 2024-04-22T07:18:43.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.708+0000 7f39263e0640 1 -- 172.21.15.37:0/2680070017 learned_addr learned my addr 172.21.15.37:0/2680070017 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-04-22T07:18:43.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.708+0000 7fb78bbf4640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fb77c0d8eb0 0x7fb77c04ae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:43.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.709+0000 7fb78bbf4640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb77c050900 0x7fb77c0df370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:43.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.709+0000 7fb78bbf4640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb77c04b3c0 con 0x7fb77c0061f0 2024-04-22T07:18:43.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.709+0000 7fb78bbf4640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7fb77c04f4e0 con 0x7fb77c0d8eb0 2024-04-22T07:18:43.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.709+0000 7fb78bbf4640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fb77c04f7c0 con 0x7fb77c050900 2024-04-22T07:18:43.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.708+0000 7fbfd99b6640 1 Processor -- start 2024-04-22T07:18:43.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.708+0000 7fbfd99b6640 1 -- start start 2024-04-22T07:18:43.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.709+0000 7f3924bdd640 1 -- 172.21.15.37:0/2680070017 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1412748860 0 0) 0x7f3920073d40 con 0x7f39200c9110 2024-04-22T07:18:43.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.709+0000 7f3924bdd640 1 -- 172.21.15.37:0/2680070017 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f390c003520 con 0x7f39200c9110 2024-04-22T07:18:43.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.709+0000 7fb78918f640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fb77c0061f0 0x7fb77c0dec60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:56536/0 (socket says 172.21.15.37:56536) 2024-04-22T07:18:43.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.709+0000 7fb78918f640 1 -- 172.21.15.37:0/1629333875 learned_addr learned my addr 172.21.15.37:0/1629333875 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-04-22T07:18:43.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.709+0000 7fb789990640 1 --2- 172.21.15.37:0/1629333875 >> v2:172.21.15.196:3300/0 conn(0x7fb77c0d8eb0 0x7fb77c04ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:43.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.709+0000 7fb78a191640 1 --2- 172.21.15.37:0/1629333875 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb77c050900 0x7fb77c0df370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:43.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.709+0000 7f231d504640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f23100d9240 0x7f2310039e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:43.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.709+0000 7f231d504640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f23100e0480 0x7f231004ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:43.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.709+0000 7f231d504640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f231003a4a0 con 0x7f23100dfa90 2024-04-22T07:18:43.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.709+0000 7f231d504640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f2310050500 con 0x7f23100e0480 2024-04-22T07:18:43.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.709+0000 7f231d504640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f231004ef20 con 0x7f23100d9240 2024-04-22T07:18:43.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.709+0000 7f23167fc640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f23100e0480 0x7f231004ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:43.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.709+0000 7f23167fc640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f23100e0480 0x7f231004ffc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54654/0 (socket says 172.21.15.37:54654) 2024-04-22T07:18:43.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.710+0000 7fb78898e640 1 -- 172.21.15.37:0/1629333875 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 786449569 0 0) 0x7fb77c04b3c0 con 0x7fb77c0061f0 2024-04-22T07:18:43.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.710+0000 7fb789990640 1 -- 172.21.15.37:0/1629333875 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb77c050900 msgr2=0x7fb77c0df370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:18:43.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.710+0000 7fb789990640 1 --2- 172.21.15.37:0/1629333875 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb77c050900 0x7fb77c0df370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:43.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.710+0000 7fb789990640 1 -- 172.21.15.37:0/1629333875 >> v1:172.21.15.37:6789/0 conn(0x7fb77c0061f0 legacy=0x7fb77c0dec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:43.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.709+0000 7f23167fc640 1 -- 172.21.15.37:0/3007620234 learned_addr learned my addr 172.21.15.37:0/3007620234 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:18:43.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.710+0000 7fbfd99b6640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbfd406e840 0x7fbfd416b900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:43.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.710+0000 7fbfd99b6640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fbfd408c460 0x7fbfd40c8b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:43.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.710+0000 7fbfd99b6640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbfd4167980 con 0x7fbfd40c5dd0 2024-04-22T07:18:43.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.710+0000 7fbfd99b6640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7fbfd416be40 con 0x7fbfd408c460 2024-04-22T07:18:43.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.710+0000 7fbfd99b6640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fbfd406ecf0 con 0x7fbfd406e840 2024-04-22T07:18:43.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.710+0000 7fb789990640 1 -- 172.21.15.37:0/1629333875 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb77c04a3a0 con 0x7fb77c0d8eb0 2024-04-22T07:18:43.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.710+0000 7fbfd27fc640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbfd406e840 0x7fbfd416b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:43.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.710+0000 7fbfd2ffd640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fbfd40c5dd0 0x7fbfd4071b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:56556/0 (socket says 172.21.15.37:56556) 2024-04-22T07:18:43.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.710+0000 7fbfd2ffd640 1 -- 172.21.15.37:0/1227460931 learned_addr learned my addr 172.21.15.37:0/1227460931 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-04-22T07:18:43.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.709+0000 7f16486c1640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f1640152e50 0x7f16400c8ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:43.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.709+0000 7f16486c1640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f16400c3610 0x7f1640159440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:43.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.709+0000 7f16486c1640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f164006ffe0 0x7f16400c3d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:43.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.710+0000 7f16486c1640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f16400c94f0 con 0x7f16400c3610 2024-04-22T07:18:43.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.710+0000 7f16486c1640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f16400ca6c0 con 0x7f1640152e50 2024-04-22T07:18:43.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.710+0000 7f16486c1640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f164006d980 con 0x7f164006ffe0 2024-04-22T07:18:43.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.710+0000 7f164645d640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f1640152e50 0x7f16400c8ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:43.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.710+0000 7f4a0e08e640 1 Processor -- start 2024-04-22T07:18:43.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.710+0000 7f164645d640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f1640152e50 0x7f16400c8ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.37:34620/0 (socket says 172.21.15.37:34620) 2024-04-22T07:18:43.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.710+0000 7f164645d640 1 -- 172.21.15.37:0/3742542616 learned_addr learned my addr 172.21.15.37:0/3742542616 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:18:43.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.710+0000 7f1646c5e640 1 --2- 172.21.15.37:0/3742542616 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f164006ffe0 0x7f16400c3d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:43.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.710+0000 7f1645c5c640 1 --2- 172.21.15.37:0/3742542616 >> v2:172.21.15.37:3300/0 conn(0x7f16400c3610 0x7f1640159440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:43.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.710+0000 7f4a0e08e640 1 -- start start 2024-04-22T07:18:43.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.710+0000 7fbfd37fe640 1 --2- 172.21.15.37:0/1227460931 >> v2:172.21.15.196:3300/0 conn(0x7fbfd408c460 0x7fbfd40c8b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:43.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.710+0000 7fbfd27fc640 1 -- 172.21.15.37:0/1227460931 >> v2:172.21.15.196:3300/0 conn(0x7fbfd408c460 msgr2=0x7fbfd40c8b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:18:43.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.710+0000 7fbfd27fc640 1 --2- 172.21.15.37:0/1227460931 >> v2:172.21.15.196:3300/0 conn(0x7fbfd408c460 0x7fbfd40c8b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:43.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.710+0000 7fbfd27fc640 1 -- 172.21.15.37:0/1227460931 >> v1:172.21.15.37:6789/0 conn(0x7fbfd40c5dd0 legacy=0x7fbfd4071b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:43.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.711+0000 7fbfd27fc640 1 -- 172.21.15.37:0/1227460931 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfd4167c40 con 0x7fbfd406e840 2024-04-22T07:18:43.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.710+0000 7f2316ffd640 1 --2- 172.21.15.37:0/3007620234 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f23100d9240 0x7f2310039e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:43.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.710+0000 7f2316ffd640 1 -- 172.21.15.37:0/3007620234 >> v2:172.21.15.37:3300/0 conn(0x7f23100e0480 msgr2=0x7f231004ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:18:43.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.710+0000 7f2316ffd640 1 --2- 172.21.15.37:0/3007620234 >> v2:172.21.15.37:3300/0 conn(0x7f23100e0480 0x7f231004ffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:43.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.710+0000 7f2316ffd640 1 -- 172.21.15.37:0/3007620234 >> v1:172.21.15.37:6789/0 conn(0x7f23100dfa90 legacy=0x7f23100071a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:43.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.710+0000 7f2316ffd640 1 -- 172.21.15.37:0/3007620234 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f231004f200 con 0x7f23100d9240 2024-04-22T07:18:43.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.710+0000 7f3924bdd640 1 -- 172.21.15.37:0/2680070017 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1401872792 0 0) 0x7f390c003520 con 0x7f39200c9110 2024-04-22T07:18:43.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.710+0000 7f3924bdd640 1 -- 172.21.15.37:0/2680070017 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f392006b970 msgr2=0x7f392015e5c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-22T07:18:43.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.710+0000 7f3924bdd640 1 --2- 172.21.15.37:0/2680070017 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f392006b970 0x7f392015e5c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:43.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.710+0000 7f3924bdd640 1 -- 172.21.15.37:0/2680070017 >> v1:172.21.15.196:6789/0 conn(0x7f3920154f30 legacy=0x7f39200706e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:43.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.710+0000 7f3924bdd640 1 -- 172.21.15.37:0/2680070017 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3920073a60 con 0x7f39200c9110 2024-04-22T07:18:43.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.710+0000 7f3924bdd640 1 -- 172.21.15.37:0/2680070017 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2576656170 0 0) 0x7f3910001670 con 0x7f39200c9110 2024-04-22T07:18:43.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.711+0000 7fb789990640 1 --2- 172.21.15.37:0/1629333875 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb77c0d8eb0 0x7fb77c04ae80 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb7740097a0 tx=0x7fb77402b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b4e4d23f61be0b99 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:43.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.710+0000 7f3924bdd640 1 -- 172.21.15.37:0/2680070017 >> v1:172.21.15.37:6789/0 conn(0x7f39200c9110 legacy=0x7f3920165670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:43.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.710+0000 7f3924bdd640 1 --2- 172.21.15.37:0/2680070017 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f392006b970 0x7f390c003a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:43.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.710+0000 7f3924bdd640 1 --2- 172.21.15.37:0/2680070017 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f390c004180 0x7f390c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:43.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.710+0000 7f3924bdd640 1 --2- 172.21.15.37:0/2680070017 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f390c004e60 0x7f390c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:43.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.710+0000 7f3924bdd640 1 -- 172.21.15.37:0/2680070017 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3920073780 con 0x7f390c004180 2024-04-22T07:18:43.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.710+0000 7f3924bdd640 1 -- 172.21.15.37:0/2680070017 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f390c0055e0 con 0x7f390c004e60 2024-04-22T07:18:43.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.710+0000 7f3924bdd640 1 -- 172.21.15.37:0/2680070017 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f390c00bf00 con 0x7f392006b970 2024-04-22T07:18:43.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.711+0000 7f39263e0640 1 --2- 172.21.15.37:0/2680070017 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f390c004e60 0x7f390c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:43.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.711+0000 7f39253de640 1 --2- 172.21.15.37:0/2680070017 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f390c004180 0x7f390c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:43.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.711+0000 7f3925bdf640 1 --2- 172.21.15.37:0/2680070017 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f392006b970 0x7f390c003a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:43.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.711+0000 7f2316ffd640 1 --2- 172.21.15.37:0/3007620234 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f23100d9240 0x7f2310039e60 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f231802db50 tx=0x7f23180a7aa0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=adf1e1478e3574c8 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:43.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.711+0000 7f2bc29fa640 1 Processor -- start 2024-04-22T07:18:43.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.711+0000 7f164645d640 1 -- 172.21.15.37:0/3742542616 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f164006ffe0 msgr2=0x7f16400c3d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:18:43.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.711+0000 7f164645d640 1 --2- 172.21.15.37:0/3742542616 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f164006ffe0 0x7f16400c3d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:43.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.711+0000 7f164645d640 1 -- 172.21.15.37:0/3742542616 >> v2:172.21.15.37:3300/0 conn(0x7f16400c3610 msgr2=0x7f1640159440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:18:43.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.711+0000 7f164645d640 1 --2- 172.21.15.37:0/3742542616 >> v2:172.21.15.37:3300/0 conn(0x7f16400c3610 0x7f1640159440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:43.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.711+0000 7f164645d640 1 -- 172.21.15.37:0/3742542616 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1640159980 con 0x7f1640152e50 2024-04-22T07:18:43.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.712+0000 7fbfd27fc640 1 --2- 172.21.15.37:0/1227460931 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbfd406e840 0x7fbfd416b900 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fbfcc00be30 tx=0x7fbfcc0302d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d4b0937d5687456f server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:43.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.712+0000 7fbfd1ffb640 1 -- 172.21.15.37:0/1227460931 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfcc00b2d0 con 0x7fbfd406e840 2024-04-22T07:18:43.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.712+0000 7fbfd1ffb640 1 -- 172.21.15.37:0/1227460931 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbfcc009540 con 0x7fbfd406e840 2024-04-22T07:18:43.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.712+0000 7fbfd1ffb640 1 -- 172.21.15.37:0/1227460931 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfcc009970 con 0x7fbfd406e840 2024-04-22T07:18:43.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.712+0000 7fb78898e640 1 -- 172.21.15.37:0/1629333875 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb774035020 con 0x7fb77c0d8eb0 2024-04-22T07:18:43.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.712+0000 7fb78898e640 1 -- 172.21.15.37:0/1629333875 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb774031830 con 0x7fb77c0d8eb0 2024-04-22T07:18:43.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.712+0000 7fb78898e640 1 -- 172.21.15.37:0/1629333875 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb774031c00 con 0x7fb77c0d8eb0 2024-04-22T07:18:43.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.713+0000 7fb78bbf4640 1 -- 172.21.15.37:0/1629333875 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb77c0d8eb0 msgr2=0x7fb77c04ae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:43.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.713+0000 7fb78bbf4640 1 --2- 172.21.15.37:0/1629333875 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb77c0d8eb0 0x7fb77c04ae80 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb7740097a0 tx=0x7fb77402b8d0 comp rx=0 tx=0).stop 2024-04-22T07:18:43.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.712+0000 7f39253de640 1 -- 172.21.15.37:0/2680070017 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f392006b970 msgr2=0x7f390c003a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:18:43.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.712+0000 7f39253de640 1 --2- 172.21.15.37:0/2680070017 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f392006b970 0x7f390c003a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:43.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.712+0000 7f39253de640 1 -- 172.21.15.37:0/2680070017 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f390c004e60 msgr2=0x7f390c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:18:43.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.712+0000 7f39253de640 1 --2- 172.21.15.37:0/2680070017 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f390c004e60 0x7f390c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:43.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.712+0000 7f39253de640 1 -- 172.21.15.37:0/2680070017 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3920073a60 con 0x7f390c004180 2024-04-22T07:18:43.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.712+0000 7f2315ffb640 1 -- 172.21.15.37:0/3007620234 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23180ab900 con 0x7f23100d9240 2024-04-22T07:18:43.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.712+0000 7f2315ffb640 1 -- 172.21.15.37:0/3007620234 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23180abae0 con 0x7f23100d9240 2024-04-22T07:18:43.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.712+0000 7f164645d640 1 --2- 172.21.15.37:0/3742542616 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1640152e50 0x7f16400c8ef0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f16400cc000 tx=0x7f163c02b890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a933756e3df9f68b server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:43.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.712+0000 7f6c30811640 1 Processor -- start 2024-04-22T07:18:43.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.712+0000 7f6c30811640 1 -- start start 2024-04-22T07:18:43.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.712+0000 7f2bc29fa640 1 -- start start 2024-04-22T07:18:43.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.712+0000 7f4a0e08e640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f4a000d51f0 0x7f4a0004b610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:43.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.712+0000 7f4a077fe640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f4a000d51f0 0x7f4a0004b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:43.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.712+0000 7f4a077fe640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f4a000d51f0 0x7f4a0004b610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.37:34654/0 (socket says 172.21.15.37:34654) 2024-04-22T07:18:43.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.712+0000 7f4a0e08e640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4a00005e80 0x7f4a00045320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:43.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.712+0000 7f4a077fe640 1 -- 172.21.15.37:0/1655961884 learned_addr learned my addr 172.21.15.37:0/1655961884 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:18:43.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.713+0000 7f4a0e08e640 1 -- 172.21.15.37:0/1655961884 --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a00045ec0 con 0x7f4a0004b080 2024-04-22T07:18:43.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.713+0000 7f4a07fff640 1 --2- 172.21.15.37:0/1655961884 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4a00005e80 0x7f4a00045320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:43.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.713+0000 7f4a0e08e640 1 -- 172.21.15.37:0/1655961884 --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f4a00046f20 con 0x7f4a000d51f0 2024-04-22T07:18:43.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.713+0000 7f4a0e08e640 1 -- 172.21.15.37:0/1655961884 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f4a00046160 con 0x7f4a00005e80 2024-04-22T07:18:43.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.713+0000 7f231d504640 1 -- 172.21.15.37:0/3007620234 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f23100d9240 msgr2=0x7f2310039e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:43.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.713+0000 7f231d504640 1 --2- 172.21.15.37:0/3007620234 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f23100d9240 0x7f2310039e60 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f231802db50 tx=0x7f23180a7aa0 comp rx=0 tx=0).stop 2024-04-22T07:18:43.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.713+0000 7f231d504640 1 -- 172.21.15.37:0/3007620234 shutdown_connections 2024-04-22T07:18:43.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.713+0000 7f231d504640 1 --2- 172.21.15.37:0/3007620234 >> v2:172.21.15.37:3300/0 conn(0x7f23100e0480 0x7f231004ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:43.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.713+0000 7f231d504640 1 --2- 172.21.15.37:0/3007620234 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f23100d9240 0x7f2310039e60 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:43.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.713+0000 7f231d504640 1 -- 172.21.15.37:0/3007620234 >> 172.21.15.37:0/3007620234 conn(0x7f231000e150 msgr2=0x7f231000e560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:43.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.713+0000 7f231d504640 1 -- 172.21.15.37:0/3007620234 shutdown_connections 2024-04-22T07:18:43.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.713+0000 7f2bc29fa640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f2bbc154df0 0x7f2bbc0c5500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:43.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.713+0000 7fbfd99b6640 1 -- 172.21.15.37:0/1227460931 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbfd406e840 msgr2=0x7fbfd416b900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:43.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.713+0000 7fbfd99b6640 1 --2- 172.21.15.37:0/1227460931 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbfd406e840 0x7fbfd416b900 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fbfcc00be30 tx=0x7fbfcc0302d0 comp rx=0 tx=0).stop 2024-04-22T07:18:43.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.713+0000 7f2bc29fa640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2bbc1551d0 0x7f2bbc0d0550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:43.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.713+0000 7f231d504640 1 -- 172.21.15.37:0/3007620234 wait complete. 2024-04-22T07:18:43.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.713+0000 7f164545b640 1 -- 172.21.15.37:0/3742542616 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f163c0317f0 con 0x7f1640152e50 2024-04-22T07:18:43.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.713+0000 7f164545b640 1 -- 172.21.15.37:0/3742542616 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f163c037070 con 0x7f1640152e50 2024-04-22T07:18:43.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.713+0000 7f164545b640 1 -- 172.21.15.37:0/3742542616 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f163c031bb0 con 0x7f1640152e50 2024-04-22T07:18:43.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.713+0000 7f39253de640 1 --2- 172.21.15.37:0/2680070017 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f390c004180 0x7f390c004800 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f3918009e60 tx=0x7f390c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=983210441ccde750 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:43.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.713+0000 7fb78bbf4640 1 -- 172.21.15.37:0/1629333875 shutdown_connections 2024-04-22T07:18:43.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.713+0000 7fb78bbf4640 1 --2- 172.21.15.37:0/1629333875 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb77c050900 0x7fb77c0df370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:43.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.713+0000 7fb78bbf4640 1 --2- 172.21.15.37:0/1629333875 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb77c0d8eb0 0x7fb77c04ae80 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:43.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.713+0000 7fb78bbf4640 1 -- 172.21.15.37:0/1629333875 >> 172.21.15.37:0/1629333875 conn(0x7fb77c054510 msgr2=0x7fb77c054920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:43.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.713+0000 7f2bc29fa640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2bbc0cde20 con 0x7f2bbc0c5a40 2024-04-22T07:18:43.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.714+0000 7f2bc19f8640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f2bbc154df0 0x7f2bbc0c5500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:43.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.714+0000 7f2bc29fa640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f2bbc0cd990 con 0x7f2bbc1551d0 2024-04-22T07:18:43.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.714+0000 7f2bc29fa640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f2bbc0ccaa0 con 0x7f2bbc154df0 2024-04-22T07:18:43.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.714+0000 7fbfd99b6640 1 -- 172.21.15.37:0/1227460931 shutdown_connections 2024-04-22T07:18:43.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.714+0000 7fbfd99b6640 1 --2- 172.21.15.37:0/1227460931 >> v2:172.21.15.196:3300/0 conn(0x7fbfd408c460 0x7fbfd40c8b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:43.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.714+0000 7fbfd99b6640 1 --2- 172.21.15.37:0/1227460931 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbfd406e840 0x7fbfd416b900 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:43.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.714+0000 7fbfd99b6640 1 -- 172.21.15.37:0/1227460931 >> 172.21.15.37:0/1227460931 conn(0x7fbfd40cc2e0 msgr2=0x7fbfd40cc6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:43.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.714+0000 7f2bc19f8640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f2bbc154df0 0x7f2bbc0c5500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.37:34658/0 (socket says 172.21.15.37:34658) 2024-04-22T07:18:43.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.714+0000 7f2bc19f8640 1 -- 172.21.15.37:0/2590240933 learned_addr learned my addr 172.21.15.37:0/2590240933 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:18:43.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.713+0000 7f4a077fe640 1 -- 172.21.15.37:0/1655961884 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4a00005e80 msgr2=0x7f4a00045320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:18:43.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.713+0000 7f4a077fe640 1 --2- 172.21.15.37:0/1655961884 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4a00005e80 0x7f4a00045320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:43.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.713+0000 7f4a077fe640 1 -- 172.21.15.37:0/1655961884 >> v1:172.21.15.196:6789/0 conn(0x7f4a0004b080 legacy=0x7f4a000db820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:18:43.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.713+0000 7f4a077fe640 1 -- 172.21.15.37:0/1655961884 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a00046440 con 0x7f4a000d51f0 2024-04-22T07:18:43.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.714+0000 7fb78bbf4640 1 -- 172.21.15.37:0/1629333875 shutdown_connections 2024-04-22T07:18:43.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.714+0000 7f16486c1640 1 -- 172.21.15.37:0/3742542616 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1640152e50 msgr2=0x7f16400c8ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:43.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.714+0000 7f16486c1640 1 --2- 172.21.15.37:0/3742542616 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1640152e50 0x7f16400c8ef0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f16400cc000 tx=0x7f163c02b890 comp rx=0 tx=0).stop 2024-04-22T07:18:43.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.714+0000 7f3924bdd640 1 -- 172.21.15.37:0/2680070017 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3918039070 con 0x7f390c004180 2024-04-22T07:18:43.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.714+0000 7f3924bdd640 1 -- 172.21.15.37:0/2680070017 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f391802cd90 con 0x7f390c004180 2024-04-22T07:18:43.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.714+0000 7f3924bdd640 1 -- 172.21.15.37:0/2680070017 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3918009a30 con 0x7f390c004180 2024-04-22T07:18:43.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.714+0000 7f6c30811640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6c2c0c89c0 0x7f6c2c0c8da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:43.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.714+0000 7f6c30811640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f6c2c072df0 0x7f6c2c1615d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:43.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.714+0000 7fb78bbf4640 1 -- 172.21.15.37:0/1629333875 wait complete. 2024-04-22T07:18:43.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.714+0000 7fbfd99b6640 1 -- 172.21.15.37:0/1227460931 shutdown_connections 2024-04-22T07:18:43.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.714+0000 7fbfd99b6640 1 -- 172.21.15.37:0/1227460931 wait complete. 2024-04-22T07:18:43.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.714+0000 7f16486c1640 1 -- 172.21.15.37:0/3742542616 shutdown_connections 2024-04-22T07:18:43.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.714+0000 7f16486c1640 1 --2- 172.21.15.37:0/3742542616 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f164006ffe0 0x7f16400c3d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:43.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.714+0000 7f16486c1640 1 --2- 172.21.15.37:0/3742542616 >> v2:172.21.15.37:3300/0 conn(0x7f16400c3610 0x7f1640159440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:43.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.714+0000 7f16486c1640 1 --2- 172.21.15.37:0/3742542616 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1640152e50 0x7f16400c8ef0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:43.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.714+0000 7f16486c1640 1 -- 172.21.15.37:0/3742542616 >> 172.21.15.37:0/3742542616 conn(0x7f16400715d0 msgr2=0x7f16400719b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:43.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.714+0000 7f16486c1640 1 -- 172.21.15.37:0/3742542616 shutdown_connections 2024-04-22T07:18:43.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.714+0000 7f16486c1640 1 -- 172.21.15.37:0/3742542616 wait complete. 2024-04-22T07:18:43.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.714+0000 7f6c30811640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c2c151390 con 0x7f6c2c06e9a0 2024-04-22T07:18:43.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.714+0000 7f6c30811640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f6c2c15b210 con 0x7f6c2c072df0 2024-04-22T07:18:43.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.714+0000 7f6c30811640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f6c2c156e60 con 0x7f6c2c0c89c0 2024-04-22T07:18:43.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.714+0000 7f6c2ad9d640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f6c2c072df0 0x7f6c2c1615d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:43.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.714+0000 7f2bc11f7640 1 --2- 172.21.15.37:0/2590240933 >> v2:172.21.15.37:3300/0 conn(0x7f2bbc1551d0 0x7f2bbc0d0550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:43.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.714+0000 7f6c2ad9d640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f6c2c072df0 0x7f6c2c1615d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.37:34672/0 (socket says 172.21.15.37:34672) 2024-04-22T07:18:43.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.715+0000 7f3926be1640 1 -- 172.21.15.37:0/2680070017 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f390c004180 msgr2=0x7f390c004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:43.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.715+0000 7f3926be1640 1 --2- 172.21.15.37:0/2680070017 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f390c004180 0x7f390c004800 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f3918009e60 tx=0x7f390c005830 comp rx=0 tx=0).stop 2024-04-22T07:18:43.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.715+0000 7f39263e0640 1 -- 172.21.15.37:0/2680070017 reap_dead start 2024-04-22T07:18:43.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.715+0000 7f3926be1640 1 -- 172.21.15.37:0/2680070017 shutdown_connections 2024-04-22T07:18:43.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.715+0000 7f3926be1640 1 -- 172.21.15.37:0/2680070017 >> 172.21.15.37:0/2680070017 conn(0x7f39200ca1e0 msgr2=0x7f39200ca5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:43.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.714+0000 7f6c2ad9d640 1 -- 172.21.15.37:0/445800334 learned_addr learned my addr 172.21.15.37:0/445800334 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:18:43.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.714+0000 7f6c2a59c640 1 --2- 172.21.15.37:0/445800334 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6c2c0c89c0 0x7f6c2c0c8da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:43.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.715+0000 7f6c2ad9d640 1 -- 172.21.15.37:0/445800334 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6c2c0c89c0 msgr2=0x7f6c2c0c8da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:18:43.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.715+0000 7f2bc19f8640 1 -- 172.21.15.37:0/2590240933 >> v2:172.21.15.37:3300/0 conn(0x7f2bbc1551d0 msgr2=0x7f2bbc0d0550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:18:43.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.715+0000 7f2bc19f8640 1 --2- 172.21.15.37:0/2590240933 >> v2:172.21.15.37:3300/0 conn(0x7f2bbc1551d0 0x7f2bbc0d0550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:43.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.715+0000 7f2bc19f8640 1 -- 172.21.15.37:0/2590240933 >> v1:172.21.15.37:6789/0 conn(0x7f2bbc0c5a40 legacy=0x7f2bbc0cb5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:18:43.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.715+0000 7f2bc19f8640 1 -- 172.21.15.37:0/2590240933 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bbc0ccd80 con 0x7f2bbc154df0 2024-04-22T07:18:43.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.715+0000 7f6c2ad9d640 1 --2- 172.21.15.37:0/445800334 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6c2c0c89c0 0x7f6c2c0c8da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:43.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.715+0000 7f6c2ad9d640 1 -- 172.21.15.37:0/445800334 >> v1:172.21.15.196:6789/0 conn(0x7f6c2c06e9a0 legacy=0x7f6c2c157340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:18:43.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.715+0000 7f6c2ad9d640 1 -- 172.21.15.37:0/445800334 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c2c06d620 con 0x7f6c2c072df0 2024-04-22T07:18:43.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.715+0000 7f231d504640 1 Processor -- start 2024-04-22T07:18:43.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.716+0000 7fbfd99b6640 1 Processor -- start 2024-04-22T07:18:43.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.716+0000 7fb78bbf4640 1 Processor -- start 2024-04-22T07:18:43.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.716+0000 7fb78bbf4640 1 -- start start 2024-04-22T07:18:43.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.716+0000 7f16486c1640 1 Processor -- start 2024-04-22T07:18:43.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.716+0000 7fbfd99b6640 1 -- start start 2024-04-22T07:18:43.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.716+0000 7f16486c1640 1 -- start start 2024-04-22T07:18:43.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.716+0000 7f6c2ad9d640 1 --2- 172.21.15.37:0/445800334 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6c2c072df0 0x7f6c2c1615d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6c24009d40 tx=0x7f6c24030370 comp rx=0 tx=0).ready entity=mon.1 client_cookie=14c61c69e1cecb9a server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:43.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.716+0000 7f6c2959a640 1 -- 172.21.15.37:0/445800334 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c2403c070 con 0x7f6c2c072df0 2024-04-22T07:18:43.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.716+0000 7f6c2959a640 1 -- 172.21.15.37:0/445800334 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c24037600 con 0x7f6c2c072df0 2024-04-22T07:18:43.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.715+0000 7f4a077fe640 1 --2- 172.21.15.37:0/1655961884 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4a000d51f0 0x7f4a0004b610 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f49fc00b1e0 tx=0x7f49fc02c210 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7e3a63c1ddeee5cd server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:43.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.715+0000 7f4a067fc640 1 -- 172.21.15.37:0/1655961884 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49fc039070 con 0x7f4a000d51f0 2024-04-22T07:18:43.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.715+0000 7f4a067fc640 1 -- 172.21.15.37:0/1655961884 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49fc034440 con 0x7f4a000d51f0 2024-04-22T07:18:43.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.715+0000 7f4a067fc640 1 -- 172.21.15.37:0/1655961884 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49fc034810 con 0x7f4a000d51f0 2024-04-22T07:18:43.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.716+0000 7f4a0e08e640 1 -- 172.21.15.37:0/1655961884 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4a000d51f0 msgr2=0x7f4a0004b610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:43.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.716+0000 7f4a0e08e640 1 --2- 172.21.15.37:0/1655961884 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4a000d51f0 0x7f4a0004b610 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f49fc00b1e0 tx=0x7f49fc02c210 comp rx=0 tx=0).stop 2024-04-22T07:18:43.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.716+0000 7f6c2959a640 1 -- 172.21.15.37:0/445800334 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c240379d0 con 0x7f6c2c072df0 2024-04-22T07:18:43.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.716+0000 7f4a0e08e640 1 -- 172.21.15.37:0/1655961884 shutdown_connections 2024-04-22T07:18:43.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.716+0000 7f4a0e08e640 1 --2- 172.21.15.37:0/1655961884 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4a00005e80 0x7f4a00045320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:43.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.716+0000 7f4a0e08e640 1 --2- 172.21.15.37:0/1655961884 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4a000d51f0 0x7f4a0004b610 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:43.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.716+0000 7f4a0e08e640 1 -- 172.21.15.37:0/1655961884 >> 172.21.15.37:0/1655961884 conn(0x7f4a00050170 msgr2=0x7f4a00050580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:43.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.717+0000 7f2bc19f8640 1 --2- 172.21.15.37:0/2590240933 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2bbc154df0 0x7f2bbc0c5500 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f2bbc0d15a0 tx=0x7f2bb802b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ebf012c10d01f2f0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:43.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.717+0000 7f4a0e08e640 1 -- 172.21.15.37:0/1655961884 shutdown_connections 2024-04-22T07:18:43.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.717+0000 7f4a0e08e640 1 -- 172.21.15.37:0/1655961884 wait complete. 2024-04-22T07:18:43.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.715+0000 7f231d504640 1 -- start start 2024-04-22T07:18:43.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.717+0000 7f231d504640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f23100d9240 0x7f23100d9980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:43.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.717+0000 7f231d504640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f23100dfa90 0x7f23100d5b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:43.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.717+0000 7f231d504640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f23100e0480 0x7f23100d3980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:43.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.717+0000 7fb78bbf4640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb77c0061f0 0x7fb77c04ca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:43.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.717+0000 7f231d504640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f231004faa0 con 0x7f23100d9240 2024-04-22T07:18:43.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.717+0000 7f231d504640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f231004f7c0 con 0x7f23100e0480 2024-04-22T07:18:43.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.717+0000 7fb78bbf4640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb77c050900 0x7fb77c0ce390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:43.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.717+0000 7fb789990640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb77c0061f0 0x7fb77c04ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:43.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.717+0000 7f23177fe640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f23100e0480 0x7f23100d3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:43.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.717+0000 7f23177fe640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f23100e0480 0x7f23100d3980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.37:34680/0 (socket says 172.21.15.37:34680) 2024-04-22T07:18:43.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.717+0000 7f23177fe640 1 -- 172.21.15.37:0/946311409 learned_addr learned my addr 172.21.15.37:0/946311409 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:18:43.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.717+0000 7fb789990640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb77c0061f0 0x7fb77c04ca30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54706/0 (socket says 172.21.15.37:54706) 2024-04-22T07:18:43.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.717+0000 7fb789990640 1 -- 172.21.15.37:0/57131175 learned_addr learned my addr 172.21.15.37:0/57131175 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:18:43.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.717+0000 7fbfd99b6640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbfd406e840 0x7fbfd4161840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:43.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.717+0000 7fbfd99b6640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbfd408c460 0x7fbfd4163580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:43.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.717+0000 7fbfd99b6640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbfd40c5dd0 0x7fbfd4209220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:43.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.717+0000 7fbfd99b6640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fbfd4072240 con 0x7fbfd406e840 2024-04-22T07:18:43.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.717+0000 7fbfd99b6640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fbfd4168200 con 0x7fbfd40c5dd0 2024-04-22T07:18:43.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.717+0000 7fbfd99b6640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fbfd40723c0 con 0x7fbfd408c460 2024-04-22T07:18:43.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.717+0000 7f231d504640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f23100dff20 con 0x7f23100dfa90 2024-04-22T07:18:43.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.717+0000 7f2316ffd640 1 --2- 172.21.15.37:0/946311409 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f23100d9240 0x7f23100d9980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:43.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.717+0000 7fb78bbf4640 1 --2- 172.21.15.37:0/57131175 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb77c0d8eb0 0x7fb77c0ce8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:43.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.717+0000 7fb78bbf4640 1 -- 172.21.15.37:0/57131175 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fb77c0d9290 con 0x7fb77c0061f0 2024-04-22T07:18:43.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.717+0000 7fb78bbf4640 1 -- 172.21.15.37:0/57131175 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fb77c04a960 con 0x7fb77c050900 2024-04-22T07:18:43.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.717+0000 7fb78bbf4640 1 -- 172.21.15.37:0/57131175 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fb77c04fc70 con 0x7fb77c0d8eb0 2024-04-22T07:18:43.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.717+0000 7f2bc09f6640 1 -- 172.21.15.37:0/2590240933 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bb8035020 con 0x7f2bbc154df0 2024-04-22T07:18:43.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.717+0000 7fbfd27fc640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbfd408c460 0x7fbfd4163580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:43.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.717+0000 7fbfd27fc640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbfd408c460 0x7fbfd4163580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.37:54088/0 (socket says 172.21.15.37:54088) 2024-04-22T07:18:43.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.717+0000 7fbfd27fc640 1 -- 172.21.15.37:0/3589724948 learned_addr learned my addr 172.21.15.37:0/3589724948 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:18:43.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.717+0000 7fb78a191640 1 --2- 172.21.15.37:0/57131175 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb77c0d8eb0 0x7fb77c0ce8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:43.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.717+0000 7f23167fc640 1 --2- 172.21.15.37:0/946311409 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f23100dfa90 0x7f23100d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:43.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.717+0000 7f16486c1640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f164006ffe0 0x7f16401548d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:43.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.717+0000 7f6c30811640 1 -- 172.21.15.37:0/445800334 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6c2c072df0 msgr2=0x7f6c2c1615d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:43.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.717+0000 7f6c30811640 1 --2- 172.21.15.37:0/445800334 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6c2c072df0 0x7f6c2c1615d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6c24009d40 tx=0x7f6c24030370 comp rx=0 tx=0).stop 2024-04-22T07:18:43.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.717+0000 7f6c30811640 1 -- 172.21.15.37:0/445800334 shutdown_connections 2024-04-22T07:18:43.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.717+0000 7f6c30811640 1 --2- 172.21.15.37:0/445800334 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6c2c072df0 0x7f6c2c1615d0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:43.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.717+0000 7f6c30811640 1 --2- 172.21.15.37:0/445800334 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6c2c0c89c0 0x7f6c2c0c8da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:43.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.717+0000 7f6c30811640 1 -- 172.21.15.37:0/445800334 >> 172.21.15.37:0/445800334 conn(0x7f6c2c0cc2e0 msgr2=0x7f6c2c0cc6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:43.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.718+0000 7fb78918f640 1 --2- 172.21.15.37:0/57131175 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb77c050900 0x7fb77c0ce390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:43.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.718+0000 7f16486c1640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f16400c3610 0x7f16400c8a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:43.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.718+0000 7f3926be1640 1 -- 172.21.15.37:0/2680070017 shutdown_connections 2024-04-22T07:18:43.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.718+0000 7fbfd37fe640 1 --2- 172.21.15.37:0/3589724948 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbfd40c5dd0 0x7fbfd4209220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:43.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.718+0000 7f3926be1640 1 -- 172.21.15.37:0/2680070017 wait complete. 2024-04-22T07:18:43.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.718+0000 7fbfd2ffd640 1 --2- 172.21.15.37:0/3589724948 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbfd406e840 0x7fbfd4161840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:43.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.718+0000 7f164645d640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f164006ffe0 0x7f16401548d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:43.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.718+0000 7f164645d640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f164006ffe0 0x7f16401548d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.37:54096/0 (socket says 172.21.15.37:54096) 2024-04-22T07:18:43.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.718+0000 7f164645d640 1 -- 172.21.15.37:0/1840914658 learned_addr learned my addr 172.21.15.37:0/1840914658 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:18:43.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.718+0000 7f16486c1640 1 --2- 172.21.15.37:0/1840914658 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1640152e50 0x7f16401ecce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:43.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.718+0000 7fbfd27fc640 1 -- 172.21.15.37:0/3589724948 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbfd40c5dd0 msgr2=0x7fbfd4209220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:43.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.718+0000 7fbfd27fc640 1 --2- 172.21.15.37:0/3589724948 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbfd40c5dd0 0x7fbfd4209220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:43.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.718+0000 7fbfd27fc640 1 -- 172.21.15.37:0/3589724948 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbfd406e840 msgr2=0x7fbfd4161840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:43.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.718+0000 7fb78a191640 1 -- 172.21.15.37:0/57131175 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb77c050900 msgr2=0x7fb77c0ce390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:43.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.718+0000 7f16486c1640 1 -- 172.21.15.37:0/1840914658 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f164006f7e0 con 0x7f16400c3610 2024-04-22T07:18:43.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.718+0000 7f16486c1640 1 -- 172.21.15.37:0/1840914658 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f16400ca3e0 con 0x7f1640152e50 2024-04-22T07:18:43.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.718+0000 7fbfd27fc640 1 --2- 172.21.15.37:0/3589724948 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbfd406e840 0x7fbfd4161840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:43.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.718+0000 7f1646c5e640 1 --2- 172.21.15.37:0/1840914658 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1640152e50 0x7f16401ecce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:43.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.718+0000 7fbfd27fc640 1 -- 172.21.15.37:0/3589724948 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfd40c27a0 con 0x7fbfd408c460 2024-04-22T07:18:43.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.718+0000 7f16486c1640 1 -- 172.21.15.37:0/1840914658 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f164006fac0 con 0x7f164006ffe0 2024-04-22T07:18:43.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.718+0000 7fbfd2ffd640 1 --2- 172.21.15.37:0/3589724948 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbfd406e840 0x7fbfd4161840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-22T07:18:43.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.718+0000 7f23177fe640 1 -- 172.21.15.37:0/946311409 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f23100dfa90 msgr2=0x7f23100d5b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:43.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.718+0000 7f23177fe640 1 --2- 172.21.15.37:0/946311409 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f23100dfa90 0x7f23100d5b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:43.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.718+0000 7f23177fe640 1 -- 172.21.15.37:0/946311409 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f23100d9240 msgr2=0x7f23100d9980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:43.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.718+0000 7f23177fe640 1 --2- 172.21.15.37:0/946311409 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f23100d9240 0x7f23100d9980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:43.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.718+0000 7f23177fe640 1 -- 172.21.15.37:0/946311409 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23100d9ec0 con 0x7f23100e0480 2024-04-22T07:18:43.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.717+0000 7f2bc09f6640 1 -- 172.21.15.37:0/2590240933 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2bb8031870 con 0x7f2bbc154df0 2024-04-22T07:18:43.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.718+0000 7f2bc09f6640 1 -- 172.21.15.37:0/2590240933 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bb8035020 con 0x7f2bbc154df0 2024-04-22T07:18:43.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.718+0000 7fb78a191640 1 --2- 172.21.15.37:0/57131175 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb77c050900 0x7fb77c0ce390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:43.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.718+0000 7f6c30811640 1 -- 172.21.15.37:0/445800334 shutdown_connections 2024-04-22T07:18:43.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.718+0000 7fb78a191640 1 -- 172.21.15.37:0/57131175 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb77c0061f0 msgr2=0x7fb77c04ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:43.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.718+0000 7fb78a191640 1 --2- 172.21.15.37:0/57131175 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb77c0061f0 0x7fb77c04ca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:43.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.718+0000 7f6c30811640 1 -- 172.21.15.37:0/445800334 wait complete. 2024-04-22T07:18:43.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.718+0000 7f2bc29fa640 1 -- 172.21.15.37:0/2590240933 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2bbc154df0 msgr2=0x7f2bbc0c5500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:43.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.718+0000 7f2bc29fa640 1 --2- 172.21.15.37:0/2590240933 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2bbc154df0 0x7f2bbc0c5500 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f2bbc0d15a0 tx=0x7f2bb802b910 comp rx=0 tx=0).stop 2024-04-22T07:18:43.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.718+0000 7fb78a191640 1 -- 172.21.15.37:0/57131175 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb77c0d9800 con 0x7fb77c0d8eb0 2024-04-22T07:18:43.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.718+0000 7fb78918f640 1 --2- 172.21.15.37:0/57131175 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb77c050900 0x7fb77c0ce390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-22T07:18:43.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.718+0000 7f2bc29fa640 1 -- 172.21.15.37:0/2590240933 shutdown_connections 2024-04-22T07:18:43.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.718+0000 7f2bc29fa640 1 --2- 172.21.15.37:0/2590240933 >> v2:172.21.15.37:3300/0 conn(0x7f2bbc1551d0 0x7f2bbc0d0550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:43.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.718+0000 7f2bc29fa640 1 --2- 172.21.15.37:0/2590240933 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2bbc154df0 0x7f2bbc0c5500 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:43.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.718+0000 7f2bc29fa640 1 -- 172.21.15.37:0/2590240933 >> 172.21.15.37:0/2590240933 conn(0x7f2bbc067aa0 msgr2=0x7f2bbc073440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:43.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.718+0000 7f1645c5c640 1 --2- 172.21.15.37:0/1840914658 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f16400c3610 0x7f16400c8a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:43.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.719+0000 7f23177fe640 1 --2- 172.21.15.37:0/946311409 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f23100e0480 0x7f23100d3980 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f230800c540 tx=0x7f230800ca00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:43.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.719+0000 7f2bc29fa640 1 -- 172.21.15.37:0/2590240933 shutdown_connections 2024-04-22T07:18:43.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.719+0000 7f22ff7fe640 1 -- 172.21.15.37:0/946311409 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2308017070 con 0x7f23100e0480 2024-04-22T07:18:43.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.719+0000 7f22ff7fe640 1 -- 172.21.15.37:0/946311409 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23080035f0 con 0x7f23100e0480 2024-04-22T07:18:43.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.719+0000 7f22ff7fe640 1 -- 172.21.15.37:0/946311409 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23080039e0 con 0x7f23100e0480 2024-04-22T07:18:43.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.719+0000 7fbfd27fc640 1 --2- 172.21.15.37:0/3589724948 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbfd408c460 0x7fbfd4163580 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fbfcc03a040 tx=0x7fbfcc004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:43.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.719+0000 7f4a0e08e640 1 Processor -- start 2024-04-22T07:18:43.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.719+0000 7fb78a191640 1 --2- 172.21.15.37:0/57131175 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb77c0d8eb0 0x7fb77c0ce8d0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fb78000e7f0 tx=0x7fb78000ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:43.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.719+0000 7fb77a7fc640 1 -- 172.21.15.37:0/57131175 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb780017070 con 0x7fb77c0d8eb0 2024-04-22T07:18:43.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.719+0000 7f231d504640 1 -- 172.21.15.37:0/946311409 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23100daec0 con 0x7f23100e0480 2024-04-22T07:18:43.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.719+0000 7f231d504640 1 -- 172.21.15.37:0/946311409 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23100d4ce0 con 0x7f23100e0480 2024-04-22T07:18:43.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.719+0000 7fb77a7fc640 1 -- 172.21.15.37:0/57131175 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb78000c730 con 0x7fb77c0d8eb0 2024-04-22T07:18:43.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.719+0000 7f3926be1640 1 Processor -- start 2024-04-22T07:18:43.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.719+0000 7f4a0e08e640 1 -- start start 2024-04-22T07:18:43.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.719+0000 7f2bc29fa640 1 -- 172.21.15.37:0/2590240933 wait complete. 2024-04-22T07:18:43.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.720+0000 7fb77a7fc640 1 -- 172.21.15.37:0/57131175 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb78000cb60 con 0x7fb77c0d8eb0 2024-04-22T07:18:43.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.720+0000 7fb78bbf4640 1 -- 172.21.15.37:0/57131175 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb77c0d9530 con 0x7fb77c0d8eb0 2024-04-22T07:18:43.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.720+0000 7fb78bbf4640 1 -- 172.21.15.37:0/57131175 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fb77c0dd5f0 con 0x7fb77c0d8eb0 2024-04-22T07:18:43.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.719+0000 7f3926be1640 1 -- start start 2024-04-22T07:18:43.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.720+0000 7f2bc29fa640 1 Processor -- start 2024-04-22T07:18:43.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.720+0000 7f3926be1640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f39200c56e0 0x7f39200c6810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:43.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.721+0000 7f4a0e08e640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4a00005e80 0x7f4a0004efd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:43.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.720+0000 7fbfbbfff640 1 -- 172.21.15.37:0/3589724948 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfcc046070 con 0x7fbfd408c460 2024-04-22T07:18:43.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.721+0000 7f3926be1640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f39200c5ac0 0x7f392015c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:43.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.721+0000 7f6c30811640 1 Processor -- start 2024-04-22T07:18:43.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.721+0000 7f4a0e08e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a0004b080 0x7f4a000c7b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:43.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.721+0000 7f6c30811640 1 -- start start 2024-04-22T07:18:43.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.721+0000 7f3925bdf640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f39200c56e0 0x7f39200c6810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:43.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.721+0000 7f3925bdf640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f39200c56e0 0x7f39200c6810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.37:34710/0 (socket says 172.21.15.37:34710) 2024-04-22T07:18:43.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.721+0000 7f3925bdf640 1 -- 172.21.15.37:0/2457752003 learned_addr learned my addr 172.21.15.37:0/2457752003 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:18:43.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.721+0000 7f4a0e08e640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4a000d51f0 0x7f4a000de490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:43.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.721+0000 7f39253de640 1 --2- 172.21.15.37:0/2457752003 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f39200c5ac0 0x7f392015c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:43.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.721+0000 7f3926be1640 1 --2- 172.21.15.37:0/2457752003 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f392015cb10 0x7f392013ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:43.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.721+0000 7f4a06ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a0004b080 0x7f4a000c7b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:43.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.721+0000 7f4a06ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a0004b080 0x7f4a000c7b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54740/0 (socket says 172.21.15.37:54740) 2024-04-22T07:18:43.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.721+0000 7f4a077fe640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4a00005e80 0x7f4a0004efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:43.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.720+0000 7fbfbbfff640 1 -- 172.21.15.37:0/3589724948 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbfcc009900 con 0x7fbfd408c460 2024-04-22T07:18:43.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.721+0000 7f4a06ffd640 1 -- 172.21.15.37:0/1475358600 learned_addr learned my addr 172.21.15.37:0/1475358600 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:18:43.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.721+0000 7f3926be1640 1 -- 172.21.15.37:0/2457752003 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3920155310 con 0x7f392015cb10 2024-04-22T07:18:43.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.721+0000 7f3926be1640 1 -- 172.21.15.37:0/2457752003 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f392006d170 con 0x7f39200c56e0 2024-04-22T07:18:43.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.721+0000 7f4a0e08e640 1 -- 172.21.15.37:0/1475358600 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f4a0000e290 con 0x7f4a0004b080 2024-04-22T07:18:43.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.721+0000 7f3926be1640 1 -- 172.21.15.37:0/2457752003 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f3920070df0 con 0x7f39200c5ac0 2024-04-22T07:18:43.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.721+0000 7f4a07fff640 1 --2- 172.21.15.37:0/1475358600 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4a000d51f0 0x7f4a000de490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:43.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.721+0000 7f4a0e08e640 1 -- 172.21.15.37:0/1475358600 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f4a00046a00 con 0x7f4a00005e80 2024-04-22T07:18:43.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.721+0000 7f4a0e08e640 1 -- 172.21.15.37:0/1475358600 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f4a0000e410 con 0x7f4a000d51f0 2024-04-22T07:18:43.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.721+0000 7f39263e0640 1 --2- 172.21.15.37:0/2457752003 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f392015cb10 0x7f392013ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:43.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.721+0000 7f2bc29fa640 1 -- start start 2024-04-22T07:18:43.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.719+0000 7f164645d640 1 -- 172.21.15.37:0/1840914658 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1640152e50 msgr2=0x7f16401ecce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:43.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.719+0000 7f164645d640 1 --2- 172.21.15.37:0/1840914658 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1640152e50 0x7f16401ecce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:43.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.719+0000 7f164645d640 1 -- 172.21.15.37:0/1840914658 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f16400c3610 msgr2=0x7f16400c8a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:43.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.719+0000 7f164645d640 1 --2- 172.21.15.37:0/1840914658 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f16400c3610 0x7f16400c8a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:43.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.719+0000 7f164645d640 1 -- 172.21.15.37:0/1840914658 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16400c90e0 con 0x7f164006ffe0 2024-04-22T07:18:43.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.719+0000 7f164645d640 1 --2- 172.21.15.37:0/1840914658 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f164006ffe0 0x7f16401548d0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f163c0090b0 tx=0x7f163c0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:43.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.722+0000 7fbfbbfff640 1 -- 172.21.15.37:0/3589724948 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfcc009cd0 con 0x7fbfd408c460 2024-04-22T07:18:43.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.722+0000 7fbfd99b6640 1 -- 172.21.15.37:0/3589724948 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbfd416b850 con 0x7fbfd408c460 2024-04-22T07:18:43.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.722+0000 7fbfd99b6640 1 -- 172.21.15.37:0/3589724948 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fbfd40c2d40 con 0x7fbfd408c460 2024-04-22T07:18:43.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.722+0000 7fb78bbf4640 1 -- 172.21.15.37:0/57131175 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb77c007b90 con 0x7fb77c0d8eb0 2024-04-22T07:18:43.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.722+0000 7f39253de640 1 -- 172.21.15.37:0/2457752003 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f39200c56e0 msgr2=0x7f39200c6810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:43.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.722+0000 7f39253de640 1 --2- 172.21.15.37:0/2457752003 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f39200c56e0 0x7f39200c6810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:43.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.722+0000 7f39253de640 1 -- 172.21.15.37:0/2457752003 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f392015cb10 msgr2=0x7f392013ee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:43.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.722+0000 7f39253de640 1 --2- 172.21.15.37:0/2457752003 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f392015cb10 0x7f392013ee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:43.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.722+0000 7f39253de640 1 -- 172.21.15.37:0/2457752003 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39200cc7a0 con 0x7f39200c5ac0 2024-04-22T07:18:43.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.722+0000 7f3925bdf640 1 --2- 172.21.15.37:0/2457752003 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f39200c56e0 0x7f39200c6810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-22T07:18:43.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.722+0000 7f39253de640 1 --2- 172.21.15.37:0/2457752003 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f39200c5ac0 0x7f392015c5d0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f3918033000 tx=0x7f3918004a80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:43.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.722+0000 7f22ff7fe640 1 -- 172.21.15.37:0/946311409 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f230801a070 con 0x7f23100e0480 2024-04-22T07:18:43.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.722+0000 7f22ff7fe640 1 --2- 172.21.15.37:0/946311409 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f230406c940 0x7f230406ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:43.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.723+0000 7f22ff7fe640 1 -- 172.21.15.37:0/946311409 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f230808afb0 con 0x7f23100e0480 2024-04-22T07:18:43.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.721+0000 7f1636ffd640 1 -- 172.21.15.37:0/1840914658 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f163c032890 con 0x7f164006ffe0 2024-04-22T07:18:43.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.722+0000 7f1636ffd640 1 -- 172.21.15.37:0/1840914658 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f163c02e070 con 0x7f164006ffe0 2024-04-22T07:18:43.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.722+0000 7f16486c1640 1 -- 172.21.15.37:0/1840914658 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16401ec220 con 0x7f164006ffe0 2024-04-22T07:18:43.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.722+0000 7f16486c1640 1 -- 172.21.15.37:0/1840914658 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f1640153b00 con 0x7f164006ffe0 2024-04-22T07:18:43.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.723+0000 7f6c30811640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6c2c06e9a0 0x7f6c2c1ec4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:43.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.722+0000 7f2bc29fa640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2bbc0c5a40 0x7f2bbc0c89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:43.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.722+0000 7f2bc29fa640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2bbc154df0 0x7f2bbc1e7af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:43.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.722+0000 7f2bc29fa640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2bbc1551d0 0x7f2bbc0b5c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:43.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.722+0000 7f2bc29fa640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f2bbc0cd620 con 0x7f2bbc1551d0 2024-04-22T07:18:43.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.722+0000 7f2bc29fa640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f2bbc0cd340 con 0x7f2bbc0c5a40 2024-04-22T07:18:43.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.722+0000 7f2bc29fa640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f2bbc0cbce0 con 0x7f2bbc154df0 2024-04-22T07:18:43.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.722+0000 7f2bc21f9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2bbc1551d0 0x7f2bbc0b5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:43.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.722+0000 7f2bc21f9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2bbc1551d0 0x7f2bbc0b5c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54756/0 (socket says 172.21.15.37:54756) 2024-04-22T07:18:43.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.722+0000 7f2bc21f9640 1 -- 172.21.15.37:0/1449475463 learned_addr learned my addr 172.21.15.37:0/1449475463 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:18:43.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.722+0000 7f2bc19f8640 1 --2- 172.21.15.37:0/1449475463 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2bbc0c5a40 0x7f2bbc0c89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:43.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.723+0000 7f2bc21f9640 1 -- 172.21.15.37:0/1449475463 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2bbc154df0 msgr2=0x7f2bbc1e7af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:43.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.723+0000 7f2bc21f9640 1 --2- 172.21.15.37:0/1449475463 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2bbc154df0 0x7f2bbc1e7af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:43.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.723+0000 7f2bc21f9640 1 -- 172.21.15.37:0/1449475463 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2bbc0c5a40 msgr2=0x7f2bbc0c89e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:43.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.723+0000 7f2bc21f9640 1 --2- 172.21.15.37:0/1449475463 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2bbc0c5a40 0x7f2bbc0c89e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:43.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.723+0000 7f2bc21f9640 1 -- 172.21.15.37:0/1449475463 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bbc14e2f0 con 0x7f2bbc1551d0 2024-04-22T07:18:43.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.722+0000 7f4a06ffd640 1 -- 172.21.15.37:0/1475358600 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4a000d51f0 msgr2=0x7f4a000de490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:43.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.722+0000 7f4a06ffd640 1 --2- 172.21.15.37:0/1475358600 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4a000d51f0 0x7f4a000de490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:43.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.722+0000 7f4a06ffd640 1 -- 172.21.15.37:0/1475358600 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4a00005e80 msgr2=0x7f4a0004efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:43.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.722+0000 7f4a06ffd640 1 --2- 172.21.15.37:0/1475358600 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4a00005e80 0x7f4a0004efd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:43.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.722+0000 7f4a06ffd640 1 -- 172.21.15.37:0/1475358600 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a0004e230 con 0x7f4a0004b080 2024-04-22T07:18:43.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.722+0000 7f4a077fe640 1 --2- 172.21.15.37:0/1475358600 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4a00005e80 0x7f4a0004efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-22T07:18:43.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.722+0000 7f4a06ffd640 1 --2- 172.21.15.37:0/1475358600 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a0004b080 0x7f4a000c7b20 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f4a0806a2a0 tx=0x7f4a08069600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:43.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.723+0000 7f6c30811640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6c2c072df0 0x7f6c2c14b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:43.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.723+0000 7f6c2a59c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6c2c06e9a0 0x7f6c2c1ec4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:43.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.723+0000 7f231d504640 1 -- 172.21.15.37:0/946311409 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22f8005290 con 0x7f23100e0480 2024-04-22T07:18:43.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.723+0000 7f6c2a59c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6c2c06e9a0 0x7f6c2c1ec4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54768/0 (socket says 172.21.15.37:54768) 2024-04-22T07:18:43.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.723+0000 7f6c30811640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6c2c0c89c0 0x7f6c2c0c62b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:43.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.723+0000 7f2316ffd640 1 --2- 172.21.15.37:0/946311409 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f230406c940 0x7f230406ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:43.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.723+0000 7f6c30811640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f6c2c15af30 con 0x7f6c2c06e9a0 2024-04-22T07:18:43.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.723+0000 7f6c30811640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f6c2c15ac50 con 0x7f6c2c0c89c0 2024-04-22T07:18:43.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.723+0000 7f6c30811640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f6c2c0c92e0 con 0x7f6c2c072df0 2024-04-22T07:18:43.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.723+0000 7f2bc21f9640 1 --2- 172.21.15.37:0/1449475463 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2bbc1551d0 0x7f2bbc0b5c10 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f2bb400c7b0 tx=0x7f2bb400cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:43.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.723+0000 7f6c2a59c640 1 -- 172.21.15.37:0/491122676 learned_addr learned my addr 172.21.15.37:0/491122676 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:18:43.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.723+0000 7f6c29d9b640 1 --2- 172.21.15.37:0/491122676 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6c2c072df0 0x7f6c2c14b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:43.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.723+0000 7f6c2ad9d640 1 --2- 172.21.15.37:0/491122676 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6c2c0c89c0 0x7f6c2c0c62b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:43.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.723+0000 7f1636ffd640 1 -- 172.21.15.37:0/1840914658 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f163c032cb0 con 0x7f164006ffe0 2024-04-22T07:18:43.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.723+0000 7f49f3fff640 1 -- 172.21.15.37:0/1475358600 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a08094400 con 0x7f4a0004b080 2024-04-22T07:18:43.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.724+0000 7f6c29d9b640 1 -- 172.21.15.37:0/491122676 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6c2c0c89c0 msgr2=0x7f6c2c0c62b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:43.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.724+0000 7f6c29d9b640 1 --2- 172.21.15.37:0/491122676 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6c2c0c89c0 0x7f6c2c0c62b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:43.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.724+0000 7f6c29d9b640 1 -- 172.21.15.37:0/491122676 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6c2c06e9a0 msgr2=0x7f6c2c1ec4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:43.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.724+0000 7f6c29d9b640 1 --2- 172.21.15.37:0/491122676 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6c2c06e9a0 0x7f6c2c1ec4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:43.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.724+0000 7f6c29d9b640 1 -- 172.21.15.37:0/491122676 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c2c1491a0 con 0x7f6c2c072df0 2024-04-22T07:18:43.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.724+0000 7f2316ffd640 1 --2- 172.21.15.37:0/946311409 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f230406c940 0x7f230406ee00 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f231004f0a0 tx=0x7f231806e030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:43.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.724+0000 7f6c2a59c640 1 --2- 172.21.15.37:0/491122676 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6c2c06e9a0 0x7f6c2c1ec4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-22T07:18:43.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.723+0000 7f4a0e08e640 1 -- 172.21.15.37:0/1475358600 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a0017c160 con 0x7f4a0004b080 2024-04-22T07:18:43.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.724+0000 7f4a0e08e640 1 -- 172.21.15.37:0/1475358600 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a0004e7d0 con 0x7f4a0004b080 2024-04-22T07:18:43.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.724+0000 7f49f3fff640 1 -- 172.21.15.37:0/1475358600 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a080945a0 con 0x7f4a0004b080 2024-04-22T07:18:43.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.724+0000 7f6c29d9b640 1 --2- 172.21.15.37:0/491122676 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6c2c072df0 0x7f6c2c14b410 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f6c1c00c470 tx=0x7f6c1c00c930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:43.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.724+0000 7fbfd99b6640 1 -- 172.21.15.37:0/3589724948 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbfd404fce0 con 0x7fbfd408c460 2024-04-22T07:18:43.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.724+0000 7f49f3fff640 1 -- 172.21.15.37:0/1475358600 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a08094a30 con 0x7f4a0004b080 2024-04-22T07:18:43.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.724+0000 7fb77a7fc640 1 -- 172.21.15.37:0/57131175 <== mon.2 v2:172.21.15.196:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb78001a070 con 0x7fb77c0d8eb0 2024-04-22T07:18:43.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.725+0000 7f2bb27fc640 1 -- 172.21.15.37:0/1449475463 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bb4017070 con 0x7f2bbc1551d0 2024-04-22T07:18:43.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.724+0000 7f16486c1640 1 -- 172.21.15.37:0/1840914658 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1640068b20 con 0x7f164006ffe0 2024-04-22T07:18:43.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.725+0000 7f6c2ad9d640 1 --2- 172.21.15.37:0/491122676 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6c2c0c89c0 0x7f6c2c0c62b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-22T07:18:43.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.725+0000 7f1636ffd640 1 -- 172.21.15.37:0/1840914658 <== mon.2 v2:172.21.15.196:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f163c04c060 con 0x7f164006ffe0 2024-04-22T07:18:43.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.725+0000 7fb77a7fc640 1 --2- 172.21.15.37:0/57131175 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fb76806c940 0x7fb76806ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:43.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.725+0000 7f2bb27fc640 1 -- 172.21.15.37:0/1449475463 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2bb4003da0 con 0x7f2bbc1551d0 2024-04-22T07:18:43.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.725+0000 7f2bc29fa640 1 -- 172.21.15.37:0/1449475463 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2bbc1527b0 con 0x7f2bbc1551d0 2024-04-22T07:18:43.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.725+0000 7f2bb27fc640 1 -- 172.21.15.37:0/1449475463 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bb400ce60 con 0x7f2bbc1551d0 2024-04-22T07:18:43.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.725+0000 7f2bc29fa640 1 -- 172.21.15.37:0/1449475463 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2bbc0b4a50 con 0x7f2bbc1551d0 2024-04-22T07:18:43.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.725+0000 7f1636ffd640 1 --2- 172.21.15.37:0/1840914658 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f162406c940 0x7f162406ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:43.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.725+0000 7fb789990640 1 --2- 172.21.15.37:0/57131175 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fb76806c940 0x7fb76806ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:43.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.725+0000 7fb77a7fc640 1 -- 172.21.15.37:0/57131175 <== mon.2 v2:172.21.15.196:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fb7800577e0 con 0x7fb77c0d8eb0 2024-04-22T07:18:43.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.725+0000 7f1645c5c640 1 --2- 172.21.15.37:0/1840914658 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f162406c940 0x7f162406ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:43.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.726+0000 7fb789990640 1 --2- 172.21.15.37:0/57131175 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fb76806c940 0x7fb76806ee00 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fb774009560 tx=0x7fb774008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:43.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.726+0000 7f4a0e08e640 1 -- 172.21.15.37:0/1475358600 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49e8005290 con 0x7f4a0004b080 2024-04-22T07:18:43.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.726+0000 7f1645c5c640 1 --2- 172.21.15.37:0/1840914658 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f162406c940 0x7f162406ee00 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f16400c46c0 tx=0x7f1630009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:43.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.726+0000 7f49f3fff640 1 -- 172.21.15.37:0/1475358600 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4a08094bd0 con 0x7f4a0004b080 2024-04-22T07:18:43.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.726+0000 7f2bc29fa640 1 -- 172.21.15.37:0/1449475463 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2bbc0cf9f0 con 0x7f2bbc1551d0 2024-04-22T07:18:43.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.726+0000 7f49f3fff640 1 --2- 172.21.15.37:0/1475358600 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f49ec06c970 0x7f49ec06ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:43.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.727+0000 7f2bb27fc640 1 -- 172.21.15.37:0/1449475463 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2bb40052b0 con 0x7f2bbc1551d0 2024-04-22T07:18:43.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.727+0000 7f49f3fff640 1 -- 172.21.15.37:0/1475358600 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f4a08107280 con 0x7f4a0004b080 2024-04-22T07:18:43.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.727+0000 7f4a077fe640 1 --2- 172.21.15.37:0/1475358600 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f49ec06c970 0x7f49ec06ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:43.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.727+0000 7f2bb27fc640 1 --2- 172.21.15.37:0/1449475463 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f2ba006c8f0 0x7f2ba006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:43.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.727+0000 7f2bb27fc640 1 -- 172.21.15.37:0/1449475463 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f2bb408b180 con 0x7f2bbc1551d0 2024-04-22T07:18:43.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.727+0000 7f2bc19f8640 1 --2- 172.21.15.37:0/1449475463 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f2ba006c8f0 0x7f2ba006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:43.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.727+0000 7f4a077fe640 1 --2- 172.21.15.37:0/1475358600 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f49ec06c970 0x7f49ec06ee30 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f49fc036000 tx=0x7f49fc030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:43.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.728+0000 7f6c22ffd640 1 -- 172.21.15.37:0/491122676 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c1c005220 con 0x7f6c2c072df0 2024-04-22T07:18:43.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.728+0000 7f39167fc640 1 -- 172.21.15.37:0/2457752003 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3918044020 con 0x7f39200c5ac0 2024-04-22T07:18:43.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.728+0000 7f1636ffd640 1 -- 172.21.15.37:0/1840914658 <== mon.2 v2:172.21.15.196:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f163c078ff0 con 0x7f164006ffe0 2024-04-22T07:18:43.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.728+0000 7f6c30811640 1 -- 172.21.15.37:0/491122676 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c2c149460 con 0x7f6c2c072df0 2024-04-22T07:18:43.801 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.728+0000 7f2bc19f8640 1 --2- 172.21.15.37:0/1449475463 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f2ba006c8f0 0x7f2ba006edb0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f2bb8036000 tx=0x7f2bb8008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:43.801 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.728+0000 7f3926be1640 1 -- 172.21.15.37:0/2457752003 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39200cca80 con 0x7f39200c5ac0 2024-04-22T07:18:43.801 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.728+0000 7f3926be1640 1 -- 172.21.15.37:0/2457752003 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f39200c6d50 con 0x7f39200c5ac0 2024-04-22T07:18:43.801 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.728+0000 7fb77a7fc640 1 -- 172.21.15.37:0/57131175 <== mon.2 v2:172.21.15.196:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fb77c007b90 con 0x7fb77c0d8eb0 2024-04-22T07:18:43.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.728+0000 7f6c30811640 1 -- 172.21.15.37:0/491122676 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c2c149a20 con 0x7f6c2c072df0 2024-04-22T07:18:43.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.729+0000 7f6c30811640 1 -- 172.21.15.37:0/491122676 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c2c04fce0 con 0x7f6c2c072df0 2024-04-22T07:18:43.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.729+0000 7f22ff7fe640 1 -- 172.21.15.37:0/946311409 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f23080593c0 con 0x7f23100e0480 2024-04-22T07:18:43.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.729+0000 7fbfbbfff640 1 -- 172.21.15.37:0/3589724948 <== mon.2 v2:172.21.15.196:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fbfcc005d10 con 0x7fbfd408c460 2024-04-22T07:18:43.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.729+0000 7f3926be1640 1 -- 172.21.15.37:0/2457752003 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f392006c8a0 con 0x7f39200c5ac0 2024-04-22T07:18:43.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.730+0000 7fbfbbfff640 1 --2- 172.21.15.37:0/3589724948 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fbfc006c940 0x7fbfc006ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:43.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.730+0000 7fbfd2ffd640 1 --2- 172.21.15.37:0/3589724948 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fbfc006c940 0x7fbfc006ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:43.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.730+0000 7fbfd2ffd640 1 --2- 172.21.15.37:0/3589724948 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fbfc006c940 0x7fbfc006ee00 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fbfc4005020 tx=0x7fbfc4004e10 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:43.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.732+0000 7f49f3fff640 1 -- 172.21.15.37:0/1475358600 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f4a08090030 con 0x7f4a0004b080 2024-04-22T07:18:43.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.733+0000 7f39167fc640 1 -- 172.21.15.37:0/2457752003 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f391803a040 con 0x7f39200c5ac0 2024-04-22T07:18:43.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.733+0000 7f39167fc640 1 -- 172.21.15.37:0/2457752003 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3918039070 con 0x7f39200c5ac0 2024-04-22T07:18:43.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.733+0000 7f6c22ffd640 1 -- 172.21.15.37:0/491122676 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c1c0053c0 con 0x7f6c2c072df0 2024-04-22T07:18:43.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.733+0000 7f6c22ffd640 1 -- 172.21.15.37:0/491122676 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c1c020060 con 0x7f6c2c072df0 2024-04-22T07:18:43.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.733+0000 7fbfbbfff640 1 -- 172.21.15.37:0/3589724948 <== mon.2 v2:172.21.15.196:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fbfcc079990 con 0x7fbfd408c460 2024-04-22T07:18:43.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.733+0000 7f1636ffd640 1 -- 172.21.15.37:0/1840914658 <== mon.2 v2:172.21.15.196:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f163c040070 con 0x7f164006ffe0 2024-04-22T07:18:43.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.735+0000 7f39167fc640 1 -- 172.21.15.37:0/2457752003 <== mon.2 v2:172.21.15.196:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3918047020 con 0x7f39200c5ac0 2024-04-22T07:18:43.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.735+0000 7f6c22ffd640 1 -- 172.21.15.37:0/491122676 <== mon.2 v2:172.21.15.196:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6c1c007030 con 0x7f6c2c072df0 2024-04-22T07:18:43.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.736+0000 7f6c22ffd640 1 --2- 172.21.15.37:0/491122676 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f6c0c06caf0 0x7f6c0c06efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:43.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.736+0000 7f39167fc640 1 --2- 172.21.15.37:0/2457752003 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f390406c8f0 0x7f390406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:43.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.736+0000 7f6c2a59c640 1 --2- 172.21.15.37:0/491122676 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f6c0c06caf0 0x7f6c0c06efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:43.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.736+0000 7f3925bdf640 1 --2- 172.21.15.37:0/2457752003 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f390406c8f0 0x7f390406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:43.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.737+0000 7f6c2a59c640 1 --2- 172.21.15.37:0/491122676 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f6c0c06caf0 0x7f6c0c06efb0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f6c1400bf00 tx=0x7f6c14008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:43.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.737+0000 7f2bb27fc640 1 -- 172.21.15.37:0/1449475463 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f2bbc0cf9f0 con 0x7f2bbc1551d0 2024-04-22T07:18:43.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.737+0000 7f3925bdf640 1 --2- 172.21.15.37:0/2457752003 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f390406c8f0 0x7f390406edb0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f391c001c40 tx=0x7f391c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:43.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.738+0000 7f39167fc640 1 -- 172.21.15.37:0/2457752003 <== mon.2 v2:172.21.15.196:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f391807a5c0 con 0x7f39200c5ac0 2024-04-22T07:18:43.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.738+0000 7f6c22ffd640 1 -- 172.21.15.37:0/491122676 <== mon.2 v2:172.21.15.196:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f6c1c0572b0 con 0x7f6c2c072df0 2024-04-22T07:18:43.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.738+0000 7fbfbbfff640 1 -- 172.21.15.37:0/3589724948 <== mon.2 v2:172.21.15.196:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fbfcc07b8f0 con 0x7fbfd408c460 2024-04-22T07:18:43.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.743+0000 7f39167fc640 1 -- 172.21.15.37:0/2457752003 <== mon.2 v2:172.21.15.196:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f391804e030 con 0x7f39200c5ac0 2024-04-22T07:18:43.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:43.747+0000 7f6c22ffd640 1 -- 172.21.15.37:0/491122676 <== mon.2 v2:172.21.15.196:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f6c1c059210 con 0x7f6c2c072df0 2024-04-22T07:18:44.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:44.160+0000 7f231d504640 1 -- 172.21.15.37:0/946311409 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f22f8005580 con 0x7f23100e0480 2024-04-22T07:18:44.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:44.161+0000 7f22ff7fe640 1 -- 172.21.15.37:0/946311409 <== mon.1 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f2308058cc0 con 0x7f23100e0480 2024-04-22T07:18:44.160 INFO:teuthology.orchestra.run.smithi037.stdout:55834574854 2024-04-22T07:18:44.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:44.164+0000 7f22fd7fa640 1 -- 172.21.15.37:0/946311409 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f230406c940 msgr2=0x7f230406ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:44.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:44.164+0000 7f22fd7fa640 1 --2- 172.21.15.37:0/946311409 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f230406c940 0x7f230406ee00 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f231004f0a0 tx=0x7f231806e030 comp rx=0 tx=0).stop 2024-04-22T07:18:44.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:44.165+0000 7f22fd7fa640 1 -- 172.21.15.37:0/946311409 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f23100e0480 msgr2=0x7f23100d3980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:44.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:44.165+0000 7f22fd7fa640 1 --2- 172.21.15.37:0/946311409 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f23100e0480 0x7f23100d3980 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f230800c540 tx=0x7f230800ca00 comp rx=0 tx=0).stop 2024-04-22T07:18:44.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:44.165+0000 7f22fd7fa640 1 -- 172.21.15.37:0/946311409 shutdown_connections 2024-04-22T07:18:44.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:44.165+0000 7f22fd7fa640 1 --2- 172.21.15.37:0/946311409 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f230406c940 0x7f230406ee00 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:44.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:44.165+0000 7f22fd7fa640 1 --2- 172.21.15.37:0/946311409 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f23100e0480 0x7f23100d3980 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:44.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:44.165+0000 7f22fd7fa640 1 --2- 172.21.15.37:0/946311409 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f23100dfa90 0x7f23100d5b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:44.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:44.165+0000 7f22fd7fa640 1 --2- 172.21.15.37:0/946311409 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f23100d9240 0x7f23100d9980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:44.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:44.165+0000 7f22fd7fa640 1 -- 172.21.15.37:0/946311409 >> 172.21.15.37:0/946311409 conn(0x7f231000e150 msgr2=0x7f23100e0930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:44.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:44.165+0000 7f22fd7fa640 1 -- 172.21.15.37:0/946311409 shutdown_connections 2024-04-22T07:18:44.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:44.165+0000 7f22fd7fa640 1 -- 172.21.15.37:0/946311409 wait complete. 2024-04-22T07:18:44.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:44.169+0000 7fb78bbf4640 1 -- 172.21.15.37:0/57131175 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fb77c0057d0 con 0x7fb77c0d8eb0 2024-04-22T07:18:44.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:44.170+0000 7fb77a7fc640 1 -- 172.21.15.37:0/57131175 <== mon.2 v2:172.21.15.196:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb77c007b90 con 0x7fb77c0d8eb0 2024-04-22T07:18:44.168 INFO:teuthology.orchestra.run.smithi037.stdout:55834574854 2024-04-22T07:18:44.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:44.172+0000 7f4a0e08e640 1 -- 172.21.15.37:0/1475358600 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f49e8005850 con 0x7f4a0004b080 2024-04-22T07:18:44.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:44.173+0000 7fb78bbf4640 1 -- 172.21.15.37:0/57131175 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fb76806c940 msgr2=0x7fb76806ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:44.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:44.173+0000 7fb78bbf4640 1 --2- 172.21.15.37:0/57131175 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fb76806c940 0x7fb76806ee00 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fb774009560 tx=0x7fb774008030 comp rx=0 tx=0).stop 2024-04-22T07:18:44.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:44.173+0000 7fb78bbf4640 1 -- 172.21.15.37:0/57131175 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb77c0d8eb0 msgr2=0x7fb77c0ce8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:44.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:44.173+0000 7fb78bbf4640 1 --2- 172.21.15.37:0/57131175 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb77c0d8eb0 0x7fb77c0ce8d0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fb78000e7f0 tx=0x7fb78000ecb0 comp rx=0 tx=0).stop 2024-04-22T07:18:44.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:44.173+0000 7f49f3fff640 1 -- 172.21.15.37:0/1475358600 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f4a080d51d0 con 0x7f4a0004b080 2024-04-22T07:18:44.173 INFO:teuthology.orchestra.run.smithi037.stdout:55834574855 2024-04-22T07:18:44.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:44.173+0000 7fb78bbf4640 1 -- 172.21.15.37:0/57131175 shutdown_connections 2024-04-22T07:18:44.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:44.173+0000 7fb78bbf4640 1 --2- 172.21.15.37:0/57131175 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fb76806c940 0x7fb76806ee00 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:44.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:44.173+0000 7fb78bbf4640 1 --2- 172.21.15.37:0/57131175 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb77c0d8eb0 0x7fb77c0ce8d0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:44.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:44.173+0000 7fb78bbf4640 1 --2- 172.21.15.37:0/57131175 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb77c050900 0x7fb77c0ce390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:44.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:44.173+0000 7fb78bbf4640 1 --2- 172.21.15.37:0/57131175 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb77c0061f0 0x7fb77c04ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:44.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:44.173+0000 7fb78bbf4640 1 -- 172.21.15.37:0/57131175 >> 172.21.15.37:0/57131175 conn(0x7fb77c054510 msgr2=0x7fb77c0059e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:44.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:44.174+0000 7fb78bbf4640 1 -- 172.21.15.37:0/57131175 shutdown_connections 2024-04-22T07:18:44.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:44.174+0000 7fb78bbf4640 1 -- 172.21.15.37:0/57131175 wait complete. 2024-04-22T07:18:44.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:44.177+0000 7f4a0e08e640 1 -- 172.21.15.37:0/1475358600 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f49ec06c970 msgr2=0x7f49ec06ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:44.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:44.177+0000 7f4a0e08e640 1 --2- 172.21.15.37:0/1475358600 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f49ec06c970 0x7f49ec06ee30 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f49fc036000 tx=0x7f49fc030000 comp rx=0 tx=0).stop 2024-04-22T07:18:44.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:44.177+0000 7f4a0e08e640 1 -- 172.21.15.37:0/1475358600 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a0004b080 msgr2=0x7f4a000c7b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:44.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:44.177+0000 7f4a0e08e640 1 --2- 172.21.15.37:0/1475358600 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a0004b080 0x7f4a000c7b20 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f4a0806a2a0 tx=0x7f4a08069600 comp rx=0 tx=0).stop 2024-04-22T07:18:44.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:44.178+0000 7f4a0e08e640 1 -- 172.21.15.37:0/1475358600 shutdown_connections 2024-04-22T07:18:44.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:44.178+0000 7f4a0e08e640 1 --2- 172.21.15.37:0/1475358600 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f49ec06c970 0x7f49ec06ee30 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:44.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:44.178+0000 7f4a0e08e640 1 --2- 172.21.15.37:0/1475358600 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4a000d51f0 0x7f4a000de490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:44.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:44.178+0000 7f4a0e08e640 1 --2- 172.21.15.37:0/1475358600 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a0004b080 0x7f4a000c7b20 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:44.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:44.178+0000 7f4a0e08e640 1 --2- 172.21.15.37:0/1475358600 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4a00005e80 0x7f4a0004efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:44.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:44.178+0000 7f4a0e08e640 1 -- 172.21.15.37:0/1475358600 >> 172.21.15.37:0/1475358600 conn(0x7f4a00050170 msgr2=0x7f4a000d3270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:44.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:44.178+0000 7f4a0e08e640 1 -- 172.21.15.37:0/1475358600 shutdown_connections 2024-04-22T07:18:44.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:44.179+0000 7f4a0e08e640 1 -- 172.21.15.37:0/1475358600 wait complete. 2024-04-22T07:18:44.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:44.179+0000 7f16486c1640 1 -- 172.21.15.37:0/1840914658 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f16400c96a0 con 0x7f164006ffe0 2024-04-22T07:18:44.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:44.179+0000 7f1636ffd640 1 -- 172.21.15.37:0/1840914658 <== mon.2 v2:172.21.15.196:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f163c07af50 con 0x7f164006ffe0 2024-04-22T07:18:44.181 INFO:teuthology.orchestra.run.smithi037.stdout:55834574855 2024-04-22T07:18:44.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:44.180+0000 7f3926be1640 1 -- 172.21.15.37:0/2457752003 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f3920142d60 con 0x7f39200c5ac0 2024-04-22T07:18:44.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:44.180+0000 7f39167fc640 1 -- 172.21.15.37:0/2457752003 <== mon.2 v2:172.21.15.196:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f3918008030 con 0x7f39200c5ac0 2024-04-22T07:18:44.183 INFO:teuthology.orchestra.run.smithi037.stdout:55834574854 2024-04-22T07:18:44.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:44.180+0000 7f6c30811640 1 -- 172.21.15.37:0/491122676 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f6c2c1444a0 con 0x7f6c2c072df0 2024-04-22T07:18:44.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:44.180+0000 7f2bc29fa640 1 -- 172.21.15.37:0/1449475463 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f2bbc04fdc0 con 0x7f2bbc1551d0 2024-04-22T07:18:44.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:44.181+0000 7f6c22ffd640 1 -- 172.21.15.37:0/491122676 <== mon.2 v2:172.21.15.196:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f6c1c05d510 con 0x7f6c2c072df0 2024-04-22T07:18:44.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:44.181+0000 7f2bb27fc640 1 -- 172.21.15.37:0/1449475463 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f2bb4058ee0 con 0x7f2bbc1551d0 2024-04-22T07:18:44.185 INFO:teuthology.orchestra.run.smithi037.stdout:55834574855 2024-04-22T07:18:44.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:44.182+0000 7fbfd99b6640 1 -- 172.21.15.37:0/3589724948 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fbfd40ca0e0 con 0x7fbfd408c460 2024-04-22T07:18:44.186 INFO:teuthology.orchestra.run.smithi037.stdout:55834574854 2024-04-22T07:18:44.186 INFO:teuthology.orchestra.run.smithi037.stdout:55834574854 2024-04-22T07:18:44.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:44.182+0000 7fbfbbfff640 1 -- 172.21.15.37:0/3589724948 <== mon.2 v2:172.21.15.196:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fbfcc07fbf0 con 0x7fbfd408c460 2024-04-22T07:18:44.188 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.4 2024-04-22T07:18:44.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:44.184+0000 7f16486c1640 1 -- 172.21.15.37:0/1840914658 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f162406c940 msgr2=0x7f162406ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:44.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:44.184+0000 7f16486c1640 1 --2- 172.21.15.37:0/1840914658 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f162406c940 0x7f162406ee00 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f16400c46c0 tx=0x7f1630009190 comp rx=0 tx=0).stop 2024-04-22T07:18:44.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:44.184+0000 7f16486c1640 1 -- 172.21.15.37:0/1840914658 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f164006ffe0 msgr2=0x7f16401548d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:44.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:44.184+0000 7f16486c1640 1 --2- 172.21.15.37:0/1840914658 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f164006ffe0 0x7f16401548d0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f163c0090b0 tx=0x7f163c0046c0 comp rx=0 tx=0).stop 2024-04-22T07:18:44.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:44.184+0000 7f3926be1640 1 -- 172.21.15.37:0/2457752003 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f390406c8f0 msgr2=0x7f390406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:44.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:44.184+0000 7f3926be1640 1 --2- 172.21.15.37:0/2457752003 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f390406c8f0 0x7f390406edb0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f391c001c40 tx=0x7f391c009040 comp rx=0 tx=0).stop 2024-04-22T07:18:44.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:44.184+0000 7f3926be1640 1 -- 172.21.15.37:0/2457752003 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f39200c5ac0 msgr2=0x7f392015c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:44.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:44.184+0000 7f3926be1640 1 --2- 172.21.15.37:0/2457752003 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f39200c5ac0 0x7f392015c5d0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f3918033000 tx=0x7f3918004a80 comp rx=0 tx=0).stop 2024-04-22T07:18:44.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:44.184+0000 7f16486c1640 1 -- 172.21.15.37:0/1840914658 shutdown_connections 2024-04-22T07:18:44.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:44.184+0000 7f16486c1640 1 --2- 172.21.15.37:0/1840914658 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f162406c940 0x7f162406ee00 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:44.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:44.184+0000 7f16486c1640 1 --2- 172.21.15.37:0/1840914658 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1640152e50 0x7f16401ecce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:44.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:44.184+0000 7f16486c1640 1 --2- 172.21.15.37:0/1840914658 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f16400c3610 0x7f16400c8a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:44.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:44.184+0000 7f3926be1640 1 -- 172.21.15.37:0/2457752003 shutdown_connections 2024-04-22T07:18:44.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:44.184+0000 7f16486c1640 1 --2- 172.21.15.37:0/1840914658 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f164006ffe0 0x7f16401548d0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:44.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:44.184+0000 7f3926be1640 1 --2- 172.21.15.37:0/2457752003 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f390406c8f0 0x7f390406edb0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:44.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:44.184+0000 7f16486c1640 1 -- 172.21.15.37:0/1840914658 >> 172.21.15.37:0/1840914658 conn(0x7f16400715d0 msgr2=0x7f16400c3c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:44.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:44.184+0000 7f3926be1640 1 --2- 172.21.15.37:0/2457752003 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f392015cb10 0x7f392013ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:44.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:44.184+0000 7f3926be1640 1 --2- 172.21.15.37:0/2457752003 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f39200c5ac0 0x7f392015c5d0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:44.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:44.184+0000 7f3926be1640 1 --2- 172.21.15.37:0/2457752003 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f39200c56e0 0x7f39200c6810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:44.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:44.184+0000 7f3926be1640 1 -- 172.21.15.37:0/2457752003 >> 172.21.15.37:0/2457752003 conn(0x7f39200ca1e0 msgr2=0x7f39200c8700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:44.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:44.184+0000 7f3926be1640 1 -- 172.21.15.37:0/2457752003 shutdown_connections 2024-04-22T07:18:44.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:44.184+0000 7f3926be1640 1 -- 172.21.15.37:0/2457752003 wait complete. 2024-04-22T07:18:44.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:44.184+0000 7f16486c1640 1 -- 172.21.15.37:0/1840914658 shutdown_connections 2024-04-22T07:18:44.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:44.184+0000 7f16486c1640 1 -- 172.21.15.37:0/1840914658 wait complete. 2024-04-22T07:18:44.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:44.185+0000 7f6c30811640 1 -- 172.21.15.37:0/491122676 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f6c0c06caf0 msgr2=0x7f6c0c06efb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:44.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:44.185+0000 7f6c30811640 1 --2- 172.21.15.37:0/491122676 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f6c0c06caf0 0x7f6c0c06efb0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f6c1400bf00 tx=0x7f6c14008040 comp rx=0 tx=0).stop 2024-04-22T07:18:44.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:44.185+0000 7f6c30811640 1 -- 172.21.15.37:0/491122676 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6c2c072df0 msgr2=0x7f6c2c14b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:44.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:44.185+0000 7f6c30811640 1 --2- 172.21.15.37:0/491122676 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6c2c072df0 0x7f6c2c14b410 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f6c1c00c470 tx=0x7f6c1c00c930 comp rx=0 tx=0).stop 2024-04-22T07:18:44.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:44.185+0000 7f6c30811640 1 -- 172.21.15.37:0/491122676 shutdown_connections 2024-04-22T07:18:44.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:44.185+0000 7f6c30811640 1 --2- 172.21.15.37:0/491122676 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f6c0c06caf0 0x7f6c0c06efb0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:44.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:44.185+0000 7f6c30811640 1 --2- 172.21.15.37:0/491122676 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6c2c0c89c0 0x7f6c2c0c62b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:44.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:44.185+0000 7f6c30811640 1 --2- 172.21.15.37:0/491122676 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6c2c072df0 0x7f6c2c14b410 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:44.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:44.185+0000 7f6c30811640 1 --2- 172.21.15.37:0/491122676 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6c2c06e9a0 0x7f6c2c1ec4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:44.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:44.185+0000 7f6c30811640 1 -- 172.21.15.37:0/491122676 >> 172.21.15.37:0/491122676 conn(0x7f6c2c0cc2e0 msgr2=0x7f6c2c150160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:44.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:44.185+0000 7f6c30811640 1 -- 172.21.15.37:0/491122676 shutdown_connections 2024-04-22T07:18:44.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:44.185+0000 7f6c30811640 1 -- 172.21.15.37:0/491122676 wait complete. 2024-04-22T07:18:44.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:44.185+0000 7f2bc29fa640 1 -- 172.21.15.37:0/1449475463 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f2ba006c8f0 msgr2=0x7f2ba006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:44.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:44.185+0000 7f2bc29fa640 1 --2- 172.21.15.37:0/1449475463 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f2ba006c8f0 0x7f2ba006edb0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f2bb8036000 tx=0x7f2bb8008030 comp rx=0 tx=0).stop 2024-04-22T07:18:44.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:44.185+0000 7f2bc29fa640 1 -- 172.21.15.37:0/1449475463 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2bbc1551d0 msgr2=0x7f2bbc0b5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:44.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:44.185+0000 7f2bc29fa640 1 --2- 172.21.15.37:0/1449475463 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2bbc1551d0 0x7f2bbc0b5c10 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f2bb400c7b0 tx=0x7f2bb400cc70 comp rx=0 tx=0).stop 2024-04-22T07:18:44.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:44.185+0000 7fbfd99b6640 1 -- 172.21.15.37:0/3589724948 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fbfc006c940 msgr2=0x7fbfc006ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:44.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:44.185+0000 7f2bc29fa640 1 -- 172.21.15.37:0/1449475463 shutdown_connections 2024-04-22T07:18:44.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:44.185+0000 7fbfd99b6640 1 --2- 172.21.15.37:0/3589724948 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fbfc006c940 0x7fbfc006ee00 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fbfc4005020 tx=0x7fbfc4004e10 comp rx=0 tx=0).stop 2024-04-22T07:18:44.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:44.185+0000 7f2bc29fa640 1 --2- 172.21.15.37:0/1449475463 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f2ba006c8f0 0x7f2ba006edb0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:44.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:44.185+0000 7f2bc29fa640 1 --2- 172.21.15.37:0/1449475463 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2bbc1551d0 0x7f2bbc0b5c10 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:44.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:44.185+0000 7fbfd99b6640 1 -- 172.21.15.37:0/3589724948 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbfd408c460 msgr2=0x7fbfd4163580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:44.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:44.185+0000 7fbfd99b6640 1 --2- 172.21.15.37:0/3589724948 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbfd408c460 0x7fbfd4163580 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fbfcc03a040 tx=0x7fbfcc004a40 comp rx=0 tx=0).stop 2024-04-22T07:18:44.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:44.185+0000 7f2bc29fa640 1 --2- 172.21.15.37:0/1449475463 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2bbc154df0 0x7f2bbc1e7af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:44.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:44.185+0000 7f2bc29fa640 1 --2- 172.21.15.37:0/1449475463 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2bbc0c5a40 0x7f2bbc0c89e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:44.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:44.185+0000 7f2bc29fa640 1 -- 172.21.15.37:0/1449475463 >> 172.21.15.37:0/1449475463 conn(0x7f2bbc067aa0 msgr2=0x7f2bbc0d0550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:44.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:44.186+0000 7f2bc29fa640 1 -- 172.21.15.37:0/1449475463 shutdown_connections 2024-04-22T07:18:44.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:44.186+0000 7fbfd99b6640 1 -- 172.21.15.37:0/3589724948 shutdown_connections 2024-04-22T07:18:44.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:44.186+0000 7fbfd99b6640 1 --2- 172.21.15.37:0/3589724948 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fbfc006c940 0x7fbfc006ee00 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:44.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:44.186+0000 7f2bc29fa640 1 -- 172.21.15.37:0/1449475463 wait complete. 2024-04-22T07:18:44.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:44.186+0000 7fbfd99b6640 1 --2- 172.21.15.37:0/3589724948 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbfd40c5dd0 0x7fbfd4209220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:44.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:44.186+0000 7fbfd99b6640 1 --2- 172.21.15.37:0/3589724948 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbfd408c460 0x7fbfd4163580 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:44.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:44.186+0000 7fbfd99b6640 1 --2- 172.21.15.37:0/3589724948 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbfd406e840 0x7fbfd4161840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:44.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:44.186+0000 7fbfd99b6640 1 -- 172.21.15.37:0/3589724948 >> 172.21.15.37:0/3589724948 conn(0x7fbfd40cc2e0 msgr2=0x7fbfd40716e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:44.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:44.186+0000 7fbfd99b6640 1 -- 172.21.15.37:0/3589724948 shutdown_connections 2024-04-22T07:18:44.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:44.187+0000 7fbfd99b6640 1 -- 172.21.15.37:0/3589724948 wait complete. 2024-04-22T07:18:44.201 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.5 2024-04-22T07:18:44.201 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.7 2024-04-22T07:18:44.202 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.6 2024-04-22T07:18:44.204 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.3 2024-04-22T07:18:44.205 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.1 2024-04-22T07:18:44.206 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.0 2024-04-22T07:18:44.207 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.2 2024-04-22T07:18:45.189 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-22T07:18:45.202 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-22T07:18:45.202 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-22T07:18:45.202 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-22T07:18:45.205 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-22T07:18:45.206 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-22T07:18:45.207 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-22T07:18:45.208 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-22T07:18:45.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.359+0000 7f79ec6d2640 1 Processor -- start 2024-04-22T07:18:45.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.359+0000 7f79ec6d2640 1 -- start start 2024-04-22T07:18:45.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.361+0000 7f79ec6d2640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f79e406ca80 0x7f79e406b970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:45.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.361+0000 7f79ec6d2640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f79e41595b0 0x7f79e4162610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:45.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.361+0000 7f79ec6d2640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f79e406c240 con 0x7f79e406ce60 2024-04-22T07:18:45.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.361+0000 7f79ec6d2640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f79e406c500 con 0x7f79e41595b0 2024-04-22T07:18:45.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.361+0000 7f79ec6d2640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f79e415f3f0 con 0x7f79e406ca80 2024-04-22T07:18:45.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.361+0000 7f79eac6f640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f79e41595b0 0x7f79e4162610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:45.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.361+0000 7f79eac6f640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f79e41595b0 0x7f79e4162610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54772/0 (socket says 172.21.15.37:54772) 2024-04-22T07:18:45.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.361+0000 7f79eac6f640 1 -- 172.21.15.37:0/4035272788 learned_addr learned my addr 172.21.15.37:0/4035272788 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:18:45.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.362+0000 7f79eac6f640 1 -- 172.21.15.37:0/4035272788 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f79e406ca80 msgr2=0x7f79e406b970 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T07:18:45.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.362+0000 7f79eac6f640 1 --2- 172.21.15.37:0/4035272788 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f79e406ca80 0x7f79e406b970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:45.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.362+0000 7f79eac6f640 1 -- 172.21.15.37:0/4035272788 >> v1:172.21.15.196:6789/0 conn(0x7f79e406ce60 legacy=0x7f79e4158ea0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T07:18:45.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.362+0000 7f79eac6f640 1 -- 172.21.15.37:0/4035272788 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79e415f6d0 con 0x7f79e41595b0 2024-04-22T07:18:45.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.363+0000 7f79eac6f640 1 --2- 172.21.15.37:0/4035272788 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f79e41595b0 0x7f79e4162610 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f79dc00b1a0 tx=0x7f79dc02c140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b47fb6b387813ce server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:45.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.364+0000 7f79e946c640 1 -- 172.21.15.37:0/4035272788 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79dc02cae0 con 0x7f79e41595b0 2024-04-22T07:18:45.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.364+0000 7f79e946c640 1 -- 172.21.15.37:0/4035272788 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79dc02cc80 con 0x7f79e41595b0 2024-04-22T07:18:45.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.365+0000 7f79ec6d2640 1 -- 172.21.15.37:0/4035272788 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f79e41595b0 msgr2=0x7f79e4162610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:45.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.365+0000 7f79ec6d2640 1 --2- 172.21.15.37:0/4035272788 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f79e41595b0 0x7f79e4162610 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f79dc00b1a0 tx=0x7f79dc02c140 comp rx=0 tx=0).stop 2024-04-22T07:18:45.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.365+0000 7f79ec6d2640 1 -- 172.21.15.37:0/4035272788 shutdown_connections 2024-04-22T07:18:45.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.365+0000 7f79ec6d2640 1 --2- 172.21.15.37:0/4035272788 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f79e41595b0 0x7f79e4162610 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:45.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.365+0000 7f79ec6d2640 1 --2- 172.21.15.37:0/4035272788 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f79e406ca80 0x7f79e406b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:45.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.365+0000 7f79ec6d2640 1 -- 172.21.15.37:0/4035272788 >> 172.21.15.37:0/4035272788 conn(0x7f79e40ca0b0 msgr2=0x7f79e40ca4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:45.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.367+0000 7f79ec6d2640 1 -- 172.21.15.37:0/4035272788 shutdown_connections 2024-04-22T07:18:45.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.367+0000 7f79ec6d2640 1 -- 172.21.15.37:0/4035272788 wait complete. 2024-04-22T07:18:45.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.369+0000 7f79ec6d2640 1 Processor -- start 2024-04-22T07:18:45.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.369+0000 7f79ec6d2640 1 -- start start 2024-04-22T07:18:45.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.370+0000 7f79ec6d2640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f79e406ca80 0x7f79e41303d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:45.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.370+0000 7f79ec6d2640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f79e406ce60 0x7f79e4130f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:45.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.370+0000 7f79ec6d2640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f79e41595b0 0x7f79e40c5830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:45.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.370+0000 7f79ec6d2640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f79e415f0a0 con 0x7f79e406ce60 2024-04-22T07:18:45.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.370+0000 7f79ec6d2640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f79e415fc90 con 0x7f79e41595b0 2024-04-22T07:18:45.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.370+0000 7f79ec6d2640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f79e406beb0 con 0x7f79e406ca80 2024-04-22T07:18:45.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.370+0000 7f79e9c6d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f79e406ce60 0x7f79e4130f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:45.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.370+0000 7f79e9c6d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f79e406ce60 0x7f79e4130f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54786/0 (socket says 172.21.15.37:54786) 2024-04-22T07:18:45.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.370+0000 7f79e9c6d640 1 -- 172.21.15.37:0/2312297506 learned_addr learned my addr 172.21.15.37:0/2312297506 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:18:45.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.371+0000 7f79eac6f640 1 --2- 172.21.15.37:0/2312297506 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f79e41595b0 0x7f79e40c5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:45.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.371+0000 7f79e9c6d640 1 -- 172.21.15.37:0/2312297506 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f79e406ca80 msgr2=0x7f79e41303d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-22T07:18:45.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.371+0000 7f79e9c6d640 1 --2- 172.21.15.37:0/2312297506 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f79e406ca80 0x7f79e41303d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:45.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.371+0000 7f79e9c6d640 1 -- 172.21.15.37:0/2312297506 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f79e41595b0 msgr2=0x7f79e40c5830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:45.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.371+0000 7f79e9c6d640 1 --2- 172.21.15.37:0/2312297506 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f79e41595b0 0x7f79e40c5830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:45.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.371+0000 7f79e9c6d640 1 -- 172.21.15.37:0/2312297506 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79e4130910 con 0x7f79e406ce60 2024-04-22T07:18:45.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.372+0000 7f79e9c6d640 1 --2- 172.21.15.37:0/2312297506 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f79e406ce60 0x7f79e4130f90 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f79e000b700 tx=0x7f79e000bbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:45.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.373+0000 7f79daffd640 1 -- 172.21.15.37:0/2312297506 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79e0019070 con 0x7f79e406ce60 2024-04-22T07:18:45.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.373+0000 7f79daffd640 1 -- 172.21.15.37:0/2312297506 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79e000c800 con 0x7f79e406ce60 2024-04-22T07:18:45.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.373+0000 7f79daffd640 1 -- 172.21.15.37:0/2312297506 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79e000cbf0 con 0x7f79e406ce60 2024-04-22T07:18:45.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.373+0000 7f79ec6d2640 1 -- 172.21.15.37:0/2312297506 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79e4146240 con 0x7f79e406ce60 2024-04-22T07:18:45.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.373+0000 7f79ec6d2640 1 -- 172.21.15.37:0/2312297506 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79e4142af0 con 0x7f79e406ce60 2024-04-22T07:18:45.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.375+0000 7f79daffd640 1 -- 172.21.15.37:0/2312297506 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f79e001c070 con 0x7f79e406ce60 2024-04-22T07:18:45.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.376+0000 7f79daffd640 1 --2- 172.21.15.37:0/2312297506 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f79c806c9c0 0x7f79c806ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:45.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.376+0000 7f79daffd640 1 -- 172.21.15.37:0/2312297506 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f79e008b040 con 0x7f79e406ce60 2024-04-22T07:18:45.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.376+0000 7f79ea46e640 1 --2- 172.21.15.37:0/2312297506 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f79c806c9c0 0x7f79c806ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:45.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.377+0000 7f79ea46e640 1 --2- 172.21.15.37:0/2312297506 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f79c806c9c0 0x7f79c806ee80 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f79d4009670 tx=0x7f79d4006bd0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:45.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.378+0000 7f79ec6d2640 1 -- 172.21.15.37:0/2312297506 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79cc005290 con 0x7f79e406ce60 2024-04-22T07:18:45.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.388+0000 7f79daffd640 1 -- 172.21.15.37:0/2312297506 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f79e0058e00 con 0x7f79e406ce60 2024-04-22T07:18:45.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.415+0000 7f0eb605f640 1 Processor -- start 2024-04-22T07:18:45.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.416+0000 7f0eb605f640 1 -- start start 2024-04-22T07:18:45.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.416+0000 7fd784ff4640 1 Processor -- start 2024-04-22T07:18:45.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.416+0000 7f8b2078e640 1 Processor -- start 2024-04-22T07:18:45.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.416+0000 7f8b2078e640 1 -- start start 2024-04-22T07:18:45.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.416+0000 7fd784ff4640 1 -- start start 2024-04-22T07:18:45.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.417+0000 7fc9c716c640 1 Processor -- start 2024-04-22T07:18:45.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.417+0000 7fc9c716c640 1 -- start start 2024-04-22T07:18:45.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.417+0000 7f0eb605f640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f0eb0071d40 0x7f0eb00716e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:45.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.417+0000 7f0eb605f640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0eb00ccd80 0x7f0eb0072b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:45.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.417+0000 7f0eb605f640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0eb0156e30 con 0x7f0eb00cc9a0 2024-04-22T07:18:45.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.417+0000 7fe24b026640 1 Processor -- start 2024-04-22T07:18:45.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.417+0000 7f0eb605f640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f0eb00730d0 con 0x7f0eb0071d40 2024-04-22T07:18:45.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.417+0000 7f0eb605f640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f0eb0157110 con 0x7f0eb00ccd80 2024-04-22T07:18:45.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.417+0000 7f0eb505d640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f0eb00cc9a0 0x7f0eb0150bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:56572/0 (socket says 172.21.15.37:56572) 2024-04-22T07:18:45.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.417+0000 7f0eb505d640 1 -- 172.21.15.37:0/927227982 learned_addr learned my addr 172.21.15.37:0/927227982 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-04-22T07:18:45.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.417+0000 7fd784ff4640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd78006bfc0 0x7fd7800c8ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:45.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.417+0000 7fd784ff4640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd7800cc900 con 0x7fd7800b37d0 2024-04-22T07:18:45.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.417+0000 7f8b2078e640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8b1806cc40 0x7f8b18162b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:45.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.417+0000 7f8b2078e640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b1806c990 con 0x7f8b180682d0 2024-04-22T07:18:45.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.417+0000 7f8b2078e640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b1815f3e0 con 0x7f8b181594f0 2024-04-22T07:18:45.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.417+0000 7fd784ff4640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd7800ccba0 con 0x7fd78006bbe0 2024-04-22T07:18:45.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.417+0000 7fd784ff4640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fd7800c9430 con 0x7fd78006bfc0 2024-04-22T07:18:45.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.417+0000 7f8b2078e640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f8b1815f6c0 con 0x7f8b1806cc40 2024-04-22T07:18:45.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.418+0000 7f0eb585e640 1 --2- 172.21.15.37:0/927227982 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0eb00ccd80 0x7f0eb0072b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:45.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.418+0000 7f8b1dd29640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8b1806cc40 0x7f8b18162b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:45.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.418+0000 7fd77ed9d640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fd7800b37d0 0x7fd78015c3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:56580/0 (socket says 172.21.15.37:56580) 2024-04-22T07:18:45.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.418+0000 7f0ea7fff640 1 -- 172.21.15.37:0/927227982 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 708559859 0 0) 0x7f0eb0156e30 con 0x7f0eb00cc9a0 2024-04-22T07:18:45.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.418+0000 7f0ea7fff640 1 -- 172.21.15.37:0/927227982 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0e9c003440 con 0x7f0eb00cc9a0 2024-04-22T07:18:45.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.418+0000 7f0eb485c640 1 --2- 172.21.15.37:0/927227982 >> v2:172.21.15.196:3300/0 conn(0x7f0eb0071d40 0x7f0eb00716e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:45.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.418+0000 7fd77ed9d640 1 -- 172.21.15.37:0/1692482843 learned_addr learned my addr 172.21.15.37:0/1692482843 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-04-22T07:18:45.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.418+0000 7fd77dd9b640 1 --2- 172.21.15.37:0/1692482843 >> v2:172.21.15.37:3300/0 conn(0x7fd78006bfc0 0x7fd7800c8ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:45.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.418+0000 7f0ea7fff640 1 -- 172.21.15.37:0/927227982 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2764755944 0 0) 0x7f0e9c003440 con 0x7f0eb00cc9a0 2024-04-22T07:18:45.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.418+0000 7fc9c716c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc9b804da40 0x7fc9b804cd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:45.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.418+0000 7fc9c716c640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc9b8008750 con 0x7fc9b804eda0 2024-04-22T07:18:45.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.418+0000 7fc9c716c640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc9b8008a30 con 0x7fc9b800a9e0 2024-04-22T07:18:45.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.418+0000 7fc9c716c640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fc9b80e2390 con 0x7fc9b804da40 2024-04-22T07:18:45.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.419+0000 7fc9c696b640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc9b804da40 0x7fc9b804cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:45.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.419+0000 7fc9c696b640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc9b804da40 0x7fc9b804cd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54804/0 (socket says 172.21.15.37:54804) 2024-04-22T07:18:45.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.419+0000 7fc9c696b640 1 -- 172.21.15.37:0/2042824067 learned_addr learned my addr 172.21.15.37:0/2042824067 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:18:45.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.417+0000 7fe24b026640 1 -- start start 2024-04-22T07:18:45.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.419+0000 7fe24b026640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe23c0dd510 0x7fe23c0455a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:45.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.419+0000 7fe24b026640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe23c045ae0 0x7fe23c04bee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:45.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.419+0000 7fe24b026640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe23c0dd8f0 con 0x7fe23c04c420 2024-04-22T07:18:45.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.419+0000 7fe24b026640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fe23c0e4090 con 0x7fe23c045ae0 2024-04-22T07:18:45.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.419+0000 7fe24b026640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fe23c0e3510 con 0x7fe23c0dd510 2024-04-22T07:18:45.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.418+0000 7f0ea7fff640 1 -- 172.21.15.37:0/927227982 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0eb00ccd80 msgr2=0x7f0eb0072b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:18:45.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.418+0000 7f0ea7fff640 1 --2- 172.21.15.37:0/927227982 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0eb00ccd80 0x7f0eb0072b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:45.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.418+0000 7f0ea7fff640 1 -- 172.21.15.37:0/927227982 >> v2:172.21.15.196:3300/0 conn(0x7f0eb0071d40 msgr2=0x7f0eb00716e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:18:45.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.418+0000 7f0ea7fff640 1 --2- 172.21.15.37:0/927227982 >> v2:172.21.15.196:3300/0 conn(0x7f0eb0071d40 0x7f0eb00716e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:45.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.418+0000 7f0ea7fff640 1 -- 172.21.15.37:0/927227982 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0eb01573f0 con 0x7f0eb00cc9a0 2024-04-22T07:18:45.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.418+0000 7f0ea7fff640 1 -- 172.21.15.37:0/927227982 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2576656170 0 0) 0x7f0ea0004cd0 con 0x7f0eb00cc9a0 2024-04-22T07:18:45.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.418+0000 7f0ea7fff640 1 -- 172.21.15.37:0/927227982 >> v1:172.21.15.37:6789/0 conn(0x7f0eb00cc9a0 legacy=0x7f0eb0150bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:45.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.419+0000 7f0ea7fff640 1 --2- 172.21.15.37:0/927227982 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0e9c003ac0 0x7f0e9c003f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:45.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.419+0000 7f0ea7fff640 1 --2- 172.21.15.37:0/927227982 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0e9c00ac50 0x7f0e9c00d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:45.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.419+0000 7f0ea7fff640 1 --2- 172.21.15.37:0/927227982 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e9c00d580 0x7f0e9c00f970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:45.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.419+0000 7f0ea7fff640 1 -- 172.21.15.37:0/927227982 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0eb00730d0 con 0x7f0e9c00d580 2024-04-22T07:18:45.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.419+0000 7f0ea7fff640 1 -- 172.21.15.37:0/927227982 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f0eb0157110 con 0x7f0e9c003ac0 2024-04-22T07:18:45.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.419+0000 7f0ea7fff640 1 -- 172.21.15.37:0/927227982 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f0e9c010280 con 0x7f0e9c00ac50 2024-04-22T07:18:45.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.419+0000 7f0eb505d640 1 --2- 172.21.15.37:0/927227982 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0e9c003ac0 0x7f0e9c003f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:45.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.419+0000 7f59f0cc1640 1 Processor -- start 2024-04-22T07:18:45.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.419+0000 7fe248dc2640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe23c0dd510 0x7fe23c0455a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:45.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.419+0000 7fe2495c3640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fe23c04c420 0x7fe23c046550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:56604/0 (socket says 172.21.15.37:56604) 2024-04-22T07:18:45.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.419+0000 7fe2495c3640 1 -- 172.21.15.37:0/3282822459 learned_addr learned my addr 172.21.15.37:0/3282822459 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-04-22T07:18:45.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.419+0000 7fc9c696b640 1 -- 172.21.15.37:0/2042824067 >> v1:172.21.15.196:6789/0 conn(0x7fc9b800a9e0 legacy=0x7fc9b80d8840 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-22T07:18:45.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.419+0000 7fc9c696b640 1 -- 172.21.15.37:0/2042824067 >> v1:172.21.15.37:6789/0 conn(0x7fc9b804eda0 legacy=0x7fc9b80df4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:18:45.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.419+0000 7fc9c696b640 1 -- 172.21.15.37:0/2042824067 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9b8008d10 con 0x7fc9b804da40 2024-04-22T07:18:45.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.419+0000 7f0eb505d640 1 -- 172.21.15.37:0/927227982 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0e9c00ac50 msgr2=0x7f0e9c00d040 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-22T07:18:45.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.419+0000 7f0eb505d640 1 --2- 172.21.15.37:0/927227982 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0e9c00ac50 0x7f0e9c00d040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:45.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.419+0000 7f0eb505d640 1 -- 172.21.15.37:0/927227982 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e9c00d580 msgr2=0x7f0e9c00f970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:18:45.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.419+0000 7f0eb505d640 1 --2- 172.21.15.37:0/927227982 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e9c00d580 0x7f0e9c00f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:45.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.419+0000 7f0eb505d640 1 -- 172.21.15.37:0/927227982 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0eb01573f0 con 0x7f0e9c003ac0 2024-04-22T07:18:45.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.419+0000 7f59f0cc1640 1 -- start start 2024-04-22T07:18:45.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.420+0000 7fd77dd9b640 1 -- 172.21.15.37:0/1692482843 >> v1:172.21.15.196:6789/0 conn(0x7fd78006bbe0 legacy=0x7fd78015ff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:45.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.420+0000 7fd77dd9b640 1 -- 172.21.15.37:0/1692482843 >> v1:172.21.15.37:6789/0 conn(0x7fd7800b37d0 legacy=0x7fd78015c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:45.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.420+0000 7fd77dd9b640 1 -- 172.21.15.37:0/1692482843 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7800cb060 con 0x7fd78006bfc0 2024-04-22T07:18:45.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.418+0000 7f8b1dd29640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8b1806cc40 0x7f8b18162b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.37:54162/0 (socket says 172.21.15.37:54162) 2024-04-22T07:18:45.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.418+0000 7f8b1dd29640 1 -- 172.21.15.37:0/1624907298 learned_addr learned my addr 172.21.15.37:0/1624907298 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:18:45.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.419+0000 7f8b1dd29640 1 -- 172.21.15.37:0/1624907298 >> v1:172.21.15.196:6789/0 conn(0x7f8b181594f0 legacy=0x7f8b180676b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:18:45.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.419+0000 7f8b1dd29640 1 -- 172.21.15.37:0/1624907298 >> v1:172.21.15.37:6789/0 conn(0x7f8b180682d0 legacy=0x7f8b18169bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:18:45.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.419+0000 7f8b1dd29640 1 -- 172.21.15.37:0/1624907298 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b1815f9a0 con 0x7f8b1806cc40 2024-04-22T07:18:45.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.420+0000 7f8b1dd29640 1 --2- 172.21.15.37:0/1624907298 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8b1806cc40 0x7f8b18162b70 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f8b080098a0 tx=0x7f8b0802b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=994e972608128bc8 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:45.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.419+0000 7fd7e9af0640 1 Processor -- start 2024-04-22T07:18:45.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.419+0000 7fd7e9af0640 1 -- start start 2024-04-22T07:18:45.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.420+0000 7fe243fff640 1 --2- 172.21.15.37:0/3282822459 >> v2:172.21.15.37:3300/0 conn(0x7fe23c045ae0 0x7fe23c04bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:45.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.420+0000 7fe2437fe640 1 -- 172.21.15.37:0/3282822459 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3780699207 0 0) 0x7fe230001110 con 0x7fe23c04c420 2024-04-22T07:18:45.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.420+0000 7fe2437fe640 1 -- 172.21.15.37:0/3282822459 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe234003520 con 0x7fe23c04c420 2024-04-22T07:18:45.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.421+0000 7f0eb505d640 1 --2- 172.21.15.37:0/927227982 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0e9c003ac0 0x7f0e9c003f00 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f0ea000d440 tx=0x7f0e9c003730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e4598834d297f90a server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:45.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.421+0000 7f8b1d528640 1 -- 172.21.15.37:0/1624907298 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b08035020 con 0x7f8b1806cc40 2024-04-22T07:18:45.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.421+0000 7fe248dc2640 1 -- 172.21.15.37:0/3282822459 >> v2:172.21.15.37:3300/0 conn(0x7fe23c045ae0 msgr2=0x7fe23c04bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:18:45.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.421+0000 7fe248dc2640 1 --2- 172.21.15.37:0/3282822459 >> v2:172.21.15.37:3300/0 conn(0x7fe23c045ae0 0x7fe23c04bee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:45.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.421+0000 7fd7e9af0640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd7e4154f90 0x7fd7e40cb070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:45.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.421+0000 7fe248dc2640 1 -- 172.21.15.37:0/3282822459 >> v1:172.21.15.37:6789/0 conn(0x7fe23c04c420 legacy=0x7fe23c046550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:45.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.421+0000 7f0ea7fff640 1 -- 172.21.15.37:0/927227982 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ea0001c40 con 0x7f0e9c003ac0 2024-04-22T07:18:45.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.421+0000 7f59f0cc1640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f59e40e0490 0x7f59e4039e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:45.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.421+0000 7f59f0cc1640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f59e404ffd0 0x7f59e40dfaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:45.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.421+0000 7f59f0cc1640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59e403a4b0 con 0x7f59e40d9250 2024-04-22T07:18:45.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.421+0000 7f59f0cc1640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f59e40dffe0 con 0x7f59e404ffd0 2024-04-22T07:18:45.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.421+0000 7f59f0cc1640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f59e404ef30 con 0x7f59e40e0490 2024-04-22T07:18:45.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.421+0000 7f0ea7fff640 1 -- 172.21.15.37:0/927227982 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ea0009040 con 0x7f0e9c003ac0 2024-04-22T07:18:45.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.421+0000 7f8b1d528640 1 -- 172.21.15.37:0/1624907298 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b08031640 con 0x7f8b1806cc40 2024-04-22T07:18:45.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.421+0000 7f8b1d528640 1 -- 172.21.15.37:0/1624907298 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b0802d040 con 0x7f8b1806cc40 2024-04-22T07:18:45.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.421+0000 7fd7e9af0640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fd7e415b310 0x7fd7e415b780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:45.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.421+0000 7fd7e9af0640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd7e415bcc0 con 0x7fd7e40cbe80 2024-04-22T07:18:45.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.421+0000 7fd7e9af0640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fd7e415e400 con 0x7fd7e4154f90 2024-04-22T07:18:45.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.421+0000 7fd7e9af0640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7fd7e415ae10 con 0x7fd7e415b310 2024-04-22T07:18:45.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.421+0000 7fe248dc2640 1 -- 172.21.15.37:0/3282822459 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe23c0e37f0 con 0x7fe23c0dd510 2024-04-22T07:18:45.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.421+0000 7fd7e92ef640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fd7e415b310 0x7fd7e415b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:45.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.421+0000 7fd7e92ef640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fd7e415b310 0x7fd7e415b780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.37:34796/0 (socket says 172.21.15.37:34796) 2024-04-22T07:18:45.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.421+0000 7fd7e92ef640 1 -- 172.21.15.37:0/938716155 learned_addr learned my addr 172.21.15.37:0/938716155 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:18:45.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.421+0000 7f0ea7fff640 1 -- 172.21.15.37:0/927227982 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ea0001c40 con 0x7f0e9c003ac0 2024-04-22T07:18:45.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.421+0000 7f59eaffd640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f59e40e0490 0x7f59e4039e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:45.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.421+0000 7fd7e8aee640 1 --2- 172.21.15.37:0/938716155 >> v2:172.21.15.37:3300/0 conn(0x7fd7e4154f90 0x7fd7e40cb070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:45.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.421+0000 7fd7e92ef640 1 -- 172.21.15.37:0/938716155 >> v2:172.21.15.37:3300/0 conn(0x7fd7e4154f90 msgr2=0x7fd7e40cb070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:18:45.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.421+0000 7fd7e92ef640 1 --2- 172.21.15.37:0/938716155 >> v2:172.21.15.37:3300/0 conn(0x7fd7e4154f90 0x7fd7e40cb070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:45.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.421+0000 7fd7e92ef640 1 -- 172.21.15.37:0/938716155 >> v1:172.21.15.196:6789/0 conn(0x7fd7e40cbe80 legacy=0x7fd7e40730c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:18:45.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.421+0000 7fd7e92ef640 1 -- 172.21.15.37:0/938716155 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7e40cdfe0 con 0x7fd7e415b310 2024-04-22T07:18:45.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.421+0000 7f59eb7fe640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7f59e40d9250 0x7f59e40071b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.37:54198/0 (socket says 172.21.15.37:54198) 2024-04-22T07:18:45.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.422+0000 7f0eb605f640 1 -- 172.21.15.37:0/927227982 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0e9c003ac0 msgr2=0x7f0e9c003f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:45.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.422+0000 7f0eb605f640 1 --2- 172.21.15.37:0/927227982 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0e9c003ac0 0x7f0e9c003f00 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f0ea000d440 tx=0x7f0e9c003730 comp rx=0 tx=0).stop 2024-04-22T07:18:45.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.422+0000 7f0eb585e640 1 -- 172.21.15.37:0/927227982 reap_dead start 2024-04-22T07:18:45.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.422+0000 7f0eb605f640 1 -- 172.21.15.37:0/927227982 shutdown_connections 2024-04-22T07:18:45.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.422+0000 7f0eb605f640 1 -- 172.21.15.37:0/927227982 >> 172.21.15.37:0/927227982 conn(0x7f0eb00676b0 msgr2=0x7f0eb0067a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:45.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.421+0000 7f59eb7fe640 1 -- 172.21.15.37:0/1796123943 learned_addr learned my addr 172.21.15.37:0/1796123943 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-04-22T07:18:45.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.421+0000 7f59ea7fc640 1 -- 172.21.15.37:0/1796123943 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2459963528 0 0) 0x7f59e403a4b0 con 0x7f59e40d9250 2024-04-22T07:18:45.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.421+0000 7f59ea7fc640 1 -- 172.21.15.37:0/1796123943 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f59dc003520 con 0x7f59e40d9250 2024-04-22T07:18:45.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.422+0000 7fc9c696b640 1 --2- 172.21.15.37:0/2042824067 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc9b804da40 0x7fc9b804cd10 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fc9c00748a0 tx=0x7fc9c00a7bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4f67b53905ebb29 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:45.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.422+0000 7f0eb605f640 1 -- 172.21.15.37:0/927227982 shutdown_connections 2024-04-22T07:18:45.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.421+0000 7f59eaffd640 1 -- 172.21.15.37:0/1796123943 >> v2:172.21.15.37:3300/0 conn(0x7f59e404ffd0 msgr2=0x7f59e40dfaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:18:45.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.421+0000 7f59eaffd640 1 --2- 172.21.15.37:0/1796123943 >> v2:172.21.15.37:3300/0 conn(0x7f59e404ffd0 0x7f59e40dfaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:45.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.421+0000 7f59eaffd640 1 -- 172.21.15.37:0/1796123943 >> v1:172.21.15.196:6789/0 conn(0x7f59e40d9250 legacy=0x7f59e40071b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:45.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.421+0000 7f59eaffd640 1 -- 172.21.15.37:0/1796123943 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59e404f210 con 0x7f59e40e0490 2024-04-22T07:18:45.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.422+0000 7fe248dc2640 1 --2- 172.21.15.37:0/3282822459 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe23c0dd510 0x7fe23c0455a0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fe2380097a0 tx=0x7fe23802b940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d44e6dc580db35da server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:45.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.423+0000 7f59eaffd640 1 --2- 172.21.15.37:0/1796123943 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f59e40e0490 0x7f59e4039e70 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f59e4012570 tx=0x7f59e0034190 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e90405b16a173af6 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:45.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.423+0000 7fd77dd9b640 1 --2- 172.21.15.37:0/1692482843 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd78006bfc0 0x7fd7800c8ef0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fd778009dc0 tx=0x7fd77802bd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fa3edb8a809db97 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:45.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.422+0000 7f0eb605f640 1 -- 172.21.15.37:0/927227982 wait complete. 2024-04-22T07:18:45.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.423+0000 7fe2437fe640 1 -- 172.21.15.37:0/3282822459 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe238034070 con 0x7fe23c0dd510 2024-04-22T07:18:45.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.423+0000 7fd7e92ef640 1 --2- 172.21.15.37:0/938716155 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd7e415b310 0x7fd7e415b780 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fd7e4062cb0 tx=0x7fd7dc02bee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ad33d0b614ca3576 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:45.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.423+0000 7f59ea7fc640 1 -- 172.21.15.37:0/1796123943 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59e0041070 con 0x7f59e40e0490 2024-04-22T07:18:45.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.423+0000 7f59ea7fc640 1 -- 172.21.15.37:0/1796123943 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59e003c440 con 0x7f59e40e0490 2024-04-22T07:18:45.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.423+0000 7f59ea7fc640 1 -- 172.21.15.37:0/1796123943 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59e003c810 con 0x7f59e40e0490 2024-04-22T07:18:45.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.423+0000 7fe2437fe640 1 -- 172.21.15.37:0/3282822459 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe238030800 con 0x7fe23c0dd510 2024-04-22T07:18:45.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.423+0000 7fe2437fe640 1 -- 172.21.15.37:0/3282822459 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe238030bd0 con 0x7fe23c0dd510 2024-04-22T07:18:45.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.423+0000 7f8b2078e640 1 -- 172.21.15.37:0/1624907298 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8b1806cc40 msgr2=0x7f8b18162b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:45.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.423+0000 7f8b2078e640 1 --2- 172.21.15.37:0/1624907298 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8b1806cc40 0x7f8b18162b70 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f8b080098a0 tx=0x7f8b0802b8f0 comp rx=0 tx=0).stop 2024-04-22T07:18:45.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.423+0000 7fc9c5168640 1 -- 172.21.15.37:0/2042824067 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9c00b5070 con 0x7fc9b804da40 2024-04-22T07:18:45.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.423+0000 7fd7e37fe640 1 -- 172.21.15.37:0/938716155 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7dc02ca80 con 0x7fd7e415b310 2024-04-22T07:18:45.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.423+0000 7fd7e37fe640 1 -- 172.21.15.37:0/938716155 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7dc02cc20 con 0x7fd7e415b310 2024-04-22T07:18:45.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.423+0000 7f8b2078e640 1 -- 172.21.15.37:0/1624907298 shutdown_connections 2024-04-22T07:18:45.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.423+0000 7f8b2078e640 1 --2- 172.21.15.37:0/1624907298 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8b1806cc40 0x7f8b18162b70 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:45.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.423+0000 7fd7e37fe640 1 -- 172.21.15.37:0/938716155 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7dc0343f0 con 0x7fd7e415b310 2024-04-22T07:18:45.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.423+0000 7f8b2078e640 1 -- 172.21.15.37:0/1624907298 >> 172.21.15.37:0/1624907298 conn(0x7f8b180cd4d0 msgr2=0x7f8b180cd8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:45.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.423+0000 7fc9c5168640 1 -- 172.21.15.37:0/2042824067 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9c00a8a80 con 0x7fc9b804da40 2024-04-22T07:18:45.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.424+0000 7fe24b026640 1 -- 172.21.15.37:0/3282822459 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe23c0dd510 msgr2=0x7fe23c0455a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:45.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.424+0000 7fe24b026640 1 --2- 172.21.15.37:0/3282822459 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe23c0dd510 0x7fe23c0455a0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fe2380097a0 tx=0x7fe23802b940 comp rx=0 tx=0).stop 2024-04-22T07:18:45.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.424+0000 7f59f0cc1640 1 -- 172.21.15.37:0/1796123943 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f59e40e0490 msgr2=0x7f59e4039e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:45.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.424+0000 7f59f0cc1640 1 --2- 172.21.15.37:0/1796123943 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f59e40e0490 0x7f59e4039e70 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f59e4012570 tx=0x7f59e0034190 comp rx=0 tx=0).stop 2024-04-22T07:18:45.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.424+0000 7fc9c5168640 1 -- 172.21.15.37:0/2042824067 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9c00b0440 con 0x7fc9b804da40 2024-04-22T07:18:45.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.424+0000 7fe24b026640 1 -- 172.21.15.37:0/3282822459 shutdown_connections 2024-04-22T07:18:45.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.424+0000 7fe24b026640 1 --2- 172.21.15.37:0/3282822459 >> v2:172.21.15.37:3300/0 conn(0x7fe23c045ae0 0x7fe23c04bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:45.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.424+0000 7fe24b026640 1 --2- 172.21.15.37:0/3282822459 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe23c0dd510 0x7fe23c0455a0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:45.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.424+0000 7fe24b026640 1 -- 172.21.15.37:0/3282822459 >> 172.21.15.37:0/3282822459 conn(0x7fe23c050600 msgr2=0x7fe23c050a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:45.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.424+0000 7fe24b026640 1 -- 172.21.15.37:0/3282822459 shutdown_connections 2024-04-22T07:18:45.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.424+0000 7f0eb605f640 1 Processor -- start 2024-04-22T07:18:45.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.424+0000 7f0eb605f640 1 -- start start 2024-04-22T07:18:45.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.424+0000 7f59f0cc1640 1 -- 172.21.15.37:0/1796123943 shutdown_connections 2024-04-22T07:18:45.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.424+0000 7f59f0cc1640 1 --2- 172.21.15.37:0/1796123943 >> v2:172.21.15.37:3300/0 conn(0x7f59e404ffd0 0x7f59e40dfaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:45.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.424+0000 7f59f0cc1640 1 --2- 172.21.15.37:0/1796123943 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f59e40e0490 0x7f59e4039e70 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:45.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.424+0000 7fd77d59a640 1 -- 172.21.15.37:0/1692482843 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd778039070 con 0x7fd78006bfc0 2024-04-22T07:18:45.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.424+0000 7fd7e9af0640 1 -- 172.21.15.37:0/938716155 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd7e415b310 msgr2=0x7fd7e415b780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:45.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.424+0000 7fd7e9af0640 1 --2- 172.21.15.37:0/938716155 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd7e415b310 0x7fd7e415b780 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fd7e4062cb0 tx=0x7fd7dc02bee0 comp rx=0 tx=0).stop 2024-04-22T07:18:45.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.424+0000 7f59f0cc1640 1 -- 172.21.15.37:0/1796123943 >> 172.21.15.37:0/1796123943 conn(0x7f59e400e160 msgr2=0x7f59e400e570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:45.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.424+0000 7f8b2078e640 1 -- 172.21.15.37:0/1624907298 shutdown_connections 2024-04-22T07:18:45.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.424+0000 7fc9c716c640 1 -- 172.21.15.37:0/2042824067 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc9b804da40 msgr2=0x7fc9b804cd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:45.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.424+0000 7fc9c716c640 1 --2- 172.21.15.37:0/2042824067 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc9b804da40 0x7fc9b804cd10 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fc9c00748a0 tx=0x7fc9c00a7bd0 comp rx=0 tx=0).stop 2024-04-22T07:18:45.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.424+0000 7fd77d59a640 1 -- 172.21.15.37:0/1692482843 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd77802cab0 con 0x7fd78006bfc0 2024-04-22T07:18:45.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.424+0000 7f8b2078e640 1 -- 172.21.15.37:0/1624907298 wait complete. 2024-04-22T07:18:45.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.424+0000 7fd7e9af0640 1 -- 172.21.15.37:0/938716155 shutdown_connections 2024-04-22T07:18:45.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.424+0000 7fd7e9af0640 1 --2- 172.21.15.37:0/938716155 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd7e415b310 0x7fd7e415b780 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:45.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.424+0000 7fd7e9af0640 1 --2- 172.21.15.37:0/938716155 >> v2:172.21.15.37:3300/0 conn(0x7fd7e4154f90 0x7fd7e40cb070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:45.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.424+0000 7fd7e9af0640 1 -- 172.21.15.37:0/938716155 >> 172.21.15.37:0/938716155 conn(0x7fd7e406c410 msgr2=0x7fd7e40676b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:45.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.424+0000 7fe24b026640 1 -- 172.21.15.37:0/3282822459 wait complete. 2024-04-22T07:18:45.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.424+0000 7fc9c716c640 1 -- 172.21.15.37:0/2042824067 shutdown_connections 2024-04-22T07:18:45.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.424+0000 7fc9c716c640 1 --2- 172.21.15.37:0/2042824067 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc9b804da40 0x7fc9b804cd10 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:45.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.424+0000 7fc9c716c640 1 -- 172.21.15.37:0/2042824067 >> 172.21.15.37:0/2042824067 conn(0x7fc9b800e690 msgr2=0x7fc9b8009d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:45.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.425+0000 7f59f0cc1640 1 -- 172.21.15.37:0/1796123943 shutdown_connections 2024-04-22T07:18:45.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.425+0000 7fc9c716c640 1 -- 172.21.15.37:0/2042824067 shutdown_connections 2024-04-22T07:18:45.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.425+0000 7f59f0cc1640 1 -- 172.21.15.37:0/1796123943 wait complete. 2024-04-22T07:18:45.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.425+0000 7fc9c716c640 1 -- 172.21.15.37:0/2042824067 wait complete. 2024-04-22T07:18:45.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.425+0000 7fd784ff4640 1 -- 172.21.15.37:0/1692482843 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd78006bfc0 msgr2=0x7fd7800c8ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:45.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.425+0000 7fd784ff4640 1 --2- 172.21.15.37:0/1692482843 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd78006bfc0 0x7fd7800c8ef0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fd778009dc0 tx=0x7fd77802bd80 comp rx=0 tx=0).stop 2024-04-22T07:18:45.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.425+0000 7f0eb605f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0eb014d010 0x7f0eb00c47d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:45.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.425+0000 7f0eb605f640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0eb014d3f0 0x7f0eb01446e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:45.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.425+0000 7f0eb605f640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0eb0143be0 0x7f0eb0144c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:45.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.425+0000 7fd7e9af0640 1 -- 172.21.15.37:0/938716155 shutdown_connections 2024-04-22T07:18:45.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.425+0000 7fd784ff4640 1 -- 172.21.15.37:0/1692482843 shutdown_connections 2024-04-22T07:18:45.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.426+0000 7fd784ff4640 1 --2- 172.21.15.37:0/1692482843 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd78006bfc0 0x7fd7800c8ef0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:45.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.426+0000 7fd784ff4640 1 -- 172.21.15.37:0/1692482843 >> 172.21.15.37:0/1692482843 conn(0x7fd7800d0560 msgr2=0x7fd7800d0970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:45.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.426+0000 7fd7e9af0640 1 -- 172.21.15.37:0/938716155 wait complete. 2024-04-22T07:18:45.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.426+0000 7f0eb485c640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0eb014d3f0 0x7f0eb01446e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:45.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.426+0000 7fe24b026640 1 Processor -- start 2024-04-22T07:18:45.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.426+0000 7fe24b026640 1 -- start start 2024-04-22T07:18:45.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.426+0000 7fd784ff4640 1 -- 172.21.15.37:0/1692482843 shutdown_connections 2024-04-22T07:18:45.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.426+0000 7f0eb485c640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0eb014d3f0 0x7f0eb01446e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.37:54190/0 (socket says 172.21.15.37:54190) 2024-04-22T07:18:45.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.426+0000 7f0eb485c640 1 -- 172.21.15.37:0/3240307937 learned_addr learned my addr 172.21.15.37:0/3240307937 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:18:45.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.426+0000 7f0eb605f640 1 -- 172.21.15.37:0/3240307937 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0eb01512c0 con 0x7f0eb014d010 2024-04-22T07:18:45.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.426+0000 7f0eb605f640 1 -- 172.21.15.37:0/3240307937 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f0eb01579b0 con 0x7f0eb0143be0 2024-04-22T07:18:45.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.426+0000 7f0eb605f640 1 -- 172.21.15.37:0/3240307937 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f0eb0151440 con 0x7f0eb014d3f0 2024-04-22T07:18:45.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.426+0000 7f8b2078e640 1 Processor -- start 2024-04-22T07:18:45.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.426+0000 7f8b2078e640 1 -- start start 2024-04-22T07:18:45.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.426+0000 7fd784ff4640 1 -- 172.21.15.37:0/1692482843 wait complete. 2024-04-22T07:18:45.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.426+0000 7f0eb585e640 1 --2- 172.21.15.37:0/3240307937 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0eb0143be0 0x7f0eb0144c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:45.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.427+0000 7f59f0cc1640 1 Processor -- start 2024-04-22T07:18:45.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.427+0000 7f0eb585e640 1 -- 172.21.15.37:0/3240307937 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0eb014d3f0 msgr2=0x7f0eb01446e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:45.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.427+0000 7f0eb585e640 1 --2- 172.21.15.37:0/3240307937 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0eb014d3f0 0x7f0eb01446e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:45.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.427+0000 7f0eb585e640 1 -- 172.21.15.37:0/3240307937 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0eb014d010 msgr2=0x7f0eb00c47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:45.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.427+0000 7f0eb505d640 1 --2- 172.21.15.37:0/3240307937 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0eb014d010 0x7f0eb00c47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:45.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.427+0000 7f0eb585e640 1 --2- 172.21.15.37:0/3240307937 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0eb014d010 0x7f0eb00c47d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:45.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.427+0000 7f8b2078e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b180682d0 0x7f8b180c70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:45.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.427+0000 7fd7e9af0640 1 Processor -- start 2024-04-22T07:18:45.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.427+0000 7f0eb585e640 1 -- 172.21.15.37:0/3240307937 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0eb01ebbf0 con 0x7f0eb0143be0 2024-04-22T07:18:45.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.427+0000 7fc9c716c640 1 Processor -- start 2024-04-22T07:18:45.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.427+0000 7fe24b026640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe23c045ae0 0x7fe23c04a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:45.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.428+0000 7f8b2078e640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8b1806cc40 0x7f8b1814af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:45.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.428+0000 7f0eb505d640 1 --2- 172.21.15.37:0/3240307937 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0eb014d010 0x7f0eb00c47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-22T07:18:45.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.428+0000 7f8b2078e640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8b181594f0 0x7f8b1814d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:45.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.428+0000 7f59f0cc1640 1 -- start start 2024-04-22T07:18:45.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.428+0000 7fe24b026640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe23c04c420 0x7fe23c0bef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:45.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.428+0000 7fe24b026640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe23c0dd510 0x7fe23c049fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:45.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.428+0000 7fe24b026640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe23c046030 con 0x7fe23c04c420 2024-04-22T07:18:45.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.428+0000 7fe24b026640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fe23c0e3db0 con 0x7fe23c0dd510 2024-04-22T07:18:45.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.428+0000 7fe24b026640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fe23c0e3160 con 0x7fe23c045ae0 2024-04-22T07:18:45.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.428+0000 7f8b2078e640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8b181598d0 con 0x7f8b180682d0 2024-04-22T07:18:45.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.428+0000 7f8b2078e640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f8b1815ff60 con 0x7f8b181594f0 2024-04-22T07:18:45.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.428+0000 7f8b2078e640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f8b18159a50 con 0x7f8b1806cc40 2024-04-22T07:18:45.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.428+0000 7f8b1dd29640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8b1806cc40 0x7f8b1814af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:45.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.428+0000 7f8b1ed2b640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8b181594f0 0x7f8b1814d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:45.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.428+0000 7f8b1dd29640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8b1806cc40 0x7f8b1814af40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.37:54196/0 (socket says 172.21.15.37:54196) 2024-04-22T07:18:45.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.428+0000 7fc9c716c640 1 -- start start 2024-04-22T07:18:45.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.428+0000 7f8b1dd29640 1 -- 172.21.15.37:0/2524441990 learned_addr learned my addr 172.21.15.37:0/2524441990 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:18:45.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.427+0000 7fd7e9af0640 1 -- start start 2024-04-22T07:18:45.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.428+0000 7f0eb585e640 1 --2- 172.21.15.37:0/3240307937 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0eb0143be0 0x7f0eb0144c20 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f0eb00681d0 tx=0x7f0ea800c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:45.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.428+0000 7fe248dc2640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe23c045ae0 0x7fe23c04a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:45.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.428+0000 7f8b1e52a640 1 --2- 172.21.15.37:0/2524441990 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b180682d0 0x7f8b180c70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:45.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.428+0000 7f8b1dd29640 1 -- 172.21.15.37:0/2524441990 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8b181594f0 msgr2=0x7f8b1814d540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:45.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.428+0000 7f8b1dd29640 1 --2- 172.21.15.37:0/2524441990 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8b181594f0 0x7f8b1814d540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:45.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.428+0000 7f8b1dd29640 1 -- 172.21.15.37:0/2524441990 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b180682d0 msgr2=0x7f8b180c70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:45.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.428+0000 7f8b1dd29640 1 --2- 172.21.15.37:0/2524441990 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b180682d0 0x7f8b180c70c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:45.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.428+0000 7f8b1dd29640 1 -- 172.21.15.37:0/2524441990 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b181f8920 con 0x7f8b1806cc40 2024-04-22T07:18:45.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.429+0000 7fe243fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe23c04c420 0x7fe23c0bef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:45.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.429+0000 7fe2495c3640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe23c0dd510 0x7fe23c049fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:45.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.429+0000 7fe243fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe23c04c420 0x7fe23c0bef70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54852/0 (socket says 172.21.15.37:54852) 2024-04-22T07:18:45.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.429+0000 7fe243fff640 1 -- 172.21.15.37:0/868755063 learned_addr learned my addr 172.21.15.37:0/868755063 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:18:45.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.429+0000 7f0ea5ffb640 1 -- 172.21.15.37:0/3240307937 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ea800ce40 con 0x7f0eb0143be0 2024-04-22T07:18:45.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.429+0000 7f0ea5ffb640 1 -- 172.21.15.37:0/3240307937 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ea801a070 con 0x7f0eb0143be0 2024-04-22T07:18:45.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.429+0000 7f0ea5ffb640 1 -- 172.21.15.37:0/3240307937 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ea80146a0 con 0x7f0eb0143be0 2024-04-22T07:18:45.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.429+0000 7fd784ff4640 1 Processor -- start 2024-04-22T07:18:45.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.429+0000 7fd7e9af0640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd7e40cbe80 0x7fd7e4150180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:45.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.429+0000 7fc9c716c640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc9b800a9e0 0x7fc9b8168460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:45.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.429+0000 7fc9c716c640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc9b804da40 0x7fc9b80ceda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:45.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.429+0000 7f59f0cc1640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f59e404ffd0 0x7f59e40ce5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:45.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.429+0000 7f8b1dd29640 1 --2- 172.21.15.37:0/2524441990 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8b1806cc40 0x7f8b1814af40 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f8b08000c00 tx=0x7f8b080046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:45.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.429+0000 7fe243fff640 1 -- 172.21.15.37:0/868755063 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe23c045ae0 msgr2=0x7fe23c04a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:45.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.429+0000 7fd7e9af0640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd7e4154f90 0x7fd7e4148fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:45.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.429+0000 7fc9c716c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc9b804eda0 0x7fc9b80cf2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:45.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.429+0000 7fc9c716c640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc9b80e3320 con 0x7fc9b804eda0 2024-04-22T07:18:45.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.429+0000 7fc9c716c640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fc9b80e31a0 con 0x7fc9b804da40 2024-04-22T07:18:45.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.429+0000 7fc9c716c640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fc9b80dfc00 con 0x7fc9b800a9e0 2024-04-22T07:18:45.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.429+0000 7fe243fff640 1 --2- 172.21.15.37:0/868755063 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe23c045ae0 0x7fe23c04a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:45.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.429+0000 7fe243fff640 1 -- 172.21.15.37:0/868755063 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe23c0dd510 msgr2=0x7fe23c049fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:45.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.429+0000 7f59f0cc1640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f59e40d9250 0x7f59e404c140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:45.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.429+0000 7fe243fff640 1 --2- 172.21.15.37:0/868755063 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe23c0dd510 0x7fe23c049fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:45.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.429+0000 7fd7e8aee640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd7e40cbe80 0x7fd7e4150180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:45.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.429+0000 7fd7e8aee640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd7e40cbe80 0x7fd7e4150180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.37:34824/0 (socket says 172.21.15.37:34824) 2024-04-22T07:18:45.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.429+0000 7fe243fff640 1 -- 172.21.15.37:0/868755063 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe23c0c0810 con 0x7fe23c04c420 2024-04-22T07:18:45.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.429+0000 7f59eb7fe640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f59e404ffd0 0x7f59e40ce5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:45.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.429+0000 7f59eb7fe640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f59e404ffd0 0x7f59e40ce5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.37:34832/0 (socket says 172.21.15.37:34832) 2024-04-22T07:18:45.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.429+0000 7fd7e8aee640 1 -- 172.21.15.37:0/413185585 learned_addr learned my addr 172.21.15.37:0/413185585 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:18:45.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.429+0000 7f0eb605f640 1 -- 172.21.15.37:0/3240307937 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0eb01f4ee0 con 0x7f0eb0143be0 2024-04-22T07:18:45.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.429+0000 7f59eb7fe640 1 -- 172.21.15.37:0/828740859 learned_addr learned my addr 172.21.15.37:0/828740859 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:18:45.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.429+0000 7fd7e3fff640 1 --2- 172.21.15.37:0/413185585 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd7e4154f90 0x7fd7e4148fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:45.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.429+0000 7fd7e9af0640 1 --2- 172.21.15.37:0/413185585 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7e415b310 0x7fd7e4149500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:45.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.430+0000 7f59f0cc1640 1 --2- 172.21.15.37:0/828740859 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f59e40e0490 0x7f59e40cabd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:45.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.430+0000 7f59eaffd640 1 --2- 172.21.15.37:0/828740859 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f59e40d9250 0x7f59e404c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:45.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.429+0000 7f8b0effd640 1 -- 172.21.15.37:0/2524441990 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b0803ac60 con 0x7f8b1806cc40 2024-04-22T07:18:45.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.430+0000 7f8b2078e640 1 -- 172.21.15.37:0/2524441990 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b181f8c00 con 0x7f8b1806cc40 2024-04-22T07:18:45.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.430+0000 7f8b2078e640 1 -- 172.21.15.37:0/2524441990 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b181f91c0 con 0x7f8b1806cc40 2024-04-22T07:18:45.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.430+0000 7fc9c5969640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc9b804da40 0x7fc9b80ceda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:45.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.430+0000 7fc9c5969640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc9b804da40 0x7fc9b80ceda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.37:34844/0 (socket says 172.21.15.37:34844) 2024-04-22T07:18:45.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.430+0000 7fc9c5969640 1 -- 172.21.15.37:0/94630778 learned_addr learned my addr 172.21.15.37:0/94630778 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:18:45.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.430+0000 7f0eb605f640 1 -- 172.21.15.37:0/3240307937 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0eb01f54a0 con 0x7f0eb0143be0 2024-04-22T07:18:45.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.430+0000 7fc9c616a640 1 --2- 172.21.15.37:0/94630778 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc9b800a9e0 0x7fc9b8168460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:45.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.430+0000 7fc9c696b640 1 --2- 172.21.15.37:0/94630778 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc9b804eda0 0x7fc9b80cf2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:45.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.430+0000 7f8b0effd640 1 -- 172.21.15.37:0/2524441990 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b0803ae20 con 0x7f8b1806cc40 2024-04-22T07:18:45.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.430+0000 7f8b0effd640 1 -- 172.21.15.37:0/2524441990 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b08044630 con 0x7f8b1806cc40 2024-04-22T07:18:45.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.430+0000 7fc9c5969640 1 -- 172.21.15.37:0/94630778 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc9b800a9e0 msgr2=0x7fc9b8168460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:45.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.430+0000 7fc9c5969640 1 --2- 172.21.15.37:0/94630778 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc9b800a9e0 0x7fc9b8168460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:45.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.430+0000 7fc9c5969640 1 -- 172.21.15.37:0/94630778 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc9b804eda0 msgr2=0x7fc9b80cf2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:45.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.430+0000 7fc9c5969640 1 --2- 172.21.15.37:0/94630778 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc9b804eda0 0x7fc9b80cf2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:45.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.430+0000 7fd7e9af0640 1 -- 172.21.15.37:0/413185585 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd7e415ec10 con 0x7fd7e415b310 2024-04-22T07:18:45.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.430+0000 7fc9c5969640 1 -- 172.21.15.37:0/94630778 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9b80d3300 con 0x7fc9b804da40 2024-04-22T07:18:45.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.430+0000 7fd7e92ef640 1 --2- 172.21.15.37:0/413185585 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7e415b310 0x7fd7e4149500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:45.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.430+0000 7fd7e9af0640 1 -- 172.21.15.37:0/413185585 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fd7e415e930 con 0x7fd7e40cbe80 2024-04-22T07:18:45.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.430+0000 7fd7e9af0640 1 -- 172.21.15.37:0/413185585 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fd7e415eef0 con 0x7fd7e4154f90 2024-04-22T07:18:45.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.430+0000 7fd784ff4640 1 -- start start 2024-04-22T07:18:45.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.430+0000 7fe243fff640 1 --2- 172.21.15.37:0/868755063 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe23c04c420 0x7fe23c0bef70 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fe2440699e0 tx=0x7fe244069600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:45.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.431+0000 7fc9c5969640 1 --2- 172.21.15.37:0/94630778 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc9b804da40 0x7fc9b80ceda0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc9bc00b450 tx=0x7fc9bc00b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:45.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.431+0000 7fc9b6ffd640 1 -- 172.21.15.37:0/94630778 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9bc015020 con 0x7fc9b804da40 2024-04-22T07:18:45.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.431+0000 7fc9c716c640 1 -- 172.21.15.37:0/94630778 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9b80d35a0 con 0x7fc9b804da40 2024-04-22T07:18:45.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.431+0000 7fc9c716c640 1 -- 172.21.15.37:0/94630778 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9b80d3840 con 0x7fc9b804da40 2024-04-22T07:18:45.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.431+0000 7fd7e92ef640 1 -- 172.21.15.37:0/413185585 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd7e4154f90 msgr2=0x7fd7e4148fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:45.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.431+0000 7fd7e92ef640 1 --2- 172.21.15.37:0/413185585 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd7e4154f90 0x7fd7e4148fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:45.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.431+0000 7fd7e92ef640 1 -- 172.21.15.37:0/413185585 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd7e40cbe80 msgr2=0x7fd7e4150180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:45.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.431+0000 7fd7e92ef640 1 --2- 172.21.15.37:0/413185585 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd7e40cbe80 0x7fd7e4150180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:45.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.431+0000 7fd7e92ef640 1 -- 172.21.15.37:0/413185585 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7e415dfb0 con 0x7fd7e415b310 2024-04-22T07:18:45.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.432+0000 7f0eb605f640 1 -- 172.21.15.37:0/3240307937 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0eb00c3da0 con 0x7f0eb0143be0 2024-04-22T07:18:45.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.432+0000 7fc9b6ffd640 1 -- 172.21.15.37:0/94630778 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9bc011850 con 0x7fc9b804da40 2024-04-22T07:18:45.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.432+0000 7f59f0cc1640 1 -- 172.21.15.37:0/828740859 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f59e404fab0 con 0x7f59e40e0490 2024-04-22T07:18:45.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.432+0000 7f59f0cc1640 1 -- 172.21.15.37:0/828740859 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f59e404f7d0 con 0x7f59e404ffd0 2024-04-22T07:18:45.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.432+0000 7f59f0cc1640 1 -- 172.21.15.37:0/828740859 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f59e4050420 con 0x7f59e40d9250 2024-04-22T07:18:45.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.432+0000 7fd784ff4640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd78006bbe0 0x7fd7801584f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:45.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.432+0000 7fd7e92ef640 1 --2- 172.21.15.37:0/413185585 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7e415b310 0x7fd7e4149500 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fd7dc032000 tx=0x7fd7dc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:45.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.431+0000 7f8b2078e640 1 -- 172.21.15.37:0/2524441990 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b00005290 con 0x7f8b1806cc40 2024-04-22T07:18:45.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.432+0000 7fd784ff4640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd78006bfc0 0x7fd7801555a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:45.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.432+0000 7f59ebfff640 1 --2- 172.21.15.37:0/828740859 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f59e40e0490 0x7f59e40cabd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:45.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.432+0000 7fd77e59c640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd78006bbe0 0x7fd7801584f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:45.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.432+0000 7fd77e59c640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd78006bbe0 0x7fd7801584f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.37:54248/0 (socket says 172.21.15.37:54248) 2024-04-22T07:18:45.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.432+0000 7fd77e59c640 1 -- 172.21.15.37:0/3559246978 learned_addr learned my addr 172.21.15.37:0/3559246978 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:18:45.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.432+0000 7f8b0effd640 1 -- 172.21.15.37:0/2524441990 <== mon.2 v2:172.21.15.196:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8b0804b060 con 0x7f8b1806cc40 2024-04-22T07:18:45.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.432+0000 7fe2417fa640 1 -- 172.21.15.37:0/868755063 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe244099070 con 0x7fe23c04c420 2024-04-22T07:18:45.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.432+0000 7fe24b026640 1 -- 172.21.15.37:0/868755063 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe23c0c0af0 con 0x7fe23c04c420 2024-04-22T07:18:45.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.433+0000 7fe24b026640 1 -- 172.21.15.37:0/868755063 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe23c0497c0 con 0x7fe23c04c420 2024-04-22T07:18:45.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.433+0000 7fc9b6ffd640 1 -- 172.21.15.37:0/94630778 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9bc011c40 con 0x7fc9b804da40 2024-04-22T07:18:45.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.432+0000 7f0ea5ffb640 1 -- 172.21.15.37:0/3240307937 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0ea8012050 con 0x7f0eb0143be0 2024-04-22T07:18:45.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.433+0000 7fe2417fa640 1 -- 172.21.15.37:0/868755063 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe244094630 con 0x7fe23c04c420 2024-04-22T07:18:45.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.433+0000 7fe2417fa640 1 -- 172.21.15.37:0/868755063 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe244094a20 con 0x7fe23c04c420 2024-04-22T07:18:45.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.433+0000 7f59eb7fe640 1 -- 172.21.15.37:0/828740859 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f59e40d9250 msgr2=0x7f59e404c140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:45.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.433+0000 7f59eb7fe640 1 --2- 172.21.15.37:0/828740859 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f59e40d9250 0x7f59e404c140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:45.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.433+0000 7f59eb7fe640 1 -- 172.21.15.37:0/828740859 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f59e40e0490 msgr2=0x7f59e40cabd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:45.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.433+0000 7f8b0effd640 1 --2- 172.21.15.37:0/2524441990 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f8afc06c9c0 0x7f8afc06ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:45.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.433+0000 7f59eb7fe640 1 --2- 172.21.15.37:0/828740859 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f59e40e0490 0x7f59e40cabd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:45.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.433+0000 7f59eb7fe640 1 -- 172.21.15.37:0/828740859 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59e40d5fc0 con 0x7f59e404ffd0 2024-04-22T07:18:45.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.433+0000 7f0ea5ffb640 1 --2- 172.21.15.37:0/3240307937 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f0e9406c9f0 0x7f0e9406eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:45.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.433+0000 7f59ebfff640 1 --2- 172.21.15.37:0/828740859 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f59e40e0490 0x7f59e40cabd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-22T07:18:45.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.433+0000 7fd77dd9b640 1 --2- 172.21.15.37:0/3559246978 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd78006bfc0 0x7fd7801555a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:45.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.433+0000 7fd784ff4640 1 --2- 172.21.15.37:0/3559246978 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd7800b37d0 0x7fd780155ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:45.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.433+0000 7fd784ff4640 1 -- 172.21.15.37:0/3559246978 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd7800b4000 con 0x7fd78006bfc0 2024-04-22T07:18:45.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.432+0000 7fd7e17fa640 1 -- 172.21.15.37:0/413185585 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7dc043020 con 0x7fd7e415b310 2024-04-22T07:18:45.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.432+0000 7fd7e17fa640 1 -- 172.21.15.37:0/413185585 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7dc03e450 con 0x7fd7e415b310 2024-04-22T07:18:45.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.432+0000 7fd7e17fa640 1 -- 172.21.15.37:0/413185585 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7dc009510 con 0x7fd7e415b310 2024-04-22T07:18:45.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.433+0000 7fd7e9af0640 1 -- 172.21.15.37:0/413185585 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7e4149de0 con 0x7fd7e415b310 2024-04-22T07:18:45.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.433+0000 7fd7e9af0640 1 -- 172.21.15.37:0/413185585 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7e4151d30 con 0x7fd7e415b310 2024-04-22T07:18:45.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.433+0000 7fd784ff4640 1 -- 172.21.15.37:0/3559246978 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fd7800cb620 con 0x7fd7800b37d0 2024-04-22T07:18:45.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.434+0000 7fc9b6ffd640 1 -- 172.21.15.37:0/94630778 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc9bc018020 con 0x7fc9b804da40 2024-04-22T07:18:45.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.433+0000 7fd784ff4640 1 -- 172.21.15.37:0/3559246978 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fd7800b4180 con 0x7fd78006bbe0 2024-04-22T07:18:45.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.434+0000 7fd77ed9d640 1 --2- 172.21.15.37:0/3559246978 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd7800b37d0 0x7fd780155ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:45.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.434+0000 7fd77dd9b640 1 -- 172.21.15.37:0/3559246978 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd78006bbe0 msgr2=0x7fd7801584f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:45.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.434+0000 7fd77dd9b640 1 --2- 172.21.15.37:0/3559246978 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd78006bbe0 0x7fd7801584f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:45.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.434+0000 7fd77dd9b640 1 -- 172.21.15.37:0/3559246978 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd7800b37d0 msgr2=0x7fd780155ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:45.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.434+0000 7fd77dd9b640 1 --2- 172.21.15.37:0/3559246978 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd7800b37d0 0x7fd780155ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:45.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.434+0000 7fd77dd9b640 1 -- 172.21.15.37:0/3559246978 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7801f5870 con 0x7fd78006bfc0 2024-04-22T07:18:45.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.434+0000 7fd77dd9b640 1 --2- 172.21.15.37:0/3559246978 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd78006bfc0 0x7fd7801555a0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fd7800ccad0 tx=0x7fd778004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:45.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.434+0000 7f0ea5ffb640 1 -- 172.21.15.37:0/3240307937 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f0ea808c1a0 con 0x7f0eb0143be0 2024-04-22T07:18:45.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.434+0000 7f0eb505d640 1 --2- 172.21.15.37:0/3240307937 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f0e9406c9f0 0x7f0e9406eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:45.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.434+0000 7f8b0effd640 1 -- 172.21.15.37:0/2524441990 <== mon.2 v2:172.21.15.196:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f8b080ad830 con 0x7f8b1806cc40 2024-04-22T07:18:45.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.434+0000 7f8b1e52a640 1 --2- 172.21.15.37:0/2524441990 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f8afc06c9c0 0x7f8afc06ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:45.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.434+0000 7fd7e9af0640 1 -- 172.21.15.37:0/413185585 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7c8005290 con 0x7fd7e415b310 2024-04-22T07:18:45.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.435+0000 7f59eb7fe640 1 --2- 172.21.15.37:0/828740859 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f59e404ffd0 0x7f59e40ce5e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f59ec06b4b0 tx=0x7f59ec068ef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:45.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.435+0000 7fc9c716c640 1 -- 172.21.15.37:0/94630778 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9a8005290 con 0x7fc9b804da40 2024-04-22T07:18:45.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.435+0000 7fe24b026640 1 -- 172.21.15.37:0/868755063 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe224005290 con 0x7fe23c04c420 2024-04-22T07:18:45.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.435+0000 7fd76effd640 1 -- 172.21.15.37:0/3559246978 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd778044020 con 0x7fd78006bfc0 2024-04-22T07:18:45.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.435+0000 7fd784ff4640 1 -- 172.21.15.37:0/3559246978 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7801f5b50 con 0x7fd78006bfc0 2024-04-22T07:18:45.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.435+0000 7f0eb505d640 1 --2- 172.21.15.37:0/3240307937 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f0e9406c9f0 0x7f0e9406eeb0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f0ea0035000 tx=0x7f0ea0030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:45.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.435+0000 7fd784ff4640 1 -- 172.21.15.37:0/3559246978 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd780161920 con 0x7fd78006bfc0 2024-04-22T07:18:45.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.435+0000 7fc9b6ffd640 1 --2- 172.21.15.37:0/94630778 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fc9a406c9c0 0x7fc9a406ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:45.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.435+0000 7fd76effd640 1 -- 172.21.15.37:0/3559246978 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd77802ca50 con 0x7fd78006bfc0 2024-04-22T07:18:45.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.435+0000 7fc9b6ffd640 1 -- 172.21.15.37:0/94630778 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fc9bc08b990 con 0x7fc9b804da40 2024-04-22T07:18:45.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.436+0000 7fd76effd640 1 -- 172.21.15.37:0/3559246978 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd778039040 con 0x7fd78006bfc0 2024-04-22T07:18:45.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.436+0000 7fc9c616a640 1 --2- 172.21.15.37:0/94630778 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fc9a406c9c0 0x7fc9a406ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:45.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.436+0000 7fe2417fa640 1 -- 172.21.15.37:0/868755063 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe24409c070 con 0x7fe23c04c420 2024-04-22T07:18:45.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.436+0000 7f8b1e52a640 1 --2- 172.21.15.37:0/2524441990 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f8afc06c9c0 0x7f8afc06ee80 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f8b14007fd0 tx=0x7f8b14009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:45.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.436+0000 7fc9c616a640 1 --2- 172.21.15.37:0/94630778 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fc9a406c9c0 0x7fc9a406ee80 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fc9b0006fd0 tx=0x7fc9b0009060 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:45.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.436+0000 7fe2417fa640 1 --2- 172.21.15.37:0/868755063 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fe22806c9f0 0x7fe22806eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:45.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.436+0000 7fd7e17fa640 1 -- 172.21.15.37:0/413185585 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd7dc005d10 con 0x7fd7e415b310 2024-04-22T07:18:45.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.436+0000 7fe2417fa640 1 -- 172.21.15.37:0/868755063 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fe244107790 con 0x7fe23c04c420 2024-04-22T07:18:45.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.437+0000 7fe248dc2640 1 --2- 172.21.15.37:0/868755063 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fe22806c9f0 0x7fe22806eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:45.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.437+0000 7fd784ff4640 1 -- 172.21.15.37:0/3559246978 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd764005290 con 0x7fd78006bfc0 2024-04-22T07:18:45.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.437+0000 7fd7e17fa640 1 --2- 172.21.15.37:0/413185585 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fd7c406c940 0x7fd7c406ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:45.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.437+0000 7fd7e17fa640 1 -- 172.21.15.37:0/413185585 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fd7dc0aecb0 con 0x7fd7e415b310 2024-04-22T07:18:45.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.437+0000 7fd7e8aee640 1 --2- 172.21.15.37:0/413185585 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fd7c406c940 0x7fd7c406ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:45.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.437+0000 7fe248dc2640 1 --2- 172.21.15.37:0/868755063 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fe22806c9f0 0x7fe22806eeb0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fe238036000 tx=0x7fe23803b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:45.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.437+0000 7fd7e8aee640 1 --2- 172.21.15.37:0/413185585 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fd7c406c940 0x7fd7c406ee00 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fd7cc006fd0 tx=0x7fd7cc008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:45.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.441+0000 7fd7e17fa640 1 -- 172.21.15.37:0/413185585 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fd7dc07cae0 con 0x7fd7e415b310 2024-04-22T07:18:45.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.442+0000 7f8b0effd640 1 -- 172.21.15.37:0/2524441990 <== mon.2 v2:172.21.15.196:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f8b0803f070 con 0x7f8b1806cc40 2024-04-22T07:18:45.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.442+0000 7fd76effd640 1 -- 172.21.15.37:0/3559246978 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd778047020 con 0x7fd78006bfc0 2024-04-22T07:18:45.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.443+0000 7f0ea5ffb640 1 -- 172.21.15.37:0/3240307937 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f0eb00c3da0 con 0x7f0eb0143be0 2024-04-22T07:18:45.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.443+0000 7f59d7fff640 1 -- 172.21.15.37:0/828740859 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59ec0924b0 con 0x7f59e404ffd0 2024-04-22T07:18:45.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.443+0000 7f59f0cc1640 1 -- 172.21.15.37:0/828740859 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59e404d0c0 con 0x7f59e404ffd0 2024-04-22T07:18:45.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.443+0000 7fd76effd640 1 --2- 172.21.15.37:0/3559246978 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fd76006c920 0x7fd76006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:45.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.443+0000 7f59f0cc1640 1 -- 172.21.15.37:0/828740859 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59e404b940 con 0x7f59e404ffd0 2024-04-22T07:18:45.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.443+0000 7fd77e59c640 1 --2- 172.21.15.37:0/3559246978 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fd76006c920 0x7fd76006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:45.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.444+0000 7fd77e59c640 1 --2- 172.21.15.37:0/3559246978 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fd76006c920 0x7fd76006ede0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fd770001a50 tx=0x7fd770009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:45.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.445+0000 7f59f0cc1640 1 -- 172.21.15.37:0/828740859 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59e404b370 con 0x7f59e404ffd0 2024-04-22T07:18:45.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.447+0000 7f59d7fff640 1 -- 172.21.15.37:0/828740859 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59ec092650 con 0x7f59e404ffd0 2024-04-22T07:18:45.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.447+0000 7f59d7fff640 1 -- 172.21.15.37:0/828740859 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59ec092a40 con 0x7f59e404ffd0 2024-04-22T07:18:45.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.447+0000 7fc9b6ffd640 1 -- 172.21.15.37:0/94630778 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc9bc01f020 con 0x7fc9b804da40 2024-04-22T07:18:45.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.449+0000 7fe2417fa640 1 -- 172.21.15.37:0/868755063 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fe2440d5b10 con 0x7fe23c04c420 2024-04-22T07:18:45.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.449+0000 7f59d7fff640 1 -- 172.21.15.37:0/828740859 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f59ec092be0 con 0x7f59e404ffd0 2024-04-22T07:18:45.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.450+0000 7f59d7fff640 1 --2- 172.21.15.37:0/828740859 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f59d006c8f0 0x7f59d006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:45.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.450+0000 7f59d7fff640 1 -- 172.21.15.37:0/828740859 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f59ec107d50 con 0x7f59e404ffd0 2024-04-22T07:18:45.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.450+0000 7fd76effd640 1 -- 172.21.15.37:0/3559246978 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fd77802ce00 con 0x7fd78006bfc0 2024-04-22T07:18:45.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.452+0000 7f59d7fff640 1 -- 172.21.15.37:0/828740859 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f59ec09a070 con 0x7f59e404ffd0 2024-04-22T07:18:45.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.459+0000 7fd76effd640 1 -- 172.21.15.37:0/3559246978 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fd77804e030 con 0x7fd78006bfc0 2024-04-22T07:18:45.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.459+0000 7f59eaffd640 1 --2- 172.21.15.37:0/828740859 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f59d006c8f0 0x7f59d006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:45.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.473+0000 7f59eaffd640 1 --2- 172.21.15.37:0/828740859 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f59d006c8f0 0x7f59d006edb0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f59e003e000 tx=0x7f59e0038000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:45.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.800+0000 7f79ec6d2640 1 -- 172.21.15.37:0/2312297506 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f79cc005580 con 0x7f79e406ce60 2024-04-22T07:18:45.805 INFO:teuthology.orchestra.run.smithi037.stdout:55834574855 2024-04-22T07:18:45.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.805+0000 7f79daffd640 1 -- 172.21.15.37:0/2312297506 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f79e005d100 con 0x7f79e406ce60 2024-04-22T07:18:45.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.808+0000 7f79ec6d2640 1 -- 172.21.15.37:0/2312297506 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f79c806c9c0 msgr2=0x7f79c806ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:45.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.808+0000 7f79ec6d2640 1 --2- 172.21.15.37:0/2312297506 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f79c806c9c0 0x7f79c806ee80 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f79d4009670 tx=0x7f79d4006bd0 comp rx=0 tx=0).stop 2024-04-22T07:18:45.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.808+0000 7f79ec6d2640 1 -- 172.21.15.37:0/2312297506 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f79e406ce60 msgr2=0x7f79e4130f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:45.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.808+0000 7f79ec6d2640 1 --2- 172.21.15.37:0/2312297506 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f79e406ce60 0x7f79e4130f90 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f79e000b700 tx=0x7f79e000bbc0 comp rx=0 tx=0).stop 2024-04-22T07:18:45.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.808+0000 7f79ec6d2640 1 -- 172.21.15.37:0/2312297506 shutdown_connections 2024-04-22T07:18:45.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.808+0000 7f79ec6d2640 1 --2- 172.21.15.37:0/2312297506 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f79c806c9c0 0x7f79c806ee80 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:45.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.808+0000 7f79ec6d2640 1 --2- 172.21.15.37:0/2312297506 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f79e41595b0 0x7f79e40c5830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:45.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.808+0000 7f79ec6d2640 1 --2- 172.21.15.37:0/2312297506 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f79e406ce60 0x7f79e4130f90 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:45.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.808+0000 7f79ec6d2640 1 --2- 172.21.15.37:0/2312297506 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f79e406ca80 0x7f79e41303d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:45.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.808+0000 7f79ec6d2640 1 -- 172.21.15.37:0/2312297506 >> 172.21.15.37:0/2312297506 conn(0x7f79e40ca0b0 msgr2=0x7f79e417b1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:45.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.809+0000 7f79ec6d2640 1 -- 172.21.15.37:0/2312297506 shutdown_connections 2024-04-22T07:18:45.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.809+0000 7f79ec6d2640 1 -- 172.21.15.37:0/2312297506 wait complete. 2024-04-22T07:18:45.823 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.4 2024-04-22T07:18:45.823 DEBUG:teuthology.parallel:result is None 2024-04-22T07:18:45.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.847+0000 7fe24b026640 1 -- 172.21.15.37:0/868755063 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fe224005580 con 0x7fe23c04c420 2024-04-22T07:18:45.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.848+0000 7fe2417fa640 1 -- 172.21.15.37:0/868755063 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fe2440d5410 con 0x7fe23c04c420 2024-04-22T07:18:45.845 INFO:teuthology.orchestra.run.smithi037.stdout:55834574855 2024-04-22T07:18:45.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.850+0000 7fe24b026640 1 -- 172.21.15.37:0/868755063 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fe22806c9f0 msgr2=0x7fe22806eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:45.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.850+0000 7fe24b026640 1 --2- 172.21.15.37:0/868755063 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fe22806c9f0 0x7fe22806eeb0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fe238036000 tx=0x7fe23803b040 comp rx=0 tx=0).stop 2024-04-22T07:18:45.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.850+0000 7fe24b026640 1 -- 172.21.15.37:0/868755063 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe23c04c420 msgr2=0x7fe23c0bef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:45.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.850+0000 7fe24b026640 1 --2- 172.21.15.37:0/868755063 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe23c04c420 0x7fe23c0bef70 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fe2440699e0 tx=0x7fe244069600 comp rx=0 tx=0).stop 2024-04-22T07:18:45.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.850+0000 7fe24b026640 1 -- 172.21.15.37:0/868755063 shutdown_connections 2024-04-22T07:18:45.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.850+0000 7fe24b026640 1 --2- 172.21.15.37:0/868755063 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fe22806c9f0 0x7fe22806eeb0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:45.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.850+0000 7fe24b026640 1 --2- 172.21.15.37:0/868755063 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe23c0dd510 0x7fe23c049fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:45.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.850+0000 7fe24b026640 1 --2- 172.21.15.37:0/868755063 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe23c04c420 0x7fe23c0bef70 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:45.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.850+0000 7fe24b026640 1 --2- 172.21.15.37:0/868755063 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe23c045ae0 0x7fe23c04a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:45.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.850+0000 7fe24b026640 1 -- 172.21.15.37:0/868755063 >> 172.21.15.37:0/868755063 conn(0x7fe23c050600 msgr2=0x7fe23c006420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:45.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.850+0000 7fe24b026640 1 -- 172.21.15.37:0/868755063 shutdown_connections 2024-04-22T07:18:45.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.850+0000 7fe24b026640 1 -- 172.21.15.37:0/868755063 wait complete. 2024-04-22T07:18:45.859 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.0 2024-04-22T07:18:45.859 DEBUG:teuthology.parallel:result is None 2024-04-22T07:18:45.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.875+0000 7f0eb605f640 1 -- 172.21.15.37:0/3240307937 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f0eb00c2880 con 0x7f0eb0143be0 2024-04-22T07:18:45.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.875+0000 7fd7e9af0640 1 -- 172.21.15.37:0/413185585 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fd7c8005850 con 0x7fd7e415b310 2024-04-22T07:18:45.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.876+0000 7f0ea5ffb640 1 -- 172.21.15.37:0/3240307937 <== mon.1 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f0eb00c2880 con 0x7f0eb0143be0 2024-04-22T07:18:45.874 INFO:teuthology.orchestra.run.smithi037.stdout:55834574856 2024-04-22T07:18:45.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.876+0000 7fd7e17fa640 1 -- 172.21.15.37:0/413185585 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fd7dc080de0 con 0x7fd7e415b310 2024-04-22T07:18:45.874 INFO:teuthology.orchestra.run.smithi037.stdout:55834574855 2024-04-22T07:18:45.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.879+0000 7f0eb605f640 1 -- 172.21.15.37:0/3240307937 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f0e9406c9f0 msgr2=0x7f0e9406eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:45.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.879+0000 7f0eb605f640 1 --2- 172.21.15.37:0/3240307937 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f0e9406c9f0 0x7f0e9406eeb0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f0ea0035000 tx=0x7f0ea0030000 comp rx=0 tx=0).stop 2024-04-22T07:18:45.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.879+0000 7f0eb605f640 1 -- 172.21.15.37:0/3240307937 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0eb0143be0 msgr2=0x7f0eb0144c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:45.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.879+0000 7f0eb605f640 1 --2- 172.21.15.37:0/3240307937 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0eb0143be0 0x7f0eb0144c20 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f0eb00681d0 tx=0x7f0ea800c490 comp rx=0 tx=0).stop 2024-04-22T07:18:45.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.879+0000 7f0eb605f640 1 -- 172.21.15.37:0/3240307937 shutdown_connections 2024-04-22T07:18:45.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.879+0000 7f0eb605f640 1 --2- 172.21.15.37:0/3240307937 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f0e9406c9f0 0x7f0e9406eeb0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:45.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.879+0000 7f0eb605f640 1 --2- 172.21.15.37:0/3240307937 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0eb0143be0 0x7f0eb0144c20 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:45.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.879+0000 7f0eb605f640 1 --2- 172.21.15.37:0/3240307937 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0eb014d3f0 0x7f0eb01446e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:45.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.879+0000 7f0eb605f640 1 --2- 172.21.15.37:0/3240307937 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0eb014d010 0x7f0eb00c47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:45.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.879+0000 7f0eb605f640 1 -- 172.21.15.37:0/3240307937 >> 172.21.15.37:0/3240307937 conn(0x7f0eb00676b0 msgr2=0x7f0eb00c6dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:45.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.879+0000 7f0eb605f640 1 -- 172.21.15.37:0/3240307937 shutdown_connections 2024-04-22T07:18:45.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.879+0000 7f0eb605f640 1 -- 172.21.15.37:0/3240307937 wait complete. 2024-04-22T07:18:45.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.879+0000 7fd7e9af0640 1 -- 172.21.15.37:0/413185585 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fd7c406c940 msgr2=0x7fd7c406ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:45.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.879+0000 7fd7e9af0640 1 --2- 172.21.15.37:0/413185585 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fd7c406c940 0x7fd7c406ee00 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fd7cc006fd0 tx=0x7fd7cc008040 comp rx=0 tx=0).stop 2024-04-22T07:18:45.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.879+0000 7fd7e9af0640 1 -- 172.21.15.37:0/413185585 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7e415b310 msgr2=0x7fd7e4149500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:45.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.879+0000 7fd7e9af0640 1 --2- 172.21.15.37:0/413185585 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7e415b310 0x7fd7e4149500 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fd7dc032000 tx=0x7fd7dc004a40 comp rx=0 tx=0).stop 2024-04-22T07:18:45.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.880+0000 7fd7e9af0640 1 -- 172.21.15.37:0/413185585 shutdown_connections 2024-04-22T07:18:45.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.880+0000 7fd7e9af0640 1 --2- 172.21.15.37:0/413185585 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fd7c406c940 0x7fd7c406ee00 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:45.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.880+0000 7fd7e9af0640 1 --2- 172.21.15.37:0/413185585 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7e415b310 0x7fd7e4149500 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:45.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.880+0000 7fd7e9af0640 1 --2- 172.21.15.37:0/413185585 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd7e4154f90 0x7fd7e4148fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:45.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.880+0000 7fd7e9af0640 1 --2- 172.21.15.37:0/413185585 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd7e40cbe80 0x7fd7e4150180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:45.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.880+0000 7fd7e9af0640 1 -- 172.21.15.37:0/413185585 >> 172.21.15.37:0/413185585 conn(0x7fd7e406c410 msgr2=0x7fd7e40d0630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:45.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.880+0000 7fd7e9af0640 1 -- 172.21.15.37:0/413185585 shutdown_connections 2024-04-22T07:18:45.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.880+0000 7fd7e9af0640 1 -- 172.21.15.37:0/413185585 wait complete. 2024-04-22T07:18:45.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.880+0000 7f8b2078e640 1 -- 172.21.15.37:0/2524441990 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f8b00005580 con 0x7f8b1806cc40 2024-04-22T07:18:45.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.881+0000 7f8b0effd640 1 -- 172.21.15.37:0/2524441990 <== mon.2 v2:172.21.15.196:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f8b1806c990 con 0x7f8b1806cc40 2024-04-22T07:18:45.881 INFO:teuthology.orchestra.run.smithi037.stdout:55834574856 2024-04-22T07:18:45.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.884+0000 7f8b2078e640 1 -- 172.21.15.37:0/2524441990 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f8afc06c9c0 msgr2=0x7f8afc06ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:45.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.884+0000 7f8b2078e640 1 --2- 172.21.15.37:0/2524441990 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f8afc06c9c0 0x7f8afc06ee80 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f8b14007fd0 tx=0x7f8b14009040 comp rx=0 tx=0).stop 2024-04-22T07:18:45.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.884+0000 7f8b2078e640 1 -- 172.21.15.37:0/2524441990 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8b1806cc40 msgr2=0x7f8b1814af40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:45.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.884+0000 7f8b2078e640 1 --2- 172.21.15.37:0/2524441990 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8b1806cc40 0x7f8b1814af40 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f8b08000c00 tx=0x7f8b080046c0 comp rx=0 tx=0).stop 2024-04-22T07:18:45.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.884+0000 7f8b2078e640 1 -- 172.21.15.37:0/2524441990 shutdown_connections 2024-04-22T07:18:45.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.884+0000 7f8b2078e640 1 --2- 172.21.15.37:0/2524441990 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f8afc06c9c0 0x7f8afc06ee80 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:45.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.884+0000 7f8b2078e640 1 --2- 172.21.15.37:0/2524441990 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8b181594f0 0x7f8b1814d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:45.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.884+0000 7f8b2078e640 1 --2- 172.21.15.37:0/2524441990 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8b1806cc40 0x7f8b1814af40 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:45.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.884+0000 7f8b2078e640 1 --2- 172.21.15.37:0/2524441990 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b180682d0 0x7f8b180c70c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:45.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.884+0000 7f8b2078e640 1 -- 172.21.15.37:0/2524441990 >> 172.21.15.37:0/2524441990 conn(0x7f8b180cd4d0 msgr2=0x7f8b180c88f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:45.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.884+0000 7f8b2078e640 1 -- 172.21.15.37:0/2524441990 shutdown_connections 2024-04-22T07:18:45.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.884+0000 7f8b2078e640 1 -- 172.21.15.37:0/2524441990 wait complete. 2024-04-22T07:18:45.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.888+0000 7f59f0cc1640 1 -- 172.21.15.37:0/828740859 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f59e400f000 con 0x7f59e404ffd0 2024-04-22T07:18:45.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.889+0000 7f59d7fff640 1 -- 172.21.15.37:0/828740859 <== mon.1 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f59e40d5fc0 con 0x7f59e404ffd0 2024-04-22T07:18:45.887 INFO:teuthology.orchestra.run.smithi037.stdout:55834574855 2024-04-22T07:18:45.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.890+0000 7fd784ff4640 1 -- 172.21.15.37:0/3559246978 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fd764005850 con 0x7fd78006bfc0 2024-04-22T07:18:45.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.890+0000 7fd76effd640 1 -- 172.21.15.37:0/3559246978 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fd77807cc40 con 0x7fd78006bfc0 2024-04-22T07:18:45.888 INFO:teuthology.orchestra.run.smithi037.stdout:55834574856 2024-04-22T07:18:45.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.891+0000 7fc9c716c640 1 -- 172.21.15.37:0/94630778 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fc9a8005580 con 0x7fc9b804da40 2024-04-22T07:18:45.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.891+0000 7fc9b6ffd640 1 -- 172.21.15.37:0/94630778 <== mon.1 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fc9bc0597e0 con 0x7fc9b804da40 2024-04-22T07:18:45.889 INFO:teuthology.orchestra.run.smithi037.stdout:55834574855 2024-04-22T07:18:45.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.893+0000 7f59f0cc1640 1 -- 172.21.15.37:0/828740859 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f59d006c8f0 msgr2=0x7f59d006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:45.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.893+0000 7f59f0cc1640 1 --2- 172.21.15.37:0/828740859 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f59d006c8f0 0x7f59d006edb0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f59e003e000 tx=0x7f59e0038000 comp rx=0 tx=0).stop 2024-04-22T07:18:45.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.893+0000 7f59f0cc1640 1 -- 172.21.15.37:0/828740859 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f59e404ffd0 msgr2=0x7f59e40ce5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:45.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.893+0000 7f59f0cc1640 1 --2- 172.21.15.37:0/828740859 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f59e404ffd0 0x7f59e40ce5e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f59ec06b4b0 tx=0x7f59ec068ef0 comp rx=0 tx=0).stop 2024-04-22T07:18:45.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.893+0000 7f59f0cc1640 1 -- 172.21.15.37:0/828740859 shutdown_connections 2024-04-22T07:18:45.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.893+0000 7f59f0cc1640 1 --2- 172.21.15.37:0/828740859 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f59d006c8f0 0x7f59d006edb0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:45.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.893+0000 7f59f0cc1640 1 --2- 172.21.15.37:0/828740859 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f59e40e0490 0x7f59e40cabd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:45.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.893+0000 7f59f0cc1640 1 --2- 172.21.15.37:0/828740859 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f59e40d9250 0x7f59e404c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:45.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.893+0000 7f59f0cc1640 1 --2- 172.21.15.37:0/828740859 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f59e404ffd0 0x7f59e40ce5e0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:45.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.893+0000 7f59f0cc1640 1 -- 172.21.15.37:0/828740859 >> 172.21.15.37:0/828740859 conn(0x7f59e400e160 msgr2=0x7f59e40d2cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:45.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.893+0000 7f59f0cc1640 1 -- 172.21.15.37:0/828740859 shutdown_connections 2024-04-22T07:18:45.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.893+0000 7f59f0cc1640 1 -- 172.21.15.37:0/828740859 wait complete. 2024-04-22T07:18:45.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.894+0000 7fd784ff4640 1 -- 172.21.15.37:0/3559246978 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fd76006c920 msgr2=0x7fd76006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:45.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.894+0000 7fd784ff4640 1 --2- 172.21.15.37:0/3559246978 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fd76006c920 0x7fd76006ede0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fd770001a50 tx=0x7fd770009040 comp rx=0 tx=0).stop 2024-04-22T07:18:45.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.894+0000 7fd784ff4640 1 -- 172.21.15.37:0/3559246978 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd78006bfc0 msgr2=0x7fd7801555a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:45.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.894+0000 7fd784ff4640 1 --2- 172.21.15.37:0/3559246978 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd78006bfc0 0x7fd7801555a0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fd7800ccad0 tx=0x7fd778004a40 comp rx=0 tx=0).stop 2024-04-22T07:18:45.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.894+0000 7fd784ff4640 1 -- 172.21.15.37:0/3559246978 shutdown_connections 2024-04-22T07:18:45.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.894+0000 7fd784ff4640 1 --2- 172.21.15.37:0/3559246978 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fd76006c920 0x7fd76006ede0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:45.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.894+0000 7fd784ff4640 1 --2- 172.21.15.37:0/3559246978 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd7800b37d0 0x7fd780155ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:45.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.894+0000 7fd784ff4640 1 --2- 172.21.15.37:0/3559246978 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd78006bfc0 0x7fd7801555a0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:45.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.894+0000 7fd784ff4640 1 --2- 172.21.15.37:0/3559246978 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd78006bbe0 0x7fd7801584f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:45.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.894+0000 7fd784ff4640 1 -- 172.21.15.37:0/3559246978 >> 172.21.15.37:0/3559246978 conn(0x7fd7800d0560 msgr2=0x7fd7800c95b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:45.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.894+0000 7fd784ff4640 1 -- 172.21.15.37:0/3559246978 shutdown_connections 2024-04-22T07:18:45.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.894+0000 7fd784ff4640 1 -- 172.21.15.37:0/3559246978 wait complete. 2024-04-22T07:18:45.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.895+0000 7fc9c716c640 1 -- 172.21.15.37:0/94630778 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fc9a406c9c0 msgr2=0x7fc9a406ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:45.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.895+0000 7fc9c716c640 1 --2- 172.21.15.37:0/94630778 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fc9a406c9c0 0x7fc9a406ee80 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fc9b0006fd0 tx=0x7fc9b0009060 comp rx=0 tx=0).stop 2024-04-22T07:18:45.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.895+0000 7fc9c716c640 1 -- 172.21.15.37:0/94630778 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc9b804da40 msgr2=0x7fc9b80ceda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:45.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.895+0000 7fc9c716c640 1 --2- 172.21.15.37:0/94630778 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc9b804da40 0x7fc9b80ceda0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc9bc00b450 tx=0x7fc9bc00b910 comp rx=0 tx=0).stop 2024-04-22T07:18:45.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.895+0000 7fc9c716c640 1 -- 172.21.15.37:0/94630778 shutdown_connections 2024-04-22T07:18:45.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.895+0000 7fc9c716c640 1 --2- 172.21.15.37:0/94630778 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fc9a406c9c0 0x7fc9a406ee80 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:45.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.895+0000 7fc9c716c640 1 --2- 172.21.15.37:0/94630778 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc9b804eda0 0x7fc9b80cf2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:45.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.895+0000 7fc9c716c640 1 --2- 172.21.15.37:0/94630778 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc9b804da40 0x7fc9b80ceda0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:45.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.895+0000 7fc9c716c640 1 --2- 172.21.15.37:0/94630778 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc9b800a9e0 0x7fc9b8168460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:45.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.895+0000 7fc9c716c640 1 -- 172.21.15.37:0/94630778 >> 172.21.15.37:0/94630778 conn(0x7fc9b800e690 msgr2=0x7fc9b80059e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:45.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.895+0000 7fc9c716c640 1 -- 172.21.15.37:0/94630778 shutdown_connections 2024-04-22T07:18:45.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:45.895+0000 7fc9c716c640 1 -- 172.21.15.37:0/94630778 wait complete. 2024-04-22T07:18:45.898 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.7 2024-04-22T07:18:45.899 DEBUG:teuthology.parallel:result is None 2024-04-22T07:18:45.899 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.2 2024-04-22T07:18:45.899 DEBUG:teuthology.parallel:result is None 2024-04-22T07:18:45.901 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.1 2024-04-22T07:18:45.901 DEBUG:teuthology.parallel:result is None 2024-04-22T07:18:45.906 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.6 2024-04-22T07:18:45.906 DEBUG:teuthology.parallel:result is None 2024-04-22T07:18:45.907 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.3 2024-04-22T07:18:45.908 DEBUG:teuthology.parallel:result is None 2024-04-22T07:18:45.908 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.5 2024-04-22T07:18:45.908 DEBUG:teuthology.parallel:result is None 2024-04-22T07:18:45.908 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-22T07:18:45.908 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-22T07:18:46.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.050+0000 7efc7a946640 1 Processor -- start 2024-04-22T07:18:46.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.050+0000 7efc7a946640 1 -- start start 2024-04-22T07:18:46.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.050+0000 7efc7a946640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7efc7415cb40 0x7efc7415b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:46.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.050+0000 7efc7a946640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efc740c5790 con 0x7efc740d0c20 2024-04-22T07:18:46.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.050+0000 7efc7a946640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efc740c5a50 con 0x7efc740d1000 2024-04-22T07:18:46.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.050+0000 7efc7a946640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7efc740c5560 con 0x7efc7415cb40 2024-04-22T07:18:46.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.051+0000 7efc78ee3640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7efc7415cb40 0x7efc7415b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:46.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.051+0000 7efc73fff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7efc740d0c20 0x7efc74154b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:56606/0 (socket says 172.21.15.37:56606) 2024-04-22T07:18:46.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.051+0000 7efc73fff640 1 -- 172.21.15.37:0/3563733026 learned_addr learned my addr 172.21.15.37:0/3563733026 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-04-22T07:18:46.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.051+0000 7efc72ffd640 1 -- 172.21.15.37:0/3563733026 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1836828636 0 0) 0x7efc740c5790 con 0x7efc740d0c20 2024-04-22T07:18:46.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.051+0000 7efc72ffd640 1 -- 172.21.15.37:0/3563733026 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efc5c003520 con 0x7efc740d0c20 2024-04-22T07:18:46.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.051+0000 7efc78ee3640 1 -- 172.21.15.37:0/3563733026 >> v1:172.21.15.196:6789/0 conn(0x7efc740d1000 legacy=0x7efc7415c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:46.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.051+0000 7efc78ee3640 1 -- 172.21.15.37:0/3563733026 >> v1:172.21.15.37:6789/0 conn(0x7efc740d0c20 legacy=0x7efc74154b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:46.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.051+0000 7efc78ee3640 1 -- 172.21.15.37:0/3563733026 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc740c5d30 con 0x7efc7415cb40 2024-04-22T07:18:46.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.052+0000 7efc78ee3640 1 --2- 172.21.15.37:0/3563733026 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efc7415cb40 0x7efc7415b750 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7efc6c009d90 tx=0x7efc6c02bfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb690fe66f84598e server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:46.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.052+0000 7efc72ffd640 1 -- 172.21.15.37:0/3563733026 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc6c039070 con 0x7efc7415cb40 2024-04-22T07:18:46.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.052+0000 7efc72ffd640 1 -- 172.21.15.37:0/3563733026 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc6c02cd80 con 0x7efc7415cb40 2024-04-22T07:18:46.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.052+0000 7efc72ffd640 1 -- 172.21.15.37:0/3563733026 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc6c034640 con 0x7efc7415cb40 2024-04-22T07:18:46.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.052+0000 7efc7a946640 1 -- 172.21.15.37:0/3563733026 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efc7415cb40 msgr2=0x7efc7415b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:46.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.052+0000 7efc7a946640 1 --2- 172.21.15.37:0/3563733026 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efc7415cb40 0x7efc7415b750 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7efc6c009d90 tx=0x7efc6c02bfd0 comp rx=0 tx=0).stop 2024-04-22T07:18:46.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.052+0000 7efc7a946640 1 -- 172.21.15.37:0/3563733026 shutdown_connections 2024-04-22T07:18:46.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.052+0000 7efc7a946640 1 --2- 172.21.15.37:0/3563733026 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efc7415cb40 0x7efc7415b750 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:46.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.052+0000 7efc7a946640 1 -- 172.21.15.37:0/3563733026 >> 172.21.15.37:0/3563733026 conn(0x7efc740676b0 msgr2=0x7efc74067ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:46.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.052+0000 7efc7a946640 1 -- 172.21.15.37:0/3563733026 shutdown_connections 2024-04-22T07:18:46.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.052+0000 7efc7a946640 1 -- 172.21.15.37:0/3563733026 wait complete. 2024-04-22T07:18:46.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.053+0000 7efc7a946640 1 Processor -- start 2024-04-22T07:18:46.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.054+0000 7efc7a946640 1 -- start start 2024-04-22T07:18:46.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.054+0000 7efc7a946640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efc740d0c20 0x7efc740c9db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:46.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.054+0000 7efc7a946640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efc740d1000 0x7efc740ca2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:46.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.054+0000 7efc7a946640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7efc7415cb40 0x7efc74157b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:46.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.054+0000 7efc7a946640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7efc740c62f0 con 0x7efc740d0c20 2024-04-22T07:18:46.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.054+0000 7efc7a946640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7efc740c6660 con 0x7efc740d1000 2024-04-22T07:18:46.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.054+0000 7efc7a946640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7efc74155260 con 0x7efc7415cb40 2024-04-22T07:18:46.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.054+0000 7efc73fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efc740d0c20 0x7efc740c9db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:46.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.054+0000 7efc73fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efc740d0c20 0x7efc740c9db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54884/0 (socket says 172.21.15.37:54884) 2024-04-22T07:18:46.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.054+0000 7efc73fff640 1 -- 172.21.15.37:0/2803302474 learned_addr learned my addr 172.21.15.37:0/2803302474 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:18:46.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.055+0000 7efc78ee3640 1 --2- 172.21.15.37:0/2803302474 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7efc7415cb40 0x7efc74157b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:46.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.055+0000 7efc73fff640 1 -- 172.21.15.37:0/2803302474 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7efc7415cb40 msgr2=0x7efc74157b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:46.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.055+0000 7efc73fff640 1 --2- 172.21.15.37:0/2803302474 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7efc7415cb40 0x7efc74157b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:46.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.055+0000 7efc73fff640 1 -- 172.21.15.37:0/2803302474 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efc740d1000 msgr2=0x7efc740ca2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:46.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.055+0000 7efc737fe640 1 --2- 172.21.15.37:0/2803302474 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efc740d1000 0x7efc740ca2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:46.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.055+0000 7efc73fff640 1 --2- 172.21.15.37:0/2803302474 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efc740d1000 0x7efc740ca2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:46.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.055+0000 7efc73fff640 1 -- 172.21.15.37:0/2803302474 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc740cd930 con 0x7efc740d0c20 2024-04-22T07:18:46.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.055+0000 7efc737fe640 1 --2- 172.21.15.37:0/2803302474 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efc740d1000 0x7efc740ca2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-22T07:18:46.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.055+0000 7efc73fff640 1 --2- 172.21.15.37:0/2803302474 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efc740d0c20 0x7efc740c9db0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7efc6400c530 tx=0x7efc6400c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:46.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.055+0000 7efc70ff9640 1 -- 172.21.15.37:0/2803302474 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc64017070 con 0x7efc740d0c20 2024-04-22T07:18:46.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.055+0000 7efc70ff9640 1 -- 172.21.15.37:0/2803302474 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc64005ce0 con 0x7efc740d0c20 2024-04-22T07:18:46.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.055+0000 7efc70ff9640 1 -- 172.21.15.37:0/2803302474 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc640072b0 con 0x7efc740d0c20 2024-04-22T07:18:46.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.055+0000 7efc7a946640 1 -- 172.21.15.37:0/2803302474 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc740cdc10 con 0x7efc740d0c20 2024-04-22T07:18:46.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.055+0000 7efc7a946640 1 -- 172.21.15.37:0/2803302474 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc740c95b0 con 0x7efc740d0c20 2024-04-22T07:18:46.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.056+0000 7efc7a946640 1 -- 172.21.15.37:0/2803302474 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc74068b20 con 0x7efc740d0c20 2024-04-22T07:18:46.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.057+0000 7efc70ff9640 1 -- 172.21.15.37:0/2803302474 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7efc6401a070 con 0x7efc740d0c20 2024-04-22T07:18:46.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.057+0000 7efc70ff9640 1 --2- 172.21.15.37:0/2803302474 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7efc6006c920 0x7efc6006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:46.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.057+0000 7efc70ff9640 1 -- 172.21.15.37:0/2803302474 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7efc6408af80 con 0x7efc740d0c20 2024-04-22T07:18:46.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.057+0000 7efc737fe640 1 --2- 172.21.15.37:0/2803302474 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7efc6006c920 0x7efc6006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:46.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.058+0000 7efc737fe640 1 --2- 172.21.15.37:0/2803302474 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7efc6006c920 0x7efc6006ede0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7efc740b2fd0 tx=0x7efc68009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:46.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.061+0000 7efc70ff9640 1 -- 172.21.15.37:0/2803302474 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7efc64059470 con 0x7efc740d0c20 2024-04-22T07:18:46.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.246+0000 7efc7a946640 1 -- 172.21.15.37:0/2803302474 --> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7efc740cdef0 con 0x7efc6006c920 2024-04-22T07:18:46.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.252+0000 7efc70ff9640 1 -- 172.21.15.37:0/2803302474 <== mgr.4103 v2:172.21.15.196:6832/321987173 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251947 (secure 0 0 0) 0x7efc740cdef0 con 0x7efc6006c920 2024-04-22T07:18:46.256 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-22T07:18:46.258 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-04-22T07:18:46.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.255+0000 7efc7a946640 1 -- 172.21.15.37:0/2803302474 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7efc6006c920 msgr2=0x7efc6006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:46.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.255+0000 7efc7a946640 1 --2- 172.21.15.37:0/2803302474 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7efc6006c920 0x7efc6006ede0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7efc740b2fd0 tx=0x7efc68009040 comp rx=0 tx=0).stop 2024-04-22T07:18:46.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.255+0000 7efc7a946640 1 -- 172.21.15.37:0/2803302474 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efc740d0c20 msgr2=0x7efc740c9db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:46.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.255+0000 7efc7a946640 1 --2- 172.21.15.37:0/2803302474 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efc740d0c20 0x7efc740c9db0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7efc6400c530 tx=0x7efc6400c9f0 comp rx=0 tx=0).stop 2024-04-22T07:18:46.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.255+0000 7efc7a946640 1 -- 172.21.15.37:0/2803302474 shutdown_connections 2024-04-22T07:18:46.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.255+0000 7efc7a946640 1 --2- 172.21.15.37:0/2803302474 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7efc6006c920 0x7efc6006ede0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:46.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.255+0000 7efc7a946640 1 --2- 172.21.15.37:0/2803302474 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7efc7415cb40 0x7efc74157b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:46.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.255+0000 7efc7a946640 1 --2- 172.21.15.37:0/2803302474 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efc740d1000 0x7efc740ca2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:46.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.255+0000 7efc7a946640 1 --2- 172.21.15.37:0/2803302474 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efc740d0c20 0x7efc740c9db0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:46.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.255+0000 7efc7a946640 1 -- 172.21.15.37:0/2803302474 >> 172.21.15.37:0/2803302474 conn(0x7efc740676b0 msgr2=0x7efc740cea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:46.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.255+0000 7efc7a946640 1 -- 172.21.15.37:0/2803302474 shutdown_connections 2024-04-22T07:18:46.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.255+0000 7efc7a946640 1 -- 172.21.15.37:0/2803302474 wait complete. 2024-04-22T07:18:46.264 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-04-22T07:18:44.587236+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218952,"kb_used_data":2824,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755768,"statfs":{"total":773094113280,"available":772869906432,"internally_reserved":0,"allocated":2891776,"data_stored":1753028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001716"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.937242+0000","last_change":"2024-04-22T07:18:36.765825+0000","last_active":"2024-04-22T07:18:37.937242+0000","last_peered":"2024-04-22T07:18:37.937242+0000","last_clean":"2024-04-22T07:18:37.937242+0000","last_became_active":"2024-04-22T07:18:36.765306+0000","last_became_peered":"2024-04-22T07:18:36.765306+0000","last_unstale":"2024-04-22T07:18:37.937242+0000","last_undegraded":"2024-04-22T07:18:37.937242+0000","last_fullsized":"2024-04-22T07:18:37.937242+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:00:45.046782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.757437+0000","last_change":"2024-04-22T07:18:36.772829+0000","last_active":"2024-04-22T07:18:37.757437+0000","last_peered":"2024-04-22T07:18:37.757437+0000","last_clean":"2024-04-22T07:18:37.757437+0000","last_became_active":"2024-04-22T07:18:36.772464+0000","last_became_peered":"2024-04-22T07:18:36.772464+0000","last_unstale":"2024-04-22T07:18:37.757437+0000","last_undegraded":"2024-04-22T07:18:37.757437+0000","last_fullsized":"2024-04-22T07:18:37.757437+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:09:08.040513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:38.894883+0000","last_change":"2024-04-22T07:18:36.760613+0000","last_active":"2024-04-22T07:18:38.894883+0000","last_peered":"2024-04-22T07:18:38.894883+0000","last_clean":"2024-04-22T07:18:38.894883+0000","last_became_active":"2024-04-22T07:18:36.760313+0000","last_became_peered":"2024-04-22T07:18:36.760313+0000","last_unstale":"2024-04-22T07:18:38.894883+0000","last_undegraded":"2024-04-22T07:18:38.894883+0000","last_fullsized":"2024-04-22T07:18:38.894883+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:51:10.038201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.763484+0000","last_change":"2024-04-22T07:18:36.767969+0000","last_active":"2024-04-22T07:18:37.763484+0000","last_peered":"2024-04-22T07:18:37.763484+0000","last_clean":"2024-04-22T07:18:37.763484+0000","last_became_active":"2024-04-22T07:18:36.767713+0000","last_became_peered":"2024-04-22T07:18:36.767713+0000","last_unstale":"2024-04-22T07:18:37.763484+0000","last_undegraded":"2024-04-22T07:18:37.763484+0000","last_fullsized":"2024-04-22T07:18:37.763484+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:36:53.716397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.936961+0000","last_change":"2024-04-22T07:18:36.764361+0000","last_active":"2024-04-22T07:18:37.936961+0000","last_peered":"2024-04-22T07:18:37.936961+0000","last_clean":"2024-04-22T07:18:37.936961+0000","last_became_active":"2024-04-22T07:18:36.763812+0000","last_became_peered":"2024-04-22T07:18:36.763812+0000","last_unstale":"2024-04-22T07:18:37.936961+0000","last_undegraded":"2024-04-22T07:18:37.936961+0000","last_fullsized":"2024-04-22T07:18:37.936961+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:18:59.298766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.763087+0000","last_change":"2024-04-22T07:18:36.762804+0000","last_active":"2024-04-22T07:18:37.763087+0000","last_peered":"2024-04-22T07:18:37.763087+0000","last_clean":"2024-04-22T07:18:37.763087+0000","last_became_active":"2024-04-22T07:18:36.762508+0000","last_became_peered":"2024-04-22T07:18:36.762508+0000","last_unstale":"2024-04-22T07:18:37.763087+0000","last_undegraded":"2024-04-22T07:18:37.763087+0000","last_fullsized":"2024-04-22T07:18:37.763087+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:09:08.040513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.936807+0000","last_change":"2024-04-22T07:18:36.771774+0000","last_active":"2024-04-22T07:18:37.936807+0000","last_peered":"2024-04-22T07:18:37.936807+0000","last_clean":"2024-04-22T07:18:37.936807+0000","last_became_active":"2024-04-22T07:18:36.771425+0000","last_became_peered":"2024-04-22T07:18:36.771425+0000","last_unstale":"2024-04-22T07:18:37.936807+0000","last_undegraded":"2024-04-22T07:18:37.936807+0000","last_fullsized":"2024-04-22T07:18:37.936807+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:45:27.464772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.767379+0000","last_change":"2024-04-22T07:18:36.773631+0000","last_active":"2024-04-22T07:18:37.767379+0000","last_peered":"2024-04-22T07:18:37.767379+0000","last_clean":"2024-04-22T07:18:37.767379+0000","last_became_active":"2024-04-22T07:18:36.773347+0000","last_became_peered":"2024-04-22T07:18:36.773347+0000","last_unstale":"2024-04-22T07:18:37.767379+0000","last_undegraded":"2024-04-22T07:18:37.767379+0000","last_fullsized":"2024-04-22T07:18:37.767379+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:23:03.787574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.937320+0000","last_change":"2024-04-22T07:18:36.773325+0000","last_active":"2024-04-22T07:18:37.937320+0000","last_peered":"2024-04-22T07:18:37.937320+0000","last_clean":"2024-04-22T07:18:37.937320+0000","last_became_active":"2024-04-22T07:18:36.773023+0000","last_became_peered":"2024-04-22T07:18:36.773023+0000","last_unstale":"2024-04-22T07:18:37.937320+0000","last_undegraded":"2024-04-22T07:18:37.937320+0000","last_fullsized":"2024-04-22T07:18:37.937320+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:11:55.496104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:38.394196+0000","last_change":"2024-04-22T07:18:36.769834+0000","last_active":"2024-04-22T07:18:38.394196+0000","last_peered":"2024-04-22T07:18:38.394196+0000","last_clean":"2024-04-22T07:18:38.394196+0000","last_became_active":"2024-04-22T07:18:36.769544+0000","last_became_peered":"2024-04-22T07:18:36.769544+0000","last_unstale":"2024-04-22T07:18:38.394196+0000","last_undegraded":"2024-04-22T07:18:38.394196+0000","last_fullsized":"2024-04-22T07:18:38.394196+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:30:36.755201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:38.394021+0000","last_change":"2024-04-22T07:18:36.762325+0000","last_active":"2024-04-22T07:18:38.394021+0000","last_peered":"2024-04-22T07:18:38.394021+0000","last_clean":"2024-04-22T07:18:38.394021+0000","last_became_active":"2024-04-22T07:18:36.762059+0000","last_became_peered":"2024-04-22T07:18:36.762059+0000","last_unstale":"2024-04-22T07:18:38.394021+0000","last_undegraded":"2024-04-22T07:18:38.394021+0000","last_fullsized":"2024-04-22T07:18:38.394021+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:51:10.038201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.763612+0000","last_change":"2024-04-22T07:18:36.761961+0000","last_active":"2024-04-22T07:18:37.763612+0000","last_peered":"2024-04-22T07:18:37.763612+0000","last_clean":"2024-04-22T07:18:37.763612+0000","last_became_active":"2024-04-22T07:18:36.761389+0000","last_became_peered":"2024-04-22T07:18:36.761389+0000","last_unstale":"2024-04-22T07:18:37.763612+0000","last_undegraded":"2024-04-22T07:18:37.763612+0000","last_fullsized":"2024-04-22T07:18:37.763612+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T19:09:21.533739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.767566+0000","last_change":"2024-04-22T07:18:36.767665+0000","last_active":"2024-04-22T07:18:37.767566+0000","last_peered":"2024-04-22T07:18:37.767566+0000","last_clean":"2024-04-22T07:18:37.767566+0000","last_became_active":"2024-04-22T07:18:36.767386+0000","last_became_peered":"2024-04-22T07:18:36.767386+0000","last_unstale":"2024-04-22T07:18:37.767566+0000","last_undegraded":"2024-04-22T07:18:37.767566+0000","last_fullsized":"2024-04-22T07:18:37.767566+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:09:08.040513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:38.894526+0000","last_change":"2024-04-22T07:18:36.770591+0000","last_active":"2024-04-22T07:18:38.894526+0000","last_peered":"2024-04-22T07:18:38.894526+0000","last_clean":"2024-04-22T07:18:38.894526+0000","last_became_active":"2024-04-22T07:18:36.768507+0000","last_became_peered":"2024-04-22T07:18:36.768507+0000","last_unstale":"2024-04-22T07:18:38.894526+0000","last_undegraded":"2024-04-22T07:18:38.894526+0000","last_fullsized":"2024-04-22T07:18:38.894526+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:00:52.151755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.757456+0000","last_change":"2024-04-22T07:18:36.769407+0000","last_active":"2024-04-22T07:18:37.757456+0000","last_peered":"2024-04-22T07:18:37.757456+0000","last_clean":"2024-04-22T07:18:37.757456+0000","last_became_active":"2024-04-22T07:18:36.769114+0000","last_became_peered":"2024-04-22T07:18:36.769114+0000","last_unstale":"2024-04-22T07:18:37.757456+0000","last_undegraded":"2024-04-22T07:18:37.757456+0000","last_fullsized":"2024-04-22T07:18:37.757456+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:30:36.755201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.763835+0000","last_change":"2024-04-22T07:18:36.766539+0000","last_active":"2024-04-22T07:18:37.763835+0000","last_peered":"2024-04-22T07:18:37.763835+0000","last_clean":"2024-04-22T07:18:37.763835+0000","last_became_active":"2024-04-22T07:18:36.764865+0000","last_became_peered":"2024-04-22T07:18:36.764865+0000","last_unstale":"2024-04-22T07:18:37.763835+0000","last_undegraded":"2024-04-22T07:18:37.763835+0000","last_fullsized":"2024-04-22T07:18:37.763835+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:45:27.464772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.764360+0000","last_change":"2024-04-22T07:18:36.767174+0000","last_active":"2024-04-22T07:18:37.764360+0000","last_peered":"2024-04-22T07:18:37.764360+0000","last_clean":"2024-04-22T07:18:37.764360+0000","last_became_active":"2024-04-22T07:18:36.766083+0000","last_became_peered":"2024-04-22T07:18:36.766083+0000","last_unstale":"2024-04-22T07:18:37.764360+0000","last_undegraded":"2024-04-22T07:18:37.764360+0000","last_fullsized":"2024-04-22T07:18:37.764360+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:00:45.046782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:38.894453+0000","last_change":"2024-04-22T07:18:36.764432+0000","last_active":"2024-04-22T07:18:38.894453+0000","last_peered":"2024-04-22T07:18:38.894453+0000","last_clean":"2024-04-22T07:18:38.894453+0000","last_became_active":"2024-04-22T07:18:36.764113+0000","last_became_peered":"2024-04-22T07:18:36.764113+0000","last_unstale":"2024-04-22T07:18:38.894453+0000","last_undegraded":"2024-04-22T07:18:38.894453+0000","last_fullsized":"2024-04-22T07:18:38.894453+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:32:48.474033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.937223+0000","last_change":"2024-04-22T07:18:36.772138+0000","last_active":"2024-04-22T07:18:37.937223+0000","last_peered":"2024-04-22T07:18:37.937223+0000","last_clean":"2024-04-22T07:18:37.937223+0000","last_became_active":"2024-04-22T07:18:36.771878+0000","last_became_peered":"2024-04-22T07:18:36.771878+0000","last_unstale":"2024-04-22T07:18:37.937223+0000","last_undegraded":"2024-04-22T07:18:37.937223+0000","last_fullsized":"2024-04-22T07:18:37.937223+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:36:27.097452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:38.394042+0000","last_change":"2024-04-22T07:18:36.769528+0000","last_active":"2024-04-22T07:18:38.394042+0000","last_peered":"2024-04-22T07:18:38.394042+0000","last_clean":"2024-04-22T07:18:38.394042+0000","last_became_active":"2024-04-22T07:18:36.769240+0000","last_became_peered":"2024-04-22T07:18:36.769240+0000","last_unstale":"2024-04-22T07:18:38.394042+0000","last_undegraded":"2024-04-22T07:18:38.394042+0000","last_fullsized":"2024-04-22T07:18:38.394042+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:09:08.040513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:38.894747+0000","last_change":"2024-04-22T07:18:36.766049+0000","last_active":"2024-04-22T07:18:38.894747+0000","last_peered":"2024-04-22T07:18:38.894747+0000","last_clean":"2024-04-22T07:18:38.894747+0000","last_became_active":"2024-04-22T07:18:36.765724+0000","last_became_peered":"2024-04-22T07:18:36.765724+0000","last_unstale":"2024-04-22T07:18:38.894747+0000","last_undegraded":"2024-04-22T07:18:38.894747+0000","last_fullsized":"2024-04-22T07:18:38.894747+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:32:20.374856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.763238+0000","last_change":"2024-04-22T07:18:36.765850+0000","last_active":"2024-04-22T07:18:37.763238+0000","last_peered":"2024-04-22T07:18:37.763238+0000","last_clean":"2024-04-22T07:18:37.763238+0000","last_became_active":"2024-04-22T07:18:36.765560+0000","last_became_peered":"2024-04-22T07:18:36.765560+0000","last_unstale":"2024-04-22T07:18:37.763238+0000","last_undegraded":"2024-04-22T07:18:37.763238+0000","last_fullsized":"2024-04-22T07:18:37.763238+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:30:36.755201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.767520+0000","last_change":"2024-04-22T07:18:36.769465+0000","last_active":"2024-04-22T07:18:37.767520+0000","last_peered":"2024-04-22T07:18:37.767520+0000","last_clean":"2024-04-22T07:18:37.767520+0000","last_became_active":"2024-04-22T07:18:36.769181+0000","last_became_peered":"2024-04-22T07:18:36.769181+0000","last_unstale":"2024-04-22T07:18:37.767520+0000","last_undegraded":"2024-04-22T07:18:37.767520+0000","last_fullsized":"2024-04-22T07:18:37.767520+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:51:10.038201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.764013+0000","last_change":"2024-04-22T07:18:36.763439+0000","last_active":"2024-04-22T07:18:37.764013+0000","last_peered":"2024-04-22T07:18:37.764013+0000","last_clean":"2024-04-22T07:18:37.764013+0000","last_became_active":"2024-04-22T07:18:36.763146+0000","last_became_peered":"2024-04-22T07:18:36.763146+0000","last_unstale":"2024-04-22T07:18:37.764013+0000","last_undegraded":"2024-04-22T07:18:37.764013+0000","last_fullsized":"2024-04-22T07:18:37.764013+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:18:59.298766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.768027+0000","last_change":"2024-04-22T07:18:36.769533+0000","last_active":"2024-04-22T07:18:37.768027+0000","last_peered":"2024-04-22T07:18:37.768027+0000","last_clean":"2024-04-22T07:18:37.768027+0000","last_became_active":"2024-04-22T07:18:36.769274+0000","last_became_peered":"2024-04-22T07:18:36.769274+0000","last_unstale":"2024-04-22T07:18:37.768027+0000","last_undegraded":"2024-04-22T07:18:37.768027+0000","last_fullsized":"2024-04-22T07:18:37.768027+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:03:50.228822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:38.394207+0000","last_change":"2024-04-22T07:18:36.763931+0000","last_active":"2024-04-22T07:18:38.394207+0000","last_peered":"2024-04-22T07:18:38.394207+0000","last_clean":"2024-04-22T07:18:38.394207+0000","last_became_active":"2024-04-22T07:18:36.763656+0000","last_became_peered":"2024-04-22T07:18:36.763656+0000","last_unstale":"2024-04-22T07:18:38.394207+0000","last_undegraded":"2024-04-22T07:18:38.394207+0000","last_fullsized":"2024-04-22T07:18:38.394207+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:22:58.884168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.757432+0000","last_change":"2024-04-22T07:18:36.767158+0000","last_active":"2024-04-22T07:18:37.757432+0000","last_peered":"2024-04-22T07:18:37.757432+0000","last_clean":"2024-04-22T07:18:37.757432+0000","last_became_active":"2024-04-22T07:18:36.766614+0000","last_became_peered":"2024-04-22T07:18:36.766614+0000","last_unstale":"2024-04-22T07:18:37.757432+0000","last_undegraded":"2024-04-22T07:18:37.757432+0000","last_fullsized":"2024-04-22T07:18:37.757432+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:44:30.785178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.767721+0000","last_change":"2024-04-22T07:18:36.773129+0000","last_active":"2024-04-22T07:18:37.767721+0000","last_peered":"2024-04-22T07:18:37.767721+0000","last_clean":"2024-04-22T07:18:37.767721+0000","last_became_active":"2024-04-22T07:18:36.772827+0000","last_became_peered":"2024-04-22T07:18:36.772827+0000","last_unstale":"2024-04-22T07:18:37.767721+0000","last_undegraded":"2024-04-22T07:18:37.767721+0000","last_fullsized":"2024-04-22T07:18:37.767721+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:45:27.464772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:38.894815+0000","last_change":"2024-04-22T07:18:36.763716+0000","last_active":"2024-04-22T07:18:38.894815+0000","last_peered":"2024-04-22T07:18:38.894815+0000","last_clean":"2024-04-22T07:18:38.894815+0000","last_became_active":"2024-04-22T07:18:36.762270+0000","last_became_peered":"2024-04-22T07:18:36.762270+0000","last_unstale":"2024-04-22T07:18:38.894815+0000","last_undegraded":"2024-04-22T07:18:38.894815+0000","last_fullsized":"2024-04-22T07:18:38.894815+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:23:03.787574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.763390+0000","last_change":"2024-04-22T07:18:36.764152+0000","last_active":"2024-04-22T07:18:37.763390+0000","last_peered":"2024-04-22T07:18:37.763390+0000","last_clean":"2024-04-22T07:18:37.763390+0000","last_became_active":"2024-04-22T07:18:36.763770+0000","last_became_peered":"2024-04-22T07:18:36.763770+0000","last_unstale":"2024-04-22T07:18:37.763390+0000","last_undegraded":"2024-04-22T07:18:37.763390+0000","last_fullsized":"2024-04-22T07:18:37.763390+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:22:58.884168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:38.894313+0000","last_change":"2024-04-22T07:18:36.771121+0000","last_active":"2024-04-22T07:18:38.894313+0000","last_peered":"2024-04-22T07:18:38.894313+0000","last_clean":"2024-04-22T07:18:38.894313+0000","last_became_active":"2024-04-22T07:18:36.770786+0000","last_became_peered":"2024-04-22T07:18:36.770786+0000","last_unstale":"2024-04-22T07:18:38.894313+0000","last_undegraded":"2024-04-22T07:18:38.894313+0000","last_fullsized":"2024-04-22T07:18:38.894313+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:45:15.213668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:38.393831+0000","last_change":"2024-04-22T07:18:36.765462+0000","last_active":"2024-04-22T07:18:38.393831+0000","last_peered":"2024-04-22T07:18:38.393831+0000","last_clean":"2024-04-22T07:18:38.393831+0000","last_became_active":"2024-04-22T07:18:36.765142+0000","last_became_peered":"2024-04-22T07:18:36.765142+0000","last_unstale":"2024-04-22T07:18:38.393831+0000","last_undegraded":"2024-04-22T07:18:38.393831+0000","last_fullsized":"2024-04-22T07:18:38.393831+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:32:20.374856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.763051+0000","last_change":"2024-04-22T07:18:36.768234+0000","last_active":"2024-04-22T07:18:37.763051+0000","last_peered":"2024-04-22T07:18:37.763051+0000","last_clean":"2024-04-22T07:18:37.763051+0000","last_became_active":"2024-04-22T07:18:36.767951+0000","last_became_peered":"2024-04-22T07:18:36.767951+0000","last_unstale":"2024-04-22T07:18:37.763051+0000","last_undegraded":"2024-04-22T07:18:37.763051+0000","last_fullsized":"2024-04-22T07:18:37.763051+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:08:05.611868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:39.604078+0000","last_change":"2024-04-22T07:18:35.751538+0000","last_active":"2024-04-22T07:18:39.604078+0000","last_peered":"2024-04-22T07:18:39.604078+0000","last_clean":"2024-04-22T07:18:39.604078+0000","last_became_active":"2024-04-22T07:18:35.751219+0000","last_became_peered":"2024-04-22T07:18:35.751219+0000","last_unstale":"2024-04-22T07:18:39.604078+0000","last_undegraded":"2024-04-22T07:18:39.604078+0000","last_fullsized":"2024-04-22T07:18:39.604078+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:00:10.289974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:38.894909+0000","last_change":"2024-04-22T07:18:36.757337+0000","last_active":"2024-04-22T07:18:38.894909+0000","last_peered":"2024-04-22T07:18:38.894909+0000","last_clean":"2024-04-22T07:18:38.894909+0000","last_became_active":"2024-04-22T07:18:36.757039+0000","last_became_peered":"2024-04-22T07:18:36.757039+0000","last_unstale":"2024-04-22T07:18:38.894909+0000","last_undegraded":"2024-04-22T07:18:38.894909+0000","last_fullsized":"2024-04-22T07:18:38.894909+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:09:08.040513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:39.601564+0000","last_change":"2024-04-22T07:18:35.746515+0000","last_active":"2024-04-22T07:18:39.601564+0000","last_peered":"2024-04-22T07:18:39.601564+0000","last_clean":"2024-04-22T07:18:39.601564+0000","last_became_active":"2024-04-22T07:18:35.746198+0000","last_became_peered":"2024-04-22T07:18:35.746198+0000","last_unstale":"2024-04-22T07:18:39.601564+0000","last_undegraded":"2024-04-22T07:18:39.601564+0000","last_fullsized":"2024-04-22T07:18:39.601564+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:43:54.682673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.767496+0000","last_change":"2024-04-22T07:18:35.752307+0000","last_active":"2024-04-22T07:18:37.767496+0000","last_peered":"2024-04-22T07:18:37.767496+0000","last_clean":"2024-04-22T07:18:37.767496+0000","last_became_active":"2024-04-22T07:18:35.751545+0000","last_became_peered":"2024-04-22T07:18:35.751545+0000","last_unstale":"2024-04-22T07:18:37.767496+0000","last_undegraded":"2024-04-22T07:18:37.767496+0000","last_fullsized":"2024-04-22T07:18:37.767496+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:21:55.316649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.767511+0000","last_change":"2024-04-22T07:18:36.772372+0000","last_active":"2024-04-22T07:18:37.767511+0000","last_peered":"2024-04-22T07:18:37.767511+0000","last_clean":"2024-04-22T07:18:37.767511+0000","last_became_active":"2024-04-22T07:18:36.772067+0000","last_became_peered":"2024-04-22T07:18:36.772067+0000","last_unstale":"2024-04-22T07:18:37.767511+0000","last_undegraded":"2024-04-22T07:18:37.767511+0000","last_fullsized":"2024-04-22T07:18:37.767511+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:44:30.785178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.764151+0000","last_change":"2024-04-22T07:18:35.740989+0000","last_active":"2024-04-22T07:18:37.764151+0000","last_peered":"2024-04-22T07:18:37.764151+0000","last_clean":"2024-04-22T07:18:37.764151+0000","last_became_active":"2024-04-22T07:18:35.740665+0000","last_became_peered":"2024-04-22T07:18:35.740665+0000","last_unstale":"2024-04-22T07:18:37.764151+0000","last_undegraded":"2024-04-22T07:18:37.764151+0000","last_fullsized":"2024-04-22T07:18:37.764151+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:00:10.289974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.757377+0000","last_change":"2024-04-22T07:18:36.767022+0000","last_active":"2024-04-22T07:18:37.757377+0000","last_peered":"2024-04-22T07:18:37.757377+0000","last_clean":"2024-04-22T07:18:37.757377+0000","last_became_active":"2024-04-22T07:18:36.766609+0000","last_became_peered":"2024-04-22T07:18:36.766609+0000","last_unstale":"2024-04-22T07:18:37.757377+0000","last_undegraded":"2024-04-22T07:18:37.757377+0000","last_fullsized":"2024-04-22T07:18:37.757377+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:32:20.374856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:38.394098+0000","last_change":"2024-04-22T07:18:35.752081+0000","last_active":"2024-04-22T07:18:38.394098+0000","last_peered":"2024-04-22T07:18:38.394098+0000","last_clean":"2024-04-22T07:18:38.394098+0000","last_became_active":"2024-04-22T07:18:35.751757+0000","last_became_peered":"2024-04-22T07:18:35.751757+0000","last_unstale":"2024-04-22T07:18:38.394098+0000","last_undegraded":"2024-04-22T07:18:38.394098+0000","last_fullsized":"2024-04-22T07:18:38.394098+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:21:55.316649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.764165+0000","last_change":"2024-04-22T07:18:36.765937+0000","last_active":"2024-04-22T07:18:37.764165+0000","last_peered":"2024-04-22T07:18:37.764165+0000","last_clean":"2024-04-22T07:18:37.764165+0000","last_became_active":"2024-04-22T07:18:36.765647+0000","last_became_peered":"2024-04-22T07:18:36.765647+0000","last_unstale":"2024-04-22T07:18:37.764165+0000","last_undegraded":"2024-04-22T07:18:37.764165+0000","last_fullsized":"2024-04-22T07:18:37.764165+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:59:57.688417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.763996+0000","last_change":"2024-04-22T07:18:35.747309+0000","last_active":"2024-04-22T07:18:37.763996+0000","last_peered":"2024-04-22T07:18:37.763996+0000","last_clean":"2024-04-22T07:18:37.763996+0000","last_became_active":"2024-04-22T07:18:35.747019+0000","last_became_peered":"2024-04-22T07:18:35.747019+0000","last_unstale":"2024-04-22T07:18:37.763996+0000","last_undegraded":"2024-04-22T07:18:37.763996+0000","last_fullsized":"2024-04-22T07:18:37.763996+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:21:55.316649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:38.895019+0000","last_change":"2024-04-22T07:18:36.763436+0000","last_active":"2024-04-22T07:18:38.895019+0000","last_peered":"2024-04-22T07:18:38.895019+0000","last_clean":"2024-04-22T07:18:38.895019+0000","last_became_active":"2024-04-22T07:18:36.763068+0000","last_became_peered":"2024-04-22T07:18:36.763068+0000","last_unstale":"2024-04-22T07:18:38.895019+0000","last_undegraded":"2024-04-22T07:18:38.895019+0000","last_fullsized":"2024-04-22T07:18:38.895019+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:22:58.884168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:41.767555+0000","last_change":"2024-04-22T07:18:35.750769+0000","last_active":"2024-04-22T07:18:41.767555+0000","last_peered":"2024-04-22T07:18:41.767555+0000","last_clean":"2024-04-22T07:18:41.767555+0000","last_became_active":"2024-04-22T07:18:35.750406+0000","last_became_peered":"2024-04-22T07:18:35.750406+0000","last_unstale":"2024-04-22T07:18:41.767555+0000","last_undegraded":"2024-04-22T07:18:41.767555+0000","last_fullsized":"2024-04-22T07:18:41.767555+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T19:09:20.529889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.763680+0000","last_change":"2024-04-22T07:18:36.767426+0000","last_active":"2024-04-22T07:18:37.763680+0000","last_peered":"2024-04-22T07:18:37.763680+0000","last_clean":"2024-04-22T07:18:37.763680+0000","last_became_active":"2024-04-22T07:18:36.767159+0000","last_became_peered":"2024-04-22T07:18:36.767159+0000","last_unstale":"2024-04-22T07:18:37.763680+0000","last_undegraded":"2024-04-22T07:18:37.763680+0000","last_fullsized":"2024-04-22T07:18:37.763680+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:19:49.652644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:41.768017+0000","last_change":"2024-04-22T07:18:35.752996+0000","last_active":"2024-04-22T07:18:41.768017+0000","last_peered":"2024-04-22T07:18:41.768017+0000","last_clean":"2024-04-22T07:18:41.768017+0000","last_became_active":"2024-04-22T07:18:35.752686+0000","last_became_peered":"2024-04-22T07:18:35.752686+0000","last_unstale":"2024-04-22T07:18:41.768017+0000","last_undegraded":"2024-04-22T07:18:41.768017+0000","last_fullsized":"2024-04-22T07:18:41.768017+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:36:55.684427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.937011+0000","last_change":"2024-04-22T07:18:36.767539+0000","last_active":"2024-04-22T07:18:37.937011+0000","last_peered":"2024-04-22T07:18:37.937011+0000","last_clean":"2024-04-22T07:18:37.937011+0000","last_became_active":"2024-04-22T07:18:36.767273+0000","last_became_peered":"2024-04-22T07:18:36.767273+0000","last_unstale":"2024-04-22T07:18:37.937011+0000","last_undegraded":"2024-04-22T07:18:37.937011+0000","last_fullsized":"2024-04-22T07:18:37.937011+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:03:50.228822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:41.764793+0000","last_change":"2024-04-22T07:18:35.752382+0000","last_active":"2024-04-22T07:18:41.764793+0000","last_peered":"2024-04-22T07:18:41.764793+0000","last_clean":"2024-04-22T07:18:41.764793+0000","last_became_active":"2024-04-22T07:18:35.752060+0000","last_became_peered":"2024-04-22T07:18:35.752060+0000","last_unstale":"2024-04-22T07:18:41.764793+0000","last_undegraded":"2024-04-22T07:18:41.764793+0000","last_fullsized":"2024-04-22T07:18:41.764793+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:31:33.559251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:38.894534+0000","last_change":"2024-04-22T07:18:36.764670+0000","last_active":"2024-04-22T07:18:38.894534+0000","last_peered":"2024-04-22T07:18:38.894534+0000","last_clean":"2024-04-22T07:18:38.894534+0000","last_became_active":"2024-04-22T07:18:36.763834+0000","last_became_peered":"2024-04-22T07:18:36.763834+0000","last_unstale":"2024-04-22T07:18:38.894534+0000","last_undegraded":"2024-04-22T07:18:38.894534+0000","last_fullsized":"2024-04-22T07:18:38.894534+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:41:20.703226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.763489+0000","last_change":"2024-04-22T07:18:35.752856+0000","last_active":"2024-04-22T07:18:37.763489+0000","last_peered":"2024-04-22T07:18:37.763489+0000","last_clean":"2024-04-22T07:18:37.763489+0000","last_became_active":"2024-04-22T07:18:35.752527+0000","last_became_peered":"2024-04-22T07:18:35.752527+0000","last_unstale":"2024-04-22T07:18:37.763489+0000","last_undegraded":"2024-04-22T07:18:37.763489+0000","last_fullsized":"2024-04-22T07:18:37.763489+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:40:59.305769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.937073+0000","last_change":"2024-04-22T07:18:36.769174+0000","last_active":"2024-04-22T07:18:37.937073+0000","last_peered":"2024-04-22T07:18:37.937073+0000","last_clean":"2024-04-22T07:18:37.937073+0000","last_became_active":"2024-04-22T07:18:36.768913+0000","last_became_peered":"2024-04-22T07:18:36.768913+0000","last_unstale":"2024-04-22T07:18:37.937073+0000","last_undegraded":"2024-04-22T07:18:37.937073+0000","last_fullsized":"2024-04-22T07:18:37.937073+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:45:42.674989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:38.393752+0000","last_change":"2024-04-22T07:18:35.749740+0000","last_active":"2024-04-22T07:18:38.393752+0000","last_peered":"2024-04-22T07:18:38.393752+0000","last_clean":"2024-04-22T07:18:38.393752+0000","last_became_active":"2024-04-22T07:18:35.749453+0000","last_became_peered":"2024-04-22T07:18:35.749453+0000","last_unstale":"2024-04-22T07:18:38.393752+0000","last_undegraded":"2024-04-22T07:18:38.393752+0000","last_fullsized":"2024-04-22T07:18:38.393752+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:08:04.608018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:38.393952+0000","last_change":"2024-04-22T07:18:36.771940+0000","last_active":"2024-04-22T07:18:38.393952+0000","last_peered":"2024-04-22T07:18:38.393952+0000","last_clean":"2024-04-22T07:18:38.393952+0000","last_became_active":"2024-04-22T07:18:36.771548+0000","last_became_peered":"2024-04-22T07:18:36.771548+0000","last_unstale":"2024-04-22T07:18:38.393952+0000","last_undegraded":"2024-04-22T07:18:38.393952+0000","last_fullsized":"2024-04-22T07:18:38.393952+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:23:03.787574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:41.765466+0000","last_change":"2024-04-22T07:18:35.749047+0000","last_active":"2024-04-22T07:18:41.765466+0000","last_peered":"2024-04-22T07:18:41.765466+0000","last_clean":"2024-04-22T07:18:41.765466+0000","last_became_active":"2024-04-22T07:18:35.748757+0000","last_became_peered":"2024-04-22T07:18:35.748757+0000","last_unstale":"2024-04-22T07:18:41.765466+0000","last_undegraded":"2024-04-22T07:18:41.765466+0000","last_fullsized":"2024-04-22T07:18:41.765466+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:40:59.305769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.936788+0000","last_change":"2024-04-22T07:18:36.769894+0000","last_active":"2024-04-22T07:18:37.936788+0000","last_peered":"2024-04-22T07:18:37.936788+0000","last_clean":"2024-04-22T07:18:37.936788+0000","last_became_active":"2024-04-22T07:18:36.768702+0000","last_became_peered":"2024-04-22T07:18:36.768702+0000","last_unstale":"2024-04-22T07:18:37.936788+0000","last_undegraded":"2024-04-22T07:18:37.936788+0000","last_fullsized":"2024-04-22T07:18:37.936788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:36:53.716397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:39.598923+0000","last_change":"2024-04-22T07:18:35.747536+0000","last_active":"2024-04-22T07:18:39.598923+0000","last_peered":"2024-04-22T07:18:39.598923+0000","last_clean":"2024-04-22T07:18:39.598923+0000","last_became_active":"2024-04-22T07:18:35.747271+0000","last_became_peered":"2024-04-22T07:18:35.747271+0000","last_unstale":"2024-04-22T07:18:39.598923+0000","last_undegraded":"2024-04-22T07:18:39.598923+0000","last_fullsized":"2024-04-22T07:18:39.598923+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:51:11.593642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.937304+0000","last_change":"2024-04-22T07:18:36.773033+0000","last_active":"2024-04-22T07:18:37.937304+0000","last_peered":"2024-04-22T07:18:37.937304+0000","last_clean":"2024-04-22T07:18:37.937304+0000","last_became_active":"2024-04-22T07:18:36.772537+0000","last_became_peered":"2024-04-22T07:18:36.772537+0000","last_unstale":"2024-04-22T07:18:37.937304+0000","last_undegraded":"2024-04-22T07:18:37.937304+0000","last_fullsized":"2024-04-22T07:18:37.937304+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:58:41.509248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:41.763188+0000","last_change":"2024-04-22T07:18:35.747533+0000","last_active":"2024-04-22T07:18:41.763188+0000","last_peered":"2024-04-22T07:18:41.763188+0000","last_clean":"2024-04-22T07:18:41.763188+0000","last_became_active":"2024-04-22T07:18:35.746881+0000","last_became_peered":"2024-04-22T07:18:35.746881+0000","last_unstale":"2024-04-22T07:18:41.763188+0000","last_undegraded":"2024-04-22T07:18:41.763188+0000","last_fullsized":"2024-04-22T07:18:41.763188+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:43:54.682673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.937347+0000","last_change":"2024-04-22T07:18:36.773723+0000","last_active":"2024-04-22T07:18:37.937347+0000","last_peered":"2024-04-22T07:18:37.937347+0000","last_clean":"2024-04-22T07:18:37.937347+0000","last_became_active":"2024-04-22T07:18:36.773466+0000","last_became_peered":"2024-04-22T07:18:36.773466+0000","last_unstale":"2024-04-22T07:18:37.937347+0000","last_undegraded":"2024-04-22T07:18:37.937347+0000","last_fullsized":"2024-04-22T07:18:37.937347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:42:20.611744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:39.603975+0000","last_change":"2024-04-22T07:18:35.750360+0000","last_active":"2024-04-22T07:18:39.603975+0000","last_peered":"2024-04-22T07:18:39.603975+0000","last_clean":"2024-04-22T07:18:39.603975+0000","last_became_active":"2024-04-22T07:18:35.749984+0000","last_became_peered":"2024-04-22T07:18:35.749984+0000","last_unstale":"2024-04-22T07:18:39.603975+0000","last_undegraded":"2024-04-22T07:18:39.603975+0000","last_fullsized":"2024-04-22T07:18:39.603975+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:19:48.648793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.764298+0000","last_change":"2024-04-22T07:18:36.765767+0000","last_active":"2024-04-22T07:18:37.764298+0000","last_peered":"2024-04-22T07:18:37.764298+0000","last_clean":"2024-04-22T07:18:37.764298+0000","last_became_active":"2024-04-22T07:18:36.764218+0000","last_became_peered":"2024-04-22T07:18:36.764218+0000","last_unstale":"2024-04-22T07:18:37.764298+0000","last_undegraded":"2024-04-22T07:18:37.764298+0000","last_fullsized":"2024-04-22T07:18:37.764298+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:45:42.674989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:38.894330+0000","last_change":"2024-04-22T07:18:35.743323+0000","last_active":"2024-04-22T07:18:38.894330+0000","last_peered":"2024-04-22T07:18:38.894330+0000","last_clean":"2024-04-22T07:18:38.894330+0000","last_became_active":"2024-04-22T07:18:35.743023+0000","last_became_peered":"2024-04-22T07:18:35.743023+0000","last_unstale":"2024-04-22T07:18:38.894330+0000","last_undegraded":"2024-04-22T07:18:38.894330+0000","last_fullsized":"2024-04-22T07:18:38.894330+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:08:04.608018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.937037+0000","last_change":"2024-04-22T07:18:36.771073+0000","last_active":"2024-04-22T07:18:37.937037+0000","last_peered":"2024-04-22T07:18:37.937037+0000","last_clean":"2024-04-22T07:18:37.937037+0000","last_became_active":"2024-04-22T07:18:36.770678+0000","last_became_peered":"2024-04-22T07:18:36.770678+0000","last_unstale":"2024-04-22T07:18:37.937037+0000","last_undegraded":"2024-04-22T07:18:37.937037+0000","last_fullsized":"2024-04-22T07:18:37.937037+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:59:57.688417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":170,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.936801+0000","last_change":"2024-04-22T07:18:26.518190+0000","last_active":"2024-04-22T07:18:37.936801+0000","last_peered":"2024-04-22T07:18:37.936801+0000","last_clean":"2024-04-22T07:18:37.936801+0000","last_became_active":"2024-04-22T07:18:26.515489+0000","last_became_peered":"2024-04-22T07:18:26.515489+0000","last_unstale":"2024-04-22T07:18:37.936801+0000","last_undegraded":"2024-04-22T07:18:37.936801+0000","last_fullsized":"2024-04-22T07:18:37.936801+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:24.652061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:24.652061+0000","last_clean_scrub_stamp":"2024-04-22T07:18:24.652061+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:32:54.875706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.762947+0000","last_change":"2024-04-22T07:18:35.748477+0000","last_active":"2024-04-22T07:18:37.762947+0000","last_peered":"2024-04-22T07:18:37.762947+0000","last_clean":"2024-04-22T07:18:37.762947+0000","last_became_active":"2024-04-22T07:18:35.748176+0000","last_became_peered":"2024-04-22T07:18:35.748176+0000","last_unstale":"2024-04-22T07:18:37.762947+0000","last_undegraded":"2024-04-22T07:18:37.762947+0000","last_fullsized":"2024-04-22T07:18:37.762947+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:36:55.684427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.767642+0000","last_change":"2024-04-22T07:18:36.771870+0000","last_active":"2024-04-22T07:18:37.767642+0000","last_peered":"2024-04-22T07:18:37.767642+0000","last_clean":"2024-04-22T07:18:37.767642+0000","last_became_active":"2024-04-22T07:18:36.771583+0000","last_became_peered":"2024-04-22T07:18:36.771583+0000","last_unstale":"2024-04-22T07:18:37.767642+0000","last_undegraded":"2024-04-22T07:18:37.767642+0000","last_fullsized":"2024-04-22T07:18:37.767642+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:22:58.884168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.936652+0000","last_change":"2024-04-22T07:18:35.755668+0000","last_active":"2024-04-22T07:18:37.936652+0000","last_peered":"2024-04-22T07:18:37.936652+0000","last_clean":"2024-04-22T07:18:37.936652+0000","last_became_active":"2024-04-22T07:18:35.755471+0000","last_became_peered":"2024-04-22T07:18:35.755471+0000","last_unstale":"2024-04-22T07:18:37.936652+0000","last_undegraded":"2024-04-22T07:18:37.936652+0000","last_fullsized":"2024-04-22T07:18:37.936652+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:36:55.684427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:38.894300+0000","last_change":"2024-04-22T07:18:36.758204+0000","last_active":"2024-04-22T07:18:38.894300+0000","last_peered":"2024-04-22T07:18:38.894300+0000","last_clean":"2024-04-22T07:18:38.894300+0000","last_became_active":"2024-04-22T07:18:36.757841+0000","last_became_peered":"2024-04-22T07:18:36.757841+0000","last_unstale":"2024-04-22T07:18:38.894300+0000","last_undegraded":"2024-04-22T07:18:38.894300+0000","last_fullsized":"2024-04-22T07:18:38.894300+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:43:09.058016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:38.894236+0000","last_change":"2024-04-22T07:18:35.746686+0000","last_active":"2024-04-22T07:18:38.894236+0000","last_peered":"2024-04-22T07:18:38.894236+0000","last_clean":"2024-04-22T07:18:38.894236+0000","last_became_active":"2024-04-22T07:18:35.746371+0000","last_became_peered":"2024-04-22T07:18:35.746371+0000","last_unstale":"2024-04-22T07:18:38.894236+0000","last_undegraded":"2024-04-22T07:18:38.894236+0000","last_fullsized":"2024-04-22T07:18:38.894236+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:36:55.684427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.757383+0000","last_change":"2024-04-22T07:18:36.765985+0000","last_active":"2024-04-22T07:18:37.757383+0000","last_peered":"2024-04-22T07:18:37.757383+0000","last_clean":"2024-04-22T07:18:37.757383+0000","last_became_active":"2024-04-22T07:18:36.765661+0000","last_became_peered":"2024-04-22T07:18:36.765661+0000","last_unstale":"2024-04-22T07:18:37.757383+0000","last_undegraded":"2024-04-22T07:18:37.757383+0000","last_fullsized":"2024-04-22T07:18:37.757383+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:23:03.787574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.763585+0000","last_change":"2024-04-22T07:18:35.754160+0000","last_active":"2024-04-22T07:18:37.763585+0000","last_peered":"2024-04-22T07:18:37.763585+0000","last_clean":"2024-04-22T07:18:37.763585+0000","last_became_active":"2024-04-22T07:18:35.753860+0000","last_became_peered":"2024-04-22T07:18:35.753860+0000","last_unstale":"2024-04-22T07:18:37.763585+0000","last_undegraded":"2024-04-22T07:18:37.763585+0000","last_fullsized":"2024-04-22T07:18:37.763585+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:08:04.608018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.763400+0000","last_change":"2024-04-22T07:18:36.762349+0000","last_active":"2024-04-22T07:18:37.763400+0000","last_peered":"2024-04-22T07:18:37.763400+0000","last_clean":"2024-04-22T07:18:37.763400+0000","last_became_active":"2024-04-22T07:18:36.762097+0000","last_became_peered":"2024-04-22T07:18:36.762097+0000","last_unstale":"2024-04-22T07:18:37.763400+0000","last_undegraded":"2024-04-22T07:18:37.763400+0000","last_fullsized":"2024-04-22T07:18:37.763400+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:43:55.686523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.757304+0000","last_change":"2024-04-22T07:18:35.758810+0000","last_active":"2024-04-22T07:18:37.757304+0000","last_peered":"2024-04-22T07:18:37.757304+0000","last_clean":"2024-04-22T07:18:37.757304+0000","last_became_active":"2024-04-22T07:18:35.758521+0000","last_became_peered":"2024-04-22T07:18:35.758521+0000","last_unstale":"2024-04-22T07:18:37.757304+0000","last_undegraded":"2024-04-22T07:18:37.757304+0000","last_fullsized":"2024-04-22T07:18:37.757304+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:40:59.305769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.764371+0000","last_change":"2024-04-22T07:18:36.764448+0000","last_active":"2024-04-22T07:18:37.764371+0000","last_peered":"2024-04-22T07:18:37.764371+0000","last_clean":"2024-04-22T07:18:37.764371+0000","last_became_active":"2024-04-22T07:18:36.763728+0000","last_became_peered":"2024-04-22T07:18:36.763728+0000","last_unstale":"2024-04-22T07:18:37.764371+0000","last_undegraded":"2024-04-22T07:18:37.764371+0000","last_fullsized":"2024-04-22T07:18:37.764371+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:58:41.509248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.937270+0000","last_change":"2024-04-22T07:18:35.758980+0000","last_active":"2024-04-22T07:18:37.937270+0000","last_peered":"2024-04-22T07:18:37.937270+0000","last_clean":"2024-04-22T07:18:37.937270+0000","last_became_active":"2024-04-22T07:18:35.758674+0000","last_became_peered":"2024-04-22T07:18:35.758674+0000","last_unstale":"2024-04-22T07:18:37.937270+0000","last_undegraded":"2024-04-22T07:18:37.937270+0000","last_fullsized":"2024-04-22T07:18:37.937270+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:45:14.209818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.757443+0000","last_change":"2024-04-22T07:18:36.772908+0000","last_active":"2024-04-22T07:18:37.757443+0000","last_peered":"2024-04-22T07:18:37.757443+0000","last_clean":"2024-04-22T07:18:37.757443+0000","last_became_active":"2024-04-22T07:18:36.772636+0000","last_became_peered":"2024-04-22T07:18:36.772636+0000","last_unstale":"2024-04-22T07:18:37.757443+0000","last_undegraded":"2024-04-22T07:18:37.757443+0000","last_fullsized":"2024-04-22T07:18:37.757443+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:51:10.038201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.757474+0000","last_change":"2024-04-22T07:18:35.753595+0000","last_active":"2024-04-22T07:18:37.757474+0000","last_peered":"2024-04-22T07:18:37.757474+0000","last_clean":"2024-04-22T07:18:37.757474+0000","last_became_active":"2024-04-22T07:18:35.753295+0000","last_became_peered":"2024-04-22T07:18:35.753295+0000","last_unstale":"2024-04-22T07:18:37.757474+0000","last_undegraded":"2024-04-22T07:18:37.757474+0000","last_fullsized":"2024-04-22T07:18:37.757474+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:08:04.608018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.768028+0000","last_change":"2024-04-22T07:18:36.768580+0000","last_active":"2024-04-22T07:18:37.768028+0000","last_peered":"2024-04-22T07:18:37.768028+0000","last_clean":"2024-04-22T07:18:37.768028+0000","last_became_active":"2024-04-22T07:18:36.767702+0000","last_became_peered":"2024-04-22T07:18:36.767702+0000","last_unstale":"2024-04-22T07:18:37.768028+0000","last_undegraded":"2024-04-22T07:18:37.768028+0000","last_fullsized":"2024-04-22T07:18:37.768028+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:59:57.688417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:41.768034+0000","last_change":"2024-04-22T07:18:35.751692+0000","last_active":"2024-04-22T07:18:41.768034+0000","last_peered":"2024-04-22T07:18:41.768034+0000","last_clean":"2024-04-22T07:18:41.768034+0000","last_became_active":"2024-04-22T07:18:35.751393+0000","last_became_peered":"2024-04-22T07:18:35.751393+0000","last_unstale":"2024-04-22T07:18:41.768034+0000","last_undegraded":"2024-04-22T07:18:41.768034+0000","last_fullsized":"2024-04-22T07:18:41.768034+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:40:59.305769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:38.894956+0000","last_change":"2024-04-22T07:18:36.768532+0000","last_active":"2024-04-22T07:18:38.894956+0000","last_peered":"2024-04-22T07:18:38.894956+0000","last_clean":"2024-04-22T07:18:38.894956+0000","last_became_active":"2024-04-22T07:18:36.768253+0000","last_became_peered":"2024-04-22T07:18:36.768253+0000","last_unstale":"2024-04-22T07:18:38.894956+0000","last_undegraded":"2024-04-22T07:18:38.894956+0000","last_fullsized":"2024-04-22T07:18:38.894956+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:30:36.755201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.936651+0000","last_change":"2024-04-22T07:18:35.758702+0000","last_active":"2024-04-22T07:18:37.936651+0000","last_peered":"2024-04-22T07:18:37.936651+0000","last_clean":"2024-04-22T07:18:37.936651+0000","last_became_active":"2024-04-22T07:18:35.758415+0000","last_became_peered":"2024-04-22T07:18:35.758415+0000","last_unstale":"2024-04-22T07:18:37.936651+0000","last_undegraded":"2024-04-22T07:18:37.936651+0000","last_fullsized":"2024-04-22T07:18:37.936651+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:08:04.608018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.763191+0000","last_change":"2024-04-22T07:18:36.763053+0000","last_active":"2024-04-22T07:18:37.763191+0000","last_peered":"2024-04-22T07:18:37.763191+0000","last_clean":"2024-04-22T07:18:37.763191+0000","last_became_active":"2024-04-22T07:18:36.762546+0000","last_became_peered":"2024-04-22T07:18:36.762546+0000","last_unstale":"2024-04-22T07:18:37.763191+0000","last_undegraded":"2024-04-22T07:18:37.763191+0000","last_fullsized":"2024-04-22T07:18:37.763191+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:36:56.688277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.757534+0000","last_change":"2024-04-22T07:18:35.748837+0000","last_active":"2024-04-22T07:18:37.757534+0000","last_peered":"2024-04-22T07:18:37.757534+0000","last_clean":"2024-04-22T07:18:37.757534+0000","last_became_active":"2024-04-22T07:18:35.748080+0000","last_became_peered":"2024-04-22T07:18:35.748080+0000","last_unstale":"2024-04-22T07:18:37.757534+0000","last_undegraded":"2024-04-22T07:18:37.757534+0000","last_fullsized":"2024-04-22T07:18:37.757534+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:36:55.684427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.767568+0000","last_change":"2024-04-22T07:18:36.769911+0000","last_active":"2024-04-22T07:18:37.767568+0000","last_peered":"2024-04-22T07:18:37.767568+0000","last_clean":"2024-04-22T07:18:37.767568+0000","last_became_active":"2024-04-22T07:18:36.768682+0000","last_became_peered":"2024-04-22T07:18:36.768682+0000","last_unstale":"2024-04-22T07:18:37.767568+0000","last_undegraded":"2024-04-22T07:18:37.767568+0000","last_fullsized":"2024-04-22T07:18:37.767568+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:30:36.755201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.757319+0000","last_change":"2024-04-22T07:18:35.753066+0000","last_active":"2024-04-22T07:18:37.757319+0000","last_peered":"2024-04-22T07:18:37.757319+0000","last_clean":"2024-04-22T07:18:37.757319+0000","last_became_active":"2024-04-22T07:18:35.752804+0000","last_became_peered":"2024-04-22T07:18:35.752804+0000","last_unstale":"2024-04-22T07:18:37.757319+0000","last_undegraded":"2024-04-22T07:18:37.757319+0000","last_fullsized":"2024-04-22T07:18:37.757319+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:43:54.682673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.767652+0000","last_change":"2024-04-22T07:18:36.774790+0000","last_active":"2024-04-22T07:18:37.767652+0000","last_peered":"2024-04-22T07:18:37.767652+0000","last_clean":"2024-04-22T07:18:37.767652+0000","last_became_active":"2024-04-22T07:18:36.774479+0000","last_became_peered":"2024-04-22T07:18:36.774479+0000","last_unstale":"2024-04-22T07:18:37.767652+0000","last_undegraded":"2024-04-22T07:18:37.767652+0000","last_fullsized":"2024-04-22T07:18:37.767652+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:36:53.716397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:41.767713+0000","last_change":"2024-04-22T07:18:35.754440+0000","last_active":"2024-04-22T07:18:41.767713+0000","last_peered":"2024-04-22T07:18:41.767713+0000","last_clean":"2024-04-22T07:18:41.767713+0000","last_became_active":"2024-04-22T07:18:35.754137+0000","last_became_peered":"2024-04-22T07:18:35.754137+0000","last_unstale":"2024-04-22T07:18:41.767713+0000","last_undegraded":"2024-04-22T07:18:41.767713+0000","last_fullsized":"2024-04-22T07:18:41.767713+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T19:09:20.529889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:38.393947+0000","last_change":"2024-04-22T07:18:36.759585+0000","last_active":"2024-04-22T07:18:38.393947+0000","last_peered":"2024-04-22T07:18:38.393947+0000","last_clean":"2024-04-22T07:18:38.393947+0000","last_became_active":"2024-04-22T07:18:36.759342+0000","last_became_peered":"2024-04-22T07:18:36.759342+0000","last_unstale":"2024-04-22T07:18:38.393947+0000","last_undegraded":"2024-04-22T07:18:38.393947+0000","last_fullsized":"2024-04-22T07:18:38.393947+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:44:30.785178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.764337+0000","last_change":"2024-04-22T07:18:36.762665+0000","last_active":"2024-04-22T07:18:37.764337+0000","last_peered":"2024-04-22T07:18:37.764337+0000","last_clean":"2024-04-22T07:18:37.764337+0000","last_became_active":"2024-04-22T07:18:36.762392+0000","last_became_peered":"2024-04-22T07:18:36.762392+0000","last_unstale":"2024-04-22T07:18:37.764337+0000","last_undegraded":"2024-04-22T07:18:37.764337+0000","last_fullsized":"2024-04-22T07:18:37.764337+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:36:27.097452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:41.767658+0000","last_change":"2024-04-22T07:18:35.755160+0000","last_active":"2024-04-22T07:18:41.767658+0000","last_peered":"2024-04-22T07:18:41.767658+0000","last_clean":"2024-04-22T07:18:41.767658+0000","last_became_active":"2024-04-22T07:18:35.754877+0000","last_became_peered":"2024-04-22T07:18:35.754877+0000","last_unstale":"2024-04-22T07:18:41.767658+0000","last_undegraded":"2024-04-22T07:18:41.767658+0000","last_fullsized":"2024-04-22T07:18:41.767658+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:43:54.682673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.764098+0000","last_change":"2024-04-22T07:18:36.761534+0000","last_active":"2024-04-22T07:18:37.764098+0000","last_peered":"2024-04-22T07:18:37.764098+0000","last_clean":"2024-04-22T07:18:37.764098+0000","last_became_active":"2024-04-22T07:18:36.761181+0000","last_became_peered":"2024-04-22T07:18:36.761181+0000","last_unstale":"2024-04-22T07:18:37.764098+0000","last_undegraded":"2024-04-22T07:18:37.764098+0000","last_fullsized":"2024-04-22T07:18:37.764098+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:03:50.228822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:41.767397+0000","last_change":"2024-04-22T07:18:35.752282+0000","last_active":"2024-04-22T07:18:41.767397+0000","last_peered":"2024-04-22T07:18:41.767397+0000","last_clean":"2024-04-22T07:18:41.767397+0000","last_became_active":"2024-04-22T07:18:35.751866+0000","last_became_peered":"2024-04-22T07:18:35.751866+0000","last_unstale":"2024-04-22T07:18:41.767397+0000","last_undegraded":"2024-04-22T07:18:41.767397+0000","last_fullsized":"2024-04-22T07:18:41.767397+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:19:48.648793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:38.894862+0000","last_change":"2024-04-22T07:18:36.763229+0000","last_active":"2024-04-22T07:18:38.894862+0000","last_peered":"2024-04-22T07:18:38.894862+0000","last_clean":"2024-04-22T07:18:38.894862+0000","last_became_active":"2024-04-22T07:18:36.762882+0000","last_became_peered":"2024-04-22T07:18:36.762882+0000","last_unstale":"2024-04-22T07:18:38.894862+0000","last_undegraded":"2024-04-22T07:18:38.894862+0000","last_fullsized":"2024-04-22T07:18:38.894862+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:44:30.785178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:39.604104+0000","last_change":"2024-04-22T07:18:35.758820+0000","last_active":"2024-04-22T07:18:39.604104+0000","last_peered":"2024-04-22T07:18:39.604104+0000","last_clean":"2024-04-22T07:18:39.604104+0000","last_became_active":"2024-04-22T07:18:35.758514+0000","last_became_peered":"2024-04-22T07:18:35.758514+0000","last_unstale":"2024-04-22T07:18:39.604104+0000","last_undegraded":"2024-04-22T07:18:39.604104+0000","last_fullsized":"2024-04-22T07:18:39.604104+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:40:59.305769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.767960+0000","last_change":"2024-04-22T07:18:36.768383+0000","last_active":"2024-04-22T07:18:37.767960+0000","last_peered":"2024-04-22T07:18:37.767960+0000","last_clean":"2024-04-22T07:18:37.767960+0000","last_became_active":"2024-04-22T07:18:36.767779+0000","last_became_peered":"2024-04-22T07:18:36.767779+0000","last_unstale":"2024-04-22T07:18:37.767960+0000","last_undegraded":"2024-04-22T07:18:37.767960+0000","last_fullsized":"2024-04-22T07:18:37.767960+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:18:59.298766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:41.768431+0000","last_change":"2024-04-22T07:18:35.754117+0000","last_active":"2024-04-22T07:18:41.768431+0000","last_peered":"2024-04-22T07:18:41.768431+0000","last_clean":"2024-04-22T07:18:41.768431+0000","last_became_active":"2024-04-22T07:18:35.753833+0000","last_became_peered":"2024-04-22T07:18:35.753833+0000","last_unstale":"2024-04-22T07:18:41.768431+0000","last_undegraded":"2024-04-22T07:18:41.768431+0000","last_fullsized":"2024-04-22T07:18:41.768431+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:54:03.123665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574856,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27800,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344040,"statfs":{"total":96636764160,"available":96608296960,"internally_reserved":0,"allocated":802816,"data_stored":661884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":208896,"data_stored":71024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":217088,"data_stored":71060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27216,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":204800,"data_stored":70934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":212992,"data_stored":71094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":811008,"data_stored":661940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-22T07:18:46.268 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-22T07:18:46.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.407+0000 7f8bb5d0e640 1 Processor -- start 2024-04-22T07:18:46.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.407+0000 7f8bb5d0e640 1 -- start start 2024-04-22T07:18:46.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.408+0000 7f8bb5d0e640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f8bb0154f90 0x7f8bb00cc7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:46.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.408+0000 7f8bb5d0e640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8bb00c6d20 con 0x7f8bb00caf70 2024-04-22T07:18:46.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.408+0000 7f8bb5d0e640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8bb0072540 con 0x7f8bb0071f90 2024-04-22T07:18:46.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.408+0000 7f8bb5d0e640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f8bb0072820 con 0x7f8bb0154f90 2024-04-22T07:18:46.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.408+0000 7f8baffff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f8bb00caf70 0x7f8bb0165610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:56608/0 (socket says 172.21.15.37:56608) 2024-04-22T07:18:46.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.408+0000 7f8baffff640 1 -- 172.21.15.37:0/1390299009 learned_addr learned my addr 172.21.15.37:0/1390299009 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-04-22T07:18:46.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.408+0000 7f8baf7fe640 1 --2- 172.21.15.37:0/1390299009 >> v2:172.21.15.196:3300/0 conn(0x7f8bb0154f90 0x7f8bb00cc7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:46.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.408+0000 7f8bae7fc640 1 -- 172.21.15.37:0/1390299009 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2724919845 0 0) 0x7f8bb00c6d20 con 0x7f8bb00caf70 2024-04-22T07:18:46.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.408+0000 7f8bae7fc640 1 -- 172.21.15.37:0/1390299009 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8b98003520 con 0x7f8bb00caf70 2024-04-22T07:18:46.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.408+0000 7f8bae7fc640 1 -- 172.21.15.37:0/1390299009 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2923661151 0 0) 0x7f8bb0072540 con 0x7f8bb0071f90 2024-04-22T07:18:46.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.408+0000 7f8bae7fc640 1 -- 172.21.15.37:0/1390299009 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8bb00c6d20 con 0x7f8bb0071f90 2024-04-22T07:18:46.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.409+0000 7f8baf7fe640 1 -- 172.21.15.37:0/1390299009 >> v1:172.21.15.196:6789/0 conn(0x7f8bb0071f90 legacy=0x7f8bb015e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:46.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.409+0000 7f8baf7fe640 1 -- 172.21.15.37:0/1390299009 >> v1:172.21.15.37:6789/0 conn(0x7f8bb00caf70 legacy=0x7f8bb0165610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:46.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.409+0000 7f8baf7fe640 1 -- 172.21.15.37:0/1390299009 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bb00c5f60 con 0x7f8bb0154f90 2024-04-22T07:18:46.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.409+0000 7f8baf7fe640 1 --2- 172.21.15.37:0/1390299009 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8bb0154f90 0x7f8bb00cc7a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f8ba00097a0 tx=0x7f8ba002b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2767bb1df8bd1c64 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:46.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.410+0000 7f8bae7fc640 1 -- 172.21.15.37:0/1390299009 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ba0034070 con 0x7f8bb0154f90 2024-04-22T07:18:46.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.410+0000 7f8bae7fc640 1 -- 172.21.15.37:0/1390299009 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ba0030610 con 0x7f8bb0154f90 2024-04-22T07:18:46.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.410+0000 7f8bae7fc640 1 -- 172.21.15.37:0/1390299009 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ba00309e0 con 0x7f8bb0154f90 2024-04-22T07:18:46.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.410+0000 7f8bb5d0e640 1 -- 172.21.15.37:0/1390299009 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8bb0154f90 msgr2=0x7f8bb00cc7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:46.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.410+0000 7f8bb5d0e640 1 --2- 172.21.15.37:0/1390299009 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8bb0154f90 0x7f8bb00cc7a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f8ba00097a0 tx=0x7f8ba002b960 comp rx=0 tx=0).stop 2024-04-22T07:18:46.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.410+0000 7f8bb5d0e640 1 -- 172.21.15.37:0/1390299009 shutdown_connections 2024-04-22T07:18:46.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.410+0000 7f8bb5d0e640 1 --2- 172.21.15.37:0/1390299009 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8bb0154f90 0x7f8bb00cc7a0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:46.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.410+0000 7f8bb5d0e640 1 -- 172.21.15.37:0/1390299009 >> 172.21.15.37:0/1390299009 conn(0x7f8bb0067ad0 msgr2=0x7f8bb00d05f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:46.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.410+0000 7f8bb5d0e640 1 -- 172.21.15.37:0/1390299009 shutdown_connections 2024-04-22T07:18:46.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.410+0000 7f8bb5d0e640 1 -- 172.21.15.37:0/1390299009 wait complete. 2024-04-22T07:18:46.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.411+0000 7f8bb5d0e640 1 Processor -- start 2024-04-22T07:18:46.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.412+0000 7f8bb5d0e640 1 -- start start 2024-04-22T07:18:46.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.412+0000 7f8bb5d0e640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8bb0071f90 0x7f8bb01561c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:46.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.412+0000 7f8bb5d0e640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8bb00caf70 0x7f8bb0151040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:46.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.412+0000 7f8bb5d0e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8bb0154f90 0x7f8bb01572f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:46.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.412+0000 7f8bb5d0e640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8bb00c6800 con 0x7f8bb0154f90 2024-04-22T07:18:46.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.412+0000 7f8bb5d0e640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f8bb00c6520 con 0x7f8bb0071f90 2024-04-22T07:18:46.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.412+0000 7f8bb5d0e640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f8bb0155370 con 0x7f8bb00caf70 2024-04-22T07:18:46.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.412+0000 7f8baffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8bb0154f90 0x7f8bb01572f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:46.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.412+0000 7f8baffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8bb0154f90 0x7f8bb01572f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54886/0 (socket says 172.21.15.37:54886) 2024-04-22T07:18:46.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.412+0000 7f8baffff640 1 -- 172.21.15.37:0/234609302 learned_addr learned my addr 172.21.15.37:0/234609302 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:18:46.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.412+0000 7f8baf7fe640 1 --2- 172.21.15.37:0/234609302 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8bb0071f90 0x7f8bb01561c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:46.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.413+0000 7f8baeffd640 1 --2- 172.21.15.37:0/234609302 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8bb00caf70 0x7f8bb0151040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:46.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.413+0000 7f8baffff640 1 -- 172.21.15.37:0/234609302 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8bb00caf70 msgr2=0x7f8bb0151040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:46.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.413+0000 7f8baffff640 1 --2- 172.21.15.37:0/234609302 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8bb00caf70 0x7f8bb0151040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:46.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.413+0000 7f8baffff640 1 -- 172.21.15.37:0/234609302 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8bb0071f90 msgr2=0x7f8bb01561c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:46.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.413+0000 7f8baffff640 1 --2- 172.21.15.37:0/234609302 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8bb0071f90 0x7f8bb01561c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:46.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.413+0000 7f8baffff640 1 -- 172.21.15.37:0/234609302 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bb01f09a0 con 0x7f8bb0154f90 2024-04-22T07:18:46.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.413+0000 7f8baffff640 1 --2- 172.21.15.37:0/234609302 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8bb0154f90 0x7f8bb01572f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f8ba800cba0 tx=0x7f8ba800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:46.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.413+0000 7f8b97fff640 1 -- 172.21.15.37:0/234609302 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ba8017070 con 0x7f8bb0154f90 2024-04-22T07:18:46.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.413+0000 7f8b97fff640 1 -- 172.21.15.37:0/234609302 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ba800ace0 con 0x7f8bb0154f90 2024-04-22T07:18:46.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.413+0000 7f8bb5d0e640 1 -- 172.21.15.37:0/234609302 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8bb0156800 con 0x7f8bb0154f90 2024-04-22T07:18:46.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.413+0000 7f8b97fff640 1 -- 172.21.15.37:0/234609302 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ba8012620 con 0x7f8bb0154f90 2024-04-22T07:18:46.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.413+0000 7f8bb5d0e640 1 -- 172.21.15.37:0/234609302 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8bb01f0f40 con 0x7f8bb0154f90 2024-04-22T07:18:46.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.414+0000 7f8bb5d0e640 1 -- 172.21.15.37:0/234609302 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8bb0069cc0 con 0x7f8bb0154f90 2024-04-22T07:18:46.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.415+0000 7f8b97fff640 1 -- 172.21.15.37:0/234609302 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8ba801a070 con 0x7f8bb0154f90 2024-04-22T07:18:46.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.415+0000 7f8b97fff640 1 --2- 172.21.15.37:0/234609302 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f8b9c06c8f0 0x7f8b9c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:46.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.415+0000 7f8b97fff640 1 -- 172.21.15.37:0/234609302 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f8ba808b920 con 0x7f8bb0154f90 2024-04-22T07:18:46.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.415+0000 7f8baf7fe640 1 --2- 172.21.15.37:0/234609302 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f8b9c06c8f0 0x7f8b9c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:46.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.416+0000 7f8baf7fe640 1 --2- 172.21.15.37:0/234609302 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f8b9c06c8f0 0x7f8b9c06edb0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f8ba0036000 tx=0x7f8ba003b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:46.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.419+0000 7f8b97fff640 1 -- 172.21.15.37:0/234609302 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f8ba8059700 con 0x7f8bb0154f90 2024-04-22T07:18:46.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.602+0000 7f8bb5d0e640 1 -- 172.21.15.37:0/234609302 --> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8bb00d0260 con 0x7f8b9c06c8f0 2024-04-22T07:18:46.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.608+0000 7f8b97fff640 1 -- 172.21.15.37:0/234609302 <== mgr.4103 v2:172.21.15.196:6832/321987173 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251835 (secure 0 0 0) 0x7f8bb00d0260 con 0x7f8b9c06c8f0 2024-04-22T07:18:46.609 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-22T07:18:46.610 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-04-22T07:18:46.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.610+0000 7f8bb5d0e640 1 -- 172.21.15.37:0/234609302 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f8b9c06c8f0 msgr2=0x7f8b9c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:46.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.610+0000 7f8bb5d0e640 1 --2- 172.21.15.37:0/234609302 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f8b9c06c8f0 0x7f8b9c06edb0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f8ba0036000 tx=0x7f8ba003b040 comp rx=0 tx=0).stop 2024-04-22T07:18:46.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.610+0000 7f8bb5d0e640 1 -- 172.21.15.37:0/234609302 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8bb0154f90 msgr2=0x7f8bb01572f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:46.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.610+0000 7f8bb5d0e640 1 --2- 172.21.15.37:0/234609302 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8bb0154f90 0x7f8bb01572f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f8ba800cba0 tx=0x7f8ba800a430 comp rx=0 tx=0).stop 2024-04-22T07:18:46.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.610+0000 7f8bb5d0e640 1 -- 172.21.15.37:0/234609302 shutdown_connections 2024-04-22T07:18:46.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.611+0000 7f8bb5d0e640 1 --2- 172.21.15.37:0/234609302 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f8b9c06c8f0 0x7f8b9c06edb0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:46.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.611+0000 7f8bb5d0e640 1 --2- 172.21.15.37:0/234609302 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8bb0154f90 0x7f8bb01572f0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:46.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.611+0000 7f8bb5d0e640 1 --2- 172.21.15.37:0/234609302 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8bb00caf70 0x7f8bb0151040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:46.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.611+0000 7f8bb5d0e640 1 --2- 172.21.15.37:0/234609302 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8bb0071f90 0x7f8bb01561c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:46.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.611+0000 7f8bb5d0e640 1 -- 172.21.15.37:0/234609302 >> 172.21.15.37:0/234609302 conn(0x7f8bb0067ad0 msgr2=0x7f8bb0072a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:46.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.611+0000 7f8bb5d0e640 1 -- 172.21.15.37:0/234609302 shutdown_connections 2024-04-22T07:18:46.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.611+0000 7f8bb5d0e640 1 -- 172.21.15.37:0/234609302 wait complete. 2024-04-22T07:18:46.620 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-04-22T07:18:46.587847+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218952,"kb_used_data":2824,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755768,"statfs":{"total":773094113280,"available":772869906432,"internally_reserved":0,"allocated":2891776,"data_stored":1753028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.839903"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.937242+0000","last_change":"2024-04-22T07:18:36.765825+0000","last_active":"2024-04-22T07:18:37.937242+0000","last_peered":"2024-04-22T07:18:37.937242+0000","last_clean":"2024-04-22T07:18:37.937242+0000","last_became_active":"2024-04-22T07:18:36.765306+0000","last_became_peered":"2024-04-22T07:18:36.765306+0000","last_unstale":"2024-04-22T07:18:37.937242+0000","last_undegraded":"2024-04-22T07:18:37.937242+0000","last_fullsized":"2024-04-22T07:18:37.937242+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:00:45.046782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.757437+0000","last_change":"2024-04-22T07:18:36.772829+0000","last_active":"2024-04-22T07:18:37.757437+0000","last_peered":"2024-04-22T07:18:37.757437+0000","last_clean":"2024-04-22T07:18:37.757437+0000","last_became_active":"2024-04-22T07:18:36.772464+0000","last_became_peered":"2024-04-22T07:18:36.772464+0000","last_unstale":"2024-04-22T07:18:37.757437+0000","last_undegraded":"2024-04-22T07:18:37.757437+0000","last_fullsized":"2024-04-22T07:18:37.757437+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:09:08.040513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:38.894883+0000","last_change":"2024-04-22T07:18:36.760613+0000","last_active":"2024-04-22T07:18:38.894883+0000","last_peered":"2024-04-22T07:18:38.894883+0000","last_clean":"2024-04-22T07:18:38.894883+0000","last_became_active":"2024-04-22T07:18:36.760313+0000","last_became_peered":"2024-04-22T07:18:36.760313+0000","last_unstale":"2024-04-22T07:18:38.894883+0000","last_undegraded":"2024-04-22T07:18:38.894883+0000","last_fullsized":"2024-04-22T07:18:38.894883+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:51:10.038201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.763484+0000","last_change":"2024-04-22T07:18:36.767969+0000","last_active":"2024-04-22T07:18:37.763484+0000","last_peered":"2024-04-22T07:18:37.763484+0000","last_clean":"2024-04-22T07:18:37.763484+0000","last_became_active":"2024-04-22T07:18:36.767713+0000","last_became_peered":"2024-04-22T07:18:36.767713+0000","last_unstale":"2024-04-22T07:18:37.763484+0000","last_undegraded":"2024-04-22T07:18:37.763484+0000","last_fullsized":"2024-04-22T07:18:37.763484+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:36:53.716397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.936961+0000","last_change":"2024-04-22T07:18:36.764361+0000","last_active":"2024-04-22T07:18:37.936961+0000","last_peered":"2024-04-22T07:18:37.936961+0000","last_clean":"2024-04-22T07:18:37.936961+0000","last_became_active":"2024-04-22T07:18:36.763812+0000","last_became_peered":"2024-04-22T07:18:36.763812+0000","last_unstale":"2024-04-22T07:18:37.936961+0000","last_undegraded":"2024-04-22T07:18:37.936961+0000","last_fullsized":"2024-04-22T07:18:37.936961+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:18:59.298766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.763087+0000","last_change":"2024-04-22T07:18:36.762804+0000","last_active":"2024-04-22T07:18:37.763087+0000","last_peered":"2024-04-22T07:18:37.763087+0000","last_clean":"2024-04-22T07:18:37.763087+0000","last_became_active":"2024-04-22T07:18:36.762508+0000","last_became_peered":"2024-04-22T07:18:36.762508+0000","last_unstale":"2024-04-22T07:18:37.763087+0000","last_undegraded":"2024-04-22T07:18:37.763087+0000","last_fullsized":"2024-04-22T07:18:37.763087+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:09:08.040513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.936807+0000","last_change":"2024-04-22T07:18:36.771774+0000","last_active":"2024-04-22T07:18:37.936807+0000","last_peered":"2024-04-22T07:18:37.936807+0000","last_clean":"2024-04-22T07:18:37.936807+0000","last_became_active":"2024-04-22T07:18:36.771425+0000","last_became_peered":"2024-04-22T07:18:36.771425+0000","last_unstale":"2024-04-22T07:18:37.936807+0000","last_undegraded":"2024-04-22T07:18:37.936807+0000","last_fullsized":"2024-04-22T07:18:37.936807+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:45:27.464772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.767379+0000","last_change":"2024-04-22T07:18:36.773631+0000","last_active":"2024-04-22T07:18:37.767379+0000","last_peered":"2024-04-22T07:18:37.767379+0000","last_clean":"2024-04-22T07:18:37.767379+0000","last_became_active":"2024-04-22T07:18:36.773347+0000","last_became_peered":"2024-04-22T07:18:36.773347+0000","last_unstale":"2024-04-22T07:18:37.767379+0000","last_undegraded":"2024-04-22T07:18:37.767379+0000","last_fullsized":"2024-04-22T07:18:37.767379+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:23:03.787574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.937320+0000","last_change":"2024-04-22T07:18:36.773325+0000","last_active":"2024-04-22T07:18:37.937320+0000","last_peered":"2024-04-22T07:18:37.937320+0000","last_clean":"2024-04-22T07:18:37.937320+0000","last_became_active":"2024-04-22T07:18:36.773023+0000","last_became_peered":"2024-04-22T07:18:36.773023+0000","last_unstale":"2024-04-22T07:18:37.937320+0000","last_undegraded":"2024-04-22T07:18:37.937320+0000","last_fullsized":"2024-04-22T07:18:37.937320+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:11:55.496104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:38.394196+0000","last_change":"2024-04-22T07:18:36.769834+0000","last_active":"2024-04-22T07:18:38.394196+0000","last_peered":"2024-04-22T07:18:38.394196+0000","last_clean":"2024-04-22T07:18:38.394196+0000","last_became_active":"2024-04-22T07:18:36.769544+0000","last_became_peered":"2024-04-22T07:18:36.769544+0000","last_unstale":"2024-04-22T07:18:38.394196+0000","last_undegraded":"2024-04-22T07:18:38.394196+0000","last_fullsized":"2024-04-22T07:18:38.394196+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:30:36.755201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:38.394021+0000","last_change":"2024-04-22T07:18:36.762325+0000","last_active":"2024-04-22T07:18:38.394021+0000","last_peered":"2024-04-22T07:18:38.394021+0000","last_clean":"2024-04-22T07:18:38.394021+0000","last_became_active":"2024-04-22T07:18:36.762059+0000","last_became_peered":"2024-04-22T07:18:36.762059+0000","last_unstale":"2024-04-22T07:18:38.394021+0000","last_undegraded":"2024-04-22T07:18:38.394021+0000","last_fullsized":"2024-04-22T07:18:38.394021+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:51:10.038201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.763612+0000","last_change":"2024-04-22T07:18:36.761961+0000","last_active":"2024-04-22T07:18:37.763612+0000","last_peered":"2024-04-22T07:18:37.763612+0000","last_clean":"2024-04-22T07:18:37.763612+0000","last_became_active":"2024-04-22T07:18:36.761389+0000","last_became_peered":"2024-04-22T07:18:36.761389+0000","last_unstale":"2024-04-22T07:18:37.763612+0000","last_undegraded":"2024-04-22T07:18:37.763612+0000","last_fullsized":"2024-04-22T07:18:37.763612+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T19:09:21.533739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.767566+0000","last_change":"2024-04-22T07:18:36.767665+0000","last_active":"2024-04-22T07:18:37.767566+0000","last_peered":"2024-04-22T07:18:37.767566+0000","last_clean":"2024-04-22T07:18:37.767566+0000","last_became_active":"2024-04-22T07:18:36.767386+0000","last_became_peered":"2024-04-22T07:18:36.767386+0000","last_unstale":"2024-04-22T07:18:37.767566+0000","last_undegraded":"2024-04-22T07:18:37.767566+0000","last_fullsized":"2024-04-22T07:18:37.767566+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:09:08.040513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:38.894526+0000","last_change":"2024-04-22T07:18:36.770591+0000","last_active":"2024-04-22T07:18:38.894526+0000","last_peered":"2024-04-22T07:18:38.894526+0000","last_clean":"2024-04-22T07:18:38.894526+0000","last_became_active":"2024-04-22T07:18:36.768507+0000","last_became_peered":"2024-04-22T07:18:36.768507+0000","last_unstale":"2024-04-22T07:18:38.894526+0000","last_undegraded":"2024-04-22T07:18:38.894526+0000","last_fullsized":"2024-04-22T07:18:38.894526+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:00:52.151755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.757456+0000","last_change":"2024-04-22T07:18:36.769407+0000","last_active":"2024-04-22T07:18:37.757456+0000","last_peered":"2024-04-22T07:18:37.757456+0000","last_clean":"2024-04-22T07:18:37.757456+0000","last_became_active":"2024-04-22T07:18:36.769114+0000","last_became_peered":"2024-04-22T07:18:36.769114+0000","last_unstale":"2024-04-22T07:18:37.757456+0000","last_undegraded":"2024-04-22T07:18:37.757456+0000","last_fullsized":"2024-04-22T07:18:37.757456+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:30:36.755201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.763835+0000","last_change":"2024-04-22T07:18:36.766539+0000","last_active":"2024-04-22T07:18:37.763835+0000","last_peered":"2024-04-22T07:18:37.763835+0000","last_clean":"2024-04-22T07:18:37.763835+0000","last_became_active":"2024-04-22T07:18:36.764865+0000","last_became_peered":"2024-04-22T07:18:36.764865+0000","last_unstale":"2024-04-22T07:18:37.763835+0000","last_undegraded":"2024-04-22T07:18:37.763835+0000","last_fullsized":"2024-04-22T07:18:37.763835+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:45:27.464772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.764360+0000","last_change":"2024-04-22T07:18:36.767174+0000","last_active":"2024-04-22T07:18:37.764360+0000","last_peered":"2024-04-22T07:18:37.764360+0000","last_clean":"2024-04-22T07:18:37.764360+0000","last_became_active":"2024-04-22T07:18:36.766083+0000","last_became_peered":"2024-04-22T07:18:36.766083+0000","last_unstale":"2024-04-22T07:18:37.764360+0000","last_undegraded":"2024-04-22T07:18:37.764360+0000","last_fullsized":"2024-04-22T07:18:37.764360+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:00:45.046782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:38.894453+0000","last_change":"2024-04-22T07:18:36.764432+0000","last_active":"2024-04-22T07:18:38.894453+0000","last_peered":"2024-04-22T07:18:38.894453+0000","last_clean":"2024-04-22T07:18:38.894453+0000","last_became_active":"2024-04-22T07:18:36.764113+0000","last_became_peered":"2024-04-22T07:18:36.764113+0000","last_unstale":"2024-04-22T07:18:38.894453+0000","last_undegraded":"2024-04-22T07:18:38.894453+0000","last_fullsized":"2024-04-22T07:18:38.894453+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:32:48.474033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.937223+0000","last_change":"2024-04-22T07:18:36.772138+0000","last_active":"2024-04-22T07:18:37.937223+0000","last_peered":"2024-04-22T07:18:37.937223+0000","last_clean":"2024-04-22T07:18:37.937223+0000","last_became_active":"2024-04-22T07:18:36.771878+0000","last_became_peered":"2024-04-22T07:18:36.771878+0000","last_unstale":"2024-04-22T07:18:37.937223+0000","last_undegraded":"2024-04-22T07:18:37.937223+0000","last_fullsized":"2024-04-22T07:18:37.937223+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:36:27.097452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:38.394042+0000","last_change":"2024-04-22T07:18:36.769528+0000","last_active":"2024-04-22T07:18:38.394042+0000","last_peered":"2024-04-22T07:18:38.394042+0000","last_clean":"2024-04-22T07:18:38.394042+0000","last_became_active":"2024-04-22T07:18:36.769240+0000","last_became_peered":"2024-04-22T07:18:36.769240+0000","last_unstale":"2024-04-22T07:18:38.394042+0000","last_undegraded":"2024-04-22T07:18:38.394042+0000","last_fullsized":"2024-04-22T07:18:38.394042+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:09:08.040513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:38.894747+0000","last_change":"2024-04-22T07:18:36.766049+0000","last_active":"2024-04-22T07:18:38.894747+0000","last_peered":"2024-04-22T07:18:38.894747+0000","last_clean":"2024-04-22T07:18:38.894747+0000","last_became_active":"2024-04-22T07:18:36.765724+0000","last_became_peered":"2024-04-22T07:18:36.765724+0000","last_unstale":"2024-04-22T07:18:38.894747+0000","last_undegraded":"2024-04-22T07:18:38.894747+0000","last_fullsized":"2024-04-22T07:18:38.894747+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:32:20.374856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.763238+0000","last_change":"2024-04-22T07:18:36.765850+0000","last_active":"2024-04-22T07:18:37.763238+0000","last_peered":"2024-04-22T07:18:37.763238+0000","last_clean":"2024-04-22T07:18:37.763238+0000","last_became_active":"2024-04-22T07:18:36.765560+0000","last_became_peered":"2024-04-22T07:18:36.765560+0000","last_unstale":"2024-04-22T07:18:37.763238+0000","last_undegraded":"2024-04-22T07:18:37.763238+0000","last_fullsized":"2024-04-22T07:18:37.763238+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:30:36.755201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.767520+0000","last_change":"2024-04-22T07:18:36.769465+0000","last_active":"2024-04-22T07:18:37.767520+0000","last_peered":"2024-04-22T07:18:37.767520+0000","last_clean":"2024-04-22T07:18:37.767520+0000","last_became_active":"2024-04-22T07:18:36.769181+0000","last_became_peered":"2024-04-22T07:18:36.769181+0000","last_unstale":"2024-04-22T07:18:37.767520+0000","last_undegraded":"2024-04-22T07:18:37.767520+0000","last_fullsized":"2024-04-22T07:18:37.767520+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:51:10.038201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.764013+0000","last_change":"2024-04-22T07:18:36.763439+0000","last_active":"2024-04-22T07:18:37.764013+0000","last_peered":"2024-04-22T07:18:37.764013+0000","last_clean":"2024-04-22T07:18:37.764013+0000","last_became_active":"2024-04-22T07:18:36.763146+0000","last_became_peered":"2024-04-22T07:18:36.763146+0000","last_unstale":"2024-04-22T07:18:37.764013+0000","last_undegraded":"2024-04-22T07:18:37.764013+0000","last_fullsized":"2024-04-22T07:18:37.764013+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:18:59.298766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.768027+0000","last_change":"2024-04-22T07:18:36.769533+0000","last_active":"2024-04-22T07:18:37.768027+0000","last_peered":"2024-04-22T07:18:37.768027+0000","last_clean":"2024-04-22T07:18:37.768027+0000","last_became_active":"2024-04-22T07:18:36.769274+0000","last_became_peered":"2024-04-22T07:18:36.769274+0000","last_unstale":"2024-04-22T07:18:37.768027+0000","last_undegraded":"2024-04-22T07:18:37.768027+0000","last_fullsized":"2024-04-22T07:18:37.768027+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:03:50.228822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:38.394207+0000","last_change":"2024-04-22T07:18:36.763931+0000","last_active":"2024-04-22T07:18:38.394207+0000","last_peered":"2024-04-22T07:18:38.394207+0000","last_clean":"2024-04-22T07:18:38.394207+0000","last_became_active":"2024-04-22T07:18:36.763656+0000","last_became_peered":"2024-04-22T07:18:36.763656+0000","last_unstale":"2024-04-22T07:18:38.394207+0000","last_undegraded":"2024-04-22T07:18:38.394207+0000","last_fullsized":"2024-04-22T07:18:38.394207+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:22:58.884168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.757432+0000","last_change":"2024-04-22T07:18:36.767158+0000","last_active":"2024-04-22T07:18:37.757432+0000","last_peered":"2024-04-22T07:18:37.757432+0000","last_clean":"2024-04-22T07:18:37.757432+0000","last_became_active":"2024-04-22T07:18:36.766614+0000","last_became_peered":"2024-04-22T07:18:36.766614+0000","last_unstale":"2024-04-22T07:18:37.757432+0000","last_undegraded":"2024-04-22T07:18:37.757432+0000","last_fullsized":"2024-04-22T07:18:37.757432+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:44:30.785178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.767721+0000","last_change":"2024-04-22T07:18:36.773129+0000","last_active":"2024-04-22T07:18:37.767721+0000","last_peered":"2024-04-22T07:18:37.767721+0000","last_clean":"2024-04-22T07:18:37.767721+0000","last_became_active":"2024-04-22T07:18:36.772827+0000","last_became_peered":"2024-04-22T07:18:36.772827+0000","last_unstale":"2024-04-22T07:18:37.767721+0000","last_undegraded":"2024-04-22T07:18:37.767721+0000","last_fullsized":"2024-04-22T07:18:37.767721+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:45:27.464772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:38.894815+0000","last_change":"2024-04-22T07:18:36.763716+0000","last_active":"2024-04-22T07:18:38.894815+0000","last_peered":"2024-04-22T07:18:38.894815+0000","last_clean":"2024-04-22T07:18:38.894815+0000","last_became_active":"2024-04-22T07:18:36.762270+0000","last_became_peered":"2024-04-22T07:18:36.762270+0000","last_unstale":"2024-04-22T07:18:38.894815+0000","last_undegraded":"2024-04-22T07:18:38.894815+0000","last_fullsized":"2024-04-22T07:18:38.894815+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:23:03.787574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.763390+0000","last_change":"2024-04-22T07:18:36.764152+0000","last_active":"2024-04-22T07:18:37.763390+0000","last_peered":"2024-04-22T07:18:37.763390+0000","last_clean":"2024-04-22T07:18:37.763390+0000","last_became_active":"2024-04-22T07:18:36.763770+0000","last_became_peered":"2024-04-22T07:18:36.763770+0000","last_unstale":"2024-04-22T07:18:37.763390+0000","last_undegraded":"2024-04-22T07:18:37.763390+0000","last_fullsized":"2024-04-22T07:18:37.763390+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:22:58.884168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:38.894313+0000","last_change":"2024-04-22T07:18:36.771121+0000","last_active":"2024-04-22T07:18:38.894313+0000","last_peered":"2024-04-22T07:18:38.894313+0000","last_clean":"2024-04-22T07:18:38.894313+0000","last_became_active":"2024-04-22T07:18:36.770786+0000","last_became_peered":"2024-04-22T07:18:36.770786+0000","last_unstale":"2024-04-22T07:18:38.894313+0000","last_undegraded":"2024-04-22T07:18:38.894313+0000","last_fullsized":"2024-04-22T07:18:38.894313+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:45:15.213668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:38.393831+0000","last_change":"2024-04-22T07:18:36.765462+0000","last_active":"2024-04-22T07:18:38.393831+0000","last_peered":"2024-04-22T07:18:38.393831+0000","last_clean":"2024-04-22T07:18:38.393831+0000","last_became_active":"2024-04-22T07:18:36.765142+0000","last_became_peered":"2024-04-22T07:18:36.765142+0000","last_unstale":"2024-04-22T07:18:38.393831+0000","last_undegraded":"2024-04-22T07:18:38.393831+0000","last_fullsized":"2024-04-22T07:18:38.393831+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:32:20.374856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.763051+0000","last_change":"2024-04-22T07:18:36.768234+0000","last_active":"2024-04-22T07:18:37.763051+0000","last_peered":"2024-04-22T07:18:37.763051+0000","last_clean":"2024-04-22T07:18:37.763051+0000","last_became_active":"2024-04-22T07:18:36.767951+0000","last_became_peered":"2024-04-22T07:18:36.767951+0000","last_unstale":"2024-04-22T07:18:37.763051+0000","last_undegraded":"2024-04-22T07:18:37.763051+0000","last_fullsized":"2024-04-22T07:18:37.763051+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:08:05.611868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:39.604078+0000","last_change":"2024-04-22T07:18:35.751538+0000","last_active":"2024-04-22T07:18:39.604078+0000","last_peered":"2024-04-22T07:18:39.604078+0000","last_clean":"2024-04-22T07:18:39.604078+0000","last_became_active":"2024-04-22T07:18:35.751219+0000","last_became_peered":"2024-04-22T07:18:35.751219+0000","last_unstale":"2024-04-22T07:18:39.604078+0000","last_undegraded":"2024-04-22T07:18:39.604078+0000","last_fullsized":"2024-04-22T07:18:39.604078+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:00:10.289974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:38.894909+0000","last_change":"2024-04-22T07:18:36.757337+0000","last_active":"2024-04-22T07:18:38.894909+0000","last_peered":"2024-04-22T07:18:38.894909+0000","last_clean":"2024-04-22T07:18:38.894909+0000","last_became_active":"2024-04-22T07:18:36.757039+0000","last_became_peered":"2024-04-22T07:18:36.757039+0000","last_unstale":"2024-04-22T07:18:38.894909+0000","last_undegraded":"2024-04-22T07:18:38.894909+0000","last_fullsized":"2024-04-22T07:18:38.894909+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:09:08.040513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:39.601564+0000","last_change":"2024-04-22T07:18:35.746515+0000","last_active":"2024-04-22T07:18:39.601564+0000","last_peered":"2024-04-22T07:18:39.601564+0000","last_clean":"2024-04-22T07:18:39.601564+0000","last_became_active":"2024-04-22T07:18:35.746198+0000","last_became_peered":"2024-04-22T07:18:35.746198+0000","last_unstale":"2024-04-22T07:18:39.601564+0000","last_undegraded":"2024-04-22T07:18:39.601564+0000","last_fullsized":"2024-04-22T07:18:39.601564+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:43:54.682673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.767496+0000","last_change":"2024-04-22T07:18:35.752307+0000","last_active":"2024-04-22T07:18:37.767496+0000","last_peered":"2024-04-22T07:18:37.767496+0000","last_clean":"2024-04-22T07:18:37.767496+0000","last_became_active":"2024-04-22T07:18:35.751545+0000","last_became_peered":"2024-04-22T07:18:35.751545+0000","last_unstale":"2024-04-22T07:18:37.767496+0000","last_undegraded":"2024-04-22T07:18:37.767496+0000","last_fullsized":"2024-04-22T07:18:37.767496+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:21:55.316649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.767511+0000","last_change":"2024-04-22T07:18:36.772372+0000","last_active":"2024-04-22T07:18:37.767511+0000","last_peered":"2024-04-22T07:18:37.767511+0000","last_clean":"2024-04-22T07:18:37.767511+0000","last_became_active":"2024-04-22T07:18:36.772067+0000","last_became_peered":"2024-04-22T07:18:36.772067+0000","last_unstale":"2024-04-22T07:18:37.767511+0000","last_undegraded":"2024-04-22T07:18:37.767511+0000","last_fullsized":"2024-04-22T07:18:37.767511+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:44:30.785178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.764151+0000","last_change":"2024-04-22T07:18:35.740989+0000","last_active":"2024-04-22T07:18:37.764151+0000","last_peered":"2024-04-22T07:18:37.764151+0000","last_clean":"2024-04-22T07:18:37.764151+0000","last_became_active":"2024-04-22T07:18:35.740665+0000","last_became_peered":"2024-04-22T07:18:35.740665+0000","last_unstale":"2024-04-22T07:18:37.764151+0000","last_undegraded":"2024-04-22T07:18:37.764151+0000","last_fullsized":"2024-04-22T07:18:37.764151+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:00:10.289974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.757377+0000","last_change":"2024-04-22T07:18:36.767022+0000","last_active":"2024-04-22T07:18:37.757377+0000","last_peered":"2024-04-22T07:18:37.757377+0000","last_clean":"2024-04-22T07:18:37.757377+0000","last_became_active":"2024-04-22T07:18:36.766609+0000","last_became_peered":"2024-04-22T07:18:36.766609+0000","last_unstale":"2024-04-22T07:18:37.757377+0000","last_undegraded":"2024-04-22T07:18:37.757377+0000","last_fullsized":"2024-04-22T07:18:37.757377+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:32:20.374856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:38.394098+0000","last_change":"2024-04-22T07:18:35.752081+0000","last_active":"2024-04-22T07:18:38.394098+0000","last_peered":"2024-04-22T07:18:38.394098+0000","last_clean":"2024-04-22T07:18:38.394098+0000","last_became_active":"2024-04-22T07:18:35.751757+0000","last_became_peered":"2024-04-22T07:18:35.751757+0000","last_unstale":"2024-04-22T07:18:38.394098+0000","last_undegraded":"2024-04-22T07:18:38.394098+0000","last_fullsized":"2024-04-22T07:18:38.394098+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:21:55.316649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.764165+0000","last_change":"2024-04-22T07:18:36.765937+0000","last_active":"2024-04-22T07:18:37.764165+0000","last_peered":"2024-04-22T07:18:37.764165+0000","last_clean":"2024-04-22T07:18:37.764165+0000","last_became_active":"2024-04-22T07:18:36.765647+0000","last_became_peered":"2024-04-22T07:18:36.765647+0000","last_unstale":"2024-04-22T07:18:37.764165+0000","last_undegraded":"2024-04-22T07:18:37.764165+0000","last_fullsized":"2024-04-22T07:18:37.764165+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:59:57.688417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.763996+0000","last_change":"2024-04-22T07:18:35.747309+0000","last_active":"2024-04-22T07:18:37.763996+0000","last_peered":"2024-04-22T07:18:37.763996+0000","last_clean":"2024-04-22T07:18:37.763996+0000","last_became_active":"2024-04-22T07:18:35.747019+0000","last_became_peered":"2024-04-22T07:18:35.747019+0000","last_unstale":"2024-04-22T07:18:37.763996+0000","last_undegraded":"2024-04-22T07:18:37.763996+0000","last_fullsized":"2024-04-22T07:18:37.763996+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:21:55.316649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:38.895019+0000","last_change":"2024-04-22T07:18:36.763436+0000","last_active":"2024-04-22T07:18:38.895019+0000","last_peered":"2024-04-22T07:18:38.895019+0000","last_clean":"2024-04-22T07:18:38.895019+0000","last_became_active":"2024-04-22T07:18:36.763068+0000","last_became_peered":"2024-04-22T07:18:36.763068+0000","last_unstale":"2024-04-22T07:18:38.895019+0000","last_undegraded":"2024-04-22T07:18:38.895019+0000","last_fullsized":"2024-04-22T07:18:38.895019+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:22:58.884168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:41.767555+0000","last_change":"2024-04-22T07:18:35.750769+0000","last_active":"2024-04-22T07:18:41.767555+0000","last_peered":"2024-04-22T07:18:41.767555+0000","last_clean":"2024-04-22T07:18:41.767555+0000","last_became_active":"2024-04-22T07:18:35.750406+0000","last_became_peered":"2024-04-22T07:18:35.750406+0000","last_unstale":"2024-04-22T07:18:41.767555+0000","last_undegraded":"2024-04-22T07:18:41.767555+0000","last_fullsized":"2024-04-22T07:18:41.767555+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T19:09:20.529889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.763680+0000","last_change":"2024-04-22T07:18:36.767426+0000","last_active":"2024-04-22T07:18:37.763680+0000","last_peered":"2024-04-22T07:18:37.763680+0000","last_clean":"2024-04-22T07:18:37.763680+0000","last_became_active":"2024-04-22T07:18:36.767159+0000","last_became_peered":"2024-04-22T07:18:36.767159+0000","last_unstale":"2024-04-22T07:18:37.763680+0000","last_undegraded":"2024-04-22T07:18:37.763680+0000","last_fullsized":"2024-04-22T07:18:37.763680+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:19:49.652644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:41.768017+0000","last_change":"2024-04-22T07:18:35.752996+0000","last_active":"2024-04-22T07:18:41.768017+0000","last_peered":"2024-04-22T07:18:41.768017+0000","last_clean":"2024-04-22T07:18:41.768017+0000","last_became_active":"2024-04-22T07:18:35.752686+0000","last_became_peered":"2024-04-22T07:18:35.752686+0000","last_unstale":"2024-04-22T07:18:41.768017+0000","last_undegraded":"2024-04-22T07:18:41.768017+0000","last_fullsized":"2024-04-22T07:18:41.768017+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:36:55.684427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.937011+0000","last_change":"2024-04-22T07:18:36.767539+0000","last_active":"2024-04-22T07:18:37.937011+0000","last_peered":"2024-04-22T07:18:37.937011+0000","last_clean":"2024-04-22T07:18:37.937011+0000","last_became_active":"2024-04-22T07:18:36.767273+0000","last_became_peered":"2024-04-22T07:18:36.767273+0000","last_unstale":"2024-04-22T07:18:37.937011+0000","last_undegraded":"2024-04-22T07:18:37.937011+0000","last_fullsized":"2024-04-22T07:18:37.937011+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:03:50.228822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:41.764793+0000","last_change":"2024-04-22T07:18:35.752382+0000","last_active":"2024-04-22T07:18:41.764793+0000","last_peered":"2024-04-22T07:18:41.764793+0000","last_clean":"2024-04-22T07:18:41.764793+0000","last_became_active":"2024-04-22T07:18:35.752060+0000","last_became_peered":"2024-04-22T07:18:35.752060+0000","last_unstale":"2024-04-22T07:18:41.764793+0000","last_undegraded":"2024-04-22T07:18:41.764793+0000","last_fullsized":"2024-04-22T07:18:41.764793+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:31:33.559251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:38.894534+0000","last_change":"2024-04-22T07:18:36.764670+0000","last_active":"2024-04-22T07:18:38.894534+0000","last_peered":"2024-04-22T07:18:38.894534+0000","last_clean":"2024-04-22T07:18:38.894534+0000","last_became_active":"2024-04-22T07:18:36.763834+0000","last_became_peered":"2024-04-22T07:18:36.763834+0000","last_unstale":"2024-04-22T07:18:38.894534+0000","last_undegraded":"2024-04-22T07:18:38.894534+0000","last_fullsized":"2024-04-22T07:18:38.894534+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:41:20.703226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.763489+0000","last_change":"2024-04-22T07:18:35.752856+0000","last_active":"2024-04-22T07:18:37.763489+0000","last_peered":"2024-04-22T07:18:37.763489+0000","last_clean":"2024-04-22T07:18:37.763489+0000","last_became_active":"2024-04-22T07:18:35.752527+0000","last_became_peered":"2024-04-22T07:18:35.752527+0000","last_unstale":"2024-04-22T07:18:37.763489+0000","last_undegraded":"2024-04-22T07:18:37.763489+0000","last_fullsized":"2024-04-22T07:18:37.763489+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:40:59.305769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.937073+0000","last_change":"2024-04-22T07:18:36.769174+0000","last_active":"2024-04-22T07:18:37.937073+0000","last_peered":"2024-04-22T07:18:37.937073+0000","last_clean":"2024-04-22T07:18:37.937073+0000","last_became_active":"2024-04-22T07:18:36.768913+0000","last_became_peered":"2024-04-22T07:18:36.768913+0000","last_unstale":"2024-04-22T07:18:37.937073+0000","last_undegraded":"2024-04-22T07:18:37.937073+0000","last_fullsized":"2024-04-22T07:18:37.937073+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:45:42.674989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:38.393752+0000","last_change":"2024-04-22T07:18:35.749740+0000","last_active":"2024-04-22T07:18:38.393752+0000","last_peered":"2024-04-22T07:18:38.393752+0000","last_clean":"2024-04-22T07:18:38.393752+0000","last_became_active":"2024-04-22T07:18:35.749453+0000","last_became_peered":"2024-04-22T07:18:35.749453+0000","last_unstale":"2024-04-22T07:18:38.393752+0000","last_undegraded":"2024-04-22T07:18:38.393752+0000","last_fullsized":"2024-04-22T07:18:38.393752+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:08:04.608018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:38.393952+0000","last_change":"2024-04-22T07:18:36.771940+0000","last_active":"2024-04-22T07:18:38.393952+0000","last_peered":"2024-04-22T07:18:38.393952+0000","last_clean":"2024-04-22T07:18:38.393952+0000","last_became_active":"2024-04-22T07:18:36.771548+0000","last_became_peered":"2024-04-22T07:18:36.771548+0000","last_unstale":"2024-04-22T07:18:38.393952+0000","last_undegraded":"2024-04-22T07:18:38.393952+0000","last_fullsized":"2024-04-22T07:18:38.393952+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:23:03.787574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:41.765466+0000","last_change":"2024-04-22T07:18:35.749047+0000","last_active":"2024-04-22T07:18:41.765466+0000","last_peered":"2024-04-22T07:18:41.765466+0000","last_clean":"2024-04-22T07:18:41.765466+0000","last_became_active":"2024-04-22T07:18:35.748757+0000","last_became_peered":"2024-04-22T07:18:35.748757+0000","last_unstale":"2024-04-22T07:18:41.765466+0000","last_undegraded":"2024-04-22T07:18:41.765466+0000","last_fullsized":"2024-04-22T07:18:41.765466+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:40:59.305769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.936788+0000","last_change":"2024-04-22T07:18:36.769894+0000","last_active":"2024-04-22T07:18:37.936788+0000","last_peered":"2024-04-22T07:18:37.936788+0000","last_clean":"2024-04-22T07:18:37.936788+0000","last_became_active":"2024-04-22T07:18:36.768702+0000","last_became_peered":"2024-04-22T07:18:36.768702+0000","last_unstale":"2024-04-22T07:18:37.936788+0000","last_undegraded":"2024-04-22T07:18:37.936788+0000","last_fullsized":"2024-04-22T07:18:37.936788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:36:53.716397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:39.598923+0000","last_change":"2024-04-22T07:18:35.747536+0000","last_active":"2024-04-22T07:18:39.598923+0000","last_peered":"2024-04-22T07:18:39.598923+0000","last_clean":"2024-04-22T07:18:39.598923+0000","last_became_active":"2024-04-22T07:18:35.747271+0000","last_became_peered":"2024-04-22T07:18:35.747271+0000","last_unstale":"2024-04-22T07:18:39.598923+0000","last_undegraded":"2024-04-22T07:18:39.598923+0000","last_fullsized":"2024-04-22T07:18:39.598923+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:51:11.593642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.937304+0000","last_change":"2024-04-22T07:18:36.773033+0000","last_active":"2024-04-22T07:18:37.937304+0000","last_peered":"2024-04-22T07:18:37.937304+0000","last_clean":"2024-04-22T07:18:37.937304+0000","last_became_active":"2024-04-22T07:18:36.772537+0000","last_became_peered":"2024-04-22T07:18:36.772537+0000","last_unstale":"2024-04-22T07:18:37.937304+0000","last_undegraded":"2024-04-22T07:18:37.937304+0000","last_fullsized":"2024-04-22T07:18:37.937304+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:58:41.509248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:41.763188+0000","last_change":"2024-04-22T07:18:35.747533+0000","last_active":"2024-04-22T07:18:41.763188+0000","last_peered":"2024-04-22T07:18:41.763188+0000","last_clean":"2024-04-22T07:18:41.763188+0000","last_became_active":"2024-04-22T07:18:35.746881+0000","last_became_peered":"2024-04-22T07:18:35.746881+0000","last_unstale":"2024-04-22T07:18:41.763188+0000","last_undegraded":"2024-04-22T07:18:41.763188+0000","last_fullsized":"2024-04-22T07:18:41.763188+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:43:54.682673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.937347+0000","last_change":"2024-04-22T07:18:36.773723+0000","last_active":"2024-04-22T07:18:37.937347+0000","last_peered":"2024-04-22T07:18:37.937347+0000","last_clean":"2024-04-22T07:18:37.937347+0000","last_became_active":"2024-04-22T07:18:36.773466+0000","last_became_peered":"2024-04-22T07:18:36.773466+0000","last_unstale":"2024-04-22T07:18:37.937347+0000","last_undegraded":"2024-04-22T07:18:37.937347+0000","last_fullsized":"2024-04-22T07:18:37.937347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:42:20.611744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:39.603975+0000","last_change":"2024-04-22T07:18:35.750360+0000","last_active":"2024-04-22T07:18:39.603975+0000","last_peered":"2024-04-22T07:18:39.603975+0000","last_clean":"2024-04-22T07:18:39.603975+0000","last_became_active":"2024-04-22T07:18:35.749984+0000","last_became_peered":"2024-04-22T07:18:35.749984+0000","last_unstale":"2024-04-22T07:18:39.603975+0000","last_undegraded":"2024-04-22T07:18:39.603975+0000","last_fullsized":"2024-04-22T07:18:39.603975+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:19:48.648793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.764298+0000","last_change":"2024-04-22T07:18:36.765767+0000","last_active":"2024-04-22T07:18:37.764298+0000","last_peered":"2024-04-22T07:18:37.764298+0000","last_clean":"2024-04-22T07:18:37.764298+0000","last_became_active":"2024-04-22T07:18:36.764218+0000","last_became_peered":"2024-04-22T07:18:36.764218+0000","last_unstale":"2024-04-22T07:18:37.764298+0000","last_undegraded":"2024-04-22T07:18:37.764298+0000","last_fullsized":"2024-04-22T07:18:37.764298+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:45:42.674989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:38.894330+0000","last_change":"2024-04-22T07:18:35.743323+0000","last_active":"2024-04-22T07:18:38.894330+0000","last_peered":"2024-04-22T07:18:38.894330+0000","last_clean":"2024-04-22T07:18:38.894330+0000","last_became_active":"2024-04-22T07:18:35.743023+0000","last_became_peered":"2024-04-22T07:18:35.743023+0000","last_unstale":"2024-04-22T07:18:38.894330+0000","last_undegraded":"2024-04-22T07:18:38.894330+0000","last_fullsized":"2024-04-22T07:18:38.894330+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:08:04.608018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.937037+0000","last_change":"2024-04-22T07:18:36.771073+0000","last_active":"2024-04-22T07:18:37.937037+0000","last_peered":"2024-04-22T07:18:37.937037+0000","last_clean":"2024-04-22T07:18:37.937037+0000","last_became_active":"2024-04-22T07:18:36.770678+0000","last_became_peered":"2024-04-22T07:18:36.770678+0000","last_unstale":"2024-04-22T07:18:37.937037+0000","last_undegraded":"2024-04-22T07:18:37.937037+0000","last_fullsized":"2024-04-22T07:18:37.937037+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:59:57.688417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":170,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.936801+0000","last_change":"2024-04-22T07:18:26.518190+0000","last_active":"2024-04-22T07:18:37.936801+0000","last_peered":"2024-04-22T07:18:37.936801+0000","last_clean":"2024-04-22T07:18:37.936801+0000","last_became_active":"2024-04-22T07:18:26.515489+0000","last_became_peered":"2024-04-22T07:18:26.515489+0000","last_unstale":"2024-04-22T07:18:37.936801+0000","last_undegraded":"2024-04-22T07:18:37.936801+0000","last_fullsized":"2024-04-22T07:18:37.936801+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:24.652061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:24.652061+0000","last_clean_scrub_stamp":"2024-04-22T07:18:24.652061+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:32:54.875706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.762947+0000","last_change":"2024-04-22T07:18:35.748477+0000","last_active":"2024-04-22T07:18:37.762947+0000","last_peered":"2024-04-22T07:18:37.762947+0000","last_clean":"2024-04-22T07:18:37.762947+0000","last_became_active":"2024-04-22T07:18:35.748176+0000","last_became_peered":"2024-04-22T07:18:35.748176+0000","last_unstale":"2024-04-22T07:18:37.762947+0000","last_undegraded":"2024-04-22T07:18:37.762947+0000","last_fullsized":"2024-04-22T07:18:37.762947+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:36:55.684427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.767642+0000","last_change":"2024-04-22T07:18:36.771870+0000","last_active":"2024-04-22T07:18:37.767642+0000","last_peered":"2024-04-22T07:18:37.767642+0000","last_clean":"2024-04-22T07:18:37.767642+0000","last_became_active":"2024-04-22T07:18:36.771583+0000","last_became_peered":"2024-04-22T07:18:36.771583+0000","last_unstale":"2024-04-22T07:18:37.767642+0000","last_undegraded":"2024-04-22T07:18:37.767642+0000","last_fullsized":"2024-04-22T07:18:37.767642+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:22:58.884168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.936652+0000","last_change":"2024-04-22T07:18:35.755668+0000","last_active":"2024-04-22T07:18:37.936652+0000","last_peered":"2024-04-22T07:18:37.936652+0000","last_clean":"2024-04-22T07:18:37.936652+0000","last_became_active":"2024-04-22T07:18:35.755471+0000","last_became_peered":"2024-04-22T07:18:35.755471+0000","last_unstale":"2024-04-22T07:18:37.936652+0000","last_undegraded":"2024-04-22T07:18:37.936652+0000","last_fullsized":"2024-04-22T07:18:37.936652+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:36:55.684427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:38.894300+0000","last_change":"2024-04-22T07:18:36.758204+0000","last_active":"2024-04-22T07:18:38.894300+0000","last_peered":"2024-04-22T07:18:38.894300+0000","last_clean":"2024-04-22T07:18:38.894300+0000","last_became_active":"2024-04-22T07:18:36.757841+0000","last_became_peered":"2024-04-22T07:18:36.757841+0000","last_unstale":"2024-04-22T07:18:38.894300+0000","last_undegraded":"2024-04-22T07:18:38.894300+0000","last_fullsized":"2024-04-22T07:18:38.894300+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:43:09.058016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:38.894236+0000","last_change":"2024-04-22T07:18:35.746686+0000","last_active":"2024-04-22T07:18:38.894236+0000","last_peered":"2024-04-22T07:18:38.894236+0000","last_clean":"2024-04-22T07:18:38.894236+0000","last_became_active":"2024-04-22T07:18:35.746371+0000","last_became_peered":"2024-04-22T07:18:35.746371+0000","last_unstale":"2024-04-22T07:18:38.894236+0000","last_undegraded":"2024-04-22T07:18:38.894236+0000","last_fullsized":"2024-04-22T07:18:38.894236+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:36:55.684427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.757383+0000","last_change":"2024-04-22T07:18:36.765985+0000","last_active":"2024-04-22T07:18:37.757383+0000","last_peered":"2024-04-22T07:18:37.757383+0000","last_clean":"2024-04-22T07:18:37.757383+0000","last_became_active":"2024-04-22T07:18:36.765661+0000","last_became_peered":"2024-04-22T07:18:36.765661+0000","last_unstale":"2024-04-22T07:18:37.757383+0000","last_undegraded":"2024-04-22T07:18:37.757383+0000","last_fullsized":"2024-04-22T07:18:37.757383+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:23:03.787574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.763585+0000","last_change":"2024-04-22T07:18:35.754160+0000","last_active":"2024-04-22T07:18:37.763585+0000","last_peered":"2024-04-22T07:18:37.763585+0000","last_clean":"2024-04-22T07:18:37.763585+0000","last_became_active":"2024-04-22T07:18:35.753860+0000","last_became_peered":"2024-04-22T07:18:35.753860+0000","last_unstale":"2024-04-22T07:18:37.763585+0000","last_undegraded":"2024-04-22T07:18:37.763585+0000","last_fullsized":"2024-04-22T07:18:37.763585+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:08:04.608018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.763400+0000","last_change":"2024-04-22T07:18:36.762349+0000","last_active":"2024-04-22T07:18:37.763400+0000","last_peered":"2024-04-22T07:18:37.763400+0000","last_clean":"2024-04-22T07:18:37.763400+0000","last_became_active":"2024-04-22T07:18:36.762097+0000","last_became_peered":"2024-04-22T07:18:36.762097+0000","last_unstale":"2024-04-22T07:18:37.763400+0000","last_undegraded":"2024-04-22T07:18:37.763400+0000","last_fullsized":"2024-04-22T07:18:37.763400+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:43:55.686523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.757304+0000","last_change":"2024-04-22T07:18:35.758810+0000","last_active":"2024-04-22T07:18:37.757304+0000","last_peered":"2024-04-22T07:18:37.757304+0000","last_clean":"2024-04-22T07:18:37.757304+0000","last_became_active":"2024-04-22T07:18:35.758521+0000","last_became_peered":"2024-04-22T07:18:35.758521+0000","last_unstale":"2024-04-22T07:18:37.757304+0000","last_undegraded":"2024-04-22T07:18:37.757304+0000","last_fullsized":"2024-04-22T07:18:37.757304+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:40:59.305769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.764371+0000","last_change":"2024-04-22T07:18:36.764448+0000","last_active":"2024-04-22T07:18:37.764371+0000","last_peered":"2024-04-22T07:18:37.764371+0000","last_clean":"2024-04-22T07:18:37.764371+0000","last_became_active":"2024-04-22T07:18:36.763728+0000","last_became_peered":"2024-04-22T07:18:36.763728+0000","last_unstale":"2024-04-22T07:18:37.764371+0000","last_undegraded":"2024-04-22T07:18:37.764371+0000","last_fullsized":"2024-04-22T07:18:37.764371+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:58:41.509248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.937270+0000","last_change":"2024-04-22T07:18:35.758980+0000","last_active":"2024-04-22T07:18:37.937270+0000","last_peered":"2024-04-22T07:18:37.937270+0000","last_clean":"2024-04-22T07:18:37.937270+0000","last_became_active":"2024-04-22T07:18:35.758674+0000","last_became_peered":"2024-04-22T07:18:35.758674+0000","last_unstale":"2024-04-22T07:18:37.937270+0000","last_undegraded":"2024-04-22T07:18:37.937270+0000","last_fullsized":"2024-04-22T07:18:37.937270+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:45:14.209818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.757443+0000","last_change":"2024-04-22T07:18:36.772908+0000","last_active":"2024-04-22T07:18:37.757443+0000","last_peered":"2024-04-22T07:18:37.757443+0000","last_clean":"2024-04-22T07:18:37.757443+0000","last_became_active":"2024-04-22T07:18:36.772636+0000","last_became_peered":"2024-04-22T07:18:36.772636+0000","last_unstale":"2024-04-22T07:18:37.757443+0000","last_undegraded":"2024-04-22T07:18:37.757443+0000","last_fullsized":"2024-04-22T07:18:37.757443+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:51:10.038201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.757474+0000","last_change":"2024-04-22T07:18:35.753595+0000","last_active":"2024-04-22T07:18:37.757474+0000","last_peered":"2024-04-22T07:18:37.757474+0000","last_clean":"2024-04-22T07:18:37.757474+0000","last_became_active":"2024-04-22T07:18:35.753295+0000","last_became_peered":"2024-04-22T07:18:35.753295+0000","last_unstale":"2024-04-22T07:18:37.757474+0000","last_undegraded":"2024-04-22T07:18:37.757474+0000","last_fullsized":"2024-04-22T07:18:37.757474+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:08:04.608018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.768028+0000","last_change":"2024-04-22T07:18:36.768580+0000","last_active":"2024-04-22T07:18:37.768028+0000","last_peered":"2024-04-22T07:18:37.768028+0000","last_clean":"2024-04-22T07:18:37.768028+0000","last_became_active":"2024-04-22T07:18:36.767702+0000","last_became_peered":"2024-04-22T07:18:36.767702+0000","last_unstale":"2024-04-22T07:18:37.768028+0000","last_undegraded":"2024-04-22T07:18:37.768028+0000","last_fullsized":"2024-04-22T07:18:37.768028+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:59:57.688417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:41.768034+0000","last_change":"2024-04-22T07:18:35.751692+0000","last_active":"2024-04-22T07:18:41.768034+0000","last_peered":"2024-04-22T07:18:41.768034+0000","last_clean":"2024-04-22T07:18:41.768034+0000","last_became_active":"2024-04-22T07:18:35.751393+0000","last_became_peered":"2024-04-22T07:18:35.751393+0000","last_unstale":"2024-04-22T07:18:41.768034+0000","last_undegraded":"2024-04-22T07:18:41.768034+0000","last_fullsized":"2024-04-22T07:18:41.768034+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:40:59.305769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:38.894956+0000","last_change":"2024-04-22T07:18:36.768532+0000","last_active":"2024-04-22T07:18:38.894956+0000","last_peered":"2024-04-22T07:18:38.894956+0000","last_clean":"2024-04-22T07:18:38.894956+0000","last_became_active":"2024-04-22T07:18:36.768253+0000","last_became_peered":"2024-04-22T07:18:36.768253+0000","last_unstale":"2024-04-22T07:18:38.894956+0000","last_undegraded":"2024-04-22T07:18:38.894956+0000","last_fullsized":"2024-04-22T07:18:38.894956+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:30:36.755201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.936651+0000","last_change":"2024-04-22T07:18:35.758702+0000","last_active":"2024-04-22T07:18:37.936651+0000","last_peered":"2024-04-22T07:18:37.936651+0000","last_clean":"2024-04-22T07:18:37.936651+0000","last_became_active":"2024-04-22T07:18:35.758415+0000","last_became_peered":"2024-04-22T07:18:35.758415+0000","last_unstale":"2024-04-22T07:18:37.936651+0000","last_undegraded":"2024-04-22T07:18:37.936651+0000","last_fullsized":"2024-04-22T07:18:37.936651+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:08:04.608018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.763191+0000","last_change":"2024-04-22T07:18:36.763053+0000","last_active":"2024-04-22T07:18:37.763191+0000","last_peered":"2024-04-22T07:18:37.763191+0000","last_clean":"2024-04-22T07:18:37.763191+0000","last_became_active":"2024-04-22T07:18:36.762546+0000","last_became_peered":"2024-04-22T07:18:36.762546+0000","last_unstale":"2024-04-22T07:18:37.763191+0000","last_undegraded":"2024-04-22T07:18:37.763191+0000","last_fullsized":"2024-04-22T07:18:37.763191+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:36:56.688277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.757534+0000","last_change":"2024-04-22T07:18:35.748837+0000","last_active":"2024-04-22T07:18:37.757534+0000","last_peered":"2024-04-22T07:18:37.757534+0000","last_clean":"2024-04-22T07:18:37.757534+0000","last_became_active":"2024-04-22T07:18:35.748080+0000","last_became_peered":"2024-04-22T07:18:35.748080+0000","last_unstale":"2024-04-22T07:18:37.757534+0000","last_undegraded":"2024-04-22T07:18:37.757534+0000","last_fullsized":"2024-04-22T07:18:37.757534+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:36:55.684427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.767568+0000","last_change":"2024-04-22T07:18:36.769911+0000","last_active":"2024-04-22T07:18:37.767568+0000","last_peered":"2024-04-22T07:18:37.767568+0000","last_clean":"2024-04-22T07:18:37.767568+0000","last_became_active":"2024-04-22T07:18:36.768682+0000","last_became_peered":"2024-04-22T07:18:36.768682+0000","last_unstale":"2024-04-22T07:18:37.767568+0000","last_undegraded":"2024-04-22T07:18:37.767568+0000","last_fullsized":"2024-04-22T07:18:37.767568+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:30:36.755201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.757319+0000","last_change":"2024-04-22T07:18:35.753066+0000","last_active":"2024-04-22T07:18:37.757319+0000","last_peered":"2024-04-22T07:18:37.757319+0000","last_clean":"2024-04-22T07:18:37.757319+0000","last_became_active":"2024-04-22T07:18:35.752804+0000","last_became_peered":"2024-04-22T07:18:35.752804+0000","last_unstale":"2024-04-22T07:18:37.757319+0000","last_undegraded":"2024-04-22T07:18:37.757319+0000","last_fullsized":"2024-04-22T07:18:37.757319+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:43:54.682673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.767652+0000","last_change":"2024-04-22T07:18:36.774790+0000","last_active":"2024-04-22T07:18:37.767652+0000","last_peered":"2024-04-22T07:18:37.767652+0000","last_clean":"2024-04-22T07:18:37.767652+0000","last_became_active":"2024-04-22T07:18:36.774479+0000","last_became_peered":"2024-04-22T07:18:36.774479+0000","last_unstale":"2024-04-22T07:18:37.767652+0000","last_undegraded":"2024-04-22T07:18:37.767652+0000","last_fullsized":"2024-04-22T07:18:37.767652+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:36:53.716397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:41.767713+0000","last_change":"2024-04-22T07:18:35.754440+0000","last_active":"2024-04-22T07:18:41.767713+0000","last_peered":"2024-04-22T07:18:41.767713+0000","last_clean":"2024-04-22T07:18:41.767713+0000","last_became_active":"2024-04-22T07:18:35.754137+0000","last_became_peered":"2024-04-22T07:18:35.754137+0000","last_unstale":"2024-04-22T07:18:41.767713+0000","last_undegraded":"2024-04-22T07:18:41.767713+0000","last_fullsized":"2024-04-22T07:18:41.767713+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T19:09:20.529889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:38.393947+0000","last_change":"2024-04-22T07:18:36.759585+0000","last_active":"2024-04-22T07:18:38.393947+0000","last_peered":"2024-04-22T07:18:38.393947+0000","last_clean":"2024-04-22T07:18:38.393947+0000","last_became_active":"2024-04-22T07:18:36.759342+0000","last_became_peered":"2024-04-22T07:18:36.759342+0000","last_unstale":"2024-04-22T07:18:38.393947+0000","last_undegraded":"2024-04-22T07:18:38.393947+0000","last_fullsized":"2024-04-22T07:18:38.393947+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:44:30.785178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.764337+0000","last_change":"2024-04-22T07:18:36.762665+0000","last_active":"2024-04-22T07:18:37.764337+0000","last_peered":"2024-04-22T07:18:37.764337+0000","last_clean":"2024-04-22T07:18:37.764337+0000","last_became_active":"2024-04-22T07:18:36.762392+0000","last_became_peered":"2024-04-22T07:18:36.762392+0000","last_unstale":"2024-04-22T07:18:37.764337+0000","last_undegraded":"2024-04-22T07:18:37.764337+0000","last_fullsized":"2024-04-22T07:18:37.764337+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:36:27.097452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:41.767658+0000","last_change":"2024-04-22T07:18:35.755160+0000","last_active":"2024-04-22T07:18:41.767658+0000","last_peered":"2024-04-22T07:18:41.767658+0000","last_clean":"2024-04-22T07:18:41.767658+0000","last_became_active":"2024-04-22T07:18:35.754877+0000","last_became_peered":"2024-04-22T07:18:35.754877+0000","last_unstale":"2024-04-22T07:18:41.767658+0000","last_undegraded":"2024-04-22T07:18:41.767658+0000","last_fullsized":"2024-04-22T07:18:41.767658+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:43:54.682673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.764098+0000","last_change":"2024-04-22T07:18:36.761534+0000","last_active":"2024-04-22T07:18:37.764098+0000","last_peered":"2024-04-22T07:18:37.764098+0000","last_clean":"2024-04-22T07:18:37.764098+0000","last_became_active":"2024-04-22T07:18:36.761181+0000","last_became_peered":"2024-04-22T07:18:36.761181+0000","last_unstale":"2024-04-22T07:18:37.764098+0000","last_undegraded":"2024-04-22T07:18:37.764098+0000","last_fullsized":"2024-04-22T07:18:37.764098+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:03:50.228822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:41.767397+0000","last_change":"2024-04-22T07:18:35.752282+0000","last_active":"2024-04-22T07:18:41.767397+0000","last_peered":"2024-04-22T07:18:41.767397+0000","last_clean":"2024-04-22T07:18:41.767397+0000","last_became_active":"2024-04-22T07:18:35.751866+0000","last_became_peered":"2024-04-22T07:18:35.751866+0000","last_unstale":"2024-04-22T07:18:41.767397+0000","last_undegraded":"2024-04-22T07:18:41.767397+0000","last_fullsized":"2024-04-22T07:18:41.767397+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:19:48.648793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:38.894862+0000","last_change":"2024-04-22T07:18:36.763229+0000","last_active":"2024-04-22T07:18:38.894862+0000","last_peered":"2024-04-22T07:18:38.894862+0000","last_clean":"2024-04-22T07:18:38.894862+0000","last_became_active":"2024-04-22T07:18:36.762882+0000","last_became_peered":"2024-04-22T07:18:36.762882+0000","last_unstale":"2024-04-22T07:18:38.894862+0000","last_undegraded":"2024-04-22T07:18:38.894862+0000","last_fullsized":"2024-04-22T07:18:38.894862+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:44:30.785178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:39.604104+0000","last_change":"2024-04-22T07:18:35.758820+0000","last_active":"2024-04-22T07:18:39.604104+0000","last_peered":"2024-04-22T07:18:39.604104+0000","last_clean":"2024-04-22T07:18:39.604104+0000","last_became_active":"2024-04-22T07:18:35.758514+0000","last_became_peered":"2024-04-22T07:18:35.758514+0000","last_unstale":"2024-04-22T07:18:39.604104+0000","last_undegraded":"2024-04-22T07:18:39.604104+0000","last_fullsized":"2024-04-22T07:18:39.604104+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:40:59.305769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.767960+0000","last_change":"2024-04-22T07:18:36.768383+0000","last_active":"2024-04-22T07:18:37.767960+0000","last_peered":"2024-04-22T07:18:37.767960+0000","last_clean":"2024-04-22T07:18:37.767960+0000","last_became_active":"2024-04-22T07:18:36.767779+0000","last_became_peered":"2024-04-22T07:18:36.767779+0000","last_unstale":"2024-04-22T07:18:37.767960+0000","last_undegraded":"2024-04-22T07:18:37.767960+0000","last_fullsized":"2024-04-22T07:18:37.767960+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:18:59.298766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:41.768431+0000","last_change":"2024-04-22T07:18:35.754117+0000","last_active":"2024-04-22T07:18:41.768431+0000","last_peered":"2024-04-22T07:18:41.768431+0000","last_clean":"2024-04-22T07:18:41.768431+0000","last_became_active":"2024-04-22T07:18:35.753833+0000","last_became_peered":"2024-04-22T07:18:35.753833+0000","last_unstale":"2024-04-22T07:18:41.768431+0000","last_undegraded":"2024-04-22T07:18:41.768431+0000","last_fullsized":"2024-04-22T07:18:41.768431+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:54:03.123665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574857,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27800,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344040,"statfs":{"total":96636764160,"available":96608296960,"internally_reserved":0,"allocated":802816,"data_stored":661884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574856,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":208896,"data_stored":71024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":217088,"data_stored":71060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574857,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27216,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":204800,"data_stored":70934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574857,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":212992,"data_stored":71094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":811008,"data_stored":661940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-22T07:18:46.624 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-22T07:18:46.624 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-04-22T07:18:46.624 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-04-22T07:18:46.625 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-22T07:18:46.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.763+0000 7f3f5113d640 1 Processor -- start 2024-04-22T07:18:46.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.763+0000 7f3f5113d640 1 -- start start 2024-04-22T07:18:46.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.764+0000 7f3f5113d640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f3f4c06c6a0 0x7f3f4c15b610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:46.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.764+0000 7f3f5113d640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3f4c15ae70 con 0x7f3f4c15bb50 2024-04-22T07:18:46.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.764+0000 7f3f5113d640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3f4c0cc650 con 0x7f3f4c1550b0 2024-04-22T07:18:46.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.764+0000 7f3f5113d640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f3f4c0c5530 con 0x7f3f4c06c6a0 2024-04-22T07:18:46.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.764+0000 7f3f4259c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f3f4c06c6a0 0x7f3f4c15b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:46.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.764+0000 7f3f4b59e640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f3f4c15bb50 0x7f3f4c0d0af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:56624/0 (socket says 172.21.15.37:56624) 2024-04-22T07:18:46.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.764+0000 7f3f4b59e640 1 -- 172.21.15.37:0/3227673753 learned_addr learned my addr 172.21.15.37:0/3227673753 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-04-22T07:18:46.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.764+0000 7f3f4259c640 1 -- 172.21.15.37:0/3227673753 >> v1:172.21.15.196:6789/0 conn(0x7f3f4c1550b0 legacy=0x7f3f4c0cbf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:18:46.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.764+0000 7f3f4259c640 1 -- 172.21.15.37:0/3227673753 >> v1:172.21.15.37:6789/0 conn(0x7f3f4c15bb50 legacy=0x7f3f4c0d0af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:46.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.764+0000 7f3f4259c640 1 -- 172.21.15.37:0/3227673753 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f4c15f290 con 0x7f3f4c06c6a0 2024-04-22T07:18:46.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.765+0000 7f3f4259c640 1 --2- 172.21.15.37:0/3227673753 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f4c06c6a0 0x7f3f4c15b610 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f3f340097a0 tx=0x7f3f3402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d6f7c9c4f00670 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:46.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.765+0000 7f3f4a59c640 1 -- 172.21.15.37:0/3227673753 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f34035020 con 0x7f3f4c06c6a0 2024-04-22T07:18:46.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.765+0000 7f3f4a59c640 1 -- 172.21.15.37:0/3227673753 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f34031830 con 0x7f3f4c06c6a0 2024-04-22T07:18:46.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.765+0000 7f3f4a59c640 1 -- 172.21.15.37:0/3227673753 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f34031c00 con 0x7f3f4c06c6a0 2024-04-22T07:18:46.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.765+0000 7f3f5113d640 1 -- 172.21.15.37:0/3227673753 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f4c06c6a0 msgr2=0x7f3f4c15b610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:46.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.765+0000 7f3f5113d640 1 --2- 172.21.15.37:0/3227673753 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f4c06c6a0 0x7f3f4c15b610 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f3f340097a0 tx=0x7f3f3402b8d0 comp rx=0 tx=0).stop 2024-04-22T07:18:46.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.766+0000 7f3f5113d640 1 -- 172.21.15.37:0/3227673753 shutdown_connections 2024-04-22T07:18:46.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.766+0000 7f3f5113d640 1 --2- 172.21.15.37:0/3227673753 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f4c06c6a0 0x7f3f4c15b610 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:46.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.766+0000 7f3f5113d640 1 -- 172.21.15.37:0/3227673753 >> 172.21.15.37:0/3227673753 conn(0x7f3f4c073630 msgr2=0x7f3f4c073a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:46.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.766+0000 7f3f5113d640 1 -- 172.21.15.37:0/3227673753 shutdown_connections 2024-04-22T07:18:46.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.766+0000 7f3f5113d640 1 -- 172.21.15.37:0/3227673753 wait complete. 2024-04-22T07:18:46.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.767+0000 7f3f5113d640 1 Processor -- start 2024-04-22T07:18:46.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.767+0000 7f3f5113d640 1 -- start start 2024-04-22T07:18:46.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.768+0000 7f3f5113d640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3f4c06c6a0 0x7f3f4c1e5ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:46.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.768+0000 7f3f5113d640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3f4c1550b0 0x7f3f4c14feb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:46.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.768+0000 7f3f5113d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f4c15bb50 0x7f3f4c15d290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:46.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.768+0000 7f3f5113d640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3f4c15b0f0 con 0x7f3f4c15bb50 2024-04-22T07:18:46.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.768+0000 7f3f5113d640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f3f4c0ccbd0 con 0x7f3f4c06c6a0 2024-04-22T07:18:46.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.768+0000 7f3f5113d640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f3f4c155490 con 0x7f3f4c1550b0 2024-04-22T07:18:46.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.768+0000 7f3f4b59e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f4c15bb50 0x7f3f4c15d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:46.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.768+0000 7f3f4b59e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f4c15bb50 0x7f3f4c15d290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54896/0 (socket says 172.21.15.37:54896) 2024-04-22T07:18:46.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.768+0000 7f3f4b59e640 1 -- 172.21.15.37:0/3837080501 learned_addr learned my addr 172.21.15.37:0/3837080501 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:18:46.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.768+0000 7f3f4ad9d640 1 --2- 172.21.15.37:0/3837080501 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3f4c06c6a0 0x7f3f4c1e5ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:46.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.768+0000 7f3f4259c640 1 --2- 172.21.15.37:0/3837080501 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3f4c1550b0 0x7f3f4c14feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:46.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.768+0000 7f3f4b59e640 1 -- 172.21.15.37:0/3837080501 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3f4c1550b0 msgr2=0x7f3f4c14feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:46.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.768+0000 7f3f4b59e640 1 --2- 172.21.15.37:0/3837080501 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3f4c1550b0 0x7f3f4c14feb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:46.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.768+0000 7f3f4b59e640 1 -- 172.21.15.37:0/3837080501 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3f4c06c6a0 msgr2=0x7f3f4c1e5ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:46.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.768+0000 7f3f4b59e640 1 --2- 172.21.15.37:0/3837080501 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3f4c06c6a0 0x7f3f4c1e5ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:46.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.768+0000 7f3f4b59e640 1 -- 172.21.15.37:0/3837080501 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f4c1f07d0 con 0x7f3f4c15bb50 2024-04-22T07:18:46.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.768+0000 7f3f4b59e640 1 --2- 172.21.15.37:0/3837080501 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f4c15bb50 0x7f3f4c15d290 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f3f4400ca80 tx=0x7f3f4400cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:46.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.768+0000 7f3f43fff640 1 -- 172.21.15.37:0/3837080501 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f44017070 con 0x7f3f4c15bb50 2024-04-22T07:18:46.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.768+0000 7f3f43fff640 1 -- 172.21.15.37:0/3837080501 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f4400ac30 con 0x7f3f4c15bb50 2024-04-22T07:18:46.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.769+0000 7f3f5113d640 1 -- 172.21.15.37:0/3837080501 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f4c1f0a90 con 0x7f3f4c15bb50 2024-04-22T07:18:46.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.769+0000 7f3f43fff640 1 -- 172.21.15.37:0/3837080501 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f44012600 con 0x7f3f4c15bb50 2024-04-22T07:18:46.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.769+0000 7f3f5113d640 1 -- 172.21.15.37:0/3837080501 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f4c1f1050 con 0x7f3f4c15bb50 2024-04-22T07:18:46.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.769+0000 7f3f5113d640 1 -- 172.21.15.37:0/3837080501 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f4c069cc0 con 0x7f3f4c15bb50 2024-04-22T07:18:46.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.770+0000 7f3f43fff640 1 -- 172.21.15.37:0/3837080501 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3f4401a070 con 0x7f3f4c15bb50 2024-04-22T07:18:46.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.770+0000 7f3f43fff640 1 --2- 172.21.15.37:0/3837080501 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f3f2c06c8f0 0x7f3f2c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:46.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.770+0000 7f3f43fff640 1 -- 172.21.15.37:0/3837080501 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f3f4408b6f0 con 0x7f3f4c15bb50 2024-04-22T07:18:46.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.771+0000 7f3f4ad9d640 1 --2- 172.21.15.37:0/3837080501 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f3f2c06c8f0 0x7f3f2c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:46.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.771+0000 7f3f4ad9d640 1 --2- 172.21.15.37:0/3837080501 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f3f2c06c8f0 0x7f3f2c06edb0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f3f3c004f60 tx=0x7f3f3c007e30 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:46.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.775+0000 7f3f43fff640 1 -- 172.21.15.37:0/3837080501 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f3f4c15ae70 con 0x7f3f4c15bb50 2024-04-22T07:18:46.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.998+0000 7f3f5113d640 1 -- 172.21.15.37:0/3837080501 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f3f4c1548b0 con 0x7f3f4c15bb50 2024-04-22T07:18:46.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:46.998+0000 7f3f43fff640 1 -- 172.21.15.37:0/3837080501 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f3f4400ae20 con 0x7f3f4c15bb50 2024-04-22T07:18:46.996 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-22T07:18:46.996 INFO:teuthology.orchestra.run.smithi037.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-22T07:18:46.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.000+0000 7f3f5113d640 1 -- 172.21.15.37:0/3837080501 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f3f2c06c8f0 msgr2=0x7f3f2c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:46.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.000+0000 7f3f5113d640 1 --2- 172.21.15.37:0/3837080501 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f3f2c06c8f0 0x7f3f2c06edb0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f3f3c004f60 tx=0x7f3f3c007e30 comp rx=0 tx=0).stop 2024-04-22T07:18:46.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.000+0000 7f3f5113d640 1 -- 172.21.15.37:0/3837080501 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f4c15bb50 msgr2=0x7f3f4c15d290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:46.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.000+0000 7f3f5113d640 1 --2- 172.21.15.37:0/3837080501 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f4c15bb50 0x7f3f4c15d290 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f3f4400ca80 tx=0x7f3f4400cf40 comp rx=0 tx=0).stop 2024-04-22T07:18:46.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.000+0000 7f3f5113d640 1 -- 172.21.15.37:0/3837080501 shutdown_connections 2024-04-22T07:18:46.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.000+0000 7f3f5113d640 1 --2- 172.21.15.37:0/3837080501 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f3f2c06c8f0 0x7f3f2c06edb0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:46.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.000+0000 7f3f5113d640 1 --2- 172.21.15.37:0/3837080501 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f4c15bb50 0x7f3f4c15d290 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:46.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.000+0000 7f3f5113d640 1 --2- 172.21.15.37:0/3837080501 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3f4c1550b0 0x7f3f4c14feb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:46.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.000+0000 7f3f5113d640 1 --2- 172.21.15.37:0/3837080501 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3f4c06c6a0 0x7f3f4c1e5ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:46.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.000+0000 7f3f5113d640 1 -- 172.21.15.37:0/3837080501 >> 172.21.15.37:0/3837080501 conn(0x7f3f4c073630 msgr2=0x7f3f4c0ccfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:46.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.000+0000 7f3f5113d640 1 -- 172.21.15.37:0/3837080501 shutdown_connections 2024-04-22T07:18:46.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.000+0000 7f3f5113d640 1 -- 172.21.15.37:0/3837080501 wait complete. 2024-04-22T07:18:47.009 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-04-22T07:18:47.009 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-22T07:18:47.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.111+0000 7f776e6c8640 1 Processor -- start 2024-04-22T07:18:47.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.111+0000 7f776e6c8640 1 -- start start 2024-04-22T07:18:47.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.112+0000 7f776e6c8640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f77680c84e0 0x7f77680c8c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:47.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.112+0000 7f776e6c8640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77680c6f70 con 0x7f77680c91a0 2024-04-22T07:18:47.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.112+0000 7f776e6c8640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77680c7250 con 0x7f7768152dc0 2024-04-22T07:18:47.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.112+0000 7f776e6c8640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f77680c7530 con 0x7f77680c84e0 2024-04-22T07:18:47.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.112+0000 7f776cc65640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f77680c91a0 0x7f776815c3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:56638/0 (socket says 172.21.15.37:56638) 2024-04-22T07:18:47.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.112+0000 7f776cc65640 1 -- 172.21.15.37:0/1625574678 learned_addr learned my addr 172.21.15.37:0/1625574678 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-04-22T07:18:47.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.112+0000 7f77677fe640 1 --2- 172.21.15.37:0/1625574678 >> v2:172.21.15.196:3300/0 conn(0x7f77680c84e0 0x7f77680c8c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:47.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.112+0000 7f7766ffd640 1 -- 172.21.15.37:0/1625574678 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3413483197 0 0) 0x7f77680c6f70 con 0x7f77680c91a0 2024-04-22T07:18:47.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.112+0000 7f7766ffd640 1 -- 172.21.15.37:0/1625574678 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7750003520 con 0x7f77680c91a0 2024-04-22T07:18:47.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.113+0000 7f7766ffd640 1 -- 172.21.15.37:0/1625574678 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 864708323 0 0) 0x7f7750003520 con 0x7f77680c91a0 2024-04-22T07:18:47.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.113+0000 7f7766ffd640 1 -- 172.21.15.37:0/1625574678 >> v2:172.21.15.196:3300/0 conn(0x7f77680c84e0 msgr2=0x7f77680c8c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:18:47.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.113+0000 7f7766ffd640 1 --2- 172.21.15.37:0/1625574678 >> v2:172.21.15.196:3300/0 conn(0x7f77680c84e0 0x7f77680c8c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:47.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.113+0000 7f7766ffd640 1 -- 172.21.15.37:0/1625574678 >> v1:172.21.15.196:6789/0 conn(0x7f7768152dc0 legacy=0x7f77680c4aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:47.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.113+0000 7f7766ffd640 1 -- 172.21.15.37:0/1625574678 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77680c3800 con 0x7f77680c91a0 2024-04-22T07:18:47.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.113+0000 7f7766ffd640 1 -- 172.21.15.37:0/1625574678 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2576656170 0 0) 0x7f77600019f0 con 0x7f77680c91a0 2024-04-22T07:18:47.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.113+0000 7f7766ffd640 1 -- 172.21.15.37:0/1625574678 >> v1:172.21.15.37:6789/0 conn(0x7f77680c91a0 legacy=0x7f776815c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:47.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.113+0000 7f7766ffd640 1 --2- 172.21.15.37:0/1625574678 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f77500039b0 0x7f7750003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:47.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.113+0000 7f7766ffd640 1 --2- 172.21.15.37:0/1625574678 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7750004800 0x7f7750004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:47.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.113+0000 7f7766ffd640 1 --2- 172.21.15.37:0/1625574678 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f77500051c0 0x7f775000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:47.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.113+0000 7f7766ffd640 1 -- 172.21.15.37:0/1625574678 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f77680c7530 con 0x7f77500039b0 2024-04-22T07:18:47.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.113+0000 7f7766ffd640 1 -- 172.21.15.37:0/1625574678 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f775000c160 con 0x7f77500051c0 2024-04-22T07:18:47.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.113+0000 7f7766ffd640 1 -- 172.21.15.37:0/1625574678 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f775000c360 con 0x7f7750004800 2024-04-22T07:18:47.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.113+0000 7f7767fff640 1 --2- 172.21.15.37:0/1625574678 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f77500039b0 0x7f7750003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:47.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.113+0000 7f776cc65640 1 --2- 172.21.15.37:0/1625574678 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f77500051c0 0x7f775000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:47.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.113+0000 7f77677fe640 1 --2- 172.21.15.37:0/1625574678 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7750004800 0x7f7750004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:47.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.113+0000 7f7767fff640 1 -- 172.21.15.37:0/1625574678 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7750004800 msgr2=0x7f7750004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:18:47.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.113+0000 7f7767fff640 1 --2- 172.21.15.37:0/1625574678 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7750004800 0x7f7750004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:47.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.113+0000 7f7767fff640 1 -- 172.21.15.37:0/1625574678 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f77500051c0 msgr2=0x7f775000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:18:47.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.113+0000 7f7767fff640 1 --2- 172.21.15.37:0/1625574678 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f77500051c0 0x7f775000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:47.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.113+0000 7f7767fff640 1 -- 172.21.15.37:0/1625574678 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7750003520 con 0x7f77500039b0 2024-04-22T07:18:47.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.113+0000 7f776cc65640 1 -- 172.21.15.37:0/1625574678 reap_dead start 2024-04-22T07:18:47.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.114+0000 7f7767fff640 1 --2- 172.21.15.37:0/1625574678 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f77500039b0 0x7f7750003dd0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f775c001750 tx=0x7f7750005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff641a778c7ee6cb server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:47.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.114+0000 7f7766ffd640 1 -- 172.21.15.37:0/1625574678 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f775c001370 con 0x7f77500039b0 2024-04-22T07:18:47.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.114+0000 7f7766ffd640 1 -- 172.21.15.37:0/1625574678 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f775c0052d0 con 0x7f77500039b0 2024-04-22T07:18:47.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.114+0000 7f7766ffd640 1 -- 172.21.15.37:0/1625574678 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f775c003830 con 0x7f77500039b0 2024-04-22T07:18:47.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.115+0000 7f776e6c8640 1 -- 172.21.15.37:0/1625574678 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f77500039b0 msgr2=0x7f7750003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:47.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.115+0000 7f776e6c8640 1 --2- 172.21.15.37:0/1625574678 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f77500039b0 0x7f7750003dd0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f775c001750 tx=0x7f7750005830 comp rx=0 tx=0).stop 2024-04-22T07:18:47.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.115+0000 7f776e6c8640 1 -- 172.21.15.37:0/1625574678 shutdown_connections 2024-04-22T07:18:47.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.115+0000 7f776e6c8640 1 --2- 172.21.15.37:0/1625574678 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f77500039b0 0x7f7750003dd0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:47.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.115+0000 7f776e6c8640 1 -- 172.21.15.37:0/1625574678 >> 172.21.15.37:0/1625574678 conn(0x7f776806b970 msgr2=0x7f776806bd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:47.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.115+0000 7f776e6c8640 1 -- 172.21.15.37:0/1625574678 shutdown_connections 2024-04-22T07:18:47.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.115+0000 7f776e6c8640 1 -- 172.21.15.37:0/1625574678 wait complete. 2024-04-22T07:18:47.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.116+0000 7f776e6c8640 1 Processor -- start 2024-04-22T07:18:47.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.116+0000 7f776e6c8640 1 -- start start 2024-04-22T07:18:47.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.117+0000 7f776e6c8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f77500039b0 0x7f776814a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:47.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.117+0000 7f776e6c8640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f77681f21c0 0x7f77680c4900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:47.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.117+0000 7f776e6c8640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f776814b720 0x7f776814bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:47.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.117+0000 7f776e6c8640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f77680c65e0 con 0x7f77500039b0 2024-04-22T07:18:47.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.117+0000 7f776e6c8640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f77680c3e50 con 0x7f77681f21c0 2024-04-22T07:18:47.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.117+0000 7f776e6c8640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f77681531a0 con 0x7f776814b720 2024-04-22T07:18:47.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.117+0000 7f7767fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f77500039b0 0x7f776814a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:47.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.117+0000 7f7767fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f77500039b0 0x7f776814a2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54910/0 (socket says 172.21.15.37:54910) 2024-04-22T07:18:47.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.117+0000 7f7767fff640 1 -- 172.21.15.37:0/1741752583 learned_addr learned my addr 172.21.15.37:0/1741752583 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:18:47.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.117+0000 7f776cc65640 1 --2- 172.21.15.37:0/1741752583 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f776814b720 0x7f776814bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:47.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.117+0000 7f7767fff640 1 -- 172.21.15.37:0/1741752583 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f776814b720 msgr2=0x7f776814bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:47.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.117+0000 7f7767fff640 1 --2- 172.21.15.37:0/1741752583 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f776814b720 0x7f776814bb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:47.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.117+0000 7f7767fff640 1 -- 172.21.15.37:0/1741752583 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f77681f21c0 msgr2=0x7f77680c4900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:47.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.117+0000 7f7767fff640 1 --2- 172.21.15.37:0/1741752583 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f77681f21c0 0x7f77680c4900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:47.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.117+0000 7f7767fff640 1 -- 172.21.15.37:0/1741752583 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f776814af90 con 0x7f77500039b0 2024-04-22T07:18:47.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.117+0000 7f7767fff640 1 --2- 172.21.15.37:0/1741752583 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f77500039b0 0x7f776814a2f0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f775c034040 tx=0x7f775c001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:47.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.117+0000 7f7764ff9640 1 -- 172.21.15.37:0/1741752583 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f775c041070 con 0x7f77500039b0 2024-04-22T07:18:47.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.117+0000 7f7764ff9640 1 -- 172.21.15.37:0/1741752583 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f775c005480 con 0x7f77500039b0 2024-04-22T07:18:47.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.117+0000 7f776e6c8640 1 -- 172.21.15.37:0/1741752583 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f776814c0c0 con 0x7f77500039b0 2024-04-22T07:18:47.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.117+0000 7f7764ff9640 1 -- 172.21.15.37:0/1741752583 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f775c007a30 con 0x7f77500039b0 2024-04-22T07:18:47.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.118+0000 7f776e6c8640 1 -- 172.21.15.37:0/1741752583 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f776815b4e0 con 0x7f77500039b0 2024-04-22T07:18:47.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.119+0000 7f776e6c8640 1 -- 172.21.15.37:0/1741752583 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7768069cc0 con 0x7f77500039b0 2024-04-22T07:18:47.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.119+0000 7f7764ff9640 1 -- 172.21.15.37:0/1741752583 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f775c044070 con 0x7f77500039b0 2024-04-22T07:18:47.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.119+0000 7f7764ff9640 1 --2- 172.21.15.37:0/1741752583 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f775406c920 0x7f775406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:47.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.120+0000 7f7764ff9640 1 -- 172.21.15.37:0/1741752583 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f775c0ad540 con 0x7f77500039b0 2024-04-22T07:18:47.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.120+0000 7f77677fe640 1 --2- 172.21.15.37:0/1741752583 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f775406c920 0x7f775406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:47.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.120+0000 7f77677fe640 1 --2- 172.21.15.37:0/1741752583 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f775406c920 0x7f775406ede0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f7758006b10 tx=0x7f7758006aa0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:47.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.124+0000 7f7764ff9640 1 -- 172.21.15.37:0/1741752583 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f775c07ba00 con 0x7f77500039b0 2024-04-22T07:18:47.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.312+0000 7f776e6c8640 1 -- 172.21.15.37:0/1741752583 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7768156770 con 0x7f77500039b0 2024-04-22T07:18:47.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.313+0000 7f7764ff9640 1 -- 172.21.15.37:0/1741752583 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16581 (secure 0 0 0) 0x7f775c07b300 con 0x7f77500039b0 2024-04-22T07:18:47.311 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-22T07:18:47.311 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":20,"fsid":"10d90a41-52d3-4e09-8022-c8ac67897ad1","created":"2024-04-22T07:18:12.420756+0000","modified":"2024-04-22T07:18:37.754119+0000","last_up_change":"2024-04-22T07:18:23.649808+0000","last_in_change":"2024-04-22T07:18:14.506974+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-22T07:18:24.602243+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-22T07:18:34.673639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-22T07:18:35.055184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e248f6e1-13ad-48e0-a8f8-ec3059995654","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":1488290385},{"type":"v1","addr":"172.21.15.37:6801","nonce":1488290385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1488290385},{"type":"v1","addr":"172.21.15.37:6803","nonce":1488290385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1488290385},{"type":"v1","addr":"172.21.15.37:6807","nonce":1488290385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1488290385},{"type":"v1","addr":"172.21.15.37:6805","nonce":1488290385}]},"public_addr":"172.21.15.37:6801/1488290385","cluster_addr":"172.21.15.37:6803/1488290385","heartbeat_back_addr":"172.21.15.37:6807/1488290385","heartbeat_front_addr":"172.21.15.37:6805/1488290385","state":["exists","up"]},{"osd":1,"uuid":"01c71ab7-1326-432b-b73a-e5847abe5132","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3918584183},{"type":"v1","addr":"172.21.15.37:6811","nonce":3918584183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6813","nonce":3918584183},{"type":"v1","addr":"172.21.15.37:6816","nonce":3918584183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":3918584183},{"type":"v1","addr":"172.21.15.37:6823","nonce":3918584183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":3918584183},{"type":"v1","addr":"172.21.15.37:6821","nonce":3918584183}]},"public_addr":"172.21.15.37:6811/3918584183","cluster_addr":"172.21.15.37:6816/3918584183","heartbeat_back_addr":"172.21.15.37:6823/3918584183","heartbeat_front_addr":"172.21.15.37:6821/3918584183","state":["exists","up"]},{"osd":2,"uuid":"33a780fd-013a-41c8-9970-136c9e080897","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1895439419},{"type":"v1","addr":"172.21.15.37:6825","nonce":1895439419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1895439419},{"type":"v1","addr":"172.21.15.37:6827","nonce":1895439419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1895439419},{"type":"v1","addr":"172.21.15.37:6831","nonce":1895439419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1895439419},{"type":"v1","addr":"172.21.15.37:6829","nonce":1895439419}]},"public_addr":"172.21.15.37:6825/1895439419","cluster_addr":"172.21.15.37:6827/1895439419","heartbeat_back_addr":"172.21.15.37:6831/1895439419","heartbeat_front_addr":"172.21.15.37:6829/1895439419","state":["exists","up"]},{"osd":3,"uuid":"b46e53c4-e5b9-4098-b243-ab5a0f1f3885","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6809","nonce":1160021017},{"type":"v1","addr":"172.21.15.37:6810","nonce":1160021017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1160021017},{"type":"v1","addr":"172.21.15.37:6814","nonce":1160021017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":1160021017},{"type":"v1","addr":"172.21.15.37:6820","nonce":1160021017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6815","nonce":1160021017},{"type":"v1","addr":"172.21.15.37:6817","nonce":1160021017}]},"public_addr":"172.21.15.37:6810/1160021017","cluster_addr":"172.21.15.37:6814/1160021017","heartbeat_back_addr":"172.21.15.37:6820/1160021017","heartbeat_front_addr":"172.21.15.37:6817/1160021017","state":["exists","up"]},{"osd":4,"uuid":"cd1032c6-6a83-4e33-b7b1-baddf92a83af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":374829049},{"type":"v1","addr":"172.21.15.196:6809","nonce":374829049}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":374829049},{"type":"v1","addr":"172.21.15.196:6811","nonce":374829049}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":374829049},{"type":"v1","addr":"172.21.15.196:6815","nonce":374829049}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":374829049},{"type":"v1","addr":"172.21.15.196:6813","nonce":374829049}]},"public_addr":"172.21.15.196:6809/374829049","cluster_addr":"172.21.15.196:6811/374829049","heartbeat_back_addr":"172.21.15.196:6815/374829049","heartbeat_front_addr":"172.21.15.196:6813/374829049","state":["exists","up"]},{"osd":5,"uuid":"f561d48a-5f2d-4deb-8681-4329aed36bae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":479311302},{"type":"v1","addr":"172.21.15.196:6801","nonce":479311302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":479311302},{"type":"v1","addr":"172.21.15.196:6803","nonce":479311302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":479311302},{"type":"v1","addr":"172.21.15.196:6807","nonce":479311302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":479311302},{"type":"v1","addr":"172.21.15.196:6805","nonce":479311302}]},"public_addr":"172.21.15.196:6801/479311302","cluster_addr":"172.21.15.196:6803/479311302","heartbeat_back_addr":"172.21.15.196:6807/479311302","heartbeat_front_addr":"172.21.15.196:6805/479311302","state":["exists","up"]},{"osd":6,"uuid":"1b239c7e-2504-42e0-b308-70f4e62519c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6817","nonce":691777224},{"type":"v1","addr":"172.21.15.196:6819","nonce":691777224}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6821","nonce":691777224},{"type":"v1","addr":"172.21.15.196:6823","nonce":691777224}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6829","nonce":691777224},{"type":"v1","addr":"172.21.15.196:6831","nonce":691777224}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6825","nonce":691777224},{"type":"v1","addr":"172.21.15.196:6827","nonce":691777224}]},"public_addr":"172.21.15.196:6819/691777224","cluster_addr":"172.21.15.196:6823/691777224","heartbeat_back_addr":"172.21.15.196:6831/691777224","heartbeat_front_addr":"172.21.15.196:6827/691777224","state":["exists","up"]},{"osd":7,"uuid":"084318d4-d1fd-4b58-8c33-b1d7856fe323","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":3106266066},{"type":"v1","addr":"172.21.15.196:6818","nonce":3106266066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":3106266066},{"type":"v1","addr":"172.21.15.196:6822","nonce":3106266066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":3106266066},{"type":"v1","addr":"172.21.15.196:6830","nonce":3106266066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":3106266066},{"type":"v1","addr":"172.21.15.196:6826","nonce":3106266066}]},"public_addr":"172.21.15.196:6818/3106266066","cluster_addr":"172.21.15.196:6822/3106266066","heartbeat_back_addr":"172.21.15.196:6830/3106266066","heartbeat_front_addr":"172.21.15.196:6826/3106266066","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:18:19.587791+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:18:19.706541+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:18:19.690674+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:18:19.648354+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:18:19.666671+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:18:19.560709+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:18:19.661412+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:18:19.770650+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-22T07:18:47.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.315+0000 7f776e6c8640 1 -- 172.21.15.37:0/1741752583 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f775406c920 msgr2=0x7f775406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:47.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.315+0000 7f776e6c8640 1 --2- 172.21.15.37:0/1741752583 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f775406c920 0x7f775406ede0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f7758006b10 tx=0x7f7758006aa0 comp rx=0 tx=0).stop 2024-04-22T07:18:47.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.315+0000 7f776e6c8640 1 -- 172.21.15.37:0/1741752583 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f77500039b0 msgr2=0x7f776814a2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:47.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.315+0000 7f776e6c8640 1 --2- 172.21.15.37:0/1741752583 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f77500039b0 0x7f776814a2f0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f775c034040 tx=0x7f775c001120 comp rx=0 tx=0).stop 2024-04-22T07:18:47.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.315+0000 7f776e6c8640 1 -- 172.21.15.37:0/1741752583 shutdown_connections 2024-04-22T07:18:47.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.315+0000 7f776e6c8640 1 --2- 172.21.15.37:0/1741752583 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f775406c920 0x7f775406ede0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:47.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.315+0000 7f776e6c8640 1 --2- 172.21.15.37:0/1741752583 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f776814b720 0x7f776814bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:47.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.315+0000 7f776e6c8640 1 --2- 172.21.15.37:0/1741752583 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f77681f21c0 0x7f77680c4900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:47.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.315+0000 7f776e6c8640 1 --2- 172.21.15.37:0/1741752583 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f77500039b0 0x7f776814a2f0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:47.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.315+0000 7f776e6c8640 1 -- 172.21.15.37:0/1741752583 >> 172.21.15.37:0/1741752583 conn(0x7f776806b970 msgr2=0x7f77680ccb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:47.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.315+0000 7f776e6c8640 1 -- 172.21.15.37:0/1741752583 shutdown_connections 2024-04-22T07:18:47.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.315+0000 7f776e6c8640 1 -- 172.21.15.37:0/1741752583 wait complete. 2024-04-22T07:18:47.325 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-22T07:18:24.602243+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-22T07:18:34.673639+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-22T07:18:35.055184+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-22T07:18:47.325 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-22T07:18:47.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.430+0000 7ff1dc359640 1 Processor -- start 2024-04-22T07:18:47.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.430+0000 7ff1dc359640 1 -- start start 2024-04-22T07:18:47.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.431+0000 7ff1dc359640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7ff1d4155200 0x7ff1d406f860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:47.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.431+0000 7ff1dc359640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff1d415e2e0 0x7ff1d415b420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:47.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.431+0000 7ff1dc359640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff1d406fda0 0x7ff1d415b960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:47.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.431+0000 7ff1dc359640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7ff1d406f010 con 0x7ff1d406fda0 2024-04-22T07:18:47.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.431+0000 7ff1dc359640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7ff1d415e7b0 con 0x7ff1d4155200 2024-04-22T07:18:47.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.431+0000 7ff1dc359640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7ff1d415ea90 con 0x7ff1d415e2e0 2024-04-22T07:18:47.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.432+0000 7ff1da8f6640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff1d406fda0 0x7ff1d415b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:47.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.432+0000 7ff1da8f6640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff1d406fda0 0x7ff1d415b960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54912/0 (socket says 172.21.15.37:54912) 2024-04-22T07:18:47.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.432+0000 7ff1da8f6640 1 -- 172.21.15.37:0/1853589083 learned_addr learned my addr 172.21.15.37:0/1853589083 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:18:47.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.432+0000 7ff1d98f4640 1 --2- 172.21.15.37:0/1853589083 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff1d415e2e0 0x7ff1d415b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:47.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.432+0000 7ff1da0f5640 1 --2- 172.21.15.37:0/1853589083 >> v2:172.21.15.196:3300/0 conn(0x7ff1d4155200 0x7ff1d406f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:47.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.432+0000 7ff1da8f6640 1 -- 172.21.15.37:0/1853589083 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff1d415e2e0 msgr2=0x7ff1d415b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:18:47.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.432+0000 7ff1da8f6640 1 --2- 172.21.15.37:0/1853589083 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff1d415e2e0 0x7ff1d415b420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:47.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.432+0000 7ff1da8f6640 1 -- 172.21.15.37:0/1853589083 >> v2:172.21.15.196:3300/0 conn(0x7ff1d4155200 msgr2=0x7ff1d406f860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:18:47.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.432+0000 7ff1da8f6640 1 --2- 172.21.15.37:0/1853589083 >> v2:172.21.15.196:3300/0 conn(0x7ff1d4155200 0x7ff1d406f860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:47.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.432+0000 7ff1da8f6640 1 -- 172.21.15.37:0/1853589083 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1d415ed70 con 0x7ff1d406fda0 2024-04-22T07:18:47.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.432+0000 7ff1da0f5640 1 --2- 172.21.15.37:0/1853589083 >> v2:172.21.15.196:3300/0 conn(0x7ff1d4155200 0x7ff1d406f860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-22T07:18:47.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.433+0000 7ff1da8f6640 1 --2- 172.21.15.37:0/1853589083 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff1d406fda0 0x7ff1d415b960 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7ff1d406ebd0 tx=0x7ff1c402bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da52ee420be81583 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:47.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.433+0000 7ff1d90f3640 1 -- 172.21.15.37:0/1853589083 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1c402cb00 con 0x7ff1d406fda0 2024-04-22T07:18:47.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.433+0000 7ff1d90f3640 1 -- 172.21.15.37:0/1853589083 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1c402cca0 con 0x7ff1d406fda0 2024-04-22T07:18:47.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.433+0000 7ff1d90f3640 1 -- 172.21.15.37:0/1853589083 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1c4034610 con 0x7ff1d406fda0 2024-04-22T07:18:47.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.433+0000 7ff1dc359640 1 -- 172.21.15.37:0/1853589083 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff1d406fda0 msgr2=0x7ff1d415b960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:47.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.433+0000 7ff1dc359640 1 --2- 172.21.15.37:0/1853589083 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff1d406fda0 0x7ff1d415b960 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7ff1d406ebd0 tx=0x7ff1c402bf60 comp rx=0 tx=0).stop 2024-04-22T07:18:47.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.433+0000 7ff1dc359640 1 -- 172.21.15.37:0/1853589083 shutdown_connections 2024-04-22T07:18:47.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.433+0000 7ff1dc359640 1 --2- 172.21.15.37:0/1853589083 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff1d415e2e0 0x7ff1d415b420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:47.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.433+0000 7ff1dc359640 1 --2- 172.21.15.37:0/1853589083 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff1d406fda0 0x7ff1d415b960 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:47.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.433+0000 7ff1dc359640 1 --2- 172.21.15.37:0/1853589083 >> v2:172.21.15.196:3300/0 conn(0x7ff1d4155200 0x7ff1d406f860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:47.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.433+0000 7ff1dc359640 1 -- 172.21.15.37:0/1853589083 >> 172.21.15.37:0/1853589083 conn(0x7ff1d4067d90 msgr2=0x7ff1d406db80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:47.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.433+0000 7ff1dc359640 1 -- 172.21.15.37:0/1853589083 shutdown_connections 2024-04-22T07:18:47.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.433+0000 7ff1dc359640 1 -- 172.21.15.37:0/1853589083 wait complete. 2024-04-22T07:18:47.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.435+0000 7ff1dc359640 1 Processor -- start 2024-04-22T07:18:47.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.435+0000 7ff1dc359640 1 -- start start 2024-04-22T07:18:47.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.435+0000 7ff1dc359640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff1d406fda0 0x7ff1d4159590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:47.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.435+0000 7ff1dc359640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff1d4155200 0x7ff1d4153300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:47.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.435+0000 7ff1dc359640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff1d415e2e0 0x7ff1d4153840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:47.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.435+0000 7ff1dc359640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff1d40ce310 con 0x7ff1d4155200 2024-04-22T07:18:47.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.435+0000 7ff1dc359640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7ff1d415af00 con 0x7ff1d406fda0 2024-04-22T07:18:47.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.435+0000 7ff1dc359640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7ff1d40ce490 con 0x7ff1d415e2e0 2024-04-22T07:18:47.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.435+0000 7ff1d98f4640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff1d4155200 0x7ff1d4153300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:47.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.435+0000 7ff1d98f4640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff1d4155200 0x7ff1d4153300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54926/0 (socket says 172.21.15.37:54926) 2024-04-22T07:18:47.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.435+0000 7ff1d98f4640 1 -- 172.21.15.37:0/2073938018 learned_addr learned my addr 172.21.15.37:0/2073938018 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:18:47.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.436+0000 7ff1da8f6640 1 --2- 172.21.15.37:0/2073938018 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff1d415e2e0 0x7ff1d4153840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:47.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.436+0000 7ff1da0f5640 1 --2- 172.21.15.37:0/2073938018 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff1d406fda0 0x7ff1d4159590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:47.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.436+0000 7ff1d98f4640 1 -- 172.21.15.37:0/2073938018 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff1d415e2e0 msgr2=0x7ff1d4153840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:47.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.436+0000 7ff1d98f4640 1 --2- 172.21.15.37:0/2073938018 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff1d415e2e0 0x7ff1d4153840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:47.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.436+0000 7ff1d98f4640 1 -- 172.21.15.37:0/2073938018 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff1d406fda0 msgr2=0x7ff1d4159590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:47.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.436+0000 7ff1d98f4640 1 --2- 172.21.15.37:0/2073938018 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff1d406fda0 0x7ff1d4159590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:47.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.436+0000 7ff1d98f4640 1 -- 172.21.15.37:0/2073938018 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1d41f25f0 con 0x7ff1d4155200 2024-04-22T07:18:47.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.436+0000 7ff1d98f4640 1 --2- 172.21.15.37:0/2073938018 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff1d4155200 0x7ff1d4153300 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7ff1c800d5c0 tx=0x7ff1c800da80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:47.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.436+0000 7ff1d2ffd640 1 -- 172.21.15.37:0/2073938018 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1c80125f0 con 0x7ff1d4155200 2024-04-22T07:18:47.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.436+0000 7ff1d2ffd640 1 -- 172.21.15.37:0/2073938018 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1c8019070 con 0x7ff1d4155200 2024-04-22T07:18:47.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.436+0000 7ff1dc359640 1 -- 172.21.15.37:0/2073938018 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1d41545b0 con 0x7ff1d4155200 2024-04-22T07:18:47.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.436+0000 7ff1d2ffd640 1 -- 172.21.15.37:0/2073938018 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1c80129d0 con 0x7ff1d4155200 2024-04-22T07:18:47.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.436+0000 7ff1dc359640 1 -- 172.21.15.37:0/2073938018 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1d4158d90 con 0x7ff1d4155200 2024-04-22T07:18:47.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.437+0000 7ff1dc359640 1 -- 172.21.15.37:0/2073938018 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1d40cea70 con 0x7ff1d4155200 2024-04-22T07:18:47.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.437+0000 7ff1d2ffd640 1 -- 172.21.15.37:0/2073938018 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff1c8012b70 con 0x7ff1d4155200 2024-04-22T07:18:47.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.438+0000 7ff1d2ffd640 1 --2- 172.21.15.37:0/2073938018 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7ff1c006c8f0 0x7ff1c006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:47.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.438+0000 7ff1d2ffd640 1 -- 172.21.15.37:0/2073938018 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7ff1c808be50 con 0x7ff1d4155200 2024-04-22T07:18:47.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.438+0000 7ff1da0f5640 1 --2- 172.21.15.37:0/2073938018 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7ff1c006c8f0 0x7ff1c006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:47.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.438+0000 7ff1da0f5640 1 --2- 172.21.15.37:0/2073938018 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7ff1c006c8f0 0x7ff1c006edb0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ff1cc006fd0 tx=0x7ff1cc008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:47.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.442+0000 7ff1d2ffd640 1 -- 172.21.15.37:0/2073938018 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ff1d40cea70 con 0x7ff1d4155200 2024-04-22T07:18:47.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.629+0000 7ff1dc359640 1 -- 172.21.15.37:0/2073938018 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7ff1d40cd930 con 0x7ff1d4155200 2024-04-22T07:18:47.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.629+0000 7ff1d2ffd640 1 -- 172.21.15.37:0/2073938018 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7ff1c805a310 con 0x7ff1d4155200 2024-04-22T07:18:47.627 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2024-04-22T07:18:47.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.631+0000 7ff1dc359640 1 -- 172.21.15.37:0/2073938018 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7ff1c006c8f0 msgr2=0x7ff1c006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:47.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.631+0000 7ff1dc359640 1 --2- 172.21.15.37:0/2073938018 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7ff1c006c8f0 0x7ff1c006edb0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ff1cc006fd0 tx=0x7ff1cc008040 comp rx=0 tx=0).stop 2024-04-22T07:18:47.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.631+0000 7ff1dc359640 1 -- 172.21.15.37:0/2073938018 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff1d4155200 msgr2=0x7ff1d4153300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:47.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.631+0000 7ff1dc359640 1 --2- 172.21.15.37:0/2073938018 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff1d4155200 0x7ff1d4153300 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7ff1c800d5c0 tx=0x7ff1c800da80 comp rx=0 tx=0).stop 2024-04-22T07:18:47.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.631+0000 7ff1dc359640 1 -- 172.21.15.37:0/2073938018 shutdown_connections 2024-04-22T07:18:47.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.631+0000 7ff1dc359640 1 --2- 172.21.15.37:0/2073938018 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7ff1c006c8f0 0x7ff1c006edb0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:47.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.631+0000 7ff1dc359640 1 --2- 172.21.15.37:0/2073938018 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff1d415e2e0 0x7ff1d4153840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:47.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.631+0000 7ff1dc359640 1 --2- 172.21.15.37:0/2073938018 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff1d4155200 0x7ff1d4153300 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:47.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.631+0000 7ff1dc359640 1 --2- 172.21.15.37:0/2073938018 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff1d406fda0 0x7ff1d4159590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:47.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.631+0000 7ff1dc359640 1 -- 172.21.15.37:0/2073938018 >> 172.21.15.37:0/2073938018 conn(0x7ff1d4067d90 msgr2=0x7ff1d40cc840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:47.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.631+0000 7ff1dc359640 1 -- 172.21.15.37:0/2073938018 shutdown_connections 2024-04-22T07:18:47.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.631+0000 7ff1dc359640 1 -- 172.21.15.37:0/2073938018 wait complete. 2024-04-22T07:18:47.640 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-22T07:18:47.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.745+0000 7febffe26640 1 Processor -- start 2024-04-22T07:18:47.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.745+0000 7febffe26640 1 -- start start 2024-04-22T07:18:47.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.746+0000 7febffe26640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7febf80cb0b0 0x7febf80cc460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:47.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.746+0000 7febffe26640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7febf81555d0 con 0x7febf80cde00 2024-04-22T07:18:47.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.746+0000 7febffe26640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7febf80ccbc0 con 0x7febf81551f0 2024-04-22T07:18:47.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.746+0000 7febffe26640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7febf80cc9a0 con 0x7febf80cb0b0 2024-04-22T07:18:47.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.746+0000 7febfe3c3640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7febf80cb0b0 0x7febf80cc460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:47.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.746+0000 7febfd3c1640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7febf80cde00 0x7febf80730c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:56642/0 (socket says 172.21.15.37:56642) 2024-04-22T07:18:47.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.746+0000 7febfd3c1640 1 -- 172.21.15.37:0/3917525566 learned_addr learned my addr 172.21.15.37:0/3917525566 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-04-22T07:18:47.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.747+0000 7febfe3c3640 1 -- 172.21.15.37:0/3917525566 >> v1:172.21.15.196:6789/0 conn(0x7febf81551f0 legacy=0x7febf815e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:18:47.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.747+0000 7febfe3c3640 1 -- 172.21.15.37:0/3917525566 >> v1:172.21.15.37:6789/0 conn(0x7febf80cde00 legacy=0x7febf80730c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:47.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.747+0000 7febfcbc0640 1 -- 172.21.15.37:0/3917525566 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2084483886 0 0) 0x7febf81555d0 con 0x7febf80cde00 2024-04-22T07:18:47.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.747+0000 7febfe3c3640 1 -- 172.21.15.37:0/3917525566 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febf80ccea0 con 0x7febf80cb0b0 2024-04-22T07:18:47.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.747+0000 7febfe3c3640 1 --2- 172.21.15.37:0/3917525566 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7febf80cb0b0 0x7febf80cc460 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7febf4009d90 tx=0x7febf402bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f0086001abb1a3a server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:47.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.748+0000 7febfcbc0640 1 -- 172.21.15.37:0/3917525566 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febf4039070 con 0x7febf80cb0b0 2024-04-22T07:18:47.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.748+0000 7febfcbc0640 1 -- 172.21.15.37:0/3917525566 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7febf402cd00 con 0x7febf80cb0b0 2024-04-22T07:18:47.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.748+0000 7febfcbc0640 1 -- 172.21.15.37:0/3917525566 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febf4034660 con 0x7febf80cb0b0 2024-04-22T07:18:47.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.748+0000 7febffe26640 1 -- 172.21.15.37:0/3917525566 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7febf80cb0b0 msgr2=0x7febf80cc460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:47.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.748+0000 7febffe26640 1 --2- 172.21.15.37:0/3917525566 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7febf80cb0b0 0x7febf80cc460 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7febf4009d90 tx=0x7febf402bf50 comp rx=0 tx=0).stop 2024-04-22T07:18:47.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.748+0000 7febffe26640 1 -- 172.21.15.37:0/3917525566 shutdown_connections 2024-04-22T07:18:47.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.748+0000 7febffe26640 1 --2- 172.21.15.37:0/3917525566 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7febf80cb0b0 0x7febf80cc460 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:47.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.748+0000 7febffe26640 1 -- 172.21.15.37:0/3917525566 >> 172.21.15.37:0/3917525566 conn(0x7febf806c410 msgr2=0x7febf80676b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:47.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.748+0000 7febffe26640 1 -- 172.21.15.37:0/3917525566 shutdown_connections 2024-04-22T07:18:47.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.748+0000 7febffe26640 1 -- 172.21.15.37:0/3917525566 wait complete. 2024-04-22T07:18:47.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.749+0000 7febffe26640 1 Processor -- start 2024-04-22T07:18:47.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.749+0000 7febffe26640 1 -- start start 2024-04-22T07:18:47.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.750+0000 7febffe26640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7febf80cb0b0 0x7febf8146d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:47.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.750+0000 7febffe26640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7febf80cde00 0x7febf80c59e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:47.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.750+0000 7febffe26640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7febf81551f0 0x7febf80c5f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:47.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.750+0000 7febffe26640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7febf815b5c0 con 0x7febf81551f0 2024-04-22T07:18:47.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.750+0000 7febffe26640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7febf815b2e0 con 0x7febf80cb0b0 2024-04-22T07:18:47.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.750+0000 7febffe26640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7febf815b8a0 con 0x7febf80cde00 2024-04-22T07:18:47.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.750+0000 7febfe3c3640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7febf81551f0 0x7febf80c5f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:47.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.750+0000 7febfe3c3640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7febf81551f0 0x7febf80c5f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54942/0 (socket says 172.21.15.37:54942) 2024-04-22T07:18:47.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.750+0000 7febfe3c3640 1 -- 172.21.15.37:0/1035706928 learned_addr learned my addr 172.21.15.37:0/1035706928 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:18:47.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.750+0000 7febfd3c1640 1 --2- 172.21.15.37:0/1035706928 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7febf80cde00 0x7febf80c59e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:47.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.750+0000 7febfdbc2640 1 --2- 172.21.15.37:0/1035706928 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7febf80cb0b0 0x7febf8146d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:47.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.750+0000 7febfe3c3640 1 -- 172.21.15.37:0/1035706928 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7febf80cde00 msgr2=0x7febf80c59e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:47.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.750+0000 7febfe3c3640 1 --2- 172.21.15.37:0/1035706928 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7febf80cde00 0x7febf80c59e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:47.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.750+0000 7febfe3c3640 1 -- 172.21.15.37:0/1035706928 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7febf80cb0b0 msgr2=0x7febf8146d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:47.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.750+0000 7febfe3c3640 1 --2- 172.21.15.37:0/1035706928 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7febf80cb0b0 0x7febf8146d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:47.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.750+0000 7febfe3c3640 1 -- 172.21.15.37:0/1035706928 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febf8147290 con 0x7febf81551f0 2024-04-22T07:18:47.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.751+0000 7febfe3c3640 1 --2- 172.21.15.37:0/1035706928 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7febf81551f0 0x7febf80c5f20 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7febf4009eb0 tx=0x7febf4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:47.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.751+0000 7febee7fc640 1 -- 172.21.15.37:0/1035706928 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febf4044020 con 0x7febf81551f0 2024-04-22T07:18:47.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.751+0000 7febee7fc640 1 -- 172.21.15.37:0/1035706928 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7febf403f470 con 0x7febf81551f0 2024-04-22T07:18:47.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.751+0000 7febffe26640 1 -- 172.21.15.37:0/1035706928 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7febf81f3ea0 con 0x7febf81551f0 2024-04-22T07:18:47.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.751+0000 7febee7fc640 1 -- 172.21.15.37:0/1035706928 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febf4039040 con 0x7febf81551f0 2024-04-22T07:18:47.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.751+0000 7febffe26640 1 -- 172.21.15.37:0/1035706928 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7febf81531b0 con 0x7febf81551f0 2024-04-22T07:18:47.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.752+0000 7febffe26640 1 -- 172.21.15.37:0/1035706928 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7febf806cc80 con 0x7febf81551f0 2024-04-22T07:18:47.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.752+0000 7febee7fc640 1 -- 172.21.15.37:0/1035706928 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7febf4047020 con 0x7febf81551f0 2024-04-22T07:18:47.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.753+0000 7febee7fc640 1 --2- 172.21.15.37:0/1035706928 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7febdc06c920 0x7febdc06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:47.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.753+0000 7febee7fc640 1 -- 172.21.15.37:0/1035706928 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7febf40ae7e0 con 0x7febf81551f0 2024-04-22T07:18:47.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.753+0000 7febfdbc2640 1 --2- 172.21.15.37:0/1035706928 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7febdc06c920 0x7febdc06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:47.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.754+0000 7febfdbc2640 1 --2- 172.21.15.37:0/1035706928 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7febdc06c920 0x7febdc06ede0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7febf0006fd0 tx=0x7febf0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:47.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.757+0000 7febee7fc640 1 -- 172.21.15.37:0/1035706928 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7febf806cc80 con 0x7febf81551f0 2024-04-22T07:18:47.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.942+0000 7febffe26640 1 -- 172.21.15.37:0/1035706928 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7febf8069cc0 con 0x7febf81551f0 2024-04-22T07:18:47.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.942+0000 7febee7fc640 1 -- 172.21.15.37:0/1035706928 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7febf404e030 con 0x7febf81551f0 2024-04-22T07:18:47.940 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2024-04-22T07:18:47.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.944+0000 7febffe26640 1 -- 172.21.15.37:0/1035706928 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7febdc06c920 msgr2=0x7febdc06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:47.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.944+0000 7febffe26640 1 --2- 172.21.15.37:0/1035706928 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7febdc06c920 0x7febdc06ede0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7febf0006fd0 tx=0x7febf0008040 comp rx=0 tx=0).stop 2024-04-22T07:18:47.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.944+0000 7febffe26640 1 -- 172.21.15.37:0/1035706928 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7febf81551f0 msgr2=0x7febf80c5f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:47.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.944+0000 7febffe26640 1 --2- 172.21.15.37:0/1035706928 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7febf81551f0 0x7febf80c5f20 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7febf4009eb0 tx=0x7febf4004a40 comp rx=0 tx=0).stop 2024-04-22T07:18:47.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.944+0000 7febffe26640 1 -- 172.21.15.37:0/1035706928 shutdown_connections 2024-04-22T07:18:47.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.944+0000 7febffe26640 1 --2- 172.21.15.37:0/1035706928 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7febdc06c920 0x7febdc06ede0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:47.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.944+0000 7febffe26640 1 --2- 172.21.15.37:0/1035706928 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7febf81551f0 0x7febf80c5f20 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:47.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.944+0000 7febffe26640 1 --2- 172.21.15.37:0/1035706928 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7febf80cde00 0x7febf80c59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:47.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.944+0000 7febffe26640 1 --2- 172.21.15.37:0/1035706928 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7febf80cb0b0 0x7febf8146d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:47.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.944+0000 7febffe26640 1 -- 172.21.15.37:0/1035706928 >> 172.21.15.37:0/1035706928 conn(0x7febf806c410 msgr2=0x7febf8149c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:47.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.944+0000 7febffe26640 1 -- 172.21.15.37:0/1035706928 shutdown_connections 2024-04-22T07:18:47.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:47.944+0000 7febffe26640 1 -- 172.21.15.37:0/1035706928 wait complete. 2024-04-22T07:18:47.953 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-22T07:18:48.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.059+0000 7fe886681640 1 Processor -- start 2024-04-22T07:18:48.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.059+0000 7fe886681640 1 -- start start 2024-04-22T07:18:48.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.059+0000 7fe886681640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe8801552e0 0x7fe8800c6000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:48.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.059+0000 7fe886681640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8800c69b0 con 0x7fe8800cb030 2024-04-22T07:18:48.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.059+0000 7fe886681640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8800c66d0 con 0x7fe8800cdd80 2024-04-22T07:18:48.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.059+0000 7fe886681640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fe8801556c0 con 0x7fe8801552e0 2024-04-22T07:18:48.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.060+0000 7fe87ffff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe8801552e0 0x7fe8800c6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:48.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.060+0000 7fe87ffff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe8801552e0 0x7fe8800c6000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54954/0 (socket says 172.21.15.37:54954) 2024-04-22T07:18:48.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.060+0000 7fe87ffff640 1 -- 172.21.15.37:0/240609513 learned_addr learned my addr 172.21.15.37:0/240609513 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:18:48.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.060+0000 7fe87ffff640 1 -- 172.21.15.37:0/240609513 >> v1:172.21.15.196:6789/0 conn(0x7fe8800cdd80 legacy=0x7fe88015b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:18:48.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.060+0000 7fe87ffff640 1 -- 172.21.15.37:0/240609513 >> v1:172.21.15.37:6789/0 conn(0x7fe8800cb030 legacy=0x7fe8800676b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:48.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.060+0000 7fe87ffff640 1 -- 172.21.15.37:0/240609513 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8800cc580 con 0x7fe8801552e0 2024-04-22T07:18:48.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.060+0000 7fe87effd640 1 -- 172.21.15.37:0/240609513 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3096600099 0 0) 0x7fe8800c69b0 con 0x7fe8800cb030 2024-04-22T07:18:48.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.061+0000 7fe87ffff640 1 --2- 172.21.15.37:0/240609513 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe8801552e0 0x7fe8800c6000 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fe870009870 tx=0x7fe87002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=811eb3ba88dab366 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:48.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.061+0000 7fe87effd640 1 -- 172.21.15.37:0/240609513 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe870034070 con 0x7fe8801552e0 2024-04-22T07:18:48.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.061+0000 7fe87effd640 1 -- 172.21.15.37:0/240609513 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe870030860 con 0x7fe8801552e0 2024-04-22T07:18:48.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.061+0000 7fe87effd640 1 -- 172.21.15.37:0/240609513 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe870030c30 con 0x7fe8801552e0 2024-04-22T07:18:48.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.061+0000 7fe886681640 1 -- 172.21.15.37:0/240609513 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe8801552e0 msgr2=0x7fe8800c6000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:48.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.061+0000 7fe886681640 1 --2- 172.21.15.37:0/240609513 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe8801552e0 0x7fe8800c6000 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fe870009870 tx=0x7fe87002b9a0 comp rx=0 tx=0).stop 2024-04-22T07:18:48.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.061+0000 7fe886681640 1 -- 172.21.15.37:0/240609513 shutdown_connections 2024-04-22T07:18:48.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.061+0000 7fe886681640 1 --2- 172.21.15.37:0/240609513 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe8801552e0 0x7fe8800c6000 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:48.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.061+0000 7fe886681640 1 -- 172.21.15.37:0/240609513 >> 172.21.15.37:0/240609513 conn(0x7fe88006d330 msgr2=0x7fe88006c290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:48.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.061+0000 7fe886681640 1 -- 172.21.15.37:0/240609513 shutdown_connections 2024-04-22T07:18:48.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.061+0000 7fe886681640 1 -- 172.21.15.37:0/240609513 wait complete. 2024-04-22T07:18:48.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.063+0000 7fe886681640 1 Processor -- start 2024-04-22T07:18:48.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.063+0000 7fe886681640 1 -- start start 2024-04-22T07:18:48.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.063+0000 7fe886681640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe8800cb030 0x7fe880157580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:48.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.063+0000 7fe886681640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe8800cdd80 0x7fe88015e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:48.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.063+0000 7fe886681640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe8801552e0 0x7fe88015ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:48.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.063+0000 7fe886681640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe8800cce20 con 0x7fe8801552e0 2024-04-22T07:18:48.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.063+0000 7fe886681640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fe8800ccb40 con 0x7fe8800cb030 2024-04-22T07:18:48.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.063+0000 7fe886681640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fe880067dc0 con 0x7fe8800cdd80 2024-04-22T07:18:48.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.064+0000 7fe884c1e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe8801552e0 0x7fe88015ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:48.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.064+0000 7fe884c1e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe8801552e0 0x7fe88015ebf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54958/0 (socket says 172.21.15.37:54958) 2024-04-22T07:18:48.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.064+0000 7fe884c1e640 1 -- 172.21.15.37:0/1655035264 learned_addr learned my addr 172.21.15.37:0/1655035264 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:18:48.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.064+0000 7fe87ffff640 1 --2- 172.21.15.37:0/1655035264 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe8800cb030 0x7fe880157580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:48.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.064+0000 7fe87f7fe640 1 --2- 172.21.15.37:0/1655035264 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe8800cdd80 0x7fe88015e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:48.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.064+0000 7fe884c1e640 1 -- 172.21.15.37:0/1655035264 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe8800cdd80 msgr2=0x7fe88015e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:48.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.064+0000 7fe884c1e640 1 --2- 172.21.15.37:0/1655035264 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe8800cdd80 0x7fe88015e6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:48.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.064+0000 7fe884c1e640 1 -- 172.21.15.37:0/1655035264 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe8800cb030 msgr2=0x7fe880157580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:48.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.064+0000 7fe884c1e640 1 --2- 172.21.15.37:0/1655035264 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe8800cb030 0x7fe880157580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:48.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.064+0000 7fe884c1e640 1 -- 172.21.15.37:0/1655035264 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe88015f1d0 con 0x7fe8801552e0 2024-04-22T07:18:48.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.064+0000 7fe884c1e640 1 --2- 172.21.15.37:0/1655035264 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe8801552e0 0x7fe88015ebf0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fe87800c780 tx=0x7fe87800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:48.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.064+0000 7fe87cff9640 1 -- 172.21.15.37:0/1655035264 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe878004b60 con 0x7fe8801552e0 2024-04-22T07:18:48.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.064+0000 7fe87cff9640 1 -- 172.21.15.37:0/1655035264 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe878004d00 con 0x7fe8801552e0 2024-04-22T07:18:48.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.064+0000 7fe886681640 1 -- 172.21.15.37:0/1655035264 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe88015c070 con 0x7fe8801552e0 2024-04-22T07:18:48.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.064+0000 7fe87cff9640 1 -- 172.21.15.37:0/1655035264 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe87800aa90 con 0x7fe8801552e0 2024-04-22T07:18:48.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.064+0000 7fe886681640 1 -- 172.21.15.37:0/1655035264 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe88015c630 con 0x7fe8801552e0 2024-04-22T07:18:48.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.065+0000 7fe886681640 1 -- 172.21.15.37:0/1655035264 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe880069cc0 con 0x7fe8801552e0 2024-04-22T07:18:48.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.066+0000 7fe87cff9640 1 -- 172.21.15.37:0/1655035264 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe87800ac30 con 0x7fe8801552e0 2024-04-22T07:18:48.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.066+0000 7fe87cff9640 1 --2- 172.21.15.37:0/1655035264 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fe86c06c8f0 0x7fe86c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:48.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.067+0000 7fe87cff9640 1 -- 172.21.15.37:0/1655035264 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fe87808c0d0 con 0x7fe8801552e0 2024-04-22T07:18:48.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.067+0000 7fe87ffff640 1 --2- 172.21.15.37:0/1655035264 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fe86c06c8f0 0x7fe86c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:48.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.067+0000 7fe87ffff640 1 --2- 172.21.15.37:0/1655035264 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fe86c06c8f0 0x7fe86c06edb0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fe870036000 tx=0x7fe870008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:48.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.071+0000 7fe87cff9640 1 -- 172.21.15.37:0/1655035264 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fe878059d00 con 0x7fe8801552e0 2024-04-22T07:18:48.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.257+0000 7fe886681640 1 -- 172.21.15.37:0/1655035264 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fe8800c6250 con 0x7fe8801552e0 2024-04-22T07:18:48.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.258+0000 7fe87cff9640 1 -- 172.21.15.37:0/1655035264 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7fe87805e000 con 0x7fe8801552e0 2024-04-22T07:18:48.255 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 64 2024-04-22T07:18:48.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.260+0000 7fe886681640 1 -- 172.21.15.37:0/1655035264 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fe86c06c8f0 msgr2=0x7fe86c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:48.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.260+0000 7fe886681640 1 --2- 172.21.15.37:0/1655035264 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fe86c06c8f0 0x7fe86c06edb0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fe870036000 tx=0x7fe870008030 comp rx=0 tx=0).stop 2024-04-22T07:18:48.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.260+0000 7fe886681640 1 -- 172.21.15.37:0/1655035264 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe8801552e0 msgr2=0x7fe88015ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:48.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.260+0000 7fe886681640 1 --2- 172.21.15.37:0/1655035264 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe8801552e0 0x7fe88015ebf0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fe87800c780 tx=0x7fe87800cc40 comp rx=0 tx=0).stop 2024-04-22T07:18:48.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.260+0000 7fe886681640 1 -- 172.21.15.37:0/1655035264 shutdown_connections 2024-04-22T07:18:48.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.260+0000 7fe886681640 1 --2- 172.21.15.37:0/1655035264 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fe86c06c8f0 0x7fe86c06edb0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:48.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.260+0000 7fe886681640 1 --2- 172.21.15.37:0/1655035264 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe8801552e0 0x7fe88015ebf0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:48.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.260+0000 7fe886681640 1 --2- 172.21.15.37:0/1655035264 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe8800cdd80 0x7fe88015e6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:48.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.260+0000 7fe886681640 1 --2- 172.21.15.37:0/1655035264 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe8800cb030 0x7fe880157580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:48.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.260+0000 7fe886681640 1 -- 172.21.15.37:0/1655035264 >> 172.21.15.37:0/1655035264 conn(0x7fe88006d330 msgr2=0x7fe8800ce5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:48.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.260+0000 7fe886681640 1 -- 172.21.15.37:0/1655035264 shutdown_connections 2024-04-22T07:18:48.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.260+0000 7fe886681640 1 -- 172.21.15.37:0/1655035264 wait complete. 2024-04-22T07:18:48.268 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-22T07:18:48.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.371+0000 7f1b9e0c8640 1 Processor -- start 2024-04-22T07:18:48.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.371+0000 7f1b9e0c8640 1 -- start start 2024-04-22T07:18:48.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.371+0000 7f1b9e0c8640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1b98152dc0 0x7f1b980c4aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:48.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.372+0000 7f1b9e0c8640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f1b980c84e0 0x7f1b980c8c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:48.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.372+0000 7f1b9e0c8640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1b980c91a0 0x7f1b9815c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:48.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.372+0000 7f1b9e0c8640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f1b980c7530 con 0x7f1b98152dc0 2024-04-22T07:18:48.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.372+0000 7f1b9e0c8640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f1b980c4fe0 con 0x7f1b980c84e0 2024-04-22T07:18:48.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.372+0000 7f1b9e0c8640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f1b980c6f70 con 0x7f1b980c91a0 2024-04-22T07:18:48.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.372+0000 7f1b977fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1b98152dc0 0x7f1b980c4aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:48.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.372+0000 7f1b977fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1b98152dc0 0x7f1b980c4aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54964/0 (socket says 172.21.15.37:54964) 2024-04-22T07:18:48.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.372+0000 7f1b977fe640 1 -- 172.21.15.37:0/3659268320 learned_addr learned my addr 172.21.15.37:0/3659268320 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:18:48.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.372+0000 7f1b97fff640 1 --2- 172.21.15.37:0/3659268320 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1b980c91a0 0x7f1b9815c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:48.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.372+0000 7f1b96ffd640 1 --2- 172.21.15.37:0/3659268320 >> v2:172.21.15.196:3300/0 conn(0x7f1b980c84e0 0x7f1b980c8c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:48.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.372+0000 7f1b977fe640 1 -- 172.21.15.37:0/3659268320 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1b980c91a0 msgr2=0x7f1b9815c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:18:48.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.372+0000 7f1b977fe640 1 --2- 172.21.15.37:0/3659268320 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1b980c91a0 0x7f1b9815c3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:48.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.372+0000 7f1b977fe640 1 -- 172.21.15.37:0/3659268320 >> v2:172.21.15.196:3300/0 conn(0x7f1b980c84e0 msgr2=0x7f1b980c8c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:18:48.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.372+0000 7f1b977fe640 1 --2- 172.21.15.37:0/3659268320 >> v2:172.21.15.196:3300/0 conn(0x7f1b980c84e0 0x7f1b980c8c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:48.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.372+0000 7f1b977fe640 1 -- 172.21.15.37:0/3659268320 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b980c7250 con 0x7f1b98152dc0 2024-04-22T07:18:48.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.372+0000 7f1b96ffd640 1 --2- 172.21.15.37:0/3659268320 >> v2:172.21.15.196:3300/0 conn(0x7f1b980c84e0 0x7f1b980c8c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T07:18:48.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.373+0000 7f1b977fe640 1 --2- 172.21.15.37:0/3659268320 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1b98152dc0 0x7f1b980c4aa0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f1b980c7b70 tx=0x7f1b8802b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7995514d8dc5eddc server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:48.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.373+0000 7f1b967fc640 1 -- 172.21.15.37:0/3659268320 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b8802e070 con 0x7f1b98152dc0 2024-04-22T07:18:48.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.373+0000 7f1b967fc640 1 -- 172.21.15.37:0/3659268320 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b88037070 con 0x7f1b98152dc0 2024-04-22T07:18:48.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.373+0000 7f1b967fc640 1 -- 172.21.15.37:0/3659268320 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b88031a00 con 0x7f1b98152dc0 2024-04-22T07:18:48.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.374+0000 7f1b9e0c8640 1 -- 172.21.15.37:0/3659268320 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1b98152dc0 msgr2=0x7f1b980c4aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:48.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.374+0000 7f1b9e0c8640 1 --2- 172.21.15.37:0/3659268320 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1b98152dc0 0x7f1b980c4aa0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f1b980c7b70 tx=0x7f1b8802b880 comp rx=0 tx=0).stop 2024-04-22T07:18:48.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.374+0000 7f1b9e0c8640 1 -- 172.21.15.37:0/3659268320 shutdown_connections 2024-04-22T07:18:48.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.374+0000 7f1b9e0c8640 1 --2- 172.21.15.37:0/3659268320 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1b980c91a0 0x7f1b9815c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:48.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.374+0000 7f1b9e0c8640 1 --2- 172.21.15.37:0/3659268320 >> v2:172.21.15.196:3300/0 conn(0x7f1b980c84e0 0x7f1b980c8c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:48.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.374+0000 7f1b9e0c8640 1 --2- 172.21.15.37:0/3659268320 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1b98152dc0 0x7f1b980c4aa0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:48.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.374+0000 7f1b9e0c8640 1 -- 172.21.15.37:0/3659268320 >> 172.21.15.37:0/3659268320 conn(0x7f1b9806b970 msgr2=0x7f1b9806bd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:48.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.374+0000 7f1b9e0c8640 1 -- 172.21.15.37:0/3659268320 shutdown_connections 2024-04-22T07:18:48.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.374+0000 7f1b9e0c8640 1 -- 172.21.15.37:0/3659268320 wait complete. 2024-04-22T07:18:48.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.375+0000 7f1b9e0c8640 1 Processor -- start 2024-04-22T07:18:48.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.375+0000 7f1b9e0c8640 1 -- start start 2024-04-22T07:18:48.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.376+0000 7f1b9e0c8640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1b980c84e0 0x7f1b981547b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:48.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.376+0000 7f1b9e0c8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1b980c91a0 0x7f1b981e5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:48.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.376+0000 7f1b9e0c8640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1b98152dc0 0x7f1b981f4590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:48.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.376+0000 7f1b9e0c8640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f1b980c3e50 con 0x7f1b980c91a0 2024-04-22T07:18:48.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.376+0000 7f1b9e0c8640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f1b980c3ae0 con 0x7f1b980c84e0 2024-04-22T07:18:48.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.376+0000 7f1b9e0c8640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f1b980c65e0 con 0x7f1b98152dc0 2024-04-22T07:18:48.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.376+0000 7f1b96ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1b980c91a0 0x7f1b981e5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:48.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.376+0000 7f1b96ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1b980c91a0 0x7f1b981e5780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54966/0 (socket says 172.21.15.37:54966) 2024-04-22T07:18:48.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.376+0000 7f1b96ffd640 1 -- 172.21.15.37:0/4003798761 learned_addr learned my addr 172.21.15.37:0/4003798761 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:18:48.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.376+0000 7f1b97fff640 1 --2- 172.21.15.37:0/4003798761 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1b98152dc0 0x7f1b981f4590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:48.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.376+0000 7f1b977fe640 1 --2- 172.21.15.37:0/4003798761 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1b980c84e0 0x7f1b981547b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:48.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.376+0000 7f1b96ffd640 1 -- 172.21.15.37:0/4003798761 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1b98152dc0 msgr2=0x7f1b981f4590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:48.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.376+0000 7f1b96ffd640 1 --2- 172.21.15.37:0/4003798761 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1b98152dc0 0x7f1b981f4590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:48.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.376+0000 7f1b96ffd640 1 -- 172.21.15.37:0/4003798761 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1b980c84e0 msgr2=0x7f1b981547b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:48.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.376+0000 7f1b96ffd640 1 --2- 172.21.15.37:0/4003798761 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1b980c84e0 0x7f1b981547b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:48.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.376+0000 7f1b96ffd640 1 -- 172.21.15.37:0/4003798761 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b980ccdc0 con 0x7f1b980c91a0 2024-04-22T07:18:48.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.376+0000 7f1b977fe640 1 --2- 172.21.15.37:0/4003798761 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1b980c84e0 0x7f1b981547b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-22T07:18:48.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.376+0000 7f1b97fff640 1 --2- 172.21.15.37:0/4003798761 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1b98152dc0 0x7f1b981f4590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-22T07:18:48.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.376+0000 7f1b96ffd640 1 --2- 172.21.15.37:0/4003798761 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1b980c91a0 0x7f1b981e5780 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f1b8000d7d0 tx=0x7f1b8000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:48.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.377+0000 7f1b8ffff640 1 -- 172.21.15.37:0/4003798761 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b80004030 con 0x7f1b980c91a0 2024-04-22T07:18:48.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.377+0000 7f1b8ffff640 1 -- 172.21.15.37:0/4003798761 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b800041d0 con 0x7f1b980c91a0 2024-04-22T07:18:48.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.377+0000 7f1b9e0c8640 1 -- 172.21.15.37:0/4003798761 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b98153610 con 0x7f1b980c91a0 2024-04-22T07:18:48.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.377+0000 7f1b8ffff640 1 -- 172.21.15.37:0/4003798761 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b800096a0 con 0x7f1b980c91a0 2024-04-22T07:18:48.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.377+0000 7f1b9e0c8640 1 -- 172.21.15.37:0/4003798761 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b981e5cc0 con 0x7f1b980c91a0 2024-04-22T07:18:48.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.378+0000 7f1b9e0c8640 1 -- 172.21.15.37:0/4003798761 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b98069cc0 con 0x7f1b980c91a0 2024-04-22T07:18:48.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.378+0000 7f1b8ffff640 1 -- 172.21.15.37:0/4003798761 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1b80009840 con 0x7f1b980c91a0 2024-04-22T07:18:48.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.378+0000 7f1b8ffff640 1 --2- 172.21.15.37:0/4003798761 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f1b7806c8f0 0x7f1b7806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:48.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.379+0000 7f1b8ffff640 1 -- 172.21.15.37:0/4003798761 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f1b8008bee0 con 0x7f1b980c91a0 2024-04-22T07:18:48.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.379+0000 7f1b977fe640 1 --2- 172.21.15.37:0/4003798761 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f1b7806c8f0 0x7f1b7806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:48.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.379+0000 7f1b977fe640 1 --2- 172.21.15.37:0/4003798761 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f1b7806c8f0 0x7f1b7806edb0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f1b88036000 tx=0x7f1b88008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:48.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.383+0000 7f1b8ffff640 1 -- 172.21.15.37:0/4003798761 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f1b8005a270 con 0x7f1b980c91a0 2024-04-22T07:18:48.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.610+0000 7f1b9e0c8640 1 -- 172.21.15.37:0/4003798761 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1b980c7780 con 0x7f1b980c91a0 2024-04-22T07:18:48.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.610+0000 7f1b8ffff640 1 -- 172.21.15.37:0/4003798761 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6827 (secure 0 0 0) 0x7f1b80059b70 con 0x7f1b980c91a0 2024-04-22T07:18:48.608 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-22T07:18:48.608 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4265,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6839/671847354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6835","nonce":671847354},{"type":"v1","addr":"172.21.15.196:6839","nonce":671847354}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6833/1549427395","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1549427395},{"type":"v1","addr":"172.21.15.37:6833","nonce":1549427395}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6836/3825988951","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":3825988951},{"type":"v1","addr":"172.21.15.37:6836","nonce":3825988951}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4272,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/611771502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6835","nonce":611771502},{"type":"v1","addr":"172.21.15.37:6837","nonce":611771502}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4291,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6837/3055080225","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6834","nonce":3055080225},{"type":"v1","addr":"172.21.15.196:6837","nonce":3055080225}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-22T07:18:36.111618+0000","modified":"2024-04-22T07:18:41.783857+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.196:6838/3264179771","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6836","nonce":3264179771},{"type":"v1","addr":"172.21.15.196:6838","nonce":3264179771}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4294,"qdb_cluster":[4294]},"id":1}]} 2024-04-22T07:18:48.608 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 8 2024-04-22T07:18:48.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.612+0000 7f1b9e0c8640 1 -- 172.21.15.37:0/4003798761 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f1b7806c8f0 msgr2=0x7f1b7806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:48.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.612+0000 7f1b9e0c8640 1 --2- 172.21.15.37:0/4003798761 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f1b7806c8f0 0x7f1b7806edb0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f1b88036000 tx=0x7f1b88008030 comp rx=0 tx=0).stop 2024-04-22T07:18:48.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.612+0000 7f1b9e0c8640 1 -- 172.21.15.37:0/4003798761 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1b980c91a0 msgr2=0x7f1b981e5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:48.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.612+0000 7f1b9e0c8640 1 --2- 172.21.15.37:0/4003798761 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1b980c91a0 0x7f1b981e5780 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f1b8000d7d0 tx=0x7f1b8000dc90 comp rx=0 tx=0).stop 2024-04-22T07:18:48.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.612+0000 7f1b9e0c8640 1 -- 172.21.15.37:0/4003798761 shutdown_connections 2024-04-22T07:18:48.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.612+0000 7f1b9e0c8640 1 --2- 172.21.15.37:0/4003798761 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f1b7806c8f0 0x7f1b7806edb0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:48.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.612+0000 7f1b9e0c8640 1 --2- 172.21.15.37:0/4003798761 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1b98152dc0 0x7f1b981f4590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:48.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.612+0000 7f1b9e0c8640 1 --2- 172.21.15.37:0/4003798761 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1b980c91a0 0x7f1b981e5780 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:48.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.612+0000 7f1b9e0c8640 1 --2- 172.21.15.37:0/4003798761 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1b980c84e0 0x7f1b981547b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:48.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.612+0000 7f1b9e0c8640 1 -- 172.21.15.37:0/4003798761 >> 172.21.15.37:0/4003798761 conn(0x7f1b9806b970 msgr2=0x7f1b9814df00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:48.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.612+0000 7f1b9e0c8640 1 -- 172.21.15.37:0/4003798761 shutdown_connections 2024-04-22T07:18:48.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.612+0000 7f1b9e0c8640 1 -- 172.21.15.37:0/4003798761 wait complete. 2024-04-22T07:18:48.621 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-22T07:18:48.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.723+0000 7f317012b640 1 Processor -- start 2024-04-22T07:18:48.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.723+0000 7f317012b640 1 -- start start 2024-04-22T07:18:48.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.724+0000 7f317012b640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f31680ccd10 0x7f31680cd150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:48.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.724+0000 7f317012b640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f316815f280 con 0x7f31681552f0 2024-04-22T07:18:48.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.724+0000 7f317012b640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31680cda00 con 0x7f31680b38f0 2024-04-22T07:18:48.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.724+0000 7f317012b640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f31680b3100 con 0x7f31680ccd10 2024-04-22T07:18:48.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.724+0000 7f316dec7640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f31681552f0 0x7f31680cb430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:56658/0 (socket says 172.21.15.37:56658) 2024-04-22T07:18:48.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.724+0000 7f316dec7640 1 -- 172.21.15.37:0/3232390965 learned_addr learned my addr 172.21.15.37:0/3232390965 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-04-22T07:18:48.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.724+0000 7f316e6c8640 1 --2- 172.21.15.37:0/3232390965 >> v2:172.21.15.37:3300/0 conn(0x7f31680ccd10 0x7f31680cd150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:48.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.725+0000 7f316cec5640 1 -- 172.21.15.37:0/3232390965 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3510817591 0 0) 0x7f316815f280 con 0x7f31681552f0 2024-04-22T07:18:48.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.725+0000 7f316cec5640 1 -- 172.21.15.37:0/3232390965 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3150003520 con 0x7f31681552f0 2024-04-22T07:18:48.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.725+0000 7f316e6c8640 1 -- 172.21.15.37:0/3232390965 >> v1:172.21.15.196:6789/0 conn(0x7f31680b38f0 legacy=0x7f316815aeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:48.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.725+0000 7f316e6c8640 1 -- 172.21.15.37:0/3232390965 >> v1:172.21.15.37:6789/0 conn(0x7f31681552f0 legacy=0x7f31680cb430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:48.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.725+0000 7f316e6c8640 1 -- 172.21.15.37:0/3232390965 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31680b3350 con 0x7f31680ccd10 2024-04-22T07:18:48.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.725+0000 7f316e6c8640 1 --2- 172.21.15.37:0/3232390965 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f31680ccd10 0x7f31680cd150 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f31600097a0 tx=0x7f316002b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cf5bb6d5df2fe93 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:48.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.726+0000 7f316cec5640 1 -- 172.21.15.37:0/3232390965 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3160034070 con 0x7f31680ccd10 2024-04-22T07:18:48.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.726+0000 7f316cec5640 1 -- 172.21.15.37:0/3232390965 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3160030610 con 0x7f31680ccd10 2024-04-22T07:18:48.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.726+0000 7f316cec5640 1 -- 172.21.15.37:0/3232390965 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31600309e0 con 0x7f31680ccd10 2024-04-22T07:18:48.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.726+0000 7f317012b640 1 -- 172.21.15.37:0/3232390965 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f31680ccd10 msgr2=0x7f31680cd150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:48.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.726+0000 7f317012b640 1 --2- 172.21.15.37:0/3232390965 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f31680ccd10 0x7f31680cd150 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f31600097a0 tx=0x7f316002b960 comp rx=0 tx=0).stop 2024-04-22T07:18:48.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.726+0000 7f317012b640 1 -- 172.21.15.37:0/3232390965 shutdown_connections 2024-04-22T07:18:48.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.726+0000 7f317012b640 1 --2- 172.21.15.37:0/3232390965 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f31680ccd10 0x7f31680cd150 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:48.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.726+0000 7f317012b640 1 -- 172.21.15.37:0/3232390965 >> 172.21.15.37:0/3232390965 conn(0x7f3168071f90 msgr2=0x7f31680723a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:48.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.726+0000 7f317012b640 1 -- 172.21.15.37:0/3232390965 shutdown_connections 2024-04-22T07:18:48.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.726+0000 7f317012b640 1 -- 172.21.15.37:0/3232390965 wait complete. 2024-04-22T07:18:48.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.727+0000 7f317012b640 1 Processor -- start 2024-04-22T07:18:48.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.727+0000 7f317012b640 1 -- start start 2024-04-22T07:18:48.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.728+0000 7f317012b640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f31680b38f0 0x7f31681f14e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:48.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.728+0000 7f317012b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f31680ccd10 0x7f316815c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:48.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.728+0000 7f317012b640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f31681552f0 0x7f316814ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:48.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.728+0000 7f317012b640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f316815e7a0 con 0x7f31680ccd10 2024-04-22T07:18:48.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.728+0000 7f317012b640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f316815e4c0 con 0x7f31680b38f0 2024-04-22T07:18:48.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.728+0000 7f317012b640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f316815ea80 con 0x7f31681552f0 2024-04-22T07:18:48.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.728+0000 7f316d6c6640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f31680ccd10 0x7f316815c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:48.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.728+0000 7f316d6c6640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f31680ccd10 0x7f316815c010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54988/0 (socket says 172.21.15.37:54988) 2024-04-22T07:18:48.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.728+0000 7f316d6c6640 1 -- 172.21.15.37:0/1715122521 learned_addr learned my addr 172.21.15.37:0/1715122521 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:18:48.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.728+0000 7f316e6c8640 1 --2- 172.21.15.37:0/1715122521 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f31681552f0 0x7f316814ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:48.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.728+0000 7f316dec7640 1 --2- 172.21.15.37:0/1715122521 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f31680b38f0 0x7f31681f14e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:48.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.728+0000 7f316d6c6640 1 -- 172.21.15.37:0/1715122521 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f31681552f0 msgr2=0x7f316814ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:48.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.728+0000 7f316d6c6640 1 --2- 172.21.15.37:0/1715122521 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f31681552f0 0x7f316814ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:48.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.728+0000 7f316d6c6640 1 -- 172.21.15.37:0/1715122521 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f31680b38f0 msgr2=0x7f31681f14e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:48.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.728+0000 7f316d6c6640 1 --2- 172.21.15.37:0/1715122521 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f31680b38f0 0x7f31681f14e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:48.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.728+0000 7f316d6c6640 1 -- 172.21.15.37:0/1715122521 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f316815c550 con 0x7f31680ccd10 2024-04-22T07:18:48.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.729+0000 7f316d6c6640 1 --2- 172.21.15.37:0/1715122521 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f31680ccd10 0x7f316815c010 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f315c00c430 tx=0x7f315c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:48.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.729+0000 7f31667fc640 1 -- 172.21.15.37:0/1715122521 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f315c0052d0 con 0x7f31680ccd10 2024-04-22T07:18:48.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.729+0000 7f31667fc640 1 -- 172.21.15.37:0/1715122521 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f315c005490 con 0x7f31680ccd10 2024-04-22T07:18:48.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.729+0000 7f317012b640 1 -- 172.21.15.37:0/1715122521 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3168156670 con 0x7f31680ccd10 2024-04-22T07:18:48.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.729+0000 7f31667fc640 1 -- 172.21.15.37:0/1715122521 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f315c007260 con 0x7f31680ccd10 2024-04-22T07:18:48.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.729+0000 7f317012b640 1 -- 172.21.15.37:0/1715122521 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3168157030 con 0x7f31680ccd10 2024-04-22T07:18:48.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.730+0000 7f317012b640 1 -- 172.21.15.37:0/1715122521 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3168069cc0 con 0x7f31680ccd10 2024-04-22T07:18:48.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.730+0000 7f31667fc640 1 -- 172.21.15.37:0/1715122521 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f315c007400 con 0x7f31680ccd10 2024-04-22T07:18:48.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.731+0000 7f31667fc640 1 --2- 172.21.15.37:0/1715122521 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f315406c920 0x7f315406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:48.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.731+0000 7f31667fc640 1 -- 172.21.15.37:0/1715122521 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f315c08b060 con 0x7f31680ccd10 2024-04-22T07:18:48.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.731+0000 7f316dec7640 1 --2- 172.21.15.37:0/1715122521 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f315406c920 0x7f315406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:48.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.732+0000 7f316dec7640 1 --2- 172.21.15.37:0/1715122521 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f315406c920 0x7f315406ede0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f3158001560 tx=0x7f31580019f0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:48.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.735+0000 7f31667fc640 1 -- 172.21.15.37:0/1715122521 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f315c058db0 con 0x7f31680ccd10 2024-04-22T07:18:48.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.921+0000 7f317012b640 1 -- 172.21.15.37:0/1715122521 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3168072600 con 0x7f31680ccd10 2024-04-22T07:18:48.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.922+0000 7f31667fc640 1 -- 172.21.15.37:0/1715122521 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16581 (secure 0 0 0) 0x7f315c05d0b0 con 0x7f31680ccd10 2024-04-22T07:18:48.920 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-22T07:18:48.920 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":20,"fsid":"10d90a41-52d3-4e09-8022-c8ac67897ad1","created":"2024-04-22T07:18:12.420756+0000","modified":"2024-04-22T07:18:37.754119+0000","last_up_change":"2024-04-22T07:18:23.649808+0000","last_in_change":"2024-04-22T07:18:14.506974+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-22T07:18:24.602243+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-22T07:18:34.673639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-22T07:18:35.055184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e248f6e1-13ad-48e0-a8f8-ec3059995654","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":1488290385},{"type":"v1","addr":"172.21.15.37:6801","nonce":1488290385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1488290385},{"type":"v1","addr":"172.21.15.37:6803","nonce":1488290385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1488290385},{"type":"v1","addr":"172.21.15.37:6807","nonce":1488290385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1488290385},{"type":"v1","addr":"172.21.15.37:6805","nonce":1488290385}]},"public_addr":"172.21.15.37:6801/1488290385","cluster_addr":"172.21.15.37:6803/1488290385","heartbeat_back_addr":"172.21.15.37:6807/1488290385","heartbeat_front_addr":"172.21.15.37:6805/1488290385","state":["exists","up"]},{"osd":1,"uuid":"01c71ab7-1326-432b-b73a-e5847abe5132","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3918584183},{"type":"v1","addr":"172.21.15.37:6811","nonce":3918584183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6813","nonce":3918584183},{"type":"v1","addr":"172.21.15.37:6816","nonce":3918584183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":3918584183},{"type":"v1","addr":"172.21.15.37:6823","nonce":3918584183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":3918584183},{"type":"v1","addr":"172.21.15.37:6821","nonce":3918584183}]},"public_addr":"172.21.15.37:6811/3918584183","cluster_addr":"172.21.15.37:6816/3918584183","heartbeat_back_addr":"172.21.15.37:6823/3918584183","heartbeat_front_addr":"172.21.15.37:6821/3918584183","state":["exists","up"]},{"osd":2,"uuid":"33a780fd-013a-41c8-9970-136c9e080897","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1895439419},{"type":"v1","addr":"172.21.15.37:6825","nonce":1895439419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1895439419},{"type":"v1","addr":"172.21.15.37:6827","nonce":1895439419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1895439419},{"type":"v1","addr":"172.21.15.37:6831","nonce":1895439419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1895439419},{"type":"v1","addr":"172.21.15.37:6829","nonce":1895439419}]},"public_addr":"172.21.15.37:6825/1895439419","cluster_addr":"172.21.15.37:6827/1895439419","heartbeat_back_addr":"172.21.15.37:6831/1895439419","heartbeat_front_addr":"172.21.15.37:6829/1895439419","state":["exists","up"]},{"osd":3,"uuid":"b46e53c4-e5b9-4098-b243-ab5a0f1f3885","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6809","nonce":1160021017},{"type":"v1","addr":"172.21.15.37:6810","nonce":1160021017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1160021017},{"type":"v1","addr":"172.21.15.37:6814","nonce":1160021017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":1160021017},{"type":"v1","addr":"172.21.15.37:6820","nonce":1160021017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6815","nonce":1160021017},{"type":"v1","addr":"172.21.15.37:6817","nonce":1160021017}]},"public_addr":"172.21.15.37:6810/1160021017","cluster_addr":"172.21.15.37:6814/1160021017","heartbeat_back_addr":"172.21.15.37:6820/1160021017","heartbeat_front_addr":"172.21.15.37:6817/1160021017","state":["exists","up"]},{"osd":4,"uuid":"cd1032c6-6a83-4e33-b7b1-baddf92a83af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":374829049},{"type":"v1","addr":"172.21.15.196:6809","nonce":374829049}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":374829049},{"type":"v1","addr":"172.21.15.196:6811","nonce":374829049}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":374829049},{"type":"v1","addr":"172.21.15.196:6815","nonce":374829049}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":374829049},{"type":"v1","addr":"172.21.15.196:6813","nonce":374829049}]},"public_addr":"172.21.15.196:6809/374829049","cluster_addr":"172.21.15.196:6811/374829049","heartbeat_back_addr":"172.21.15.196:6815/374829049","heartbeat_front_addr":"172.21.15.196:6813/374829049","state":["exists","up"]},{"osd":5,"uuid":"f561d48a-5f2d-4deb-8681-4329aed36bae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":479311302},{"type":"v1","addr":"172.21.15.196:6801","nonce":479311302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":479311302},{"type":"v1","addr":"172.21.15.196:6803","nonce":479311302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":479311302},{"type":"v1","addr":"172.21.15.196:6807","nonce":479311302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":479311302},{"type":"v1","addr":"172.21.15.196:6805","nonce":479311302}]},"public_addr":"172.21.15.196:6801/479311302","cluster_addr":"172.21.15.196:6803/479311302","heartbeat_back_addr":"172.21.15.196:6807/479311302","heartbeat_front_addr":"172.21.15.196:6805/479311302","state":["exists","up"]},{"osd":6,"uuid":"1b239c7e-2504-42e0-b308-70f4e62519c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6817","nonce":691777224},{"type":"v1","addr":"172.21.15.196:6819","nonce":691777224}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6821","nonce":691777224},{"type":"v1","addr":"172.21.15.196:6823","nonce":691777224}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6829","nonce":691777224},{"type":"v1","addr":"172.21.15.196:6831","nonce":691777224}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6825","nonce":691777224},{"type":"v1","addr":"172.21.15.196:6827","nonce":691777224}]},"public_addr":"172.21.15.196:6819/691777224","cluster_addr":"172.21.15.196:6823/691777224","heartbeat_back_addr":"172.21.15.196:6831/691777224","heartbeat_front_addr":"172.21.15.196:6827/691777224","state":["exists","up"]},{"osd":7,"uuid":"084318d4-d1fd-4b58-8c33-b1d7856fe323","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":3106266066},{"type":"v1","addr":"172.21.15.196:6818","nonce":3106266066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":3106266066},{"type":"v1","addr":"172.21.15.196:6822","nonce":3106266066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":3106266066},{"type":"v1","addr":"172.21.15.196:6830","nonce":3106266066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":3106266066},{"type":"v1","addr":"172.21.15.196:6826","nonce":3106266066}]},"public_addr":"172.21.15.196:6818/3106266066","cluster_addr":"172.21.15.196:6822/3106266066","heartbeat_back_addr":"172.21.15.196:6830/3106266066","heartbeat_front_addr":"172.21.15.196:6826/3106266066","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:18:19.587791+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:18:19.706541+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:18:19.690674+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:18:19.648354+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:18:19.666671+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:18:19.560709+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:18:19.661412+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:18:19.770650+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-22T07:18:48.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.924+0000 7f317012b640 1 -- 172.21.15.37:0/1715122521 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f315406c920 msgr2=0x7f315406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:48.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.924+0000 7f317012b640 1 --2- 172.21.15.37:0/1715122521 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f315406c920 0x7f315406ede0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f3158001560 tx=0x7f31580019f0 comp rx=0 tx=0).stop 2024-04-22T07:18:48.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.924+0000 7f317012b640 1 -- 172.21.15.37:0/1715122521 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f31680ccd10 msgr2=0x7f316815c010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:48.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.924+0000 7f317012b640 1 --2- 172.21.15.37:0/1715122521 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f31680ccd10 0x7f316815c010 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f315c00c430 tx=0x7f315c00c8f0 comp rx=0 tx=0).stop 2024-04-22T07:18:48.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.924+0000 7f317012b640 1 -- 172.21.15.37:0/1715122521 shutdown_connections 2024-04-22T07:18:48.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.924+0000 7f317012b640 1 --2- 172.21.15.37:0/1715122521 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f315406c920 0x7f315406ede0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:48.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.924+0000 7f317012b640 1 --2- 172.21.15.37:0/1715122521 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f31681552f0 0x7f316814ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:48.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.924+0000 7f317012b640 1 --2- 172.21.15.37:0/1715122521 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f31680ccd10 0x7f316815c010 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:48.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.924+0000 7f317012b640 1 --2- 172.21.15.37:0/1715122521 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f31680b38f0 0x7f31681f14e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:48.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.924+0000 7f317012b640 1 -- 172.21.15.37:0/1715122521 >> 172.21.15.37:0/1715122521 conn(0x7f3168071f90 msgr2=0x7f3168153490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:48.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.924+0000 7f317012b640 1 -- 172.21.15.37:0/1715122521 shutdown_connections 2024-04-22T07:18:48.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:48.924+0000 7f317012b640 1 -- 172.21.15.37:0/1715122521 wait complete. 2024-04-22T07:18:48.933 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-22T07:18:24.602243+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-22T07:18:34.673639+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-22T07:18:35.055184+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-22T07:18:48.933 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-22T07:18:49.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.039+0000 7fb3960c0640 1 Processor -- start 2024-04-22T07:18:49.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.039+0000 7fb3960c0640 1 -- start start 2024-04-22T07:18:49.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.039+0000 7fb3960c0640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb390159610 0x7fb390164520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:49.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.039+0000 7fb3960c0640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb390153290 con 0x7fb39006fb30 2024-04-22T07:18:49.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.039+0000 7fb3960c0640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3900c84f0 con 0x7fb390152eb0 2024-04-22T07:18:49.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.039+0000 7fb3960c0640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fb39006ffc0 con 0x7fb390159610 2024-04-22T07:18:49.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.039+0000 7fb38ffff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb390159610 0x7fb390164520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:49.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.040+0000 7fb38effd640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fb39006fb30 0x7fb3900c6a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:56666/0 (socket says 172.21.15.37:56666) 2024-04-22T07:18:49.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.040+0000 7fb38effd640 1 -- 172.21.15.37:0/997996889 learned_addr learned my addr 172.21.15.37:0/997996889 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-04-22T07:18:49.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.040+0000 7fb38ffff640 1 --2- 172.21.15.37:0/997996889 >> v2:172.21.15.37:3300/0 conn(0x7fb390159610 0x7fb390164520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54994/0 (socket says 172.21.15.37:54994) 2024-04-22T07:18:49.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.040+0000 7fb38ffff640 1 -- 172.21.15.37:0/997996889 >> v1:172.21.15.196:6789/0 conn(0x7fb390152eb0 legacy=0x7fb39015c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:49.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.040+0000 7fb38ffff640 1 -- 172.21.15.37:0/997996889 >> v1:172.21.15.37:6789/0 conn(0x7fb39006fb30 legacy=0x7fb3900c6a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:49.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.040+0000 7fb38ffff640 1 -- 172.21.15.37:0/997996889 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3900701e0 con 0x7fb390159610 2024-04-22T07:18:49.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.040+0000 7fb38e7fc640 1 -- 172.21.15.37:0/997996889 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2233476128 0 0) 0x7fb390153290 con 0x7fb39006fb30 2024-04-22T07:18:49.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.041+0000 7fb38ffff640 1 --2- 172.21.15.37:0/997996889 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb390159610 0x7fb390164520 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fb388009d90 tx=0x7fb38802bfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8d64db0f7b88e2 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:49.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.041+0000 7fb38e7fc640 1 -- 172.21.15.37:0/997996889 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb388039070 con 0x7fb390159610 2024-04-22T07:18:49.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.041+0000 7fb38e7fc640 1 -- 172.21.15.37:0/997996889 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb38802cd80 con 0x7fb390159610 2024-04-22T07:18:49.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.041+0000 7fb38e7fc640 1 -- 172.21.15.37:0/997996889 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb388034660 con 0x7fb390159610 2024-04-22T07:18:49.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.041+0000 7fb3960c0640 1 -- 172.21.15.37:0/997996889 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb390159610 msgr2=0x7fb390164520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:49.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.041+0000 7fb3960c0640 1 --2- 172.21.15.37:0/997996889 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb390159610 0x7fb390164520 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fb388009d90 tx=0x7fb38802bfd0 comp rx=0 tx=0).stop 2024-04-22T07:18:49.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.041+0000 7fb3960c0640 1 -- 172.21.15.37:0/997996889 shutdown_connections 2024-04-22T07:18:49.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.041+0000 7fb3960c0640 1 --2- 172.21.15.37:0/997996889 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb390159610 0x7fb390164520 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:49.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.041+0000 7fb3960c0640 1 -- 172.21.15.37:0/997996889 >> 172.21.15.37:0/997996889 conn(0x7fb3900cd370 msgr2=0x7fb3900cd750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:49.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.041+0000 7fb3960c0640 1 -- 172.21.15.37:0/997996889 shutdown_connections 2024-04-22T07:18:49.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.041+0000 7fb3960c0640 1 -- 172.21.15.37:0/997996889 wait complete. 2024-04-22T07:18:49.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.042+0000 7fb3960c0640 1 Processor -- start 2024-04-22T07:18:49.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.043+0000 7fb3960c0640 1 -- start start 2024-04-22T07:18:49.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.043+0000 7fb3960c0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb39006fb30 0x7fb3901ee600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:49.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.043+0000 7fb3960c0640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb390152eb0 0x7fb390158380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:49.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.043+0000 7fb3960c0640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb390159610 0x7fb39014b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:49.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.043+0000 7fb3960c0640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fb390071040 con 0x7fb39006fb30 2024-04-22T07:18:49.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.043+0000 7fb3960c0640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fb390070d60 con 0x7fb390152eb0 2024-04-22T07:18:49.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.043+0000 7fb3960c0640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fb3900c7cf0 con 0x7fb390159610 2024-04-22T07:18:49.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.043+0000 7fb38f7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb39006fb30 0x7fb3901ee600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:49.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.043+0000 7fb38f7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb39006fb30 0x7fb3901ee600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55010/0 (socket says 172.21.15.37:55010) 2024-04-22T07:18:49.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.043+0000 7fb38f7fe640 1 -- 172.21.15.37:0/1279191263 learned_addr learned my addr 172.21.15.37:0/1279191263 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:18:49.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.044+0000 7fb38ffff640 1 --2- 172.21.15.37:0/1279191263 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb390159610 0x7fb39014b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:49.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.044+0000 7fb38effd640 1 --2- 172.21.15.37:0/1279191263 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb390152eb0 0x7fb390158380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:49.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.044+0000 7fb38f7fe640 1 -- 172.21.15.37:0/1279191263 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb390159610 msgr2=0x7fb39014b710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:49.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.044+0000 7fb38f7fe640 1 --2- 172.21.15.37:0/1279191263 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb390159610 0x7fb39014b710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:49.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.044+0000 7fb38f7fe640 1 -- 172.21.15.37:0/1279191263 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb390152eb0 msgr2=0x7fb390158380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:49.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.044+0000 7fb38f7fe640 1 --2- 172.21.15.37:0/1279191263 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb390152eb0 0x7fb390158380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:49.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.044+0000 7fb38f7fe640 1 -- 172.21.15.37:0/1279191263 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb39014f540 con 0x7fb39006fb30 2024-04-22T07:18:49.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.044+0000 7fb38f7fe640 1 --2- 172.21.15.37:0/1279191263 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb39006fb30 0x7fb3901ee600 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fb38000c450 tx=0x7fb38000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:49.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.044+0000 7fb377fff640 1 -- 172.21.15.37:0/1279191263 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3800052d0 con 0x7fb39006fb30 2024-04-22T07:18:49.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.044+0000 7fb377fff640 1 -- 172.21.15.37:0/1279191263 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb380005470 con 0x7fb39006fb30 2024-04-22T07:18:49.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.044+0000 7fb3960c0640 1 -- 172.21.15.37:0/1279191263 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb39014f820 con 0x7fb39006fb30 2024-04-22T07:18:49.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.044+0000 7fb377fff640 1 -- 172.21.15.37:0/1279191263 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb380012870 con 0x7fb39006fb30 2024-04-22T07:18:49.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.044+0000 7fb3960c0640 1 -- 172.21.15.37:0/1279191263 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3901f1ff0 con 0x7fb39006fb30 2024-04-22T07:18:49.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.045+0000 7fb3960c0640 1 -- 172.21.15.37:0/1279191263 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb390068b20 con 0x7fb39006fb30 2024-04-22T07:18:49.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.046+0000 7fb377fff640 1 -- 172.21.15.37:0/1279191263 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb380012a10 con 0x7fb39006fb30 2024-04-22T07:18:49.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.046+0000 7fb377fff640 1 --2- 172.21.15.37:0/1279191263 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fb37c06c8f0 0x7fb37c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:49.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.046+0000 7fb377fff640 1 -- 172.21.15.37:0/1279191263 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fb38008b790 con 0x7fb39006fb30 2024-04-22T07:18:49.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.046+0000 7fb38effd640 1 --2- 172.21.15.37:0/1279191263 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fb37c06c8f0 0x7fb37c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:49.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.047+0000 7fb38effd640 1 --2- 172.21.15.37:0/1279191263 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fb37c06c8f0 0x7fb37c06edb0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fb384007fd0 tx=0x7fb384009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:49.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.050+0000 7fb377fff640 1 -- 172.21.15.37:0/1279191263 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fb380059b30 con 0x7fb39006fb30 2024-04-22T07:18:49.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.237+0000 7fb3960c0640 1 -- 172.21.15.37:0/1279191263 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fb3900cde60 con 0x7fb39006fb30 2024-04-22T07:18:49.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.238+0000 7fb377fff640 1 -- 172.21.15.37:0/1279191263 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7fb380059430 con 0x7fb39006fb30 2024-04-22T07:18:49.236 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2024-04-22T07:18:49.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.240+0000 7fb3960c0640 1 -- 172.21.15.37:0/1279191263 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fb37c06c8f0 msgr2=0x7fb37c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:49.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.240+0000 7fb3960c0640 1 --2- 172.21.15.37:0/1279191263 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fb37c06c8f0 0x7fb37c06edb0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fb384007fd0 tx=0x7fb384009040 comp rx=0 tx=0).stop 2024-04-22T07:18:49.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.240+0000 7fb3960c0640 1 -- 172.21.15.37:0/1279191263 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb39006fb30 msgr2=0x7fb3901ee600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:49.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.240+0000 7fb3960c0640 1 --2- 172.21.15.37:0/1279191263 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb39006fb30 0x7fb3901ee600 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fb38000c450 tx=0x7fb38000c910 comp rx=0 tx=0).stop 2024-04-22T07:18:49.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.240+0000 7fb3960c0640 1 -- 172.21.15.37:0/1279191263 shutdown_connections 2024-04-22T07:18:49.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.240+0000 7fb3960c0640 1 --2- 172.21.15.37:0/1279191263 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fb37c06c8f0 0x7fb37c06edb0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:49.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.240+0000 7fb3960c0640 1 --2- 172.21.15.37:0/1279191263 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb390159610 0x7fb39014b710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:49.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.240+0000 7fb3960c0640 1 --2- 172.21.15.37:0/1279191263 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb390152eb0 0x7fb390158380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:49.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.240+0000 7fb3960c0640 1 --2- 172.21.15.37:0/1279191263 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb39006fb30 0x7fb3901ee600 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:49.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.240+0000 7fb3960c0640 1 -- 172.21.15.37:0/1279191263 >> 172.21.15.37:0/1279191263 conn(0x7fb3900cd370 msgr2=0x7fb39014e020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:49.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.240+0000 7fb3960c0640 1 -- 172.21.15.37:0/1279191263 shutdown_connections 2024-04-22T07:18:49.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.240+0000 7fb3960c0640 1 -- 172.21.15.37:0/1279191263 wait complete. 2024-04-22T07:18:49.249 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-22T07:18:49.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.357+0000 7f1c2ace0640 1 Processor -- start 2024-04-22T07:18:49.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.357+0000 7f1c2ace0640 1 -- start start 2024-04-22T07:18:49.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.358+0000 7f1c2ace0640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1c240cb010 0x7f1c240c5fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:49.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.358+0000 7f1c2ace0640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f1c240cdd60 0x7f1c2415b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:49.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.358+0000 7f1c2ace0640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1c240c6990 con 0x7f1c241552c0 2024-04-22T07:18:49.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.358+0000 7f1c2ace0640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f1c241556a0 con 0x7f1c240cb010 2024-04-22T07:18:49.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.358+0000 7f1c2ace0640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f1c240c66b0 con 0x7f1c240cdd60 2024-04-22T07:18:49.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.358+0000 7f1c23fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1c240cb010 0x7f1c240c5fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:49.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.358+0000 7f1c23fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1c240cb010 0x7f1c240c5fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55016/0 (socket says 172.21.15.37:55016) 2024-04-22T07:18:49.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.358+0000 7f1c23fff640 1 -- 172.21.15.37:0/1813201225 learned_addr learned my addr 172.21.15.37:0/1813201225 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:18:49.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.358+0000 7f1c2927d640 1 --2- 172.21.15.37:0/1813201225 >> v2:172.21.15.196:3300/0 conn(0x7f1c240cdd60 0x7f1c2415b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:49.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.358+0000 7f1c23fff640 1 -- 172.21.15.37:0/1813201225 >> v2:172.21.15.196:3300/0 conn(0x7f1c240cdd60 msgr2=0x7f1c2415b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:18:49.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.358+0000 7f1c23fff640 1 --2- 172.21.15.37:0/1813201225 >> v2:172.21.15.196:3300/0 conn(0x7f1c240cdd60 0x7f1c2415b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:49.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.358+0000 7f1c23fff640 1 -- 172.21.15.37:0/1813201225 >> v1:172.21.15.196:6789/0 conn(0x7f1c241552c0 legacy=0x7f1c240676b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:49.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.358+0000 7f1c23fff640 1 -- 172.21.15.37:0/1813201225 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c240cc560 con 0x7f1c240cb010 2024-04-22T07:18:49.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.359+0000 7f1c23fff640 1 --2- 172.21.15.37:0/1813201225 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1c240cb010 0x7f1c240c5fe0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f1c2406cee0 tx=0x7f1c1002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61ac878f053f08c5 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:49.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.359+0000 7f1c237fe640 1 -- 172.21.15.37:0/1813201225 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c10034070 con 0x7f1c240cb010 2024-04-22T07:18:49.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.359+0000 7f1c237fe640 1 -- 172.21.15.37:0/1813201225 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c10030860 con 0x7f1c240cb010 2024-04-22T07:18:49.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.359+0000 7f1c237fe640 1 -- 172.21.15.37:0/1813201225 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c10030c30 con 0x7f1c240cb010 2024-04-22T07:18:49.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.359+0000 7f1c2ace0640 1 -- 172.21.15.37:0/1813201225 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1c240cb010 msgr2=0x7f1c240c5fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:49.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.360+0000 7f1c2ace0640 1 --2- 172.21.15.37:0/1813201225 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1c240cb010 0x7f1c240c5fe0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f1c2406cee0 tx=0x7f1c1002b9a0 comp rx=0 tx=0).stop 2024-04-22T07:18:49.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.360+0000 7f1c2ace0640 1 -- 172.21.15.37:0/1813201225 shutdown_connections 2024-04-22T07:18:49.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.360+0000 7f1c2ace0640 1 --2- 172.21.15.37:0/1813201225 >> v2:172.21.15.196:3300/0 conn(0x7f1c240cdd60 0x7f1c2415b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:49.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.360+0000 7f1c2ace0640 1 --2- 172.21.15.37:0/1813201225 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1c240cb010 0x7f1c240c5fe0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:49.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.360+0000 7f1c2ace0640 1 -- 172.21.15.37:0/1813201225 >> 172.21.15.37:0/1813201225 conn(0x7f1c2406d330 msgr2=0x7f1c2406c290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:49.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.360+0000 7f1c2ace0640 1 -- 172.21.15.37:0/1813201225 shutdown_connections 2024-04-22T07:18:49.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.360+0000 7f1c2ace0640 1 -- 172.21.15.37:0/1813201225 wait complete. 2024-04-22T07:18:49.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.361+0000 7f1c2ace0640 1 Processor -- start 2024-04-22T07:18:49.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.361+0000 7f1c2ace0640 1 -- start start 2024-04-22T07:18:49.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.362+0000 7f1c2ace0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1c240cb010 0x7f1c240ceee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:49.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.362+0000 7f1c2ace0640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1c240cdd60 0x7f1c24142670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:49.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.362+0000 7f1c2ace0640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1c241552c0 0x7f1c241f0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:49.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.362+0000 7f1c2ace0640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f1c240cce00 con 0x7f1c240cb010 2024-04-22T07:18:49.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.362+0000 7f1c2ace0640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f1c240ccb20 con 0x7f1c240cdd60 2024-04-22T07:18:49.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.362+0000 7f1c2ace0640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f1c24067dc0 con 0x7f1c241552c0 2024-04-22T07:18:49.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.362+0000 7f1c28a7c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1c240cb010 0x7f1c240ceee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:49.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.362+0000 7f1c28a7c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1c240cb010 0x7f1c240ceee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55026/0 (socket says 172.21.15.37:55026) 2024-04-22T07:18:49.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.362+0000 7f1c28a7c640 1 -- 172.21.15.37:0/2715494614 learned_addr learned my addr 172.21.15.37:0/2715494614 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:18:49.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.362+0000 7f1c23fff640 1 --2- 172.21.15.37:0/2715494614 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1c240cdd60 0x7f1c24142670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:49.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.362+0000 7f1c2927d640 1 --2- 172.21.15.37:0/2715494614 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1c241552c0 0x7f1c241f0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:49.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.362+0000 7f1c28a7c640 1 -- 172.21.15.37:0/2715494614 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1c241552c0 msgr2=0x7f1c241f0ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:49.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.362+0000 7f1c28a7c640 1 --2- 172.21.15.37:0/2715494614 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1c241552c0 0x7f1c241f0ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:49.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.362+0000 7f1c28a7c640 1 -- 172.21.15.37:0/2715494614 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1c240cdd60 msgr2=0x7f1c24142670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:49.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.362+0000 7f1c28a7c640 1 --2- 172.21.15.37:0/2715494614 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1c240cdd60 0x7f1c24142670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:49.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.362+0000 7f1c28a7c640 1 -- 172.21.15.37:0/2715494614 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c24142bb0 con 0x7f1c240cb010 2024-04-22T07:18:49.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.362+0000 7f1c23fff640 1 --2- 172.21.15.37:0/2715494614 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1c240cdd60 0x7f1c24142670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T07:18:49.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.362+0000 7f1c28a7c640 1 --2- 172.21.15.37:0/2715494614 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1c240cb010 0x7f1c240ceee0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f1c1800c430 tx=0x7f1c1800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:49.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.362+0000 7f1c217fa640 1 -- 172.21.15.37:0/2715494614 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c180052d0 con 0x7f1c240cb010 2024-04-22T07:18:49.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.362+0000 7f1c217fa640 1 -- 172.21.15.37:0/2715494614 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c18005490 con 0x7f1c240cb010 2024-04-22T07:18:49.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.362+0000 7f1c2ace0640 1 -- 172.21.15.37:0/2715494614 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c240cf570 con 0x7f1c240cb010 2024-04-22T07:18:49.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.362+0000 7f1c217fa640 1 -- 172.21.15.37:0/2715494614 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c18007260 con 0x7f1c240cb010 2024-04-22T07:18:49.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.362+0000 7f1c2ace0640 1 -- 172.21.15.37:0/2715494614 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c240d0010 con 0x7f1c240cb010 2024-04-22T07:18:49.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.364+0000 7f1c2ace0640 1 -- 172.21.15.37:0/2715494614 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c240b4b30 con 0x7f1c240cb010 2024-04-22T07:18:49.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.364+0000 7f1c217fa640 1 -- 172.21.15.37:0/2715494614 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1c18007400 con 0x7f1c240cb010 2024-04-22T07:18:49.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.364+0000 7f1c217fa640 1 --2- 172.21.15.37:0/2715494614 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f1c0806c8f0 0x7f1c0806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:49.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.364+0000 7f1c217fa640 1 -- 172.21.15.37:0/2715494614 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f1c1808afe0 con 0x7f1c240cb010 2024-04-22T07:18:49.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.364+0000 7f1c23fff640 1 --2- 172.21.15.37:0/2715494614 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f1c0806c8f0 0x7f1c0806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:49.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.365+0000 7f1c23fff640 1 --2- 172.21.15.37:0/2715494614 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f1c0806c8f0 0x7f1c0806edb0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f1c10036000 tx=0x7f1c1003b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:49.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.369+0000 7f1c217fa640 1 -- 172.21.15.37:0/2715494614 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f1c240b4b30 con 0x7f1c240cb010 2024-04-22T07:18:49.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.552+0000 7f1c2ace0640 1 -- 172.21.15.37:0/2715494614 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f1c24069cc0 con 0x7f1c240cb010 2024-04-22T07:18:49.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.553+0000 7f1c217fa640 1 -- 172.21.15.37:0/2715494614 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7f1c180594a0 con 0x7f1c240cb010 2024-04-22T07:18:49.551 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2024-04-22T07:18:49.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.554+0000 7f1c2ace0640 1 -- 172.21.15.37:0/2715494614 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f1c0806c8f0 msgr2=0x7f1c0806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:49.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.554+0000 7f1c2ace0640 1 --2- 172.21.15.37:0/2715494614 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f1c0806c8f0 0x7f1c0806edb0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f1c10036000 tx=0x7f1c1003b040 comp rx=0 tx=0).stop 2024-04-22T07:18:49.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.555+0000 7f1c2ace0640 1 -- 172.21.15.37:0/2715494614 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1c240cb010 msgr2=0x7f1c240ceee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:49.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.555+0000 7f1c2ace0640 1 --2- 172.21.15.37:0/2715494614 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1c240cb010 0x7f1c240ceee0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f1c1800c430 tx=0x7f1c1800c8f0 comp rx=0 tx=0).stop 2024-04-22T07:18:49.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.555+0000 7f1c2ace0640 1 -- 172.21.15.37:0/2715494614 shutdown_connections 2024-04-22T07:18:49.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.555+0000 7f1c2ace0640 1 --2- 172.21.15.37:0/2715494614 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f1c0806c8f0 0x7f1c0806edb0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:49.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.555+0000 7f1c2ace0640 1 --2- 172.21.15.37:0/2715494614 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1c241552c0 0x7f1c241f0ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:49.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.555+0000 7f1c2ace0640 1 --2- 172.21.15.37:0/2715494614 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1c240cdd60 0x7f1c24142670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:49.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.555+0000 7f1c2ace0640 1 --2- 172.21.15.37:0/2715494614 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1c240cb010 0x7f1c240ceee0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:49.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.555+0000 7f1c2ace0640 1 -- 172.21.15.37:0/2715494614 >> 172.21.15.37:0/2715494614 conn(0x7f1c2406d330 msgr2=0x7f1c240b4420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:49.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.555+0000 7f1c2ace0640 1 -- 172.21.15.37:0/2715494614 shutdown_connections 2024-04-22T07:18:49.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.555+0000 7f1c2ace0640 1 -- 172.21.15.37:0/2715494614 wait complete. 2024-04-22T07:18:49.563 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-22T07:18:49.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.669+0000 7eff4d504640 1 Processor -- start 2024-04-22T07:18:49.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.669+0000 7eff4d504640 1 -- start start 2024-04-22T07:18:49.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.670+0000 7eff4d504640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7eff48159610 0x7eff48164520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:49.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.670+0000 7eff4d504640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff48153290 con 0x7eff4806fb30 2024-04-22T07:18:49.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.670+0000 7eff4d504640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff480c84f0 con 0x7eff48152eb0 2024-04-22T07:18:49.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.670+0000 7eff4d504640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7eff4806ffc0 con 0x7eff48159610 2024-04-22T07:18:49.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.670+0000 7eff467fc640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7eff4806fb30 0x7eff480c6a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:54270/0 (socket says 172.21.15.37:54270) 2024-04-22T07:18:49.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.670+0000 7eff467fc640 1 -- 172.21.15.37:0/1805891619 learned_addr learned my addr 172.21.15.37:0/1805891619 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-04-22T07:18:49.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.670+0000 7eff477fe640 1 --2- 172.21.15.37:0/1805891619 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7eff48159610 0x7eff48164520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:49.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.671+0000 7eff45ffb640 1 -- 172.21.15.37:0/1805891619 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2874622250 0 0) 0x7eff48153290 con 0x7eff4806fb30 2024-04-22T07:18:49.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.671+0000 7eff45ffb640 1 -- 172.21.15.37:0/1805891619 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7eff34003520 con 0x7eff4806fb30 2024-04-22T07:18:49.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.671+0000 7eff45ffb640 1 -- 172.21.15.37:0/1805891619 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 575230956 0 0) 0x7eff480c84f0 con 0x7eff48152eb0 2024-04-22T07:18:49.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.671+0000 7eff45ffb640 1 -- 172.21.15.37:0/1805891619 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7eff48153290 con 0x7eff48152eb0 2024-04-22T07:18:49.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.671+0000 7eff45ffb640 1 -- 172.21.15.37:0/1805891619 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3465873455 0 0) 0x7eff34003520 con 0x7eff4806fb30 2024-04-22T07:18:49.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.671+0000 7eff45ffb640 1 -- 172.21.15.37:0/1805891619 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7eff48159610 msgr2=0x7eff48164520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:18:49.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.671+0000 7eff45ffb640 1 --2- 172.21.15.37:0/1805891619 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7eff48159610 0x7eff48164520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:49.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.671+0000 7eff45ffb640 1 -- 172.21.15.37:0/1805891619 >> v1:172.21.15.196:6789/0 conn(0x7eff48152eb0 legacy=0x7eff4815c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:49.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.671+0000 7eff45ffb640 1 -- 172.21.15.37:0/1805891619 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff480701e0 con 0x7eff4806fb30 2024-04-22T07:18:49.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.671+0000 7eff45ffb640 1 -- 172.21.15.37:0/1805891619 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2576656170 0 0) 0x7eff30001670 con 0x7eff4806fb30 2024-04-22T07:18:49.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.671+0000 7eff45ffb640 1 -- 172.21.15.37:0/1805891619 >> v1:172.21.15.37:6789/0 conn(0x7eff4806fb30 legacy=0x7eff480c6a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:49.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.671+0000 7eff45ffb640 1 --2- 172.21.15.37:0/1805891619 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7eff48159610 0x7eff34003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:49.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.671+0000 7eff45ffb640 1 --2- 172.21.15.37:0/1805891619 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff340040d0 0x7eff34004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:49.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.671+0000 7eff45ffb640 1 --2- 172.21.15.37:0/1805891619 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7eff34004d40 0x7eff340051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:49.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.671+0000 7eff45ffb640 1 -- 172.21.15.37:0/1805891619 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7eff4806ffc0 con 0x7eff340040d0 2024-04-22T07:18:49.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.671+0000 7eff45ffb640 1 -- 172.21.15.37:0/1805891619 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7eff3400baa0 con 0x7eff34004d40 2024-04-22T07:18:49.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.671+0000 7eff45ffb640 1 -- 172.21.15.37:0/1805891619 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7eff3400bca0 con 0x7eff48159610 2024-04-22T07:18:49.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.671+0000 7eff467fc640 1 --2- 172.21.15.37:0/1805891619 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff340040d0 0x7eff34004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:49.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.671+0000 7eff46ffd640 1 --2- 172.21.15.37:0/1805891619 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7eff48159610 0x7eff34003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:49.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.671+0000 7eff477fe640 1 --2- 172.21.15.37:0/1805891619 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7eff34004d40 0x7eff340051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:49.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.671+0000 7eff467fc640 1 -- 172.21.15.37:0/1805891619 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7eff48159610 msgr2=0x7eff34003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:18:49.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.671+0000 7eff467fc640 1 --2- 172.21.15.37:0/1805891619 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7eff48159610 0x7eff34003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:49.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.671+0000 7eff467fc640 1 -- 172.21.15.37:0/1805891619 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7eff34004d40 msgr2=0x7eff340051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:18:49.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.671+0000 7eff467fc640 1 --2- 172.21.15.37:0/1805891619 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7eff34004d40 0x7eff340051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:49.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.671+0000 7eff467fc640 1 -- 172.21.15.37:0/1805891619 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff34003520 con 0x7eff340040d0 2024-04-22T07:18:49.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.672+0000 7eff467fc640 1 --2- 172.21.15.37:0/1805891619 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff340040d0 0x7eff34004800 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7eff3000c160 tx=0x7eff34005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1401701d04c9958e server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:49.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.672+0000 7eff45ffb640 1 -- 172.21.15.37:0/1805891619 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff30007ca0 con 0x7eff340040d0 2024-04-22T07:18:49.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.672+0000 7eff45ffb640 1 -- 172.21.15.37:0/1805891619 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff30030070 con 0x7eff340040d0 2024-04-22T07:18:49.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.672+0000 7eff45ffb640 1 -- 172.21.15.37:0/1805891619 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff30005d70 con 0x7eff340040d0 2024-04-22T07:18:49.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.673+0000 7eff4d504640 1 -- 172.21.15.37:0/1805891619 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff340040d0 msgr2=0x7eff34004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:49.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.673+0000 7eff4d504640 1 --2- 172.21.15.37:0/1805891619 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff340040d0 0x7eff34004800 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7eff3000c160 tx=0x7eff34005830 comp rx=0 tx=0).stop 2024-04-22T07:18:49.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.673+0000 7eff477fe640 1 -- 172.21.15.37:0/1805891619 reap_dead start 2024-04-22T07:18:49.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.673+0000 7eff4d504640 1 -- 172.21.15.37:0/1805891619 shutdown_connections 2024-04-22T07:18:49.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.673+0000 7eff4d504640 1 -- 172.21.15.37:0/1805891619 >> 172.21.15.37:0/1805891619 conn(0x7eff480cd370 msgr2=0x7eff480cd750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:49.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.673+0000 7eff4d504640 1 -- 172.21.15.37:0/1805891619 shutdown_connections 2024-04-22T07:18:49.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.673+0000 7eff4d504640 1 -- 172.21.15.37:0/1805891619 wait complete. 2024-04-22T07:18:49.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.674+0000 7eff4d504640 1 Processor -- start 2024-04-22T07:18:49.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.674+0000 7eff4d504640 1 -- start start 2024-04-22T07:18:49.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.675+0000 7eff4d504640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7eff340040d0 0x7eff4814fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:49.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.675+0000 7eff4d504640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7eff481562e0 0x7eff481ef210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:49.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.675+0000 7eff4d504640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff48154780 0x7eff481553f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:49.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.675+0000 7eff4d504640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7eff48071040 con 0x7eff48154780 2024-04-22T07:18:49.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.675+0000 7eff4d504640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7eff48070d60 con 0x7eff340040d0 2024-04-22T07:18:49.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.675+0000 7eff4d504640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7eff480c7cf0 con 0x7eff481562e0 2024-04-22T07:18:49.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.675+0000 7eff477fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff48154780 0x7eff481553f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:49.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.675+0000 7eff477fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff48154780 0x7eff481553f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39200/0 (socket says 172.21.15.37:39200) 2024-04-22T07:18:49.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.675+0000 7eff477fe640 1 -- 172.21.15.37:0/3138930297 learned_addr learned my addr 172.21.15.37:0/3138930297 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:18:49.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.675+0000 7eff46ffd640 1 --2- 172.21.15.37:0/3138930297 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7eff340040d0 0x7eff4814fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:49.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.675+0000 7eff467fc640 1 --2- 172.21.15.37:0/3138930297 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7eff481562e0 0x7eff481ef210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:49.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.675+0000 7eff477fe640 1 -- 172.21.15.37:0/3138930297 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7eff481562e0 msgr2=0x7eff481ef210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:49.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.675+0000 7eff477fe640 1 --2- 172.21.15.37:0/3138930297 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7eff481562e0 0x7eff481ef210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:49.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.675+0000 7eff477fe640 1 -- 172.21.15.37:0/3138930297 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7eff340040d0 msgr2=0x7eff4814fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:49.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.675+0000 7eff477fe640 1 --2- 172.21.15.37:0/3138930297 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7eff340040d0 0x7eff4814fc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:49.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.675+0000 7eff477fe640 1 -- 172.21.15.37:0/3138930297 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff481ee750 con 0x7eff48154780 2024-04-22T07:18:49.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.675+0000 7eff477fe640 1 --2- 172.21.15.37:0/3138930297 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff48154780 0x7eff481553f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7eff40011860 tx=0x7eff40011d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:49.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.675+0000 7eff3f7fe640 1 -- 172.21.15.37:0/3138930297 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff40004240 con 0x7eff48154780 2024-04-22T07:18:49.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.676+0000 7eff3f7fe640 1 -- 172.21.15.37:0/3138930297 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff4001b070 con 0x7eff48154780 2024-04-22T07:18:49.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.676+0000 7eff3f7fe640 1 -- 172.21.15.37:0/3138930297 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff4000f740 con 0x7eff48154780 2024-04-22T07:18:49.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.676+0000 7eff4d504640 1 -- 172.21.15.37:0/3138930297 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff481513f0 con 0x7eff48154780 2024-04-22T07:18:49.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.676+0000 7eff4d504640 1 -- 172.21.15.37:0/3138930297 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff481519b0 con 0x7eff48154780 2024-04-22T07:18:49.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.676+0000 7eff4d504640 1 -- 172.21.15.37:0/3138930297 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff48068b20 con 0x7eff48154780 2024-04-22T07:18:49.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.677+0000 7eff3f7fe640 1 -- 172.21.15.37:0/3138930297 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7eff40012040 con 0x7eff48154780 2024-04-22T07:18:49.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.677+0000 7eff3f7fe640 1 --2- 172.21.15.37:0/3138930297 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7eff2806c8f0 0x7eff2806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:49.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.677+0000 7eff3f7fe640 1 -- 172.21.15.37:0/3138930297 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7eff4008b870 con 0x7eff48154780 2024-04-22T07:18:49.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.678+0000 7eff46ffd640 1 --2- 172.21.15.37:0/3138930297 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7eff2806c8f0 0x7eff2806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:49.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.678+0000 7eff46ffd640 1 --2- 172.21.15.37:0/3138930297 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7eff2806c8f0 0x7eff2806edb0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7eff38003ed0 tx=0x7eff38009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:49.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.682+0000 7eff3f7fe640 1 -- 172.21.15.37:0/3138930297 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7eff40059ca0 con 0x7eff48154780 2024-04-22T07:18:49.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.866+0000 7eff4d504640 1 -- 172.21.15.37:0/3138930297 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7eff480c9a90 con 0x7eff48154780 2024-04-22T07:18:49.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.867+0000 7eff3f7fe640 1 -- 172.21.15.37:0/3138930297 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7eff400595a0 con 0x7eff48154780 2024-04-22T07:18:49.865 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 64 2024-04-22T07:18:49.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.869+0000 7eff4d504640 1 -- 172.21.15.37:0/3138930297 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7eff2806c8f0 msgr2=0x7eff2806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:49.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.869+0000 7eff4d504640 1 --2- 172.21.15.37:0/3138930297 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7eff2806c8f0 0x7eff2806edb0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7eff38003ed0 tx=0x7eff38009040 comp rx=0 tx=0).stop 2024-04-22T07:18:49.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.869+0000 7eff4d504640 1 -- 172.21.15.37:0/3138930297 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff48154780 msgr2=0x7eff481553f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:49.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.869+0000 7eff4d504640 1 --2- 172.21.15.37:0/3138930297 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff48154780 0x7eff481553f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7eff40011860 tx=0x7eff40011d20 comp rx=0 tx=0).stop 2024-04-22T07:18:49.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.869+0000 7eff4d504640 1 -- 172.21.15.37:0/3138930297 shutdown_connections 2024-04-22T07:18:49.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.869+0000 7eff4d504640 1 --2- 172.21.15.37:0/3138930297 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7eff2806c8f0 0x7eff2806edb0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:49.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.869+0000 7eff4d504640 1 --2- 172.21.15.37:0/3138930297 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff48154780 0x7eff481553f0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:49.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.869+0000 7eff4d504640 1 --2- 172.21.15.37:0/3138930297 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7eff481562e0 0x7eff481ef210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:49.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.869+0000 7eff4d504640 1 --2- 172.21.15.37:0/3138930297 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7eff340040d0 0x7eff4814fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:49.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.869+0000 7eff4d504640 1 -- 172.21.15.37:0/3138930297 >> 172.21.15.37:0/3138930297 conn(0x7eff480cd370 msgr2=0x7eff480cb170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:49.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.869+0000 7eff4d504640 1 -- 172.21.15.37:0/3138930297 shutdown_connections 2024-04-22T07:18:49.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.869+0000 7eff4d504640 1 -- 172.21.15.37:0/3138930297 wait complete. 2024-04-22T07:18:49.877 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-22T07:18:49.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.980+0000 7fcc3132e640 1 Processor -- start 2024-04-22T07:18:49.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.980+0000 7fcc3132e640 1 -- start start 2024-04-22T07:18:49.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.980+0000 7fcc3132e640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcc2c1552f0 0x7fcc2c0cb430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:49.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.980+0000 7fcc3132e640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fcc2c0b38f0 0x7fcc2c15aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:49.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.980+0000 7fcc3132e640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcc2c15f280 con 0x7fcc2c15b3f0 2024-04-22T07:18:49.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.980+0000 7fcc3132e640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7fcc2c0b3100 con 0x7fcc2c0b38f0 2024-04-22T07:18:49.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.980+0000 7fcc3132e640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fcc2c0cda00 con 0x7fcc2c1552f0 2024-04-22T07:18:49.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.981+0000 7fcc2b7fe640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fcc2c15b3f0 0x7fcc2c0ccd10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:54272/0 (socket says 172.21.15.37:54272) 2024-04-22T07:18:49.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.981+0000 7fcc2b7fe640 1 -- 172.21.15.37:0/3340373068 learned_addr learned my addr 172.21.15.37:0/3340373068 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-04-22T07:18:49.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.981+0000 7fcc2affd640 1 --2- 172.21.15.37:0/3340373068 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcc2c1552f0 0x7fcc2c0cb430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:49.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.981+0000 7fcc227fc640 1 --2- 172.21.15.37:0/3340373068 >> v2:172.21.15.196:3300/0 conn(0x7fcc2c0b38f0 0x7fcc2c15aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:49.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.981+0000 7fcc2a7fc640 1 -- 172.21.15.37:0/3340373068 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3190115021 0 0) 0x7fcc2c15f280 con 0x7fcc2c15b3f0 2024-04-22T07:18:49.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.981+0000 7fcc2a7fc640 1 -- 172.21.15.37:0/3340373068 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcc18003520 con 0x7fcc2c15b3f0 2024-04-22T07:18:49.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.981+0000 7fcc2a7fc640 1 -- 172.21.15.37:0/3340373068 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 411276824 0 0) 0x7fcc18003520 con 0x7fcc2c15b3f0 2024-04-22T07:18:49.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.981+0000 7fcc2a7fc640 1 -- 172.21.15.37:0/3340373068 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcc2c1552f0 msgr2=0x7fcc2c0cb430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:18:49.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.981+0000 7fcc2a7fc640 1 --2- 172.21.15.37:0/3340373068 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcc2c1552f0 0x7fcc2c0cb430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:49.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.981+0000 7fcc2a7fc640 1 -- 172.21.15.37:0/3340373068 >> v2:172.21.15.196:3300/0 conn(0x7fcc2c0b38f0 msgr2=0x7fcc2c15aeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:18:49.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.981+0000 7fcc2a7fc640 1 --2- 172.21.15.37:0/3340373068 >> v2:172.21.15.196:3300/0 conn(0x7fcc2c0b38f0 0x7fcc2c15aeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:49.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.981+0000 7fcc2a7fc640 1 -- 172.21.15.37:0/3340373068 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc2c0b3350 con 0x7fcc2c15b3f0 2024-04-22T07:18:49.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.981+0000 7fcc2a7fc640 1 -- 172.21.15.37:0/3340373068 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2576656170 0 0) 0x7fcc240019f0 con 0x7fcc2c15b3f0 2024-04-22T07:18:49.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.981+0000 7fcc2affd640 1 --2- 172.21.15.37:0/3340373068 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcc2c1552f0 0x7fcc2c0cb430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-22T07:18:49.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.981+0000 7fcc2a7fc640 1 -- 172.21.15.37:0/3340373068 >> v1:172.21.15.37:6789/0 conn(0x7fcc2c15b3f0 legacy=0x7fcc2c0ccd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:49.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.981+0000 7fcc2a7fc640 1 --2- 172.21.15.37:0/3340373068 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcc180039b0 0x7fcc18003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:49.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.981+0000 7fcc2a7fc640 1 --2- 172.21.15.37:0/3340373068 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcc2c1552f0 0x7fcc18004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:49.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.981+0000 7fcc2a7fc640 1 --2- 172.21.15.37:0/3340373068 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcc18004d40 0x7fcc180051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:49.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.981+0000 7fcc2a7fc640 1 -- 172.21.15.37:0/3340373068 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fcc2c0b3100 con 0x7fcc180039b0 2024-04-22T07:18:49.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.981+0000 7fcc2a7fc640 1 -- 172.21.15.37:0/3340373068 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fcc2c0cda00 con 0x7fcc18004d40 2024-04-22T07:18:49.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.981+0000 7fcc2a7fc640 1 -- 172.21.15.37:0/3340373068 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fcc1800b9c0 con 0x7fcc2c1552f0 2024-04-22T07:18:49.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.981+0000 7fcc2affd640 1 --2- 172.21.15.37:0/3340373068 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcc180039b0 0x7fcc18003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:49.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.981+0000 7fcc227fc640 1 --2- 172.21.15.37:0/3340373068 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcc2c1552f0 0x7fcc18004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:49.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.981+0000 7fcc2b7fe640 1 --2- 172.21.15.37:0/3340373068 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcc18004d40 0x7fcc180051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:49.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.982+0000 7fcc2affd640 1 -- 172.21.15.37:0/3340373068 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcc2c1552f0 msgr2=0x7fcc18004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:18:49.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.982+0000 7fcc2affd640 1 --2- 172.21.15.37:0/3340373068 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcc2c1552f0 0x7fcc18004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:49.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.982+0000 7fcc2affd640 1 -- 172.21.15.37:0/3340373068 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcc18004d40 msgr2=0x7fcc180051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:18:49.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.982+0000 7fcc2affd640 1 --2- 172.21.15.37:0/3340373068 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcc18004d40 0x7fcc180051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:49.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.982+0000 7fcc2affd640 1 -- 172.21.15.37:0/3340373068 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc18003520 con 0x7fcc180039b0 2024-04-22T07:18:49.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.982+0000 7fcc227fc640 1 --2- 172.21.15.37:0/3340373068 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcc2c1552f0 0x7fcc18004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T07:18:49.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.982+0000 7fcc2affd640 1 --2- 172.21.15.37:0/3340373068 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcc180039b0 0x7fcc18003dd0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fcc1c009c90 tx=0x7fcc18005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17b505b57c3fe0ef server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:49.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.982+0000 7fcc2a7fc640 1 -- 172.21.15.37:0/3340373068 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc1c039070 con 0x7fcc180039b0 2024-04-22T07:18:49.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.982+0000 7fcc2a7fc640 1 -- 172.21.15.37:0/3340373068 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc1c02c8f0 con 0x7fcc180039b0 2024-04-22T07:18:49.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.982+0000 7fcc2a7fc640 1 -- 172.21.15.37:0/3340373068 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc1c009860 con 0x7fcc180039b0 2024-04-22T07:18:49.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.983+0000 7fcc3132e640 1 -- 172.21.15.37:0/3340373068 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcc180039b0 msgr2=0x7fcc18003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:49.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.983+0000 7fcc3132e640 1 --2- 172.21.15.37:0/3340373068 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcc180039b0 0x7fcc18003dd0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fcc1c009c90 tx=0x7fcc18005830 comp rx=0 tx=0).stop 2024-04-22T07:18:49.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.983+0000 7fcc2b7fe640 1 -- 172.21.15.37:0/3340373068 reap_dead start 2024-04-22T07:18:49.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.983+0000 7fcc3132e640 1 -- 172.21.15.37:0/3340373068 shutdown_connections 2024-04-22T07:18:49.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.983+0000 7fcc3132e640 1 -- 172.21.15.37:0/3340373068 >> 172.21.15.37:0/3340373068 conn(0x7fcc2c071f90 msgr2=0x7fcc2c0723a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:49.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.983+0000 7fcc3132e640 1 -- 172.21.15.37:0/3340373068 shutdown_connections 2024-04-22T07:18:49.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.983+0000 7fcc3132e640 1 -- 172.21.15.37:0/3340373068 wait complete. 2024-04-22T07:18:49.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.984+0000 7fcc3132e640 1 Processor -- start 2024-04-22T07:18:49.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.984+0000 7fcc3132e640 1 -- start start 2024-04-22T07:18:49.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.985+0000 7fcc3132e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcc180039b0 0x7fcc2c1f0bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:49.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.985+0000 7fcc3132e640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcc2c1f1110 0x7fcc2c15caf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:49.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.985+0000 7fcc3132e640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcc2c15d030 0x7fcc2c1f3fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:49.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.985+0000 7fcc3132e640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fcc2c15e7a0 con 0x7fcc180039b0 2024-04-22T07:18:49.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.985+0000 7fcc3132e640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fcc2c15e4c0 con 0x7fcc2c15d030 2024-04-22T07:18:49.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.985+0000 7fcc3132e640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fcc2c15ea80 con 0x7fcc2c1f1110 2024-04-22T07:18:49.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.985+0000 7fcc2affd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcc180039b0 0x7fcc2c1f0bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:49.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.985+0000 7fcc2affd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcc180039b0 0x7fcc2c1f0bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39232/0 (socket says 172.21.15.37:39232) 2024-04-22T07:18:49.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.985+0000 7fcc2affd640 1 -- 172.21.15.37:0/446819365 learned_addr learned my addr 172.21.15.37:0/446819365 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:18:49.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.985+0000 7fcc227fc640 1 --2- 172.21.15.37:0/446819365 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcc2c1f1110 0x7fcc2c15caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:49.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.985+0000 7fcc2affd640 1 -- 172.21.15.37:0/446819365 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcc2c1f1110 msgr2=0x7fcc2c15caf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:49.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.985+0000 7fcc2affd640 1 --2- 172.21.15.37:0/446819365 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcc2c1f1110 0x7fcc2c15caf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:49.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.985+0000 7fcc2affd640 1 -- 172.21.15.37:0/446819365 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcc2c15d030 msgr2=0x7fcc2c1f3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:49.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.985+0000 7fcc2affd640 1 --2- 172.21.15.37:0/446819365 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcc2c15d030 0x7fcc2c1f3fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:49.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.985+0000 7fcc2affd640 1 -- 172.21.15.37:0/446819365 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc2c15d9f0 con 0x7fcc180039b0 2024-04-22T07:18:49.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.986+0000 7fcc2affd640 1 --2- 172.21.15.37:0/446819365 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcc180039b0 0x7fcc2c1f0bd0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fcc1c009db0 tx=0x7fcc1c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:49.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.986+0000 7fcc23fff640 1 -- 172.21.15.37:0/446819365 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc1c039050 con 0x7fcc180039b0 2024-04-22T07:18:49.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.986+0000 7fcc23fff640 1 -- 172.21.15.37:0/446819365 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc1c045070 con 0x7fcc180039b0 2024-04-22T07:18:49.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.986+0000 7fcc3132e640 1 -- 172.21.15.37:0/446819365 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc2c1f1570 con 0x7fcc180039b0 2024-04-22T07:18:49.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.986+0000 7fcc23fff640 1 -- 172.21.15.37:0/446819365 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc1c009860 con 0x7fcc180039b0 2024-04-22T07:18:49.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.986+0000 7fcc3132e640 1 -- 172.21.15.37:0/446819365 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc2c0d1200 con 0x7fcc180039b0 2024-04-22T07:18:49.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.987+0000 7fcc3132e640 1 -- 172.21.15.37:0/446819365 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc2c069cc0 con 0x7fcc180039b0 2024-04-22T07:18:49.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.987+0000 7fcc23fff640 1 -- 172.21.15.37:0/446819365 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fcc1c04a460 con 0x7fcc180039b0 2024-04-22T07:18:49.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.988+0000 7fcc23fff640 1 --2- 172.21.15.37:0/446819365 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fcc0c06c920 0x7fcc0c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:49.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.988+0000 7fcc23fff640 1 -- 172.21.15.37:0/446819365 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fcc1c0add90 con 0x7fcc180039b0 2024-04-22T07:18:49.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.988+0000 7fcc227fc640 1 --2- 172.21.15.37:0/446819365 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fcc0c06c920 0x7fcc0c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:49.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.988+0000 7fcc227fc640 1 --2- 172.21.15.37:0/446819365 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fcc0c06c920 0x7fcc0c06ede0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fcc2c0c7320 tx=0x7fcc14008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:49.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:49.992+0000 7fcc23fff640 1 -- 172.21.15.37:0/446819365 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fcc1c07c120 con 0x7fcc180039b0 2024-04-22T07:18:50.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:50.214+0000 7fcc3132e640 1 -- 172.21.15.37:0/446819365 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcc2c072540 con 0x7fcc180039b0 2024-04-22T07:18:50.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:50.215+0000 7fcc23fff640 1 -- 172.21.15.37:0/446819365 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6827 (secure 0 0 0) 0x7fcc1c07ba20 con 0x7fcc180039b0 2024-04-22T07:18:50.213 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-22T07:18:50.213 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4265,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6839/671847354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6835","nonce":671847354},{"type":"v1","addr":"172.21.15.196:6839","nonce":671847354}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6833/1549427395","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1549427395},{"type":"v1","addr":"172.21.15.37:6833","nonce":1549427395}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6836/3825988951","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":3825988951},{"type":"v1","addr":"172.21.15.37:6836","nonce":3825988951}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4272,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/611771502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6835","nonce":611771502},{"type":"v1","addr":"172.21.15.37:6837","nonce":611771502}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4291,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6837/3055080225","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6834","nonce":3055080225},{"type":"v1","addr":"172.21.15.196:6837","nonce":3055080225}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-22T07:18:36.111618+0000","modified":"2024-04-22T07:18:41.783857+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.196:6838/3264179771","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6836","nonce":3264179771},{"type":"v1","addr":"172.21.15.196:6838","nonce":3264179771}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4294,"qdb_cluster":[4294]},"id":1}]} 2024-04-22T07:18:50.213 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 8 2024-04-22T07:18:50.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:50.217+0000 7fcc3132e640 1 -- 172.21.15.37:0/446819365 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fcc0c06c920 msgr2=0x7fcc0c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:50.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:50.217+0000 7fcc3132e640 1 --2- 172.21.15.37:0/446819365 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fcc0c06c920 0x7fcc0c06ede0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fcc2c0c7320 tx=0x7fcc14008040 comp rx=0 tx=0).stop 2024-04-22T07:18:50.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:50.217+0000 7fcc3132e640 1 -- 172.21.15.37:0/446819365 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcc180039b0 msgr2=0x7fcc2c1f0bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:50.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:50.217+0000 7fcc3132e640 1 --2- 172.21.15.37:0/446819365 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcc180039b0 0x7fcc2c1f0bd0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fcc1c009db0 tx=0x7fcc1c004730 comp rx=0 tx=0).stop 2024-04-22T07:18:50.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:50.217+0000 7fcc3132e640 1 -- 172.21.15.37:0/446819365 shutdown_connections 2024-04-22T07:18:50.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:50.217+0000 7fcc3132e640 1 --2- 172.21.15.37:0/446819365 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fcc0c06c920 0x7fcc0c06ede0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:50.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:50.217+0000 7fcc3132e640 1 --2- 172.21.15.37:0/446819365 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcc2c15d030 0x7fcc2c1f3fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:50.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:50.217+0000 7fcc3132e640 1 --2- 172.21.15.37:0/446819365 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcc2c1f1110 0x7fcc2c15caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:50.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:50.217+0000 7fcc3132e640 1 --2- 172.21.15.37:0/446819365 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcc180039b0 0x7fcc2c1f0bd0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:50.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:50.217+0000 7fcc3132e640 1 -- 172.21.15.37:0/446819365 >> 172.21.15.37:0/446819365 conn(0x7fcc2c071f90 msgr2=0x7fcc2c0b3cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:50.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:50.217+0000 7fcc3132e640 1 -- 172.21.15.37:0/446819365 shutdown_connections 2024-04-22T07:18:50.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:50.217+0000 7fcc3132e640 1 -- 172.21.15.37:0/446819365 wait complete. 2024-04-22T07:18:50.225 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-22T07:18:50.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:50.328+0000 7fdfb5ec0640 1 Processor -- start 2024-04-22T07:18:50.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:50.328+0000 7fdfb5ec0640 1 -- start start 2024-04-22T07:18:50.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:50.329+0000 7fdfb5ec0640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fdfb00c36d0 0x7fdfb00c8a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:50.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:50.329+0000 7fdfb5ec0640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fdfb00c8fd0 0x7fdfb015ae90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:50.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:50.329+0000 7fdfb5ec0640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdfb00c9600 con 0x7fdfb0151a90 2024-04-22T07:18:50.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:50.329+0000 7fdfb5ec0640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fdfb00c93e0 con 0x7fdfb00c36d0 2024-04-22T07:18:50.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:50.329+0000 7fdfb5ec0640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7fdfb01578a0 con 0x7fdfb00c8fd0 2024-04-22T07:18:50.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:50.329+0000 7fdfaeffd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fdfb00c36d0 0x7fdfb00c8a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:50.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:50.329+0000 7fdfaeffd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fdfb00c36d0 0x7fdfb00c8a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39248/0 (socket says 172.21.15.37:39248) 2024-04-22T07:18:50.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:50.329+0000 7fdfaeffd640 1 -- 172.21.15.37:0/2317058496 learned_addr learned my addr 172.21.15.37:0/2317058496 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:18:50.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:50.329+0000 7fdfaffff640 1 --2- 172.21.15.37:0/2317058496 >> v2:172.21.15.196:3300/0 conn(0x7fdfb00c8fd0 0x7fdfb015ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:50.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:50.329+0000 7fdfaeffd640 1 -- 172.21.15.37:0/2317058496 >> v2:172.21.15.196:3300/0 conn(0x7fdfb00c8fd0 msgr2=0x7fdfb015ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:18:50.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:50.329+0000 7fdfaeffd640 1 --2- 172.21.15.37:0/2317058496 >> v2:172.21.15.196:3300/0 conn(0x7fdfb00c8fd0 0x7fdfb015ae90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:50.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:50.329+0000 7fdfaeffd640 1 -- 172.21.15.37:0/2317058496 >> v1:172.21.15.196:6789/0 conn(0x7fdfb0151a90 legacy=0x7fdfb0073340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:18:50.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:50.329+0000 7fdfaeffd640 1 -- 172.21.15.37:0/2317058496 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfb0157b60 con 0x7fdfb00c36d0 2024-04-22T07:18:50.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:50.330+0000 7fdfaeffd640 1 --2- 172.21.15.37:0/2317058496 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdfb00c36d0 0x7fdfb00c8a90 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fdfb01553e0 tx=0x7fdfa402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dfcee82b92a6bb1 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:50.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:50.330+0000 7fdfae7fc640 1 -- 172.21.15.37:0/2317058496 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfa4034070 con 0x7fdfb00c36d0 2024-04-22T07:18:50.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:50.330+0000 7fdfae7fc640 1 -- 172.21.15.37:0/2317058496 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdfa4030860 con 0x7fdfb00c36d0 2024-04-22T07:18:50.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:50.330+0000 7fdfae7fc640 1 -- 172.21.15.37:0/2317058496 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfa4030c30 con 0x7fdfb00c36d0 2024-04-22T07:18:50.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:50.330+0000 7fdfb5ec0640 1 -- 172.21.15.37:0/2317058496 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdfb00c36d0 msgr2=0x7fdfb00c8a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:50.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:50.330+0000 7fdfb5ec0640 1 --2- 172.21.15.37:0/2317058496 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdfb00c36d0 0x7fdfb00c8a90 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fdfb01553e0 tx=0x7fdfa402b9a0 comp rx=0 tx=0).stop 2024-04-22T07:18:50.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:50.330+0000 7fdfb5ec0640 1 -- 172.21.15.37:0/2317058496 shutdown_connections 2024-04-22T07:18:50.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:50.330+0000 7fdfb5ec0640 1 --2- 172.21.15.37:0/2317058496 >> v2:172.21.15.196:3300/0 conn(0x7fdfb00c8fd0 0x7fdfb015ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:50.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:50.330+0000 7fdfb5ec0640 1 --2- 172.21.15.37:0/2317058496 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdfb00c36d0 0x7fdfb00c8a90 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:50.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:50.331+0000 7fdfb5ec0640 1 -- 172.21.15.37:0/2317058496 >> 172.21.15.37:0/2317058496 conn(0x7fdfb006b970 msgr2=0x7fdfb006bd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:50.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:50.331+0000 7fdfb5ec0640 1 -- 172.21.15.37:0/2317058496 shutdown_connections 2024-04-22T07:18:50.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:50.331+0000 7fdfb5ec0640 1 -- 172.21.15.37:0/2317058496 wait complete. 2024-04-22T07:18:50.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:50.332+0000 7fdfb5ec0640 1 Processor -- start 2024-04-22T07:18:50.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:50.332+0000 7fdfb5ec0640 1 -- start start 2024-04-22T07:18:50.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:50.333+0000 7fdfb5ec0640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdfb00c36d0 0x7fdfb0140340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:50.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:50.333+0000 7fdfb5ec0640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fdfb00c8fd0 0x7fdfb0156b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:50.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:50.333+0000 7fdfb5ec0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdfb0151a90 0x7fdfb0140ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:50.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:50.333+0000 7fdfb5ec0640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fdfb0158400 con 0x7fdfb0151a90 2024-04-22T07:18:50.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:50.333+0000 7fdfb5ec0640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fdfb0158120 con 0x7fdfb00c36d0 2024-04-22T07:18:50.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:50.333+0000 7fdfb5ec0640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fdfb0151e70 con 0x7fdfb00c8fd0 2024-04-22T07:18:50.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:50.333+0000 7fdfaffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdfb0151a90 0x7fdfb0140ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:50.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:50.333+0000 7fdfaffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdfb0151a90 0x7fdfb0140ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39258/0 (socket says 172.21.15.37:39258) 2024-04-22T07:18:50.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:50.333+0000 7fdfaffff640 1 -- 172.21.15.37:0/269684978 learned_addr learned my addr 172.21.15.37:0/269684978 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:18:50.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:50.333+0000 7fdfaeffd640 1 --2- 172.21.15.37:0/269684978 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fdfb00c8fd0 0x7fdfb0156b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:50.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:50.333+0000 7fdfaf7fe640 1 --2- 172.21.15.37:0/269684978 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdfb00c36d0 0x7fdfb0140340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:50.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:50.333+0000 7fdfaffff640 1 -- 172.21.15.37:0/269684978 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fdfb00c8fd0 msgr2=0x7fdfb0156b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:50.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:50.333+0000 7fdfaffff640 1 --2- 172.21.15.37:0/269684978 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fdfb00c8fd0 0x7fdfb0156b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:50.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:50.333+0000 7fdfaffff640 1 -- 172.21.15.37:0/269684978 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdfb00c36d0 msgr2=0x7fdfb0140340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:50.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:50.333+0000 7fdfaffff640 1 --2- 172.21.15.37:0/269684978 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdfb00c36d0 0x7fdfb0140340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:50.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:50.333+0000 7fdfaffff640 1 -- 172.21.15.37:0/269684978 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfb014d050 con 0x7fdfb0151a90 2024-04-22T07:18:50.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:50.333+0000 7fdfaffff640 1 --2- 172.21.15.37:0/269684978 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdfb0151a90 0x7fdfb0140ed0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fdfa800cd70 tx=0x7fdfa800a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:50.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:50.333+0000 7fdf97fff640 1 -- 172.21.15.37:0/269684978 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfa8003b90 con 0x7fdfb0151a90 2024-04-22T07:18:50.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:50.333+0000 7fdf97fff640 1 -- 172.21.15.37:0/269684978 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdfa8003d30 con 0x7fdfb0151a90 2024-04-22T07:18:50.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:50.333+0000 7fdfb5ec0640 1 -- 172.21.15.37:0/269684978 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdfb014d2f0 con 0x7fdfb0151a90 2024-04-22T07:18:50.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:50.333+0000 7fdf97fff640 1 -- 172.21.15.37:0/269684978 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfa8004240 con 0x7fdfb0151a90 2024-04-22T07:18:50.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:50.334+0000 7fdfb5ec0640 1 -- 172.21.15.37:0/269684978 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdfb014d8b0 con 0x7fdfb0151a90 2024-04-22T07:18:50.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:50.334+0000 7fdfb5ec0640 1 -- 172.21.15.37:0/269684978 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdfb0069cc0 con 0x7fdfb0151a90 2024-04-22T07:18:50.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:50.335+0000 7fdf97fff640 1 -- 172.21.15.37:0/269684978 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fdfa80043e0 con 0x7fdfb0151a90 2024-04-22T07:18:50.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:50.335+0000 7fdf97fff640 1 --2- 172.21.15.37:0/269684978 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fdf9c06c920 0x7fdf9c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:50.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:50.335+0000 7fdf97fff640 1 -- 172.21.15.37:0/269684978 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fdfa808c3f0 con 0x7fdfb0151a90 2024-04-22T07:18:50.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:50.336+0000 7fdfaf7fe640 1 --2- 172.21.15.37:0/269684978 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fdf9c06c920 0x7fdf9c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:50.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:50.336+0000 7fdfaf7fe640 1 --2- 172.21.15.37:0/269684978 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fdf9c06c920 0x7fdf9c06ede0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fdfa0006fd0 tx=0x7fdfa0009060 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:50.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:50.339+0000 7fdf97fff640 1 -- 172.21.15.37:0/269684978 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fdfa805a260 con 0x7fdfb0151a90 2024-04-22T07:18:50.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:50.528+0000 7fdfb5ec0640 1 -- 172.21.15.37:0/269684978 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fdfb0142100 con 0x7fdfb0151a90 2024-04-22T07:18:50.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:50.530+0000 7fdf97fff640 1 -- 172.21.15.37:0/269684978 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16581 (secure 0 0 0) 0x7fdfa805e560 con 0x7fdfb0151a90 2024-04-22T07:18:50.527 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-22T07:18:50.528 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":20,"fsid":"10d90a41-52d3-4e09-8022-c8ac67897ad1","created":"2024-04-22T07:18:12.420756+0000","modified":"2024-04-22T07:18:37.754119+0000","last_up_change":"2024-04-22T07:18:23.649808+0000","last_in_change":"2024-04-22T07:18:14.506974+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-22T07:18:24.602243+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-22T07:18:34.673639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-22T07:18:35.055184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e248f6e1-13ad-48e0-a8f8-ec3059995654","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":1488290385},{"type":"v1","addr":"172.21.15.37:6801","nonce":1488290385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1488290385},{"type":"v1","addr":"172.21.15.37:6803","nonce":1488290385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1488290385},{"type":"v1","addr":"172.21.15.37:6807","nonce":1488290385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1488290385},{"type":"v1","addr":"172.21.15.37:6805","nonce":1488290385}]},"public_addr":"172.21.15.37:6801/1488290385","cluster_addr":"172.21.15.37:6803/1488290385","heartbeat_back_addr":"172.21.15.37:6807/1488290385","heartbeat_front_addr":"172.21.15.37:6805/1488290385","state":["exists","up"]},{"osd":1,"uuid":"01c71ab7-1326-432b-b73a-e5847abe5132","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3918584183},{"type":"v1","addr":"172.21.15.37:6811","nonce":3918584183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6813","nonce":3918584183},{"type":"v1","addr":"172.21.15.37:6816","nonce":3918584183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":3918584183},{"type":"v1","addr":"172.21.15.37:6823","nonce":3918584183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":3918584183},{"type":"v1","addr":"172.21.15.37:6821","nonce":3918584183}]},"public_addr":"172.21.15.37:6811/3918584183","cluster_addr":"172.21.15.37:6816/3918584183","heartbeat_back_addr":"172.21.15.37:6823/3918584183","heartbeat_front_addr":"172.21.15.37:6821/3918584183","state":["exists","up"]},{"osd":2,"uuid":"33a780fd-013a-41c8-9970-136c9e080897","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1895439419},{"type":"v1","addr":"172.21.15.37:6825","nonce":1895439419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1895439419},{"type":"v1","addr":"172.21.15.37:6827","nonce":1895439419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1895439419},{"type":"v1","addr":"172.21.15.37:6831","nonce":1895439419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1895439419},{"type":"v1","addr":"172.21.15.37:6829","nonce":1895439419}]},"public_addr":"172.21.15.37:6825/1895439419","cluster_addr":"172.21.15.37:6827/1895439419","heartbeat_back_addr":"172.21.15.37:6831/1895439419","heartbeat_front_addr":"172.21.15.37:6829/1895439419","state":["exists","up"]},{"osd":3,"uuid":"b46e53c4-e5b9-4098-b243-ab5a0f1f3885","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6809","nonce":1160021017},{"type":"v1","addr":"172.21.15.37:6810","nonce":1160021017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1160021017},{"type":"v1","addr":"172.21.15.37:6814","nonce":1160021017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":1160021017},{"type":"v1","addr":"172.21.15.37:6820","nonce":1160021017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6815","nonce":1160021017},{"type":"v1","addr":"172.21.15.37:6817","nonce":1160021017}]},"public_addr":"172.21.15.37:6810/1160021017","cluster_addr":"172.21.15.37:6814/1160021017","heartbeat_back_addr":"172.21.15.37:6820/1160021017","heartbeat_front_addr":"172.21.15.37:6817/1160021017","state":["exists","up"]},{"osd":4,"uuid":"cd1032c6-6a83-4e33-b7b1-baddf92a83af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":374829049},{"type":"v1","addr":"172.21.15.196:6809","nonce":374829049}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":374829049},{"type":"v1","addr":"172.21.15.196:6811","nonce":374829049}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":374829049},{"type":"v1","addr":"172.21.15.196:6815","nonce":374829049}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":374829049},{"type":"v1","addr":"172.21.15.196:6813","nonce":374829049}]},"public_addr":"172.21.15.196:6809/374829049","cluster_addr":"172.21.15.196:6811/374829049","heartbeat_back_addr":"172.21.15.196:6815/374829049","heartbeat_front_addr":"172.21.15.196:6813/374829049","state":["exists","up"]},{"osd":5,"uuid":"f561d48a-5f2d-4deb-8681-4329aed36bae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":479311302},{"type":"v1","addr":"172.21.15.196:6801","nonce":479311302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":479311302},{"type":"v1","addr":"172.21.15.196:6803","nonce":479311302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":479311302},{"type":"v1","addr":"172.21.15.196:6807","nonce":479311302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":479311302},{"type":"v1","addr":"172.21.15.196:6805","nonce":479311302}]},"public_addr":"172.21.15.196:6801/479311302","cluster_addr":"172.21.15.196:6803/479311302","heartbeat_back_addr":"172.21.15.196:6807/479311302","heartbeat_front_addr":"172.21.15.196:6805/479311302","state":["exists","up"]},{"osd":6,"uuid":"1b239c7e-2504-42e0-b308-70f4e62519c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6817","nonce":691777224},{"type":"v1","addr":"172.21.15.196:6819","nonce":691777224}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6821","nonce":691777224},{"type":"v1","addr":"172.21.15.196:6823","nonce":691777224}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6829","nonce":691777224},{"type":"v1","addr":"172.21.15.196:6831","nonce":691777224}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6825","nonce":691777224},{"type":"v1","addr":"172.21.15.196:6827","nonce":691777224}]},"public_addr":"172.21.15.196:6819/691777224","cluster_addr":"172.21.15.196:6823/691777224","heartbeat_back_addr":"172.21.15.196:6831/691777224","heartbeat_front_addr":"172.21.15.196:6827/691777224","state":["exists","up"]},{"osd":7,"uuid":"084318d4-d1fd-4b58-8c33-b1d7856fe323","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":3106266066},{"type":"v1","addr":"172.21.15.196:6818","nonce":3106266066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":3106266066},{"type":"v1","addr":"172.21.15.196:6822","nonce":3106266066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":3106266066},{"type":"v1","addr":"172.21.15.196:6830","nonce":3106266066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":3106266066},{"type":"v1","addr":"172.21.15.196:6826","nonce":3106266066}]},"public_addr":"172.21.15.196:6818/3106266066","cluster_addr":"172.21.15.196:6822/3106266066","heartbeat_back_addr":"172.21.15.196:6830/3106266066","heartbeat_front_addr":"172.21.15.196:6826/3106266066","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:18:19.587791+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:18:19.706541+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:18:19.690674+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:18:19.648354+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:18:19.666671+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:18:19.560709+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:18:19.661412+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:18:19.770650+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-22T07:18:50.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:50.532+0000 7fdfb5ec0640 1 -- 172.21.15.37:0/269684978 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fdf9c06c920 msgr2=0x7fdf9c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:50.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:50.532+0000 7fdfb5ec0640 1 --2- 172.21.15.37:0/269684978 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fdf9c06c920 0x7fdf9c06ede0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fdfa0006fd0 tx=0x7fdfa0009060 comp rx=0 tx=0).stop 2024-04-22T07:18:50.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:50.532+0000 7fdfb5ec0640 1 -- 172.21.15.37:0/269684978 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdfb0151a90 msgr2=0x7fdfb0140ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:50.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:50.532+0000 7fdfb5ec0640 1 --2- 172.21.15.37:0/269684978 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdfb0151a90 0x7fdfb0140ed0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fdfa800cd70 tx=0x7fdfa800a660 comp rx=0 tx=0).stop 2024-04-22T07:18:50.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:50.532+0000 7fdfb5ec0640 1 -- 172.21.15.37:0/269684978 shutdown_connections 2024-04-22T07:18:50.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:50.532+0000 7fdfb5ec0640 1 --2- 172.21.15.37:0/269684978 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fdf9c06c920 0x7fdf9c06ede0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:50.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:50.532+0000 7fdfb5ec0640 1 --2- 172.21.15.37:0/269684978 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdfb0151a90 0x7fdfb0140ed0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:50.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:50.532+0000 7fdfb5ec0640 1 --2- 172.21.15.37:0/269684978 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fdfb00c8fd0 0x7fdfb0156b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:50.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:50.532+0000 7fdfb5ec0640 1 --2- 172.21.15.37:0/269684978 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdfb00c36d0 0x7fdfb0140340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:50.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:50.532+0000 7fdfb5ec0640 1 -- 172.21.15.37:0/269684978 >> 172.21.15.37:0/269684978 conn(0x7fdfb006b970 msgr2=0x7fdfb0071a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:50.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:50.532+0000 7fdfb5ec0640 1 -- 172.21.15.37:0/269684978 shutdown_connections 2024-04-22T07:18:50.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:50.532+0000 7fdfb5ec0640 1 -- 172.21.15.37:0/269684978 wait complete. 2024-04-22T07:18:50.541 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-22T07:18:50.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:50.643+0000 7f08e3e81640 1 Processor -- start 2024-04-22T07:18:50.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:50.643+0000 7f08e3e81640 1 -- start start 2024-04-22T07:18:50.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:50.644+0000 7f08e3e81640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f08dc071f90 0x7f08dc15e280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:50.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:50.644+0000 7f08e3e81640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f08dc15e7c0 0x7f08dc0caf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:50.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:50.644+0000 7f08e3e81640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08dc0c6d20 con 0x7f08dc154f90 2024-04-22T07:18:50.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:50.644+0000 7f08e3e81640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f08dc072540 con 0x7f08dc15e7c0 2024-04-22T07:18:50.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:50.644+0000 7f08e3e81640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f08dc072820 con 0x7f08dc071f90 2024-04-22T07:18:50.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:50.644+0000 7f08e241e640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f08dc15e7c0 0x7f08dc0caf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:50.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:50.644+0000 7f08e241e640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f08dc15e7c0 0x7f08dc0caf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39260/0 (socket says 172.21.15.37:39260) 2024-04-22T07:18:50.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:50.644+0000 7f08e1c1d640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f08dc154f90 0x7f08dc0cc7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:54282/0 (socket says 172.21.15.37:54282) 2024-04-22T07:18:50.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:50.644+0000 7f08e241e640 1 -- 172.21.15.37:0/654950825 learned_addr learned my addr 172.21.15.37:0/654950825 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:18:50.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:50.644+0000 7f08e141c640 1 --2- 172.21.15.37:0/654950825 >> v2:172.21.15.196:3300/0 conn(0x7f08dc071f90 0x7f08dc15e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:50.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:50.644+0000 7f08e241e640 1 -- 172.21.15.37:0/654950825 >> v2:172.21.15.196:3300/0 conn(0x7f08dc071f90 msgr2=0x7f08dc15e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:18:50.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:50.644+0000 7f08e241e640 1 --2- 172.21.15.37:0/654950825 >> v2:172.21.15.196:3300/0 conn(0x7f08dc071f90 0x7f08dc15e280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:50.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:50.644+0000 7f08e241e640 1 -- 172.21.15.37:0/654950825 >> v1:172.21.15.37:6789/0 conn(0x7f08dc154f90 legacy=0x7f08dc0cc7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:50.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:50.644+0000 7f08e0c1b640 1 -- 172.21.15.37:0/654950825 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 382236608 0 0) 0x7f08dc0c6d20 con 0x7f08dc154f90 2024-04-22T07:18:50.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:50.644+0000 7f08e241e640 1 -- 172.21.15.37:0/654950825 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08dc0c5f60 con 0x7f08dc15e7c0 2024-04-22T07:18:50.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:50.645+0000 7f08e241e640 1 --2- 172.21.15.37:0/654950825 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08dc15e7c0 0x7f08dc0caf70 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f08dc0cabf0 tx=0x7f08cc02bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d2c5916a068e53a server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:50.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:50.645+0000 7f08e0c1b640 1 -- 172.21.15.37:0/654950825 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08cc02cb20 con 0x7f08dc15e7c0 2024-04-22T07:18:50.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:50.645+0000 7f08e0c1b640 1 -- 172.21.15.37:0/654950825 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08cc02ccc0 con 0x7f08dc15e7c0 2024-04-22T07:18:50.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:50.645+0000 7f08e0c1b640 1 -- 172.21.15.37:0/654950825 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08cc034610 con 0x7f08dc15e7c0 2024-04-22T07:18:50.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:50.646+0000 7f08e3e81640 1 -- 172.21.15.37:0/654950825 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08dc15e7c0 msgr2=0x7f08dc0caf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:50.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:50.646+0000 7f08e3e81640 1 --2- 172.21.15.37:0/654950825 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08dc15e7c0 0x7f08dc0caf70 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f08dc0cabf0 tx=0x7f08cc02bf80 comp rx=0 tx=0).stop 2024-04-22T07:18:50.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:50.646+0000 7f08e3e81640 1 -- 172.21.15.37:0/654950825 shutdown_connections 2024-04-22T07:18:50.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:50.646+0000 7f08e3e81640 1 --2- 172.21.15.37:0/654950825 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08dc15e7c0 0x7f08dc0caf70 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:50.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:50.646+0000 7f08e3e81640 1 --2- 172.21.15.37:0/654950825 >> v2:172.21.15.196:3300/0 conn(0x7f08dc071f90 0x7f08dc15e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:50.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:50.646+0000 7f08e3e81640 1 -- 172.21.15.37:0/654950825 >> 172.21.15.37:0/654950825 conn(0x7f08dc067ad0 msgr2=0x7f08dc0d05f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:50.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:50.646+0000 7f08e3e81640 1 -- 172.21.15.37:0/654950825 shutdown_connections 2024-04-22T07:18:50.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:50.646+0000 7f08e3e81640 1 -- 172.21.15.37:0/654950825 wait complete. 2024-04-22T07:18:50.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:50.647+0000 7f08e3e81640 1 Processor -- start 2024-04-22T07:18:50.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:50.647+0000 7f08e3e81640 1 -- start start 2024-04-22T07:18:50.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:50.648+0000 7f08e3e81640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f08dc071f90 0x7f08dc1f4740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:50.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:50.648+0000 7f08e3e81640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f08dc154f90 0x7f08dc0b5560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:50.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:50.648+0000 7f08e3e81640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08dc15e7c0 0x7f08dc0b5aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:50.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:50.648+0000 7f08e3e81640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f08dc0c6800 con 0x7f08dc15e7c0 2024-04-22T07:18:50.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:50.648+0000 7f08e3e81640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f08dc0c6520 con 0x7f08dc071f90 2024-04-22T07:18:50.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:50.648+0000 7f08e3e81640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f08dc155370 con 0x7f08dc154f90 2024-04-22T07:18:50.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:50.648+0000 7f08e241e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08dc15e7c0 0x7f08dc0b5aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:50.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:50.648+0000 7f08e241e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08dc15e7c0 0x7f08dc0b5aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39264/0 (socket says 172.21.15.37:39264) 2024-04-22T07:18:50.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:50.648+0000 7f08e241e640 1 -- 172.21.15.37:0/3987427382 learned_addr learned my addr 172.21.15.37:0/3987427382 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:18:50.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:50.648+0000 7f08e141c640 1 --2- 172.21.15.37:0/3987427382 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f08dc154f90 0x7f08dc0b5560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:50.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:50.648+0000 7f08e1c1d640 1 --2- 172.21.15.37:0/3987427382 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f08dc071f90 0x7f08dc1f4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:50.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:50.648+0000 7f08e241e640 1 -- 172.21.15.37:0/3987427382 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f08dc154f90 msgr2=0x7f08dc0b5560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:50.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:50.648+0000 7f08e241e640 1 --2- 172.21.15.37:0/3987427382 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f08dc154f90 0x7f08dc0b5560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:50.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:50.648+0000 7f08e241e640 1 -- 172.21.15.37:0/3987427382 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f08dc071f90 msgr2=0x7f08dc1f4740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:50.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:50.648+0000 7f08e241e640 1 --2- 172.21.15.37:0/3987427382 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f08dc071f90 0x7f08dc1f4740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:50.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:50.648+0000 7f08e241e640 1 -- 172.21.15.37:0/3987427382 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08dc1e5960 con 0x7f08dc15e7c0 2024-04-22T07:18:50.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:50.648+0000 7f08e1c1d640 1 --2- 172.21.15.37:0/3987427382 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f08dc071f90 0x7f08dc1f4740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T07:18:50.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:50.648+0000 7f08e241e640 1 --2- 172.21.15.37:0/3987427382 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08dc15e7c0 0x7f08dc0b5aa0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f08cc009f40 tx=0x7f08cc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:50.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:50.649+0000 7f08da7fc640 1 -- 172.21.15.37:0/3987427382 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08cc043030 con 0x7f08dc15e7c0 2024-04-22T07:18:50.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:50.649+0000 7f08da7fc640 1 -- 172.21.15.37:0/3987427382 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08cc03e450 con 0x7f08dc15e7c0 2024-04-22T07:18:50.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:50.649+0000 7f08e3e81640 1 -- 172.21.15.37:0/3987427382 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08dc1f4c80 con 0x7f08dc15e7c0 2024-04-22T07:18:50.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:50.649+0000 7f08da7fc640 1 -- 172.21.15.37:0/3987427382 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08cc009510 con 0x7f08dc15e7c0 2024-04-22T07:18:50.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:50.649+0000 7f08e3e81640 1 -- 172.21.15.37:0/3987427382 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08dc1e56a0 con 0x7f08dc15e7c0 2024-04-22T07:18:50.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:50.649+0000 7f08e3e81640 1 -- 172.21.15.37:0/3987427382 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08dc0c72c0 con 0x7f08dc15e7c0 2024-04-22T07:18:50.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:50.650+0000 7f08da7fc640 1 -- 172.21.15.37:0/3987427382 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f08cc046070 con 0x7f08dc15e7c0 2024-04-22T07:18:50.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:50.650+0000 7f08da7fc640 1 --2- 172.21.15.37:0/3987427382 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f08c806c8f0 0x7f08c806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:50.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:50.651+0000 7f08da7fc640 1 -- 172.21.15.37:0/3987427382 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f08cc0adf00 con 0x7f08dc15e7c0 2024-04-22T07:18:50.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:50.651+0000 7f08e1c1d640 1 --2- 172.21.15.37:0/3987427382 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f08c806c8f0 0x7f08c806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:50.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:50.651+0000 7f08e1c1d640 1 --2- 172.21.15.37:0/3987427382 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f08c806c8f0 0x7f08c806edb0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f08d4000f60 tx=0x7f08d4007ca0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:50.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:50.655+0000 7f08da7fc640 1 -- 172.21.15.37:0/3987427382 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f08dc0c72c0 con 0x7f08dc15e7c0 2024-04-22T07:18:50.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:50.881+0000 7f08e3e81640 1 -- 172.21.15.37:0/3987427382 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f08dc0cba40 con 0x7f08dc15e7c0 2024-04-22T07:18:50.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:50.882+0000 7f08da7fc640 1 -- 172.21.15.37:0/3987427382 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6827 (secure 0 0 0) 0x7f08cc04d070 con 0x7f08dc15e7c0 2024-04-22T07:18:50.880 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-22T07:18:50.880 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4265,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6839/671847354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6835","nonce":671847354},{"type":"v1","addr":"172.21.15.196:6839","nonce":671847354}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6833/1549427395","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1549427395},{"type":"v1","addr":"172.21.15.37:6833","nonce":1549427395}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6836/3825988951","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":3825988951},{"type":"v1","addr":"172.21.15.37:6836","nonce":3825988951}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4272,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/611771502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6835","nonce":611771502},{"type":"v1","addr":"172.21.15.37:6837","nonce":611771502}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4291,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6837/3055080225","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6834","nonce":3055080225},{"type":"v1","addr":"172.21.15.196:6837","nonce":3055080225}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-22T07:18:36.111618+0000","modified":"2024-04-22T07:18:41.783857+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.196:6838/3264179771","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6836","nonce":3264179771},{"type":"v1","addr":"172.21.15.196:6838","nonce":3264179771}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4294,"qdb_cluster":[4294]},"id":1}]} 2024-04-22T07:18:50.880 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 8 2024-04-22T07:18:50.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:50.884+0000 7f08e3e81640 1 -- 172.21.15.37:0/3987427382 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f08c806c8f0 msgr2=0x7f08c806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:50.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:50.884+0000 7f08e3e81640 1 --2- 172.21.15.37:0/3987427382 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f08c806c8f0 0x7f08c806edb0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f08d4000f60 tx=0x7f08d4007ca0 comp rx=0 tx=0).stop 2024-04-22T07:18:50.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:50.884+0000 7f08e3e81640 1 -- 172.21.15.37:0/3987427382 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08dc15e7c0 msgr2=0x7f08dc0b5aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:50.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:50.884+0000 7f08e3e81640 1 --2- 172.21.15.37:0/3987427382 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08dc15e7c0 0x7f08dc0b5aa0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f08cc009f40 tx=0x7f08cc004a40 comp rx=0 tx=0).stop 2024-04-22T07:18:50.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:50.884+0000 7f08e3e81640 1 -- 172.21.15.37:0/3987427382 shutdown_connections 2024-04-22T07:18:50.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:50.884+0000 7f08e3e81640 1 --2- 172.21.15.37:0/3987427382 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f08c806c8f0 0x7f08c806edb0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:50.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:50.884+0000 7f08e3e81640 1 --2- 172.21.15.37:0/3987427382 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08dc15e7c0 0x7f08dc0b5aa0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:50.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:50.884+0000 7f08e3e81640 1 --2- 172.21.15.37:0/3987427382 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f08dc154f90 0x7f08dc0b5560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:50.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:50.884+0000 7f08e3e81640 1 --2- 172.21.15.37:0/3987427382 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f08dc071f90 0x7f08dc1f4740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:50.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:50.884+0000 7f08e3e81640 1 -- 172.21.15.37:0/3987427382 >> 172.21.15.37:0/3987427382 conn(0x7f08dc067ad0 msgr2=0x7f08dc062420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:50.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:50.884+0000 7f08e3e81640 1 -- 172.21.15.37:0/3987427382 shutdown_connections 2024-04-22T07:18:50.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:50.884+0000 7f08e3e81640 1 -- 172.21.15.37:0/3987427382 wait complete. 2024-04-22T07:18:51.157 INFO:tasks.ceph.mds.f.smithi196.stderr:2024-04-22T07:18:51.159+0000 7f6249af0640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-22T07:18:51.496 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-22T07:18:36.111618+0000', 'modified': '2024-04-22T07:18:41.783857+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4294}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4294': {'gid': 4294, 'name': 'f', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.196:6838/3264179771', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.196:6836', 'nonce': 3264179771}, {'type': 'v1', 'addr': '172.21.15.196:6838', 'nonce': 3264179771}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4294, 'qdb_cluster': [4294]} 2024-04-22T07:18:51.497 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-22T07:18:51.497 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.f status 2024-04-22T07:18:51.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.610+0000 7f973b7c3640 1 Processor -- start 2024-04-22T07:18:51.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.610+0000 7f973b7c3640 1 -- start start 2024-04-22T07:18:51.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.611+0000 7f973b7c3640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f97340cb0b0 0x7f97340cc460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:51.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.611+0000 7f973b7c3640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f97341555d0 con 0x7f97341551f0 2024-04-22T07:18:51.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.611+0000 7f973b7c3640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f97340ccbc0 con 0x7f97340cde00 2024-04-22T07:18:51.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.611+0000 7f973b7c3640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f97340cc9a0 con 0x7f97340cb0b0 2024-04-22T07:18:51.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.611+0000 7f973955f640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f97341551f0 0x7f973415e4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:54290/0 (socket says 172.21.15.37:54290) 2024-04-22T07:18:51.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.611+0000 7f973955f640 1 -- 172.21.15.37:0/3684647125 learned_addr learned my addr 172.21.15.37:0/3684647125 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-04-22T07:18:51.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.611+0000 7f9739d60640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f97340cb0b0 0x7f97340cc460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:51.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.611+0000 7f9739d60640 1 -- 172.21.15.37:0/3684647125 >> v1:172.21.15.196:6789/0 conn(0x7f97340cde00 legacy=0x7f97340730c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:18:51.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.611+0000 7f9739d60640 1 -- 172.21.15.37:0/3684647125 >> v1:172.21.15.37:6789/0 conn(0x7f97341551f0 legacy=0x7f973415e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:51.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.611+0000 7f972bfff640 1 -- 172.21.15.37:0/3684647125 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1573282024 0 0) 0x7f97341555d0 con 0x7f97341551f0 2024-04-22T07:18:51.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.611+0000 7f9739d60640 1 -- 172.21.15.37:0/3684647125 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97340ccea0 con 0x7f97340cb0b0 2024-04-22T07:18:51.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.612+0000 7f9739d60640 1 --2- 172.21.15.37:0/3684647125 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97340cb0b0 0x7f97340cc460 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f972c009d90 tx=0x7f972c02bfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=268ca1f79b8922e2 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:51.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.612+0000 7f972bfff640 1 -- 172.21.15.37:0/3684647125 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f972c039070 con 0x7f97340cb0b0 2024-04-22T07:18:51.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.612+0000 7f972bfff640 1 -- 172.21.15.37:0/3684647125 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f972c02cd80 con 0x7f97340cb0b0 2024-04-22T07:18:51.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.612+0000 7f972bfff640 1 -- 172.21.15.37:0/3684647125 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f972c034660 con 0x7f97340cb0b0 2024-04-22T07:18:51.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.612+0000 7f973b7c3640 1 -- 172.21.15.37:0/3684647125 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97340cb0b0 msgr2=0x7f97340cc460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:51.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.612+0000 7f973b7c3640 1 --2- 172.21.15.37:0/3684647125 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97340cb0b0 0x7f97340cc460 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f972c009d90 tx=0x7f972c02bfd0 comp rx=0 tx=0).stop 2024-04-22T07:18:51.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.613+0000 7f973b7c3640 1 -- 172.21.15.37:0/3684647125 shutdown_connections 2024-04-22T07:18:51.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.613+0000 7f973b7c3640 1 --2- 172.21.15.37:0/3684647125 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97340cb0b0 0x7f97340cc460 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:51.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.613+0000 7f973b7c3640 1 -- 172.21.15.37:0/3684647125 >> 172.21.15.37:0/3684647125 conn(0x7f973406c410 msgr2=0x7f97340676b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:51.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.613+0000 7f973b7c3640 1 -- 172.21.15.37:0/3684647125 shutdown_connections 2024-04-22T07:18:51.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.613+0000 7f973b7c3640 1 -- 172.21.15.37:0/3684647125 wait complete. 2024-04-22T07:18:51.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.614+0000 7f973b7c3640 1 Processor -- start 2024-04-22T07:18:51.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.614+0000 7f973b7c3640 1 -- start start 2024-04-22T07:18:51.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.614+0000 7f973b7c3640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f97340cb0b0 0x7f9734148eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:51.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.614+0000 7f973b7c3640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97340cde00 0x7f9734150960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:51.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.614+0000 7f973b7c3640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f97341551f0 0x7f9734150ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:51.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.615+0000 7f973b7c3640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f973415b5c0 con 0x7f97340cde00 2024-04-22T07:18:51.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.615+0000 7f973b7c3640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f973415b2e0 con 0x7f97340cb0b0 2024-04-22T07:18:51.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.615+0000 7f973b7c3640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f973415b8a0 con 0x7f97341551f0 2024-04-22T07:18:51.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.615+0000 7f9738d5e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97340cde00 0x7f9734150960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:51.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.615+0000 7f9738d5e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97340cde00 0x7f9734150960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39290/0 (socket says 172.21.15.37:39290) 2024-04-22T07:18:51.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.615+0000 7f9738d5e640 1 -- 172.21.15.37:0/2133232968 learned_addr learned my addr 172.21.15.37:0/2133232968 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:18:51.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.615+0000 7f973955f640 1 --2- 172.21.15.37:0/2133232968 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f97340cb0b0 0x7f9734148eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:51.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.615+0000 7f9739d60640 1 --2- 172.21.15.37:0/2133232968 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f97341551f0 0x7f9734150ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:51.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.615+0000 7f9738d5e640 1 -- 172.21.15.37:0/2133232968 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f97341551f0 msgr2=0x7f9734150ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:51.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.615+0000 7f9738d5e640 1 --2- 172.21.15.37:0/2133232968 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f97341551f0 0x7f9734150ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:51.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.615+0000 7f9738d5e640 1 -- 172.21.15.37:0/2133232968 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f97340cb0b0 msgr2=0x7f9734148eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:51.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.615+0000 7f9738d5e640 1 --2- 172.21.15.37:0/2133232968 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f97340cb0b0 0x7f9734148eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:51.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.615+0000 7f9738d5e640 1 -- 172.21.15.37:0/2133232968 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97341457e0 con 0x7f97340cde00 2024-04-22T07:18:51.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.615+0000 7f9739d60640 1 --2- 172.21.15.37:0/2133232968 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f97341551f0 0x7f9734150ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T07:18:51.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.615+0000 7f973955f640 1 --2- 172.21.15.37:0/2133232968 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f97340cb0b0 0x7f9734148eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T07:18:51.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.615+0000 7f9738d5e640 1 --2- 172.21.15.37:0/2133232968 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97340cde00 0x7f9734150960 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f972400c400 tx=0x7f972400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:51.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.615+0000 7f9729ffb640 1 -- 172.21.15.37:0/2133232968 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9724017070 con 0x7f97340cde00 2024-04-22T07:18:51.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.615+0000 7f9729ffb640 1 -- 172.21.15.37:0/2133232968 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97240052d0 con 0x7f97340cde00 2024-04-22T07:18:51.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.615+0000 7f973b7c3640 1 -- 172.21.15.37:0/2133232968 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9734151770 con 0x7f97340cde00 2024-04-22T07:18:51.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.615+0000 7f9729ffb640 1 -- 172.21.15.37:0/2133232968 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9724003830 con 0x7f97340cde00 2024-04-22T07:18:51.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.616+0000 7f973b7c3640 1 -- 172.21.15.37:0/2133232968 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97341593e0 con 0x7f97340cde00 2024-04-22T07:18:51.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.617+0000 7f9729ffb640 1 -- 172.21.15.37:0/2133232968 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f972401a070 con 0x7f97340cde00 2024-04-22T07:18:51.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.617+0000 7f9729ffb640 1 --2- 172.21.15.37:0/2133232968 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f971806c920 0x7f971806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:51.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.617+0000 7f9729ffb640 1 -- 172.21.15.37:0/2133232968 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f972408aee0 con 0x7f97340cde00 2024-04-22T07:18:51.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.618+0000 7f973955f640 1 --2- 172.21.15.37:0/2133232968 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f971806c920 0x7f971806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:51.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.618+0000 7f973955f640 1 --2- 172.21.15.37:0/2133232968 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f971806c920 0x7f971806ede0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f9730007fd0 tx=0x7f9730007dc0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:51.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.618+0000 7f973e3b0740 1 Processor -- start 2024-04-22T07:18:51.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.618+0000 7f973e3b0740 1 -- start start 2024-04-22T07:18:51.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.619+0000 7f973e3b0740 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x562db4385e40 0x562db438ef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:51.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.619+0000 7f973e3b0740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562db4346ec0 0x562db438f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:51.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.619+0000 7f973e3b0740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562db4342ca0 0x562db436aee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:51.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.619+0000 7f973e3b0740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x562db42a9b10 con 0x562db4342ca0 2024-04-22T07:18:51.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.619+0000 7f973e3b0740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x562db4247240 con 0x562db4346ec0 2024-04-22T07:18:51.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.619+0000 7f973e3b0740 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x562db42a5ad0 con 0x562db4385e40 2024-04-22T07:18:51.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.619+0000 7f9739d60640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562db4342ca0 0x562db436aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:51.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.619+0000 7f9739d60640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562db4342ca0 0x562db436aee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39304/0 (socket says 172.21.15.37:39304) 2024-04-22T07:18:51.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.619+0000 7f9739d60640 1 -- 172.21.15.37:0/4129738019 learned_addr learned my addr 172.21.15.37:0/4129738019 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:18:51.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.619+0000 7f973955f640 1 --2- 172.21.15.37:0/4129738019 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x562db4385e40 0x562db438ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:51.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.619+0000 7f9738d5e640 1 --2- 172.21.15.37:0/4129738019 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562db4346ec0 0x562db438f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:51.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.620+0000 7f9739d60640 1 -- 172.21.15.37:0/4129738019 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x562db4385e40 msgr2=0x562db438ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:18:51.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.620+0000 7f9739d60640 1 --2- 172.21.15.37:0/4129738019 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x562db4385e40 0x562db438ef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:51.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.620+0000 7f9739d60640 1 -- 172.21.15.37:0/4129738019 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562db4346ec0 msgr2=0x562db438f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:18:51.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.620+0000 7f9739d60640 1 --2- 172.21.15.37:0/4129738019 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562db4346ec0 0x562db438f4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:51.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.620+0000 7f9739d60640 1 -- 172.21.15.37:0/4129738019 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562db3fbc2d0 con 0x562db4342ca0 2024-04-22T07:18:51.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.620+0000 7f9739d60640 1 --2- 172.21.15.37:0/4129738019 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562db4342ca0 0x562db436aee0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f972c037040 tx=0x7f972c02e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e20ffb0686169d66 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:51.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.620+0000 7f971effd640 1 -- 172.21.15.37:0/4129738019 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f972c039070 con 0x562db4342ca0 2024-04-22T07:18:51.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.620+0000 7f971effd640 1 -- 172.21.15.37:0/4129738019 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f972c045070 con 0x562db4342ca0 2024-04-22T07:18:51.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.620+0000 7f971effd640 1 -- 172.21.15.37:0/4129738019 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f972c003db0 con 0x562db4342ca0 2024-04-22T07:18:51.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.620+0000 7f973e3b0740 1 -- 172.21.15.37:0/4129738019 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562db4342ca0 msgr2=0x562db436aee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:51.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.620+0000 7f973e3b0740 1 --2- 172.21.15.37:0/4129738019 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562db4342ca0 0x562db436aee0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f972c037040 tx=0x7f972c02e000 comp rx=0 tx=0).stop 2024-04-22T07:18:51.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.621+0000 7f973e3b0740 1 -- 172.21.15.37:0/4129738019 shutdown_connections 2024-04-22T07:18:51.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.621+0000 7f973e3b0740 1 --2- 172.21.15.37:0/4129738019 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562db4342ca0 0x562db436aee0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:51.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.621+0000 7f973e3b0740 1 --2- 172.21.15.37:0/4129738019 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562db4346ec0 0x562db438f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:51.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.621+0000 7f973e3b0740 1 --2- 172.21.15.37:0/4129738019 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x562db4385e40 0x562db438ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:51.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.621+0000 7f973e3b0740 1 -- 172.21.15.37:0/4129738019 >> 172.21.15.37:0/4129738019 conn(0x562db4341990 msgr2=0x562db4344290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:51.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.621+0000 7f973e3b0740 1 -- 172.21.15.37:0/4129738019 shutdown_connections 2024-04-22T07:18:51.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.621+0000 7f973e3b0740 1 -- 172.21.15.37:0/4129738019 wait complete. 2024-04-22T07:18:51.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.621+0000 7f973e3b0740 1 -- start start 2024-04-22T07:18:51.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.621+0000 7f973e3b0740 1 Processor -- start 2024-04-22T07:18:51.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.622+0000 7f973e3b0740 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x562db4346ec0 0x562db4399f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:51.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.622+0000 7f973e3b0740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562db4385e40 0x562db438a560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:51.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.622+0000 7f973e3b0740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562db4366330 0x562db4387330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:51.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.622+0000 7f973e3b0740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x562db4345250 con 0x562db4366330 2024-04-22T07:18:51.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.622+0000 7f973e3b0740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x562db4232190 con 0x562db4385e40 2024-04-22T07:18:51.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.622+0000 7f973e3b0740 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x562db4345530 con 0x562db4346ec0 2024-04-22T07:18:51.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.622+0000 7f973e3b0740 10 client.0 _ll_register_callbacks cb 0x562db422d8b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-22T07:18:51.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.622+0000 7f9739d60640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562db4366330 0x562db4387330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:51.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.622+0000 7f9739d60640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562db4366330 0x562db4387330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39306/0 (socket says 172.21.15.37:39306) 2024-04-22T07:18:51.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.622+0000 7f9739d60640 1 -- 172.21.15.37:0/870057225 learned_addr learned my addr 172.21.15.37:0/870057225 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:18:51.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.622+0000 7f9738d5e640 1 --2- 172.21.15.37:0/870057225 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562db4385e40 0x562db438a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:51.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.622+0000 7f973955f640 1 --2- 172.21.15.37:0/870057225 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x562db4346ec0 0x562db4399f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:51.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.623+0000 7f9739d60640 1 -- 172.21.15.37:0/870057225 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x562db4346ec0 msgr2=0x562db4399f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:18:51.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.623+0000 7f9739d60640 1 --2- 172.21.15.37:0/870057225 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x562db4346ec0 0x562db4399f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:51.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.623+0000 7f9739d60640 1 -- 172.21.15.37:0/870057225 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562db4385e40 msgr2=0x562db438a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:18:51.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.623+0000 7f9739d60640 1 --2- 172.21.15.37:0/870057225 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562db4385e40 0x562db438a560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:51.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.623+0000 7f9739d60640 1 -- 172.21.15.37:0/870057225 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562db40866b0 con 0x562db4366330 2024-04-22T07:18:51.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.623+0000 7f9739d60640 1 --2- 172.21.15.37:0/870057225 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562db4366330 0x562db4387330 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f972c009e80 tx=0x7f972c004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc0bf368390647e9 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:51.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.623+0000 7f9713fff640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-04-22T07:18:51.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.623+0000 7f9713fff640 1 -- 172.21.15.37:0/870057225 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f972c04e070 con 0x562db4366330 2024-04-22T07:18:51.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.623+0000 7f9713fff640 1 -- 172.21.15.37:0/870057225 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f972c004240 con 0x562db4366330 2024-04-22T07:18:51.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.623+0000 7f973e3b0740 1 -- 172.21.15.37:0/870057225 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f972c045070 con 0x562db4366330 2024-04-22T07:18:51.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.623+0000 7f9713fff640 1 -- 172.21.15.37:0/870057225 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7f972c059050 con 0x562db4366330 2024-04-22T07:18:51.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.623+0000 7f973e3b0740 10 client.4686 fetch_fsmap learned FSMap version 8 2024-04-22T07:18:51.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.623+0000 7f973e3b0740 1 -- 172.21.15.37:0/870057225 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x562db438e560 con 0x562db4366330 2024-04-22T07:18:51.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.623+0000 7f9713fff640 1 -- 172.21.15.37:0/870057225 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f972c045070 con 0x562db4366330 2024-04-22T07:18:51.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.623+0000 7f9713fff640 1 -- 172.21.15.37:0/870057225 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 8) ==== 4704+0+0 (secure 0 0 0) 0x7f972c05c020 con 0x562db4366330 2024-04-22T07:18:51.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.623+0000 7f973e3b0740 10 client.4686 fetch_fsmap finished waiting for FSMap version 8 2024-04-22T07:18:51.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.623+0000 7f973e3b0740 10 client.4686 resolve_mds: resolved name 'f' to daemon mds.f 2024-04-22T07:18:51.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.623+0000 7f973e3b0740 20 client.4686 populate_metadata read hostname 'smithi037' 2024-04-22T07:18:51.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.623+0000 7f973e3b0740 1 --2- 172.21.15.37:0/870057225 >> [v2:172.21.15.196:6836/3264179771,v1:172.21.15.196:6838/3264179771] conn(0x562db437fbe0 0x562db43a57c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:51.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.623+0000 7f973e3b0740 4 client.4686 mds_command: new command op to 4294 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-22T07:18:51.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.623+0000 7f973e3b0740 1 -- 172.21.15.37:0/870057225 --> [v2:172.21.15.196:6836/3264179771,v1:172.21.15.196:6838/3264179771] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562db42b7530 con 0x562db437fbe0 2024-04-22T07:18:51.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.624+0000 7f973955f640 1 --2- 172.21.15.37:0/870057225 >> [v2:172.21.15.196:6836/3264179771,v1:172.21.15.196:6838/3264179771] conn(0x562db437fbe0 0x562db43a57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:51.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.624+0000 7f9713fff640 10 client.4686 ms_handle_connect on v2:172.21.15.196:6836/3264179771 2024-04-22T07:18:51.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.624+0000 7f973955f640 1 --2- 172.21.15.37:0/870057225 >> [v2:172.21.15.196:6836/3264179771,v1:172.21.15.196:6838/3264179771] conn(0x562db437fbe0 0x562db43a57c0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9d39f80b1cb202a5 server_cookie=e500a3dc860cf046 in_seq=0 out_seq=0 2024-04-22T07:18:51.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.625+0000 7f9713fff640 1 -- 172.21.15.37:0/870057225 <== mds.0 v2:172.21.15.196:6836/3264179771 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x562db42b7530 con 0x562db437fbe0 2024-04-22T07:18:51.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.625+0000 7f9713fff640 10 client.4686 handle_command_reply: tid=0 2024-04-22T07:18:51.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.625+0000 7f973e3b0740 1 client.4686 shutdown 2024-04-22T07:18:51.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.625+0000 7f973e3b0740 1 -- 172.21.15.37:0/870057225 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562db4366330 msgr2=0x562db4387330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:51.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.625+0000 7f973e3b0740 1 --2- 172.21.15.37:0/870057225 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562db4366330 0x562db4387330 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f972c009e80 tx=0x7f972c004ab0 comp rx=0 tx=0).stop 2024-04-22T07:18:51.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.625+0000 7f973e3b0740 1 -- 172.21.15.37:0/870057225 shutdown_connections 2024-04-22T07:18:51.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.625+0000 7f973e3b0740 1 --2- 172.21.15.37:0/870057225 >> [v2:172.21.15.196:6836/3264179771,v1:172.21.15.196:6838/3264179771] conn(0x562db437fbe0 0x562db43a57c0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:51.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.625+0000 7f973e3b0740 1 --2- 172.21.15.37:0/870057225 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562db4366330 0x562db4387330 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:51.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.625+0000 7f973e3b0740 1 --2- 172.21.15.37:0/870057225 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562db4385e40 0x562db438a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:51.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.625+0000 7f9713fff640 0 client.4686 ms_handle_reset on v2:172.21.15.196:6836/3264179771 2024-04-22T07:18:51.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.625+0000 7f973e3b0740 1 --2- 172.21.15.37:0/870057225 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x562db4346ec0 0x562db4399f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:51.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.625+0000 7f973e3b0740 1 -- 172.21.15.37:0/870057225 >> 172.21.15.37:0/870057225 conn(0x562db4342ca0 msgr2=0x562db4345a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:51.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.625+0000 7f973e3b0740 1 -- 172.21.15.37:0/870057225 shutdown_connections 2024-04-22T07:18:51.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.625+0000 7f973e3b0740 1 -- 172.21.15.37:0/870057225 wait complete. 2024-04-22T07:18:51.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.625+0000 7f973e3b0740 20 client.4686 trim_cache size 0 max 16384 2024-04-22T07:18:51.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.644+0000 7f973e3b0740 1 Processor -- start 2024-04-22T07:18:51.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.644+0000 7f973e3b0740 1 -- start start 2024-04-22T07:18:51.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.645+0000 7f973e3b0740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562db4346ec0 0x562db4399080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:51.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.645+0000 7f973e3b0740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562db4366330 0x562db435c820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:51.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.645+0000 7f973e3b0740 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x562db437fbe0 0x562db435cd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:51.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.645+0000 7f973e3b0740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f97341f4430 con 0x562db4366330 2024-04-22T07:18:51.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.645+0000 7f973e3b0740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f97341f4a80 con 0x562db4346ec0 2024-04-22T07:18:51.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.645+0000 7f973e3b0740 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x562db438ad50 con 0x562db437fbe0 2024-04-22T07:18:51.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.645+0000 7f9738d5e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562db4366330 0x562db435c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:51.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.645+0000 7f9738d5e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562db4366330 0x562db435c820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39314/0 (socket says 172.21.15.37:39314) 2024-04-22T07:18:51.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.645+0000 7f9738d5e640 1 -- 172.21.15.37:0/3248247205 learned_addr learned my addr 172.21.15.37:0/3248247205 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:18:51.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.645+0000 7f9739d60640 1 --2- 172.21.15.37:0/3248247205 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x562db437fbe0 0x562db435cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:51.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.645+0000 7f973955f640 1 --2- 172.21.15.37:0/3248247205 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562db4346ec0 0x562db4399080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:51.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.645+0000 7f9738d5e640 1 -- 172.21.15.37:0/3248247205 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x562db437fbe0 msgr2=0x562db435cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:18:51.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.645+0000 7f9738d5e640 1 --2- 172.21.15.37:0/3248247205 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x562db437fbe0 0x562db435cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:51.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.645+0000 7f9738d5e640 1 -- 172.21.15.37:0/3248247205 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562db4346ec0 msgr2=0x562db4399080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:18:51.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.645+0000 7f9738d5e640 1 --2- 172.21.15.37:0/3248247205 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562db4346ec0 0x562db4399080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:51.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.645+0000 7f9738d5e640 1 -- 172.21.15.37:0/3248247205 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562db438aed0 con 0x562db4366330 2024-04-22T07:18:51.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.645+0000 7f973955f640 1 --2- 172.21.15.37:0/3248247205 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562db4346ec0 0x562db4399080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-22T07:18:51.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.645+0000 7f9738d5e640 1 --2- 172.21.15.37:0/3248247205 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562db4366330 0x562db435c820 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f9724058910 tx=0x7f9724005040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6035468e1282b9fa server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:51.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.645+0000 7f971e7fc640 1 -- 172.21.15.37:0/3248247205 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9724056cb0 con 0x562db4366330 2024-04-22T07:18:51.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.645+0000 7f971e7fc640 1 -- 172.21.15.37:0/3248247205 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9724056f10 con 0x562db4366330 2024-04-22T07:18:51.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.645+0000 7f971e7fc640 1 -- 172.21.15.37:0/3248247205 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9724055280 con 0x562db4366330 2024-04-22T07:18:51.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.646+0000 7f973e3b0740 1 -- 172.21.15.37:0/3248247205 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562db4366330 msgr2=0x562db435c820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:51.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.646+0000 7f973e3b0740 1 --2- 172.21.15.37:0/3248247205 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562db4366330 0x562db435c820 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f9724058910 tx=0x7f9724005040 comp rx=0 tx=0).stop 2024-04-22T07:18:51.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.646+0000 7f973e3b0740 1 -- 172.21.15.37:0/3248247205 shutdown_connections 2024-04-22T07:18:51.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.646+0000 7f973e3b0740 1 --2- 172.21.15.37:0/3248247205 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x562db437fbe0 0x562db435cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:51.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.646+0000 7f973e3b0740 1 --2- 172.21.15.37:0/3248247205 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562db4366330 0x562db435c820 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:51.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.646+0000 7f973e3b0740 1 --2- 172.21.15.37:0/3248247205 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562db4346ec0 0x562db4399080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:51.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.646+0000 7f973e3b0740 1 -- 172.21.15.37:0/3248247205 >> 172.21.15.37:0/3248247205 conn(0x562db4342ca0 msgr2=0x562db433a800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:51.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.646+0000 7f973e3b0740 1 -- 172.21.15.37:0/3248247205 shutdown_connections 2024-04-22T07:18:51.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.646+0000 7f973e3b0740 1 -- 172.21.15.37:0/3248247205 wait complete. 2024-04-22T07:18:51.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.646+0000 7f973e3b0740 1 -- start start 2024-04-22T07:18:51.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.647+0000 7f973e3b0740 1 Processor -- start 2024-04-22T07:18:51.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.647+0000 7f973e3b0740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562db4346ec0 0x562db4369690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:51.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.647+0000 7f973e3b0740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562db4366330 0x562db438cd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:51.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.647+0000 7f973e3b0740 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x562db437fbe0 0x562db438d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:51.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.647+0000 7f973e3b0740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x562db43a1230 con 0x562db4346ec0 2024-04-22T07:18:51.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.647+0000 7f973e3b0740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x562db4380000 con 0x562db4366330 2024-04-22T07:18:51.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.647+0000 7f973e3b0740 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x562db43a18e0 con 0x562db437fbe0 2024-04-22T07:18:51.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.648+0000 7f973e3b0740 10 client.0 _ll_register_callbacks cb 0x7f9724005540 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-22T07:18:51.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.648+0000 7f973955f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562db4346ec0 0x562db4369690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:51.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.648+0000 7f973955f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562db4346ec0 0x562db4369690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39328/0 (socket says 172.21.15.37:39328) 2024-04-22T07:18:51.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.648+0000 7f973955f640 1 -- 172.21.15.37:0/3513981570 learned_addr learned my addr 172.21.15.37:0/3513981570 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:18:51.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.648+0000 7f9738d5e640 1 --2- 172.21.15.37:0/3513981570 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562db4366330 0x562db438cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:51.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.648+0000 7f9739d60640 1 --2- 172.21.15.37:0/3513981570 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x562db437fbe0 0x562db438d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:51.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.648+0000 7f973955f640 1 -- 172.21.15.37:0/3513981570 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x562db437fbe0 msgr2=0x562db438d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:18:51.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.648+0000 7f973955f640 1 --2- 172.21.15.37:0/3513981570 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x562db437fbe0 0x562db438d7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:51.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.648+0000 7f973955f640 1 -- 172.21.15.37:0/3513981570 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562db4366330 msgr2=0x562db438cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:18:51.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.648+0000 7f973955f640 1 --2- 172.21.15.37:0/3513981570 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562db4366330 0x562db438cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:51.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.648+0000 7f973955f640 1 -- 172.21.15.37:0/3513981570 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562db436a570 con 0x562db4346ec0 2024-04-22T07:18:51.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.648+0000 7f9738d5e640 1 --2- 172.21.15.37:0/3513981570 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562db4366330 0x562db438cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T07:18:51.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.648+0000 7f973955f640 1 --2- 172.21.15.37:0/3513981570 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562db4346ec0 0x562db4369690 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f9730001d40 tx=0x7f9730011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=494dab6cef2da64c server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:51.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.648+0000 7f9713fff640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-04-22T07:18:51.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.648+0000 7f9713fff640 1 -- 172.21.15.37:0/3513981570 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9730026b50 con 0x562db4346ec0 2024-04-22T07:18:51.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.648+0000 7f9713fff640 1 -- 172.21.15.37:0/3513981570 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f9730010040 con 0x562db4346ec0 2024-04-22T07:18:51.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.648+0000 7f973e3b0740 1 -- 172.21.15.37:0/3513981570 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9724056f10 con 0x562db4346ec0 2024-04-22T07:18:51.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.648+0000 7f9713fff640 1 -- 172.21.15.37:0/3513981570 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7f9730035050 con 0x562db4346ec0 2024-04-22T07:18:51.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.648+0000 7f973e3b0740 10 client.4692 fetch_fsmap learned FSMap version 8 2024-04-22T07:18:51.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.648+0000 7f973e3b0740 1 -- 172.21.15.37:0/3513981570 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x562db4383ae0 con 0x562db4346ec0 2024-04-22T07:18:51.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.648+0000 7f9713fff640 1 -- 172.21.15.37:0/3513981570 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9724056f10 con 0x562db4346ec0 2024-04-22T07:18:51.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.649+0000 7f9713fff640 1 -- 172.21.15.37:0/3513981570 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 8) ==== 4704+0+0 (secure 0 0 0) 0x7f9730038020 con 0x562db4346ec0 2024-04-22T07:18:51.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.649+0000 7f973e3b0740 10 client.4692 fetch_fsmap finished waiting for FSMap version 8 2024-04-22T07:18:51.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.649+0000 7f973e3b0740 10 client.4692 resolve_mds: resolved name 'f' to daemon mds.f 2024-04-22T07:18:51.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.649+0000 7f973e3b0740 20 client.4692 populate_metadata read hostname 'smithi037' 2024-04-22T07:18:51.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.649+0000 7f973e3b0740 1 --2- 172.21.15.37:0/3513981570 >> [v2:172.21.15.196:6836/3264179771,v1:172.21.15.196:6838/3264179771] conn(0x562db4385e40 0x562db43a9b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:51.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.649+0000 7f973e3b0740 4 client.4692 mds_command: new command op to 4294 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-22T07:18:51.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.649+0000 7f973e3b0740 1 -- 172.21.15.37:0/3513981570 --> [v2:172.21.15.196:6836/3264179771,v1:172.21.15.196:6838/3264179771] -- command(tid 0: {"prefix": "status"}) -- 0x562db4384420 con 0x562db4385e40 2024-04-22T07:18:51.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.649+0000 7f9738d5e640 1 --2- 172.21.15.37:0/3513981570 >> [v2:172.21.15.196:6836/3264179771,v1:172.21.15.196:6838/3264179771] conn(0x562db4385e40 0x562db43a9b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:51.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.649+0000 7f9713fff640 10 client.4692 ms_handle_connect on v2:172.21.15.196:6836/3264179771 2024-04-22T07:18:51.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.649+0000 7f9738d5e640 1 --2- 172.21.15.37:0/3513981570 >> [v2:172.21.15.196:6836/3264179771,v1:172.21.15.196:6838/3264179771] conn(0x562db4385e40 0x562db43a9b70 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=47694cae86aec5ca server_cookie=5fbd10606c098632 in_seq=0 out_seq=0 2024-04-22T07:18:51.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.649+0000 7f9713fff640 1 -- 172.21.15.37:0/3513981570 <== mds.0 v2:172.21.15.196:6836/3264179771 1 ==== command_reply(tid 0: 0 ) ==== 8+0+324 (crc 0 0 0) 0x562db4384420 con 0x562db4385e40 2024-04-22T07:18:51.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.649+0000 7f9713fff640 10 client.4692 handle_command_reply: tid=0 2024-04-22T07:18:51.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.649+0000 7f973e3b0740 1 client.4692 shutdown 2024-04-22T07:18:51.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.649+0000 7f973e3b0740 1 -- 172.21.15.37:0/3513981570 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562db4346ec0 msgr2=0x562db4369690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:51.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.649+0000 7f973e3b0740 1 --2- 172.21.15.37:0/3513981570 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562db4346ec0 0x562db4369690 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f9730001d40 tx=0x7f9730011000 comp rx=0 tx=0).stop 2024-04-22T07:18:51.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.650+0000 7f973e3b0740 1 -- 172.21.15.37:0/3513981570 shutdown_connections 2024-04-22T07:18:51.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.650+0000 7f973e3b0740 1 --2- 172.21.15.37:0/3513981570 >> [v2:172.21.15.196:6836/3264179771,v1:172.21.15.196:6838/3264179771] conn(0x562db4385e40 0x562db43a9b70 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:51.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.650+0000 7f973e3b0740 1 --2- 172.21.15.37:0/3513981570 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x562db437fbe0 0x562db438d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:51.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.650+0000 7f973e3b0740 1 --2- 172.21.15.37:0/3513981570 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562db4366330 0x562db438cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:51.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.650+0000 7f9713fff640 0 client.4692 ms_handle_reset on v2:172.21.15.196:6836/3264179771 2024-04-22T07:18:51.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.650+0000 7f973e3b0740 1 --2- 172.21.15.37:0/3513981570 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562db4346ec0 0x562db4369690 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:51.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.650+0000 7f973e3b0740 1 -- 172.21.15.37:0/3513981570 >> 172.21.15.37:0/3513981570 conn(0x562db4342ca0 msgr2=0x562db4386da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:51.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.650+0000 7f973e3b0740 1 -- 172.21.15.37:0/3513981570 shutdown_connections 2024-04-22T07:18:51.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.650+0000 7f973e3b0740 1 -- 172.21.15.37:0/3513981570 wait complete. 2024-04-22T07:18:51.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.650+0000 7f973e3b0740 20 client.4692 trim_cache size 0 max 16384 2024-04-22T07:18:51.656 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-04-22T07:18:51.656 INFO:teuthology.orchestra.run.smithi037.stdout: "cluster_fsid": "10d90a41-52d3-4e09-8022-c8ac67897ad1", 2024-04-22T07:18:51.656 INFO:teuthology.orchestra.run.smithi037.stdout: "whoami": 0, 2024-04-22T07:18:51.656 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 4294, 2024-04-22T07:18:51.657 INFO:teuthology.orchestra.run.smithi037.stdout: "want_state": "up:active", 2024-04-22T07:18:51.657 INFO:teuthology.orchestra.run.smithi037.stdout: "state": "up:active", 2024-04-22T07:18:51.657 INFO:teuthology.orchestra.run.smithi037.stdout: "fs_name": "cephfs", 2024-04-22T07:18:51.657 INFO:teuthology.orchestra.run.smithi037.stdout: "rank_uptime": 14.895042131, 2024-04-22T07:18:51.657 INFO:teuthology.orchestra.run.smithi037.stdout: "mdsmap_epoch": 8, 2024-04-22T07:18:51.657 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch": 20, 2024-04-22T07:18:51.657 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch_barrier": 20, 2024-04-22T07:18:51.657 INFO:teuthology.orchestra.run.smithi037.stdout: "uptime": 21.490723604999999 2024-04-22T07:18:51.657 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-04-22T07:18:51.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.650+0000 7f973b7c3640 1 -- 172.21.15.37:0/2133232968 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f971806c920 msgr2=0x7f971806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:51.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.650+0000 7f973b7c3640 1 --2- 172.21.15.37:0/2133232968 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f971806c920 0x7f971806ede0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f9730007fd0 tx=0x7f9730007dc0 comp rx=0 tx=0).stop 2024-04-22T07:18:51.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.650+0000 7f973b7c3640 1 -- 172.21.15.37:0/2133232968 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97340cde00 msgr2=0x7f9734150960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:51.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.650+0000 7f973b7c3640 1 --2- 172.21.15.37:0/2133232968 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97340cde00 0x7f9734150960 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f972400c400 tx=0x7f972400c8c0 comp rx=0 tx=0).stop 2024-04-22T07:18:51.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.650+0000 7f973b7c3640 1 -- 172.21.15.37:0/2133232968 shutdown_connections 2024-04-22T07:18:51.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.650+0000 7f973b7c3640 1 --2- 172.21.15.37:0/2133232968 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f971806c920 0x7f971806ede0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:51.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.650+0000 7f973b7c3640 1 --2- 172.21.15.37:0/2133232968 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f97341551f0 0x7f9734150ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:51.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.650+0000 7f973b7c3640 1 --2- 172.21.15.37:0/2133232968 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97340cde00 0x7f9734150960 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:51.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.650+0000 7f973b7c3640 1 --2- 172.21.15.37:0/2133232968 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f97340cb0b0 0x7f9734148eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:51.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.650+0000 7f973b7c3640 1 -- 172.21.15.37:0/2133232968 >> 172.21.15.37:0/2133232968 conn(0x7f973406c410 msgr2=0x7f97340ce940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:51.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.650+0000 7f973b7c3640 1 -- 172.21.15.37:0/2133232968 shutdown_connections 2024-04-22T07:18:51.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.650+0000 7f973b7c3640 1 -- 172.21.15.37:0/2133232968 wait complete. 2024-04-22T07:18:51.660 INFO:teuthology.run_tasks:Running task sequential... 2024-04-22T07:18:51.671 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-04-22T07:18:51.671 INFO:teuthology.task.sequential:In sequential, running task print... 2024-04-22T07:18:51.672 INFO:teuthology.task.print:Enabling mgr modules 2024-04-22T07:18:51.672 INFO:teuthology.run_tasks:Running task kclient... 2024-04-22T07:18:51.694 INFO:tasks.kclient:Mounting kernel clients... 2024-04-22T07:18:51.694 INFO:tasks.kclient:config is {'client.0': {}} 2024-04-22T07:18:51.694 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-22T07:18:51.695 DEBUG:teuthology.orchestra.run.smithi037:> ip netns list 2024-04-22T07:18:51.711 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-22T07:18:51.711 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link delete ceph-brx 2024-04-22T07:18:51.776 INFO:teuthology.orchestra.run.smithi037.stderr:Cannot find device "ceph-brx" 2024-04-22T07:18:51.777 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-22T07:18:51.777 INFO:tasks.kclient:client.0 config is {'syntax': 'v2'} 2024-04-22T07:18:51.778 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-22T07:18:51.778 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-22T07:18:51.778 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-22T07:18:51.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.920+0000 7fd8972b3640 1 Processor -- start 2024-04-22T07:18:51.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.921+0000 7fd8972b3640 1 -- start start 2024-04-22T07:18:51.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.921+0000 7fd8972b3640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fd89006c6a0 0x7fd89015b610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:51.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.921+0000 7fd8972b3640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd89015ae70 con 0x7fd8901550b0 2024-04-22T07:18:51.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.921+0000 7fd8972b3640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd8900cc650 con 0x7fd89015bb50 2024-04-22T07:18:51.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.921+0000 7fd8972b3640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7fd8900c5530 con 0x7fd89006c6a0 2024-04-22T07:18:51.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.921+0000 7fd89504f640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fd8901550b0 0x7fd8900cbf00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:54294/0 (socket says 172.21.15.37:54294) 2024-04-22T07:18:51.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.921+0000 7fd89504f640 1 -- 172.21.15.37:0/476342868 learned_addr learned my addr 172.21.15.37:0/476342868 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-04-22T07:18:51.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.922+0000 7fd89484e640 1 --2- 172.21.15.37:0/476342868 >> v2:172.21.15.196:3300/0 conn(0x7fd89006c6a0 0x7fd89015b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:51.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.922+0000 7fd887fff640 1 -- 172.21.15.37:0/476342868 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3858758292 0 0) 0x7fd88c001110 con 0x7fd8901550b0 2024-04-22T07:18:51.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.922+0000 7fd887fff640 1 -- 172.21.15.37:0/476342868 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd87c003520 con 0x7fd8901550b0 2024-04-22T07:18:51.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.922+0000 7fd887fff640 1 -- 172.21.15.37:0/476342868 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3487859504 0 0) 0x7fd87c003520 con 0x7fd8901550b0 2024-04-22T07:18:51.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.922+0000 7fd887fff640 1 -- 172.21.15.37:0/476342868 >> v2:172.21.15.196:3300/0 conn(0x7fd89006c6a0 msgr2=0x7fd89015b610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:18:51.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.922+0000 7fd887fff640 1 --2- 172.21.15.37:0/476342868 >> v2:172.21.15.196:3300/0 conn(0x7fd89006c6a0 0x7fd89015b610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:51.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.922+0000 7fd887fff640 1 -- 172.21.15.37:0/476342868 >> v1:172.21.15.196:6789/0 conn(0x7fd89015bb50 legacy=0x7fd8900d0af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:51.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.922+0000 7fd887fff640 1 -- 172.21.15.37:0/476342868 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd89015f290 con 0x7fd8901550b0 2024-04-22T07:18:51.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.922+0000 7fd887fff640 1 -- 172.21.15.37:0/476342868 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2576656170 0 0) 0x7fd88c001840 con 0x7fd8901550b0 2024-04-22T07:18:51.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.922+0000 7fd887fff640 1 -- 172.21.15.37:0/476342868 >> v1:172.21.15.37:6789/0 conn(0x7fd8901550b0 legacy=0x7fd8900cbf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:51.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.922+0000 7fd887fff640 1 --2- 172.21.15.37:0/476342868 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd87c0039b0 0x7fd87c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:51.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.922+0000 7fd887fff640 1 --2- 172.21.15.37:0/476342868 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd87c004800 0x7fd87c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:51.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.922+0000 7fd887fff640 1 --2- 172.21.15.37:0/476342868 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd87c0051c0 0x7fd87c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:51.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.922+0000 7fd887fff640 1 -- 172.21.15.37:0/476342868 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd87c00c030 con 0x7fd87c0051c0 2024-04-22T07:18:51.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.922+0000 7fd887fff640 1 -- 172.21.15.37:0/476342868 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fd87c00c1e0 con 0x7fd87c004800 2024-04-22T07:18:51.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.922+0000 7fd887fff640 1 -- 172.21.15.37:0/476342868 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fd87c00c3e0 con 0x7fd87c0039b0 2024-04-22T07:18:51.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.922+0000 7fd895850640 1 --2- 172.21.15.37:0/476342868 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd87c0051c0 0x7fd87c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:51.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.922+0000 7fd89484e640 1 --2- 172.21.15.37:0/476342868 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd87c004800 0x7fd87c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:51.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.922+0000 7fd89504f640 1 --2- 172.21.15.37:0/476342868 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd87c0039b0 0x7fd87c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:51.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.922+0000 7fd895850640 1 -- 172.21.15.37:0/476342868 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd87c0039b0 msgr2=0x7fd87c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:18:51.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.922+0000 7fd895850640 1 --2- 172.21.15.37:0/476342868 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd87c0039b0 0x7fd87c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:51.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.922+0000 7fd895850640 1 -- 172.21.15.37:0/476342868 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd87c004800 msgr2=0x7fd87c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:18:51.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.922+0000 7fd895850640 1 --2- 172.21.15.37:0/476342868 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd87c004800 0x7fd87c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:51.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.923+0000 7fd895850640 1 -- 172.21.15.37:0/476342868 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd87c003520 con 0x7fd87c0051c0 2024-04-22T07:18:51.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.923+0000 7fd895850640 1 -- 172.21.15.37:0/476342868 reap_dead start 2024-04-22T07:18:51.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.923+0000 7fd895850640 1 --2- 172.21.15.37:0/476342868 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd87c0051c0 0x7fd87c00b9c0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fd888001e50 tx=0x7fd87c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb71d4856eab9325 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:51.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.923+0000 7fd887fff640 1 -- 172.21.15.37:0/476342868 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd888001a70 con 0x7fd87c0051c0 2024-04-22T07:18:51.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.923+0000 7fd887fff640 1 -- 172.21.15.37:0/476342868 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd888003b90 con 0x7fd87c0051c0 2024-04-22T07:18:51.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.923+0000 7fd887fff640 1 -- 172.21.15.37:0/476342868 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8880050d0 con 0x7fd87c0051c0 2024-04-22T07:18:51.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.924+0000 7fd8972b3640 1 -- 172.21.15.37:0/476342868 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd87c0051c0 msgr2=0x7fd87c00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:51.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.924+0000 7fd8972b3640 1 --2- 172.21.15.37:0/476342868 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd87c0051c0 0x7fd87c00b9c0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fd888001e50 tx=0x7fd87c005830 comp rx=0 tx=0).stop 2024-04-22T07:18:51.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.924+0000 7fd8972b3640 1 -- 172.21.15.37:0/476342868 shutdown_connections 2024-04-22T07:18:51.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.924+0000 7fd8972b3640 1 --2- 172.21.15.37:0/476342868 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd87c0051c0 0x7fd87c00b9c0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:51.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.924+0000 7fd8972b3640 1 -- 172.21.15.37:0/476342868 >> 172.21.15.37:0/476342868 conn(0x7fd890073630 msgr2=0x7fd890073a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:51.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.924+0000 7fd8972b3640 1 -- 172.21.15.37:0/476342868 shutdown_connections 2024-04-22T07:18:51.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.924+0000 7fd8972b3640 1 -- 172.21.15.37:0/476342868 wait complete. 2024-04-22T07:18:51.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.925+0000 7fd8972b3640 1 Processor -- start 2024-04-22T07:18:51.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.925+0000 7fd8972b3640 1 -- start start 2024-04-22T07:18:51.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.926+0000 7fd8972b3640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd87c0051c0 0x7fd8900cfcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:51.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.926+0000 7fd8972b3640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd890155b20 0x7fd89015c360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:51.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.926+0000 7fd8972b3640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd8901f40d0 0x7fd89015c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:51.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.926+0000 7fd8972b3640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd89015b0f0 con 0x7fd87c0051c0 2024-04-22T07:18:51.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.926+0000 7fd8972b3640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fd8900ccbd0 con 0x7fd890155b20 2024-04-22T07:18:51.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.926+0000 7fd8972b3640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fd890155490 con 0x7fd8901f40d0 2024-04-22T07:18:51.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.926+0000 7fd89504f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd87c0051c0 0x7fd8900cfcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:51.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.926+0000 7fd89504f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd87c0051c0 0x7fd8900cfcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39358/0 (socket says 172.21.15.37:39358) 2024-04-22T07:18:51.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.926+0000 7fd89504f640 1 -- 172.21.15.37:0/1014513315 learned_addr learned my addr 172.21.15.37:0/1014513315 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:18:51.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.926+0000 7fd89504f640 1 -- 172.21.15.37:0/1014513315 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd8901f40d0 msgr2=0x7fd89015c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:51.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.926+0000 7fd89504f640 1 --2- 172.21.15.37:0/1014513315 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd8901f40d0 0x7fd89015c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:51.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.926+0000 7fd89504f640 1 -- 172.21.15.37:0/1014513315 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd890155b20 msgr2=0x7fd89015c360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:51.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.926+0000 7fd89504f640 1 --2- 172.21.15.37:0/1014513315 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd890155b20 0x7fd89015c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:51.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.926+0000 7fd89504f640 1 -- 172.21.15.37:0/1014513315 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8901f0c70 con 0x7fd87c0051c0 2024-04-22T07:18:51.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.926+0000 7fd89504f640 1 --2- 172.21.15.37:0/1014513315 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd87c0051c0 0x7fd8900cfcf0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fd88c007370 tx=0x7fd88c007830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:51.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.926+0000 7fd885ffb640 1 -- 172.21.15.37:0/1014513315 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd88c01a070 con 0x7fd87c0051c0 2024-04-22T07:18:51.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.926+0000 7fd885ffb640 1 -- 172.21.15.37:0/1014513315 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd88c00f960 con 0x7fd87c0051c0 2024-04-22T07:18:51.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.926+0000 7fd8972b3640 1 -- 172.21.15.37:0/1014513315 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8901f0f50 con 0x7fd87c0051c0 2024-04-22T07:18:51.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.926+0000 7fd885ffb640 1 -- 172.21.15.37:0/1014513315 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd88c00fd70 con 0x7fd87c0051c0 2024-04-22T07:18:51.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.927+0000 7fd8972b3640 1 -- 172.21.15.37:0/1014513315 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8901f1510 con 0x7fd87c0051c0 2024-04-22T07:18:51.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.928+0000 7fd8972b3640 1 -- 172.21.15.37:0/1014513315 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd890069cc0 con 0x7fd87c0051c0 2024-04-22T07:18:51.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.928+0000 7fd885ffb640 1 -- 172.21.15.37:0/1014513315 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd88c01d070 con 0x7fd87c0051c0 2024-04-22T07:18:51.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.928+0000 7fd885ffb640 1 --2- 172.21.15.37:0/1014513315 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fd87406c8f0 0x7fd87406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:51.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.928+0000 7fd885ffb640 1 -- 172.21.15.37:0/1014513315 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fd88c08b520 con 0x7fd87c0051c0 2024-04-22T07:18:51.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.929+0000 7fd89484e640 1 --2- 172.21.15.37:0/1014513315 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fd87406c8f0 0x7fd87406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:51.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.929+0000 7fd89484e640 1 --2- 172.21.15.37:0/1014513315 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fd87406c8f0 0x7fd87406edb0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fd89015aad0 tx=0x7fd880009320 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:51.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:51.933+0000 7fd885ffb640 1 -- 172.21.15.37:0/1014513315 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fd89015ae70 con 0x7fd87c0051c0 2024-04-22T07:18:52.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:52.163+0000 7fd8972b3640 1 -- 172.21.15.37:0/1014513315 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fd890153440 con 0x7fd87c0051c0 2024-04-22T07:18:52.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:52.163+0000 7fd885ffb640 1 -- 172.21.15.37:0/1014513315 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+73 (secure 0 0 0) 0x7fd88c059aa0 con 0x7fd87c0051c0 2024-04-22T07:18:52.161 INFO:teuthology.orchestra.run.smithi037.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-22T07:18:52.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:52.165+0000 7fd8972b3640 1 -- 172.21.15.37:0/1014513315 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fd87406c8f0 msgr2=0x7fd87406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:52.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:52.165+0000 7fd8972b3640 1 --2- 172.21.15.37:0/1014513315 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fd87406c8f0 0x7fd87406edb0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fd89015aad0 tx=0x7fd880009320 comp rx=0 tx=0).stop 2024-04-22T07:18:52.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:52.165+0000 7fd8972b3640 1 -- 172.21.15.37:0/1014513315 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd87c0051c0 msgr2=0x7fd8900cfcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:52.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:52.165+0000 7fd8972b3640 1 --2- 172.21.15.37:0/1014513315 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd87c0051c0 0x7fd8900cfcf0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fd88c007370 tx=0x7fd88c007830 comp rx=0 tx=0).stop 2024-04-22T07:18:52.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:52.165+0000 7fd8972b3640 1 -- 172.21.15.37:0/1014513315 shutdown_connections 2024-04-22T07:18:52.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:52.165+0000 7fd8972b3640 1 --2- 172.21.15.37:0/1014513315 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fd87406c8f0 0x7fd87406edb0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:52.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:52.165+0000 7fd8972b3640 1 --2- 172.21.15.37:0/1014513315 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd8901f40d0 0x7fd89015c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:52.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:52.165+0000 7fd8972b3640 1 --2- 172.21.15.37:0/1014513315 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd890155b20 0x7fd89015c360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:52.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:52.165+0000 7fd8972b3640 1 --2- 172.21.15.37:0/1014513315 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd87c0051c0 0x7fd8900cfcf0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:52.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:52.165+0000 7fd8972b3640 1 -- 172.21.15.37:0/1014513315 >> 172.21.15.37:0/1014513315 conn(0x7fd890073630 msgr2=0x7fd8900d0af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:52.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:52.165+0000 7fd8972b3640 1 -- 172.21.15.37:0/1014513315 shutdown_connections 2024-04-22T07:18:52.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:52.165+0000 7fd8972b3640 1 -- 172.21.15.37:0/1014513315 wait complete. 2024-04-22T07:18:52.174 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-22T07:18:52.174 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-22T07:18:52.174 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi037.front.sepia.ceph.com 2024-04-22T07:18:52.174 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-22T07:18:52.174 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-22T07:18:52.174 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-22T07:18:52.174 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-22T07:18:52.174 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-22T07:18:52.174 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-22T07:18:52.174 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-22T07:18:52.175 DEBUG:teuthology.orchestra.run.smithi037:> ip addr 2024-04-22T07:18:52.190 INFO:teuthology.orchestra.run.smithi037.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-22T07:18:52.190 INFO:teuthology.orchestra.run.smithi037.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-22T07:18:52.190 INFO:teuthology.orchestra.run.smithi037.stdout: inet 127.0.0.1/8 scope host lo 2024-04-22T07:18:52.190 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-04-22T07:18:52.190 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 ::1/128 scope host 2024-04-22T07:18:52.190 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-04-22T07:18:52.190 INFO:teuthology.orchestra.run.smithi037.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-22T07:18:52.190 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:6b:fd:18 brd ff:ff:ff:ff:ff:ff 2024-04-22T07:18:52.190 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp7s0f0 2024-04-22T07:18:52.190 INFO:teuthology.orchestra.run.smithi037.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-22T07:18:52.190 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:6b:fd:19 brd ff:ff:ff:ff:ff:ff 2024-04-22T07:18:52.191 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp7s0f1 2024-04-22T07:18:52.191 INFO:teuthology.orchestra.run.smithi037.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-22T07:18:52.191 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:88:77:94 brd ff:ff:ff:ff:ff:ff 2024-04-22T07:18:52.191 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp1s0f0 2024-04-22T07:18:52.191 INFO:teuthology.orchestra.run.smithi037.stdout: inet 172.21.15.37/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-04-22T07:18:52.191 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft 42676sec preferred_lft 42676sec 2024-04-22T07:18:52.191 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::ec4:7aff:fe88:7794/64 scope link noprefixroute 2024-04-22T07:18:52.191 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-04-22T07:18:52.191 INFO:teuthology.orchestra.run.smithi037.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-22T07:18:52.191 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:88:77:95 brd ff:ff:ff:ff:ff:ff 2024-04-22T07:18:52.191 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp1s0f1 2024-04-22T07:18:52.192 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-22T07:18:52.192 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-22T07:18:52.192 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2024-04-22T07:18:52.192 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link add name ceph-brx type bridge 2024-04-22T07:18:52.192 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip addr flush dev ceph-brx 2024-04-22T07:18:52.192 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link set ceph-brx up 2024-04-22T07:18:52.192 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-22T07:18:52.192 DEBUG:teuthology.orchestra.run.smithi037:> ') 2024-04-22T07:18:52.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:52 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-22T07:18:52.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-22T07:18:52.374 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-22T07:18:52.374 DEBUG:teuthology.orchestra.run.smithi037:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-22T07:18:52.399 INFO:teuthology.orchestra.run.smithi037.stdout:1 2024-04-22T07:18:52.401 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-22T07:18:52.401 DEBUG:teuthology.orchestra.run.smithi037:> route 2024-04-22T07:18:52.462 INFO:teuthology.orchestra.run.smithi037.stdout:Kernel IP routing table 2024-04-22T07:18:52.462 INFO:teuthology.orchestra.run.smithi037.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-22T07:18:52.462 INFO:teuthology.orchestra.run.smithi037.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-04-22T07:18:52.462 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-04-22T07:18:52.463 INFO:teuthology.orchestra.run.smithi037.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-22T07:18:52.463 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-22T07:18:52.463 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2024-04-22T07:18:52.463 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-22T07:18:52.463 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-22T07:18:52.463 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-22T07:18:52.463 DEBUG:teuthology.orchestra.run.smithi037:> ') 2024-04-22T07:18:52.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:52 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-22T07:18:52.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-22T07:18:52.796 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-22T07:18:52.796 DEBUG:teuthology.orchestra.run.smithi037:> ip netns list 2024-04-22T07:18:52.811 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-22T07:18:52.812 DEBUG:teuthology.orchestra.run.smithi037:> ip netns list-id 2024-04-22T07:18:52.867 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-22T07:18:52.867 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2024-04-22T07:18:52.867 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-22T07:18:52.867 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-04-22T07:18:52.867 DEBUG:teuthology.orchestra.run.smithi037:> ') 2024-04-22T07:18:52.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:52 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-22T07:18:52.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-22T07:18:52.987 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-04-22T07:18:52.987 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-22T07:18:52.987 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2024-04-22T07:18:52.988 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-04-22T07:18:52.988 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-22T07:18:52.988 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-04-22T07:18:52.988 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-04-22T07:18:52.988 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-04-22T07:18:52.988 DEBUG:teuthology.orchestra.run.smithi037:> ') 2024-04-22T07:18:53.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:53 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-22T07:18:53.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-22T07:18:53.121 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-22T07:18:53.121 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2024-04-22T07:18:53.121 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link set brx.0 up 2024-04-22T07:18:53.121 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link set dev brx.0 master ceph-brx 2024-04-22T07:18:53.121 DEBUG:teuthology.orchestra.run.smithi037:> ') 2024-04-22T07:18:53.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:53 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-22T07:18:53.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-22T07:18:53.199 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-22T07:18:53.199 DEBUG:teuthology.orchestra.run.smithi037:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-22T07:18:53.214 INFO:teuthology.orchestra.run.smithi037.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-22T07:18:53.214 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-22T07:18:53.214 DEBUG:teuthology.orchestra.run.smithi037:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-22T07:18:53.269 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-04-22T07:18:53.269 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-22T07:18:53.270 DEBUG:teuthology.orchestra.run.smithi037:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-22T07:18:53.361 INFO:teuthology.orchestra.run.smithi037.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-22T07:18:53.362 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-22T07:18:53.487 INFO:teuthology.orchestra.run.smithi037.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-22T07:18:53.487 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-22T07:18:53.487 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: resolved to: "172.21.15.37:3300,172.21.15.196:3300,172.21.15.196:3301" 2024-04-22T07:18:53.487 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: trying mount with new device syntax: 0@10d90a41-52d3-4e09-8022-c8ac67897ad1.cephfs=/ 2024-04-22T07:18:53.487 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.37:3300/172.21.15.196:3300/172.21.15.196:3301" will pass to kernel 2024-04-22T07:18:53.487 INFO:teuthology.orchestra.run.smithi037.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-04-22T07:18:53.488 INFO:teuthology.orchestra.run.smithi037.stdout: You just mounted a file system that supports labels which does not 2024-04-22T07:18:53.488 INFO:teuthology.orchestra.run.smithi037.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-22T07:18:53.488 INFO:teuthology.orchestra.run.smithi037.stdout: applications will generate AVC messages and not be allowed access to 2024-04-22T07:18:53.488 INFO:teuthology.orchestra.run.smithi037.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-22T07:18:53.490 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-22T07:18:53.490 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-22T07:18:53.490 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-22T07:18:53.515 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-22T07:18:53.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:53 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-22T07:18:53.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-22T07:18:53.619 INFO:teuthology.orchestra.run.smithi037.stdout:client4517 2024-04-22T07:18:53.619 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-04-22T07:18:53.619 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-22T07:18:53.635 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-22T07:18:53.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:53 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-22T07:18:53.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-22T07:18:53.737 INFO:teuthology.orchestra.run.smithi037.stdout:client4517 2024-04-22T07:18:53.737 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-22T07:18:53.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:53 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-22T07:18:53.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-22T07:18:53.800 INFO:teuthology.orchestra.run.smithi037.stdout:client4517 2024-04-22T07:18:53.801 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/10d90a41-52d3-4e09-8022-c8ac67897ad1.client4517/status') 2024-04-22T07:18:53.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:53 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-22T07:18:53.876 INFO:teuthology.orchestra.run.smithi037.stdout:instance: client.4517 (3)172.21.15.37:0/4099690271 2024-04-22T07:18:53.876 INFO:teuthology.orchestra.run.smithi037.stdout:blocklisted: false 2024-04-22T07:18:53.876 INFO:teuthology.orchestra.run.smithi037.stderr:0+1 records in 2024-04-22T07:18:53.876 INFO:teuthology.orchestra.run.smithi037.stderr:0+1 records out 2024-04-22T07:18:53.876 INFO:teuthology.orchestra.run.smithi037.stderr:70 bytes copied, 2.4209e-05 s, 2.9 MB/s 2024-04-22T07:18:53.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-22T07:18:53.884 INFO:teuthology.run_tasks:Running task quiescer... 2024-04-22T07:18:53.895 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-22T07:18:53.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:53.998+0000 7fa92e88c640 1 Processor -- start 2024-04-22T07:18:53.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:53.998+0000 7fa92e88c640 1 -- start start 2024-04-22T07:18:53.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:53.999+0000 7fa92e88c640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa928158590 0x7fa92806b970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:53.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:53.999+0000 7fa92e88c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa928070420 0x7fa9280c3ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:53.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:53.999+0000 7fa92e88c640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa92815b840 con 0x7fa9280c43e0 2024-04-22T07:18:53.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:53.999+0000 7fa92e88c640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fa92806ffc0 con 0x7fa928070420 2024-04-22T07:18:53.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:53.999+0000 7fa92e88c640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fa92815bb00 con 0x7fa928158590 2024-04-22T07:18:53.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:53.999+0000 7fa9277fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa928070420 0x7fa9280c3ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:53.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:53.999+0000 7fa92ce29640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fa9280c43e0 0x7fa92806c380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:54306/0 (socket says 172.21.15.37:54306) 2024-04-22T07:18:53.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:53.999+0000 7fa92ce29640 1 -- 172.21.15.37:0/3228665532 learned_addr learned my addr 172.21.15.37:0/3228665532 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-04-22T07:18:53.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:53.999+0000 7fa927fff640 1 --2- 172.21.15.37:0/3228665532 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa928158590 0x7fa92806b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:53.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:53.999+0000 7fa9277fe640 1 -- 172.21.15.37:0/3228665532 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa928158590 msgr2=0x7fa92806b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:18:53.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:53.999+0000 7fa9277fe640 1 --2- 172.21.15.37:0/3228665532 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa928158590 0x7fa92806b970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:53.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:53.999+0000 7fa9277fe640 1 -- 172.21.15.37:0/3228665532 >> v1:172.21.15.37:6789/0 conn(0x7fa9280c43e0 legacy=0x7fa92806c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:53.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:53.999+0000 7fa9277fe640 1 -- 172.21.15.37:0/3228665532 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa92806f200 con 0x7fa928070420 2024-04-22T07:18:53.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:53.999+0000 7fa926ffd640 1 -- 172.21.15.37:0/3228665532 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3094140574 0 0) 0x7fa92815b840 con 0x7fa9280c43e0 2024-04-22T07:18:53.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:53.999+0000 7fa927fff640 1 --2- 172.21.15.37:0/3228665532 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa928158590 0x7fa92806b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T07:18:53.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.000+0000 7fa9277fe640 1 --2- 172.21.15.37:0/3228665532 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa928070420 0x7fa9280c3ea0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fa91c0097a0 tx=0x7fa91c02b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f408da8d12692036 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:53.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.000+0000 7fa926ffd640 1 -- 172.21.15.37:0/3228665532 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa91c034070 con 0x7fa928070420 2024-04-22T07:18:53.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.000+0000 7fa926ffd640 1 -- 172.21.15.37:0/3228665532 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa91c030610 con 0x7fa928070420 2024-04-22T07:18:53.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.000+0000 7fa926ffd640 1 -- 172.21.15.37:0/3228665532 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa91c0309e0 con 0x7fa928070420 2024-04-22T07:18:54.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.001+0000 7fa92e88c640 1 -- 172.21.15.37:0/3228665532 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa928070420 msgr2=0x7fa9280c3ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:54.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.001+0000 7fa92e88c640 1 --2- 172.21.15.37:0/3228665532 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa928070420 0x7fa9280c3ea0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fa91c0097a0 tx=0x7fa91c02b960 comp rx=0 tx=0).stop 2024-04-22T07:18:54.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.001+0000 7fa92e88c640 1 -- 172.21.15.37:0/3228665532 shutdown_connections 2024-04-22T07:18:54.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.001+0000 7fa92e88c640 1 --2- 172.21.15.37:0/3228665532 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa928070420 0x7fa9280c3ea0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:54.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.001+0000 7fa92e88c640 1 --2- 172.21.15.37:0/3228665532 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa928158590 0x7fa92806b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:54.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.001+0000 7fa92e88c640 1 -- 172.21.15.37:0/3228665532 >> 172.21.15.37:0/3228665532 conn(0x7fa928071580 msgr2=0x7fa928071960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:54.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.001+0000 7fa92e88c640 1 -- 172.21.15.37:0/3228665532 shutdown_connections 2024-04-22T07:18:54.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.001+0000 7fa92e88c640 1 -- 172.21.15.37:0/3228665532 wait complete. 2024-04-22T07:18:54.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.002+0000 7fa92e88c640 1 Processor -- start 2024-04-22T07:18:54.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.002+0000 7fa92e88c640 1 -- start start 2024-04-22T07:18:54.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.003+0000 7fa92e88c640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa928070420 0x7fa9281f4d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:54.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.003+0000 7fa92e88c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa9280c43e0 0x7fa9280cd110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:54.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.003+0000 7fa92e88c640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa928158590 0x7fa92815abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:54.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.003+0000 7fa92e88c640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa92806faa0 con 0x7fa9280c43e0 2024-04-22T07:18:54.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.003+0000 7fa92e88c640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fa92806f7c0 con 0x7fa928070420 2024-04-22T07:18:54.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.003+0000 7fa92e88c640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fa9280c93b0 con 0x7fa928158590 2024-04-22T07:18:54.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.003+0000 7fa9277fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa9280c43e0 0x7fa9280cd110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:54.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.003+0000 7fa9277fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa9280c43e0 0x7fa9280cd110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39386/0 (socket says 172.21.15.37:39386) 2024-04-22T07:18:54.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.003+0000 7fa9277fe640 1 -- 172.21.15.37:0/1468576600 learned_addr learned my addr 172.21.15.37:0/1468576600 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:18:54.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.003+0000 7fa92ce29640 1 --2- 172.21.15.37:0/1468576600 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa928158590 0x7fa92815abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:54.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.003+0000 7fa927fff640 1 --2- 172.21.15.37:0/1468576600 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa928070420 0x7fa9281f4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:54.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.003+0000 7fa9277fe640 1 -- 172.21.15.37:0/1468576600 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa928158590 msgr2=0x7fa92815abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:54.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.003+0000 7fa9277fe640 1 --2- 172.21.15.37:0/1468576600 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa928158590 0x7fa92815abf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:54.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.003+0000 7fa9277fe640 1 -- 172.21.15.37:0/1468576600 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa928070420 msgr2=0x7fa9281f4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:54.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.003+0000 7fa9277fe640 1 --2- 172.21.15.37:0/1468576600 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa928070420 0x7fa9281f4d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:54.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.003+0000 7fa9277fe640 1 -- 172.21.15.37:0/1468576600 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9281f4280 con 0x7fa9280c43e0 2024-04-22T07:18:54.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.004+0000 7fa9277fe640 1 --2- 172.21.15.37:0/1468576600 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa9280c43e0 0x7fa9280cd110 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fa91c02bf70 tx=0x7fa91c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:54.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.004+0000 7fa924ff9640 1 -- 172.21.15.37:0/1468576600 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa91c048070 con 0x7fa9280c43e0 2024-04-22T07:18:54.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.004+0000 7fa924ff9640 1 -- 172.21.15.37:0/1468576600 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa91c039a10 con 0x7fa9280c43e0 2024-04-22T07:18:54.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.004+0000 7fa92e88c640 1 -- 172.21.15.37:0/1468576600 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9281f1570 con 0x7fa9280c43e0 2024-04-22T07:18:54.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.004+0000 7fa924ff9640 1 -- 172.21.15.37:0/1468576600 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa91c034040 con 0x7fa9280c43e0 2024-04-22T07:18:54.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.004+0000 7fa92e88c640 1 -- 172.21.15.37:0/1468576600 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9281f4520 con 0x7fa9280c43e0 2024-04-22T07:18:54.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.005+0000 7fa92e88c640 1 -- 172.21.15.37:0/1468576600 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa928069cc0 con 0x7fa9280c43e0 2024-04-22T07:18:54.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.005+0000 7fa924ff9640 1 -- 172.21.15.37:0/1468576600 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa91c04b070 con 0x7fa9280c43e0 2024-04-22T07:18:54.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.006+0000 7fa924ff9640 1 --2- 172.21.15.37:0/1468576600 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fa91406c920 0x7fa91406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:54.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.006+0000 7fa924ff9640 1 -- 172.21.15.37:0/1468576600 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fa91c0ad390 con 0x7fa9280c43e0 2024-04-22T07:18:54.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.006+0000 7fa927fff640 1 --2- 172.21.15.37:0/1468576600 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fa91406c920 0x7fa91406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:54.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.006+0000 7fa927fff640 1 --2- 172.21.15.37:0/1468576600 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fa91406c920 0x7fa91406ede0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fa918006fd0 tx=0x7fa918008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:54.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.010+0000 7fa924ff9640 1 -- 172.21.15.37:0/1468576600 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fa91c039e20 con 0x7fa9280c43e0 2024-04-22T07:18:54.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.196+0000 7fa92e88c640 1 -- 172.21.15.37:0/1468576600 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa9280c5730 con 0x7fa9280c43e0 2024-04-22T07:18:54.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.197+0000 7fa924ff9640 1 -- 172.21.15.37:0/1468576600 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16581 (secure 0 0 0) 0x7fa91c07b730 con 0x7fa9280c43e0 2024-04-22T07:18:54.195 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-22T07:18:54.195 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":20,"fsid":"10d90a41-52d3-4e09-8022-c8ac67897ad1","created":"2024-04-22T07:18:12.420756+0000","modified":"2024-04-22T07:18:37.754119+0000","last_up_change":"2024-04-22T07:18:23.649808+0000","last_in_change":"2024-04-22T07:18:14.506974+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-22T07:18:24.602243+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-22T07:18:34.673639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-22T07:18:35.055184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e248f6e1-13ad-48e0-a8f8-ec3059995654","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":1488290385},{"type":"v1","addr":"172.21.15.37:6801","nonce":1488290385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1488290385},{"type":"v1","addr":"172.21.15.37:6803","nonce":1488290385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1488290385},{"type":"v1","addr":"172.21.15.37:6807","nonce":1488290385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1488290385},{"type":"v1","addr":"172.21.15.37:6805","nonce":1488290385}]},"public_addr":"172.21.15.37:6801/1488290385","cluster_addr":"172.21.15.37:6803/1488290385","heartbeat_back_addr":"172.21.15.37:6807/1488290385","heartbeat_front_addr":"172.21.15.37:6805/1488290385","state":["exists","up"]},{"osd":1,"uuid":"01c71ab7-1326-432b-b73a-e5847abe5132","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3918584183},{"type":"v1","addr":"172.21.15.37:6811","nonce":3918584183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6813","nonce":3918584183},{"type":"v1","addr":"172.21.15.37:6816","nonce":3918584183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":3918584183},{"type":"v1","addr":"172.21.15.37:6823","nonce":3918584183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":3918584183},{"type":"v1","addr":"172.21.15.37:6821","nonce":3918584183}]},"public_addr":"172.21.15.37:6811/3918584183","cluster_addr":"172.21.15.37:6816/3918584183","heartbeat_back_addr":"172.21.15.37:6823/3918584183","heartbeat_front_addr":"172.21.15.37:6821/3918584183","state":["exists","up"]},{"osd":2,"uuid":"33a780fd-013a-41c8-9970-136c9e080897","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1895439419},{"type":"v1","addr":"172.21.15.37:6825","nonce":1895439419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1895439419},{"type":"v1","addr":"172.21.15.37:6827","nonce":1895439419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1895439419},{"type":"v1","addr":"172.21.15.37:6831","nonce":1895439419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1895439419},{"type":"v1","addr":"172.21.15.37:6829","nonce":1895439419}]},"public_addr":"172.21.15.37:6825/1895439419","cluster_addr":"172.21.15.37:6827/1895439419","heartbeat_back_addr":"172.21.15.37:6831/1895439419","heartbeat_front_addr":"172.21.15.37:6829/1895439419","state":["exists","up"]},{"osd":3,"uuid":"b46e53c4-e5b9-4098-b243-ab5a0f1f3885","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6809","nonce":1160021017},{"type":"v1","addr":"172.21.15.37:6810","nonce":1160021017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1160021017},{"type":"v1","addr":"172.21.15.37:6814","nonce":1160021017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":1160021017},{"type":"v1","addr":"172.21.15.37:6820","nonce":1160021017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6815","nonce":1160021017},{"type":"v1","addr":"172.21.15.37:6817","nonce":1160021017}]},"public_addr":"172.21.15.37:6810/1160021017","cluster_addr":"172.21.15.37:6814/1160021017","heartbeat_back_addr":"172.21.15.37:6820/1160021017","heartbeat_front_addr":"172.21.15.37:6817/1160021017","state":["exists","up"]},{"osd":4,"uuid":"cd1032c6-6a83-4e33-b7b1-baddf92a83af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":374829049},{"type":"v1","addr":"172.21.15.196:6809","nonce":374829049}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":374829049},{"type":"v1","addr":"172.21.15.196:6811","nonce":374829049}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":374829049},{"type":"v1","addr":"172.21.15.196:6815","nonce":374829049}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":374829049},{"type":"v1","addr":"172.21.15.196:6813","nonce":374829049}]},"public_addr":"172.21.15.196:6809/374829049","cluster_addr":"172.21.15.196:6811/374829049","heartbeat_back_addr":"172.21.15.196:6815/374829049","heartbeat_front_addr":"172.21.15.196:6813/374829049","state":["exists","up"]},{"osd":5,"uuid":"f561d48a-5f2d-4deb-8681-4329aed36bae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":479311302},{"type":"v1","addr":"172.21.15.196:6801","nonce":479311302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":479311302},{"type":"v1","addr":"172.21.15.196:6803","nonce":479311302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":479311302},{"type":"v1","addr":"172.21.15.196:6807","nonce":479311302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":479311302},{"type":"v1","addr":"172.21.15.196:6805","nonce":479311302}]},"public_addr":"172.21.15.196:6801/479311302","cluster_addr":"172.21.15.196:6803/479311302","heartbeat_back_addr":"172.21.15.196:6807/479311302","heartbeat_front_addr":"172.21.15.196:6805/479311302","state":["exists","up"]},{"osd":6,"uuid":"1b239c7e-2504-42e0-b308-70f4e62519c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6817","nonce":691777224},{"type":"v1","addr":"172.21.15.196:6819","nonce":691777224}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6821","nonce":691777224},{"type":"v1","addr":"172.21.15.196:6823","nonce":691777224}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6829","nonce":691777224},{"type":"v1","addr":"172.21.15.196:6831","nonce":691777224}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6825","nonce":691777224},{"type":"v1","addr":"172.21.15.196:6827","nonce":691777224}]},"public_addr":"172.21.15.196:6819/691777224","cluster_addr":"172.21.15.196:6823/691777224","heartbeat_back_addr":"172.21.15.196:6831/691777224","heartbeat_front_addr":"172.21.15.196:6827/691777224","state":["exists","up"]},{"osd":7,"uuid":"084318d4-d1fd-4b58-8c33-b1d7856fe323","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":3106266066},{"type":"v1","addr":"172.21.15.196:6818","nonce":3106266066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":3106266066},{"type":"v1","addr":"172.21.15.196:6822","nonce":3106266066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":3106266066},{"type":"v1","addr":"172.21.15.196:6830","nonce":3106266066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":3106266066},{"type":"v1","addr":"172.21.15.196:6826","nonce":3106266066}]},"public_addr":"172.21.15.196:6818/3106266066","cluster_addr":"172.21.15.196:6822/3106266066","heartbeat_back_addr":"172.21.15.196:6830/3106266066","heartbeat_front_addr":"172.21.15.196:6826/3106266066","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:18:19.587791+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:18:19.706541+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:18:19.690674+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:18:19.648354+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:18:19.666671+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:18:19.560709+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:18:19.661412+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:18:19.770650+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-22T07:18:54.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.199+0000 7fa92e88c640 1 -- 172.21.15.37:0/1468576600 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fa91406c920 msgr2=0x7fa91406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:54.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.199+0000 7fa92e88c640 1 --2- 172.21.15.37:0/1468576600 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fa91406c920 0x7fa91406ede0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fa918006fd0 tx=0x7fa918008040 comp rx=0 tx=0).stop 2024-04-22T07:18:54.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.199+0000 7fa92e88c640 1 -- 172.21.15.37:0/1468576600 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa9280c43e0 msgr2=0x7fa9280cd110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:54.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.199+0000 7fa92e88c640 1 --2- 172.21.15.37:0/1468576600 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa9280c43e0 0x7fa9280cd110 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fa91c02bf70 tx=0x7fa91c0046c0 comp rx=0 tx=0).stop 2024-04-22T07:18:54.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.199+0000 7fa92e88c640 1 -- 172.21.15.37:0/1468576600 shutdown_connections 2024-04-22T07:18:54.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.199+0000 7fa92e88c640 1 --2- 172.21.15.37:0/1468576600 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fa91406c920 0x7fa91406ede0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:54.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.199+0000 7fa92e88c640 1 --2- 172.21.15.37:0/1468576600 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa928158590 0x7fa92815abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:54.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.199+0000 7fa92e88c640 1 --2- 172.21.15.37:0/1468576600 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa9280c43e0 0x7fa9280cd110 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:54.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.199+0000 7fa92e88c640 1 --2- 172.21.15.37:0/1468576600 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa928070420 0x7fa9281f4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:54.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.199+0000 7fa92e88c640 1 -- 172.21.15.37:0/1468576600 >> 172.21.15.37:0/1468576600 conn(0x7fa928071580 msgr2=0x7fa9280af9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:54.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.199+0000 7fa92e88c640 1 -- 172.21.15.37:0/1468576600 shutdown_connections 2024-04-22T07:18:54.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.199+0000 7fa92e88c640 1 -- 172.21.15.37:0/1468576600 wait complete. 2024-04-22T07:18:54.208 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-22T07:18:24.602243+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-22T07:18:34.673639+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-22T07:18:35.055184+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-22T07:18:54.208 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-22T07:18:54.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.314+0000 7fcb19152640 1 Processor -- start 2024-04-22T07:18:54.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.314+0000 7fcb19152640 1 -- start start 2024-04-22T07:18:54.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.315+0000 7fcb19152640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fcb14155110 0x7fcb140ce490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:54.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.315+0000 7fcb19152640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcb1415ad80 0x7fcb140ce9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:54.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.315+0000 7fcb19152640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fcb1415c9e0 0x7fcb1415ce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:54.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.315+0000 7fcb19152640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fcb141554f0 con 0x7fcb14155110 2024-04-22T07:18:54.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.315+0000 7fcb19152640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7fcb1415c270 con 0x7fcb1415c9e0 2024-04-22T07:18:54.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.315+0000 7fcb19152640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fcb1415c550 con 0x7fcb1415ad80 2024-04-22T07:18:54.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.315+0000 7fcb12d9d640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fcb14155110 0x7fcb140ce490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:54.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.315+0000 7fcb12d9d640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fcb14155110 0x7fcb140ce490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39388/0 (socket says 172.21.15.37:39388) 2024-04-22T07:18:54.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.315+0000 7fcb12d9d640 1 -- 172.21.15.37:0/1296540105 learned_addr learned my addr 172.21.15.37:0/1296540105 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:18:54.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.315+0000 7fcb0bfff640 1 --2- 172.21.15.37:0/1296540105 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcb1415ad80 0x7fcb140ce9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:54.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.315+0000 7fcb1359e640 1 --2- 172.21.15.37:0/1296540105 >> v2:172.21.15.196:3300/0 conn(0x7fcb1415c9e0 0x7fcb1415ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:54.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.315+0000 7fcb12d9d640 1 -- 172.21.15.37:0/1296540105 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcb1415ad80 msgr2=0x7fcb140ce9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:18:54.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.315+0000 7fcb12d9d640 1 --2- 172.21.15.37:0/1296540105 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcb1415ad80 0x7fcb140ce9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:54.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.315+0000 7fcb12d9d640 1 -- 172.21.15.37:0/1296540105 >> v2:172.21.15.196:3300/0 conn(0x7fcb1415c9e0 msgr2=0x7fcb1415ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:18:54.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.315+0000 7fcb12d9d640 1 --2- 172.21.15.37:0/1296540105 >> v2:172.21.15.196:3300/0 conn(0x7fcb1415c9e0 0x7fcb1415ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:54.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.315+0000 7fcb12d9d640 1 -- 172.21.15.37:0/1296540105 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb1415d3b0 con 0x7fcb14155110 2024-04-22T07:18:54.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.316+0000 7fcb12d9d640 1 --2- 172.21.15.37:0/1296540105 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb14155110 0x7fcb140ce490 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fcb140738f0 tx=0x7fcb0402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=656f090223b650de server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:54.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.316+0000 7fcb1259c640 1 -- 172.21.15.37:0/1296540105 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb04035020 con 0x7fcb14155110 2024-04-22T07:18:54.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.316+0000 7fcb1259c640 1 -- 172.21.15.37:0/1296540105 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb04031870 con 0x7fcb14155110 2024-04-22T07:18:54.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.316+0000 7fcb1259c640 1 -- 172.21.15.37:0/1296540105 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb04031c40 con 0x7fcb14155110 2024-04-22T07:18:54.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.316+0000 7fcb19152640 1 -- 172.21.15.37:0/1296540105 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb14155110 msgr2=0x7fcb140ce490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:54.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.316+0000 7fcb19152640 1 --2- 172.21.15.37:0/1296540105 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb14155110 0x7fcb140ce490 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fcb140738f0 tx=0x7fcb0402b910 comp rx=0 tx=0).stop 2024-04-22T07:18:54.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.317+0000 7fcb19152640 1 -- 172.21.15.37:0/1296540105 shutdown_connections 2024-04-22T07:18:54.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.317+0000 7fcb19152640 1 --2- 172.21.15.37:0/1296540105 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcb1415ad80 0x7fcb140ce9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:54.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.317+0000 7fcb19152640 1 --2- 172.21.15.37:0/1296540105 >> v2:172.21.15.196:3300/0 conn(0x7fcb1415c9e0 0x7fcb1415ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:54.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.317+0000 7fcb19152640 1 --2- 172.21.15.37:0/1296540105 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb14155110 0x7fcb140ce490 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:54.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.317+0000 7fcb19152640 1 -- 172.21.15.37:0/1296540105 >> 172.21.15.37:0/1296540105 conn(0x7fcb140716d0 msgr2=0x7fcb14071ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:54.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.317+0000 7fcb19152640 1 -- 172.21.15.37:0/1296540105 shutdown_connections 2024-04-22T07:18:54.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.317+0000 7fcb19152640 1 -- 172.21.15.37:0/1296540105 wait complete. 2024-04-22T07:18:54.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.318+0000 7fcb19152640 1 Processor -- start 2024-04-22T07:18:54.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.318+0000 7fcb19152640 1 -- start start 2024-04-22T07:18:54.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.319+0000 7fcb19152640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb14155110 0x7fcb14157ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:54.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.319+0000 7fcb19152640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcb1415ad80 0x7fcb141f4440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:54.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.319+0000 7fcb19152640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcb1415c9e0 0x7fcb14154100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:54.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.319+0000 7fcb19152640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fcb1415b880 con 0x7fcb14155110 2024-04-22T07:18:54.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.319+0000 7fcb19152640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fcb1415b5a0 con 0x7fcb1415ad80 2024-04-22T07:18:54.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.319+0000 7fcb19152640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fcb1415bb60 con 0x7fcb1415c9e0 2024-04-22T07:18:54.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.319+0000 7fcb12d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb14155110 0x7fcb14157ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:54.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.319+0000 7fcb12d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb14155110 0x7fcb14157ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39404/0 (socket says 172.21.15.37:39404) 2024-04-22T07:18:54.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.319+0000 7fcb12d9d640 1 -- 172.21.15.37:0/475139337 learned_addr learned my addr 172.21.15.37:0/475139337 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:18:54.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.319+0000 7fcb1359e640 1 --2- 172.21.15.37:0/475139337 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcb1415c9e0 0x7fcb14154100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:54.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.319+0000 7fcb0bfff640 1 --2- 172.21.15.37:0/475139337 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcb1415ad80 0x7fcb141f4440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:54.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.319+0000 7fcb12d9d640 1 -- 172.21.15.37:0/475139337 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcb1415c9e0 msgr2=0x7fcb14154100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:54.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.319+0000 7fcb12d9d640 1 --2- 172.21.15.37:0/475139337 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcb1415c9e0 0x7fcb14154100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:54.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.319+0000 7fcb12d9d640 1 -- 172.21.15.37:0/475139337 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcb1415ad80 msgr2=0x7fcb141f4440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:54.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.319+0000 7fcb12d9d640 1 --2- 172.21.15.37:0/475139337 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcb1415ad80 0x7fcb141f4440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:54.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.319+0000 7fcb12d9d640 1 -- 172.21.15.37:0/475139337 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb141f4980 con 0x7fcb14155110 2024-04-22T07:18:54.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.319+0000 7fcb12d9d640 1 --2- 172.21.15.37:0/475139337 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb14155110 0x7fcb14157ef0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fcb04000c00 tx=0x7fcb040046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:54.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.319+0000 7fcb0b7fe640 1 -- 172.21.15.37:0/475139337 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb0403ad60 con 0x7fcb14155110 2024-04-22T07:18:54.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.319+0000 7fcb0b7fe640 1 -- 172.21.15.37:0/475139337 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb040443f0 con 0x7fcb14155110 2024-04-22T07:18:54.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.319+0000 7fcb19152640 1 -- 172.21.15.37:0/475139337 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb141f0700 con 0x7fcb14155110 2024-04-22T07:18:54.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.319+0000 7fcb0b7fe640 1 -- 172.21.15.37:0/475139337 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb040447e0 con 0x7fcb14155110 2024-04-22T07:18:54.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.319+0000 7fcb19152640 1 -- 172.21.15.37:0/475139337 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb141f0cc0 con 0x7fcb14155110 2024-04-22T07:18:54.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.321+0000 7fcb19152640 1 -- 172.21.15.37:0/475139337 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb14069cc0 con 0x7fcb14155110 2024-04-22T07:18:54.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.321+0000 7fcb0b7fe640 1 -- 172.21.15.37:0/475139337 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fcb0404b060 con 0x7fcb14155110 2024-04-22T07:18:54.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.321+0000 7fcb0b7fe640 1 --2- 172.21.15.37:0/475139337 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fcaf406c8f0 0x7fcaf406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:54.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.321+0000 7fcb0b7fe640 1 -- 172.21.15.37:0/475139337 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fcb040adb30 con 0x7fcb14155110 2024-04-22T07:18:54.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.322+0000 7fcb0bfff640 1 --2- 172.21.15.37:0/475139337 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fcaf406c8f0 0x7fcaf406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:54.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.322+0000 7fcb0bfff640 1 --2- 172.21.15.37:0/475139337 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fcaf406c8f0 0x7fcaf406edb0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fcafc006fd0 tx=0x7fcafc008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:54.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.326+0000 7fcb0b7fe640 1 -- 172.21.15.37:0/475139337 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fcb0403f070 con 0x7fcb14155110 2024-04-22T07:18:54.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.508+0000 7fcb19152640 1 -- 172.21.15.37:0/475139337 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fcb1415efe0 con 0x7fcb14155110 2024-04-22T07:18:54.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.509+0000 7fcb0b7fe640 1 -- 172.21.15.37:0/475139337 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7fcb0407b910 con 0x7fcb14155110 2024-04-22T07:18:54.507 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2024-04-22T07:18:54.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.511+0000 7fcb19152640 1 -- 172.21.15.37:0/475139337 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fcaf406c8f0 msgr2=0x7fcaf406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:54.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.511+0000 7fcb19152640 1 --2- 172.21.15.37:0/475139337 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fcaf406c8f0 0x7fcaf406edb0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fcafc006fd0 tx=0x7fcafc008040 comp rx=0 tx=0).stop 2024-04-22T07:18:54.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.511+0000 7fcb19152640 1 -- 172.21.15.37:0/475139337 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb14155110 msgr2=0x7fcb14157ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:54.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.511+0000 7fcb19152640 1 --2- 172.21.15.37:0/475139337 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb14155110 0x7fcb14157ef0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fcb04000c00 tx=0x7fcb040046c0 comp rx=0 tx=0).stop 2024-04-22T07:18:54.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.511+0000 7fcb19152640 1 -- 172.21.15.37:0/475139337 shutdown_connections 2024-04-22T07:18:54.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.511+0000 7fcb19152640 1 --2- 172.21.15.37:0/475139337 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fcaf406c8f0 0x7fcaf406edb0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:54.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.511+0000 7fcb19152640 1 --2- 172.21.15.37:0/475139337 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcb1415c9e0 0x7fcb14154100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:54.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.511+0000 7fcb19152640 1 --2- 172.21.15.37:0/475139337 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcb1415ad80 0x7fcb141f4440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:54.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.511+0000 7fcb19152640 1 --2- 172.21.15.37:0/475139337 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb14155110 0x7fcb14157ef0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:54.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.511+0000 7fcb19152640 1 -- 172.21.15.37:0/475139337 >> 172.21.15.37:0/475139337 conn(0x7fcb140716d0 msgr2=0x7fcb1406d970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:54.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.511+0000 7fcb19152640 1 -- 172.21.15.37:0/475139337 shutdown_connections 2024-04-22T07:18:54.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.511+0000 7fcb19152640 1 -- 172.21.15.37:0/475139337 wait complete. 2024-04-22T07:18:54.519 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-22T07:18:54.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.625+0000 7f835f5a4640 1 Processor -- start 2024-04-22T07:18:54.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.626+0000 7f835f5a4640 1 -- start start 2024-04-22T07:18:54.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.626+0000 7f835f5a4640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f83580cde00 0x7f83580cc460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:54.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.626+0000 7f835f5a4640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f83580cb0b0 0x7f83580730c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:54.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.626+0000 7f835f5a4640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83581555d0 con 0x7f83581551f0 2024-04-22T07:18:54.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.626+0000 7f835f5a4640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f83580cc9a0 con 0x7f83580cde00 2024-04-22T07:18:54.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.626+0000 7f835f5a4640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f83580ccbc0 con 0x7f83580cb0b0 2024-04-22T07:18:54.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.627+0000 7f835cb3f640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f83580cde00 0x7f83580cc460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:54.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.627+0000 7f835cb3f640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f83580cde00 0x7f83580cc460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39420/0 (socket says 172.21.15.37:39420) 2024-04-22T07:18:54.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.627+0000 7f835cb3f640 1 -- 172.21.15.37:0/2844875330 learned_addr learned my addr 172.21.15.37:0/2844875330 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:18:54.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.627+0000 7f835db41640 1 --2- 172.21.15.37:0/2844875330 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f83580cb0b0 0x7f83580730c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:54.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.627+0000 7f835cb3f640 1 -- 172.21.15.37:0/2844875330 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f83580cb0b0 msgr2=0x7f83580730c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:18:54.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.627+0000 7f835cb3f640 1 --2- 172.21.15.37:0/2844875330 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f83580cb0b0 0x7f83580730c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:54.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.627+0000 7f835cb3f640 1 -- 172.21.15.37:0/2844875330 >> v1:172.21.15.196:6789/0 conn(0x7f83581551f0 legacy=0x7f835815e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:54.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.627+0000 7f835cb3f640 1 -- 172.21.15.37:0/2844875330 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83580ccea0 con 0x7f83580cde00 2024-04-22T07:18:54.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.627+0000 7f835db41640 1 --2- 172.21.15.37:0/2844875330 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f83580cb0b0 0x7f83580730c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T07:18:54.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.628+0000 7f835cb3f640 1 --2- 172.21.15.37:0/2844875330 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f83580cde00 0x7f83580cc460 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f8348009870 tx=0x7f834802ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81c37e878c443a51 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:54.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.628+0000 7f834ffff640 1 -- 172.21.15.37:0/2844875330 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f834802f840 con 0x7f83580cde00 2024-04-22T07:18:54.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.628+0000 7f834ffff640 1 -- 172.21.15.37:0/2844875330 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f834802f9e0 con 0x7f83580cde00 2024-04-22T07:18:54.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.628+0000 7f834ffff640 1 -- 172.21.15.37:0/2844875330 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f834802fdb0 con 0x7f83580cde00 2024-04-22T07:18:54.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.628+0000 7f835f5a4640 1 -- 172.21.15.37:0/2844875330 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f83580cde00 msgr2=0x7f83580cc460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:54.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.628+0000 7f835f5a4640 1 --2- 172.21.15.37:0/2844875330 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f83580cde00 0x7f83580cc460 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f8348009870 tx=0x7f834802ba20 comp rx=0 tx=0).stop 2024-04-22T07:18:54.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.628+0000 7f835f5a4640 1 -- 172.21.15.37:0/2844875330 shutdown_connections 2024-04-22T07:18:54.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.628+0000 7f835f5a4640 1 --2- 172.21.15.37:0/2844875330 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f83580cb0b0 0x7f83580730c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:54.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.628+0000 7f835f5a4640 1 --2- 172.21.15.37:0/2844875330 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f83580cde00 0x7f83580cc460 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:54.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.628+0000 7f835f5a4640 1 -- 172.21.15.37:0/2844875330 >> 172.21.15.37:0/2844875330 conn(0x7f835806c410 msgr2=0x7f83580676b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:54.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.629+0000 7f835f5a4640 1 -- 172.21.15.37:0/2844875330 shutdown_connections 2024-04-22T07:18:54.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.629+0000 7f835f5a4640 1 -- 172.21.15.37:0/2844875330 wait complete. 2024-04-22T07:18:54.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.630+0000 7f835f5a4640 1 Processor -- start 2024-04-22T07:18:54.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.630+0000 7f835f5a4640 1 -- start start 2024-04-22T07:18:54.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.630+0000 7f835f5a4640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f83580cb0b0 0x7f835813ff10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:54.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.630+0000 7f835f5a4640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f83580cde00 0x7f83580b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:54.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.630+0000 7f835f5a4640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f83581551f0 0x7f83580b52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:54.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.630+0000 7f835f5a4640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f835815b5c0 con 0x7f83580cb0b0 2024-04-22T07:18:54.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.630+0000 7f835f5a4640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f835815b2e0 con 0x7f83580cde00 2024-04-22T07:18:54.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.630+0000 7f835f5a4640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f835815b8a0 con 0x7f83581551f0 2024-04-22T07:18:54.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.631+0000 7f835d340640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f83580cb0b0 0x7f835813ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:54.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.631+0000 7f835d340640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f83580cb0b0 0x7f835813ff10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39434/0 (socket says 172.21.15.37:39434) 2024-04-22T07:18:54.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.631+0000 7f835d340640 1 -- 172.21.15.37:0/1756944060 learned_addr learned my addr 172.21.15.37:0/1756944060 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:18:54.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.631+0000 7f835cb3f640 1 --2- 172.21.15.37:0/1756944060 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f83580cde00 0x7f83580b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:54.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.631+0000 7f835db41640 1 --2- 172.21.15.37:0/1756944060 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f83581551f0 0x7f83580b52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:54.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.631+0000 7f835d340640 1 -- 172.21.15.37:0/1756944060 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f83581551f0 msgr2=0x7f83580b52d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:54.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.631+0000 7f835d340640 1 --2- 172.21.15.37:0/1756944060 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f83581551f0 0x7f83580b52d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:54.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.631+0000 7f835d340640 1 -- 172.21.15.37:0/1756944060 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f83580cde00 msgr2=0x7f83580b4d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:54.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.631+0000 7f835d340640 1 --2- 172.21.15.37:0/1756944060 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f83580cde00 0x7f83580b4d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:54.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.631+0000 7f835d340640 1 -- 172.21.15.37:0/1756944060 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83581f0e20 con 0x7f83580cb0b0 2024-04-22T07:18:54.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.631+0000 7f835d340640 1 --2- 172.21.15.37:0/1756944060 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f83580cb0b0 0x7f835813ff10 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f835400c340 tx=0x7f835400c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:54.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.631+0000 7f834dffb640 1 -- 172.21.15.37:0/1756944060 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8354017070 con 0x7f83580cb0b0 2024-04-22T07:18:54.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.631+0000 7f834dffb640 1 -- 172.21.15.37:0/1756944060 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83540052d0 con 0x7f83580cb0b0 2024-04-22T07:18:54.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.631+0000 7f835f5a4640 1 -- 172.21.15.37:0/1756944060 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83581f1100 con 0x7f83580cb0b0 2024-04-22T07:18:54.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.631+0000 7f834dffb640 1 -- 172.21.15.37:0/1756944060 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8354003850 con 0x7f83580cb0b0 2024-04-22T07:18:54.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.632+0000 7f835f5a4640 1 -- 172.21.15.37:0/1756944060 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83581f16c0 con 0x7f83580cb0b0 2024-04-22T07:18:54.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.633+0000 7f835f5a4640 1 -- 172.21.15.37:0/1756944060 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8358069cc0 con 0x7f83580cb0b0 2024-04-22T07:18:54.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.633+0000 7f834dffb640 1 -- 172.21.15.37:0/1756944060 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f835401a070 con 0x7f83580cb0b0 2024-04-22T07:18:54.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.633+0000 7f834dffb640 1 --2- 172.21.15.37:0/1756944060 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f833c06c920 0x7f833c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:54.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.634+0000 7f834dffb640 1 -- 172.21.15.37:0/1756944060 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f835408ad70 con 0x7f83580cb0b0 2024-04-22T07:18:54.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.634+0000 7f835cb3f640 1 --2- 172.21.15.37:0/1756944060 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f833c06c920 0x7f833c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:54.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.634+0000 7f835cb3f640 1 --2- 172.21.15.37:0/1756944060 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f833c06c920 0x7f833c06ede0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f8348036000 tx=0x7f8348008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:54.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.638+0000 7f834dffb640 1 -- 172.21.15.37:0/1756944060 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f8354058b50 con 0x7f83580cb0b0 2024-04-22T07:18:54.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.824+0000 7f835f5a4640 1 -- 172.21.15.37:0/1756944060 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f83580c7290 con 0x7f83580cb0b0 2024-04-22T07:18:54.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.825+0000 7f834dffb640 1 -- 172.21.15.37:0/1756944060 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7f835405ce50 con 0x7f83580cb0b0 2024-04-22T07:18:54.823 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2024-04-22T07:18:54.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.827+0000 7f835f5a4640 1 -- 172.21.15.37:0/1756944060 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f833c06c920 msgr2=0x7f833c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:54.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.827+0000 7f835f5a4640 1 --2- 172.21.15.37:0/1756944060 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f833c06c920 0x7f833c06ede0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f8348036000 tx=0x7f8348008030 comp rx=0 tx=0).stop 2024-04-22T07:18:54.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.827+0000 7f835f5a4640 1 -- 172.21.15.37:0/1756944060 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f83580cb0b0 msgr2=0x7f835813ff10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:54.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.827+0000 7f835f5a4640 1 --2- 172.21.15.37:0/1756944060 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f83580cb0b0 0x7f835813ff10 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f835400c340 tx=0x7f835400c800 comp rx=0 tx=0).stop 2024-04-22T07:18:54.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.827+0000 7f835f5a4640 1 -- 172.21.15.37:0/1756944060 shutdown_connections 2024-04-22T07:18:54.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.827+0000 7f835f5a4640 1 --2- 172.21.15.37:0/1756944060 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f833c06c920 0x7f833c06ede0 secure :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f8348036000 tx=0x7f8348008030 comp rx=0 tx=0).stop 2024-04-22T07:18:54.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.827+0000 7f835f5a4640 1 --2- 172.21.15.37:0/1756944060 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f83581551f0 0x7f83580b52d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:54.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.828+0000 7f835f5a4640 1 --2- 172.21.15.37:0/1756944060 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f83580cde00 0x7f83580b4d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:54.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.828+0000 7f835f5a4640 1 --2- 172.21.15.37:0/1756944060 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f83580cb0b0 0x7f835813ff10 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:54.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.828+0000 7f835f5a4640 1 -- 172.21.15.37:0/1756944060 >> 172.21.15.37:0/1756944060 conn(0x7f835806c410 msgr2=0x7f83580730c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:54.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.828+0000 7f835f5a4640 1 -- 172.21.15.37:0/1756944060 shutdown_connections 2024-04-22T07:18:54.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.828+0000 7f835f5a4640 1 -- 172.21.15.37:0/1756944060 wait complete. 2024-04-22T07:18:54.836 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-22T07:18:54.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.942+0000 7f2cadac8640 1 Processor -- start 2024-04-22T07:18:54.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.942+0000 7f2cadac8640 1 -- start start 2024-04-22T07:18:54.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.943+0000 7f2cadac8640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f2ca8155250 0x7f2ca815af40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:54.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.943+0000 7f2cadac8640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2ca80b3190 0x7f2ca80b35b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:54.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.943+0000 7f2cadac8640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2ca80ccd20 0x7f2ca80cd1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:54.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.943+0000 7f2cadac8640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f2ca80cb6a0 con 0x7f2ca80ccd20 2024-04-22T07:18:54.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.943+0000 7f2cadac8640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f2ca815e4b0 con 0x7f2ca8155250 2024-04-22T07:18:54.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.943+0000 7f2cadac8640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f2ca80b3bd0 con 0x7f2ca80b3190 2024-04-22T07:18:54.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.943+0000 7f2ca7fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2ca80ccd20 0x7f2ca80cd1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:54.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.943+0000 7f2ca7fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2ca80ccd20 0x7f2ca80cd1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39436/0 (socket says 172.21.15.37:39436) 2024-04-22T07:18:54.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.943+0000 7f2ca7fff640 1 -- 172.21.15.37:0/3131863473 learned_addr learned my addr 172.21.15.37:0/3131863473 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:18:54.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.943+0000 7f2ca6ffd640 1 --2- 172.21.15.37:0/3131863473 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2ca80b3190 0x7f2ca80b35b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:54.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.943+0000 7f2ca77fe640 1 --2- 172.21.15.37:0/3131863473 >> v2:172.21.15.196:3300/0 conn(0x7f2ca8155250 0x7f2ca815af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:54.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.943+0000 7f2ca7fff640 1 -- 172.21.15.37:0/3131863473 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2ca80b3190 msgr2=0x7f2ca80b35b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:18:54.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.943+0000 7f2ca7fff640 1 --2- 172.21.15.37:0/3131863473 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2ca80b3190 0x7f2ca80b35b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:54.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.943+0000 7f2ca7fff640 1 -- 172.21.15.37:0/3131863473 >> v2:172.21.15.196:3300/0 conn(0x7f2ca8155250 msgr2=0x7f2ca815af40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:18:54.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.943+0000 7f2ca7fff640 1 --2- 172.21.15.37:0/3131863473 >> v2:172.21.15.196:3300/0 conn(0x7f2ca8155250 0x7f2ca815af40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:54.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.943+0000 7f2ca7fff640 1 -- 172.21.15.37:0/3131863473 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ca80b3eb0 con 0x7f2ca80ccd20 2024-04-22T07:18:54.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.944+0000 7f2ca7fff640 1 --2- 172.21.15.37:0/3131863473 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ca80ccd20 0x7f2ca80cd1b0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f2ca80d1750 tx=0x7f2ca002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d4608170c6739e server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:54.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.944+0000 7f2ca67fc640 1 -- 172.21.15.37:0/3131863473 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ca002ca70 con 0x7f2ca80ccd20 2024-04-22T07:18:54.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.944+0000 7f2ca67fc640 1 -- 172.21.15.37:0/3131863473 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ca002cc10 con 0x7f2ca80ccd20 2024-04-22T07:18:54.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.944+0000 7f2ca67fc640 1 -- 172.21.15.37:0/3131863473 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ca00343f0 con 0x7f2ca80ccd20 2024-04-22T07:18:54.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.944+0000 7f2cadac8640 1 -- 172.21.15.37:0/3131863473 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ca80ccd20 msgr2=0x7f2ca80cd1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:54.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.944+0000 7f2cadac8640 1 --2- 172.21.15.37:0/3131863473 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ca80ccd20 0x7f2ca80cd1b0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f2ca80d1750 tx=0x7f2ca002bed0 comp rx=0 tx=0).stop 2024-04-22T07:18:54.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.944+0000 7f2cadac8640 1 -- 172.21.15.37:0/3131863473 shutdown_connections 2024-04-22T07:18:54.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.944+0000 7f2cadac8640 1 --2- 172.21.15.37:0/3131863473 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2ca80b3190 0x7f2ca80b35b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:54.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.944+0000 7f2cadac8640 1 --2- 172.21.15.37:0/3131863473 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ca80ccd20 0x7f2ca80cd1b0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:54.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.944+0000 7f2cadac8640 1 --2- 172.21.15.37:0/3131863473 >> v2:172.21.15.196:3300/0 conn(0x7f2ca8155250 0x7f2ca815af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:54.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.944+0000 7f2cadac8640 1 -- 172.21.15.37:0/3131863473 >> 172.21.15.37:0/3131863473 conn(0x7f2ca8071f90 msgr2=0x7f2ca80723a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:54.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.945+0000 7f2cadac8640 1 -- 172.21.15.37:0/3131863473 shutdown_connections 2024-04-22T07:18:54.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.945+0000 7f2cadac8640 1 -- 172.21.15.37:0/3131863473 wait complete. 2024-04-22T07:18:54.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.946+0000 7f2cadac8640 1 Processor -- start 2024-04-22T07:18:54.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.946+0000 7f2cadac8640 1 -- start start 2024-04-22T07:18:54.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.946+0000 7f2cadac8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ca80b3190 0x7f2ca8157290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:54.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.947+0000 7f2cadac8640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2ca80ccd20 0x7f2ca81f0c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:54.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.947+0000 7f2cadac8640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2ca8155250 0x7f2ca81f1190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:54.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.947+0000 7f2cadac8640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f2ca815ecc0 con 0x7f2ca80b3190 2024-04-22T07:18:54.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.947+0000 7f2cadac8640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f2ca815e9e0 con 0x7f2ca80ccd20 2024-04-22T07:18:54.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.947+0000 7f2cadac8640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f2ca8155630 con 0x7f2ca8155250 2024-04-22T07:18:54.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.947+0000 7f2ca77fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ca80b3190 0x7f2ca8157290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:54.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.947+0000 7f2ca77fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ca80b3190 0x7f2ca8157290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39442/0 (socket says 172.21.15.37:39442) 2024-04-22T07:18:54.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.947+0000 7f2ca77fe640 1 -- 172.21.15.37:0/2262135265 learned_addr learned my addr 172.21.15.37:0/2262135265 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:18:54.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.947+0000 7f2ca6ffd640 1 --2- 172.21.15.37:0/2262135265 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2ca80ccd20 0x7f2ca81f0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:54.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.947+0000 7f2ca7fff640 1 --2- 172.21.15.37:0/2262135265 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2ca8155250 0x7f2ca81f1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:54.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.947+0000 7f2ca77fe640 1 -- 172.21.15.37:0/2262135265 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2ca8155250 msgr2=0x7f2ca81f1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:54.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.947+0000 7f2ca77fe640 1 --2- 172.21.15.37:0/2262135265 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2ca8155250 0x7f2ca81f1190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:54.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.947+0000 7f2ca77fe640 1 -- 172.21.15.37:0/2262135265 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2ca80ccd20 msgr2=0x7f2ca81f0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:54.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.947+0000 7f2ca77fe640 1 --2- 172.21.15.37:0/2262135265 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2ca80ccd20 0x7f2ca81f0c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:54.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.947+0000 7f2ca77fe640 1 -- 172.21.15.37:0/2262135265 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ca81f18d0 con 0x7f2ca80b3190 2024-04-22T07:18:54.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.947+0000 7f2ca77fe640 1 --2- 172.21.15.37:0/2262135265 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ca80b3190 0x7f2ca8157290 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f2c9800d800 tx=0x7f2c9800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:54.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.947+0000 7f2c8ffff640 1 -- 172.21.15.37:0/2262135265 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c9800b6c0 con 0x7f2ca80b3190 2024-04-22T07:18:54.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.947+0000 7f2c8ffff640 1 -- 172.21.15.37:0/2262135265 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c98019070 con 0x7f2ca80b3190 2024-04-22T07:18:54.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.947+0000 7f2cadac8640 1 -- 172.21.15.37:0/2262135265 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ca81567f0 con 0x7f2ca80b3190 2024-04-22T07:18:54.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.947+0000 7f2c8ffff640 1 -- 172.21.15.37:0/2262135265 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c9800ba80 con 0x7f2ca80b3190 2024-04-22T07:18:54.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.947+0000 7f2cadac8640 1 -- 172.21.15.37:0/2262135265 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ca8153350 con 0x7f2ca80b3190 2024-04-22T07:18:54.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.948+0000 7f2cadac8640 1 -- 172.21.15.37:0/2262135265 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ca8069cc0 con 0x7f2ca80b3190 2024-04-22T07:18:54.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.949+0000 7f2c8ffff640 1 -- 172.21.15.37:0/2262135265 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2c9800bc20 con 0x7f2ca80b3190 2024-04-22T07:18:54.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.949+0000 7f2c8ffff640 1 --2- 172.21.15.37:0/2262135265 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f2c9406c8f0 0x7f2c9406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:54.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.949+0000 7f2c8ffff640 1 -- 172.21.15.37:0/2262135265 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f2c9808bf30 con 0x7f2ca80b3190 2024-04-22T07:18:54.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.949+0000 7f2ca6ffd640 1 --2- 172.21.15.37:0/2262135265 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f2c9406c8f0 0x7f2c9406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:54.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.950+0000 7f2ca6ffd640 1 --2- 172.21.15.37:0/2262135265 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f2c9406c8f0 0x7f2c9406edb0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f2ca80d1520 tx=0x7f2c9c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:54.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:54.953+0000 7f2c8ffff640 1 -- 172.21.15.37:0/2262135265 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f2c98059c70 con 0x7f2ca80b3190 2024-04-22T07:18:55.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.143+0000 7f2cadac8640 1 -- 172.21.15.37:0/2262135265 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f2ca815be80 con 0x7f2ca80b3190 2024-04-22T07:18:55.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.144+0000 7f2c8ffff640 1 -- 172.21.15.37:0/2262135265 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7f2c9805df70 con 0x7f2ca80b3190 2024-04-22T07:18:55.142 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 64 2024-04-22T07:18:55.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.146+0000 7f2cadac8640 1 -- 172.21.15.37:0/2262135265 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f2c9406c8f0 msgr2=0x7f2c9406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:55.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.146+0000 7f2cadac8640 1 --2- 172.21.15.37:0/2262135265 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f2c9406c8f0 0x7f2c9406edb0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f2ca80d1520 tx=0x7f2c9c008040 comp rx=0 tx=0).stop 2024-04-22T07:18:55.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.146+0000 7f2cadac8640 1 -- 172.21.15.37:0/2262135265 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ca80b3190 msgr2=0x7f2ca8157290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:55.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.146+0000 7f2cadac8640 1 --2- 172.21.15.37:0/2262135265 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ca80b3190 0x7f2ca8157290 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f2c9800d800 tx=0x7f2c9800dcc0 comp rx=0 tx=0).stop 2024-04-22T07:18:55.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.146+0000 7f2cadac8640 1 -- 172.21.15.37:0/2262135265 shutdown_connections 2024-04-22T07:18:55.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.146+0000 7f2cadac8640 1 --2- 172.21.15.37:0/2262135265 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f2c9406c8f0 0x7f2c9406edb0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:55.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.146+0000 7f2cadac8640 1 --2- 172.21.15.37:0/2262135265 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2ca8155250 0x7f2ca81f1190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:55.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.146+0000 7f2cadac8640 1 --2- 172.21.15.37:0/2262135265 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2ca80ccd20 0x7f2ca81f0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:55.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.146+0000 7f2cadac8640 1 --2- 172.21.15.37:0/2262135265 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ca80b3190 0x7f2ca8157290 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:55.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.146+0000 7f2cadac8640 1 -- 172.21.15.37:0/2262135265 >> 172.21.15.37:0/2262135265 conn(0x7f2ca8071f90 msgr2=0x7f2ca80d0740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:55.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.146+0000 7f2cadac8640 1 -- 172.21.15.37:0/2262135265 shutdown_connections 2024-04-22T07:18:55.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.146+0000 7f2cadac8640 1 -- 172.21.15.37:0/2262135265 wait complete. 2024-04-22T07:18:55.154 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-22T07:18:55.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.259+0000 7f96e346a640 1 Processor -- start 2024-04-22T07:18:55.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.259+0000 7f96e346a640 1 -- start start 2024-04-22T07:18:55.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.260+0000 7f96e346a640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f96dc06c6a0 0x7f96dc15b610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:55.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.260+0000 7f96e346a640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f96dc15bb50 0x7f96dc0d0af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:55.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.260+0000 7f96e346a640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96dc15ae70 con 0x7f96dc1550b0 2024-04-22T07:18:55.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.260+0000 7f96e346a640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f96dc0c5530 con 0x7f96dc06c6a0 2024-04-22T07:18:55.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.260+0000 7f96e346a640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f96dc0cc650 con 0x7f96dc15bb50 2024-04-22T07:18:55.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.260+0000 7f96e0a05640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f96dc06c6a0 0x7f96dc15b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:55.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.260+0000 7f96e0a05640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f96dc06c6a0 0x7f96dc15b610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.37:51904/0 (socket says 172.21.15.37:51904) 2024-04-22T07:18:55.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.260+0000 7f96e1206640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7f96dc1550b0 0x7f96dc0cbf00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.37:43962/0 (socket says 172.21.15.37:43962) 2024-04-22T07:18:55.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.260+0000 7f96e0a05640 1 -- 172.21.15.37:0/3010933870 learned_addr learned my addr 172.21.15.37:0/3010933870 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:18:55.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.260+0000 7f96e1a07640 1 --2- 172.21.15.37:0/3010933870 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f96dc15bb50 0x7f96dc0d0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:55.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.260+0000 7f96e0a05640 1 -- 172.21.15.37:0/3010933870 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f96dc15bb50 msgr2=0x7f96dc0d0af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:18:55.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.260+0000 7f96e0a05640 1 --2- 172.21.15.37:0/3010933870 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f96dc15bb50 0x7f96dc0d0af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:55.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.260+0000 7f96e0a05640 1 -- 172.21.15.37:0/3010933870 >> v1:172.21.15.196:6789/0 conn(0x7f96dc1550b0 legacy=0x7f96dc0cbf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:55.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.260+0000 7f96e0a05640 1 -- 172.21.15.37:0/3010933870 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96dc15f290 con 0x7f96dc06c6a0 2024-04-22T07:18:55.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.261+0000 7f96e0a05640 1 --2- 172.21.15.37:0/3010933870 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f96dc06c6a0 0x7f96dc15b610 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f96cc009870 tx=0x7f96cc02b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dce6ca69f44eb71 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:55.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.261+0000 7f96d3fff640 1 -- 172.21.15.37:0/3010933870 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96cc034070 con 0x7f96dc06c6a0 2024-04-22T07:18:55.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.261+0000 7f96d3fff640 1 -- 172.21.15.37:0/3010933870 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96cc030840 con 0x7f96dc06c6a0 2024-04-22T07:18:55.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.261+0000 7f96d3fff640 1 -- 172.21.15.37:0/3010933870 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96cc030c10 con 0x7f96dc06c6a0 2024-04-22T07:18:55.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.262+0000 7f96e346a640 1 -- 172.21.15.37:0/3010933870 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f96dc06c6a0 msgr2=0x7f96dc15b610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:55.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.262+0000 7f96e346a640 1 --2- 172.21.15.37:0/3010933870 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f96dc06c6a0 0x7f96dc15b610 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f96cc009870 tx=0x7f96cc02b980 comp rx=0 tx=0).stop 2024-04-22T07:18:55.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.262+0000 7f96e346a640 1 -- 172.21.15.37:0/3010933870 shutdown_connections 2024-04-22T07:18:55.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.262+0000 7f96e346a640 1 --2- 172.21.15.37:0/3010933870 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f96dc15bb50 0x7f96dc0d0af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:55.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.262+0000 7f96e346a640 1 --2- 172.21.15.37:0/3010933870 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f96dc06c6a0 0x7f96dc15b610 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:55.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.262+0000 7f96e346a640 1 -- 172.21.15.37:0/3010933870 >> 172.21.15.37:0/3010933870 conn(0x7f96dc073630 msgr2=0x7f96dc073a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:55.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.262+0000 7f96e346a640 1 -- 172.21.15.37:0/3010933870 shutdown_connections 2024-04-22T07:18:55.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.262+0000 7f96e346a640 1 -- 172.21.15.37:0/3010933870 wait complete. 2024-04-22T07:18:55.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.263+0000 7f96e346a640 1 Processor -- start 2024-04-22T07:18:55.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.263+0000 7f96e346a640 1 -- start start 2024-04-22T07:18:55.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.264+0000 7f96e346a640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f96dc06c6a0 0x7f96dc14f780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:55.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.264+0000 7f96e346a640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f96dc1550b0 0x7f96dc14ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:55.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.264+0000 7f96e346a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96dc15bb50 0x7f96dc14d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:55.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.264+0000 7f96e346a640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f96dc15b0f0 con 0x7f96dc15bb50 2024-04-22T07:18:55.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.264+0000 7f96e346a640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f96dc0ccbd0 con 0x7f96dc1550b0 2024-04-22T07:18:55.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.264+0000 7f96e346a640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f96dc155490 con 0x7f96dc06c6a0 2024-04-22T07:18:55.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.264+0000 7f96e1a07640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96dc15bb50 0x7f96dc14d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:55.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.264+0000 7f96e1a07640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96dc15bb50 0x7f96dc14d350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39456/0 (socket says 172.21.15.37:39456) 2024-04-22T07:18:55.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.264+0000 7f96e1a07640 1 -- 172.21.15.37:0/796316536 learned_addr learned my addr 172.21.15.37:0/796316536 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:18:55.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.264+0000 7f96e0a05640 1 --2- 172.21.15.37:0/796316536 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f96dc1550b0 0x7f96dc14ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:55.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.264+0000 7f96e1206640 1 --2- 172.21.15.37:0/796316536 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f96dc06c6a0 0x7f96dc14f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:55.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.264+0000 7f96e1a07640 1 -- 172.21.15.37:0/796316536 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f96dc06c6a0 msgr2=0x7f96dc14f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:55.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.264+0000 7f96e1a07640 1 --2- 172.21.15.37:0/796316536 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f96dc06c6a0 0x7f96dc14f780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:55.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.264+0000 7f96e1a07640 1 -- 172.21.15.37:0/796316536 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f96dc1550b0 msgr2=0x7f96dc14ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:55.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.264+0000 7f96e1a07640 1 --2- 172.21.15.37:0/796316536 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f96dc1550b0 0x7f96dc14ce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:55.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.264+0000 7f96e1a07640 1 -- 172.21.15.37:0/796316536 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96dc1f10b0 con 0x7f96dc15bb50 2024-04-22T07:18:55.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.265+0000 7f96e1a07640 1 --2- 172.21.15.37:0/796316536 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96dc15bb50 0x7f96dc14d350 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f96d4009d30 tx=0x7f96d400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:55.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.265+0000 7f96d1ffb640 1 -- 172.21.15.37:0/796316536 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96d4018020 con 0x7f96dc15bb50 2024-04-22T07:18:55.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.265+0000 7f96d1ffb640 1 -- 172.21.15.37:0/796316536 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96d4014480 con 0x7f96dc15bb50 2024-04-22T07:18:55.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.265+0000 7f96e346a640 1 -- 172.21.15.37:0/796316536 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96dc1f1390 con 0x7f96dc15bb50 2024-04-22T07:18:55.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.265+0000 7f96d1ffb640 1 -- 172.21.15.37:0/796316536 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96d4014870 con 0x7f96dc15bb50 2024-04-22T07:18:55.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.265+0000 7f96e346a640 1 -- 172.21.15.37:0/796316536 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96dc1f1950 con 0x7f96dc15bb50 2024-04-22T07:18:55.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.266+0000 7f96e346a640 1 -- 172.21.15.37:0/796316536 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96dc15e190 con 0x7f96dc15bb50 2024-04-22T07:18:55.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.266+0000 7f96d1ffb640 1 -- 172.21.15.37:0/796316536 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f96d4005d10 con 0x7f96dc15bb50 2024-04-22T07:18:55.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.267+0000 7f96d1ffb640 1 --2- 172.21.15.37:0/796316536 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f96c006c8f0 0x7f96c006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:55.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.267+0000 7f96d1ffb640 1 -- 172.21.15.37:0/796316536 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f96d408c510 con 0x7f96dc15bb50 2024-04-22T07:18:55.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.267+0000 7f96e1206640 1 --2- 172.21.15.37:0/796316536 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f96c006c8f0 0x7f96c006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:55.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.267+0000 7f96e1206640 1 --2- 172.21.15.37:0/796316536 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f96c006c8f0 0x7f96c006edb0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f96d8007fd0 tx=0x7f96d8007e80 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:55.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.271+0000 7f96d1ffb640 1 -- 172.21.15.37:0/796316536 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f96d4022070 con 0x7f96dc15bb50 2024-04-22T07:18:55.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.456+0000 7f96e346a640 1 -- 172.21.15.37:0/796316536 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f96dc06cb80 con 0x7f96dc15bb50 2024-04-22T07:18:55.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.457+0000 7f96d1ffb640 1 -- 172.21.15.37:0/796316536 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16581 (secure 0 0 0) 0x7f96dc06cb80 con 0x7f96dc15bb50 2024-04-22T07:18:55.455 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-22T07:18:55.455 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":20,"fsid":"10d90a41-52d3-4e09-8022-c8ac67897ad1","created":"2024-04-22T07:18:12.420756+0000","modified":"2024-04-22T07:18:37.754119+0000","last_up_change":"2024-04-22T07:18:23.649808+0000","last_in_change":"2024-04-22T07:18:14.506974+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-22T07:18:24.602243+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-22T07:18:34.673639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-22T07:18:35.055184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e248f6e1-13ad-48e0-a8f8-ec3059995654","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":1488290385},{"type":"v1","addr":"172.21.15.37:6801","nonce":1488290385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1488290385},{"type":"v1","addr":"172.21.15.37:6803","nonce":1488290385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1488290385},{"type":"v1","addr":"172.21.15.37:6807","nonce":1488290385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1488290385},{"type":"v1","addr":"172.21.15.37:6805","nonce":1488290385}]},"public_addr":"172.21.15.37:6801/1488290385","cluster_addr":"172.21.15.37:6803/1488290385","heartbeat_back_addr":"172.21.15.37:6807/1488290385","heartbeat_front_addr":"172.21.15.37:6805/1488290385","state":["exists","up"]},{"osd":1,"uuid":"01c71ab7-1326-432b-b73a-e5847abe5132","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3918584183},{"type":"v1","addr":"172.21.15.37:6811","nonce":3918584183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6813","nonce":3918584183},{"type":"v1","addr":"172.21.15.37:6816","nonce":3918584183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":3918584183},{"type":"v1","addr":"172.21.15.37:6823","nonce":3918584183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":3918584183},{"type":"v1","addr":"172.21.15.37:6821","nonce":3918584183}]},"public_addr":"172.21.15.37:6811/3918584183","cluster_addr":"172.21.15.37:6816/3918584183","heartbeat_back_addr":"172.21.15.37:6823/3918584183","heartbeat_front_addr":"172.21.15.37:6821/3918584183","state":["exists","up"]},{"osd":2,"uuid":"33a780fd-013a-41c8-9970-136c9e080897","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1895439419},{"type":"v1","addr":"172.21.15.37:6825","nonce":1895439419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1895439419},{"type":"v1","addr":"172.21.15.37:6827","nonce":1895439419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1895439419},{"type":"v1","addr":"172.21.15.37:6831","nonce":1895439419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1895439419},{"type":"v1","addr":"172.21.15.37:6829","nonce":1895439419}]},"public_addr":"172.21.15.37:6825/1895439419","cluster_addr":"172.21.15.37:6827/1895439419","heartbeat_back_addr":"172.21.15.37:6831/1895439419","heartbeat_front_addr":"172.21.15.37:6829/1895439419","state":["exists","up"]},{"osd":3,"uuid":"b46e53c4-e5b9-4098-b243-ab5a0f1f3885","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6809","nonce":1160021017},{"type":"v1","addr":"172.21.15.37:6810","nonce":1160021017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1160021017},{"type":"v1","addr":"172.21.15.37:6814","nonce":1160021017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":1160021017},{"type":"v1","addr":"172.21.15.37:6820","nonce":1160021017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6815","nonce":1160021017},{"type":"v1","addr":"172.21.15.37:6817","nonce":1160021017}]},"public_addr":"172.21.15.37:6810/1160021017","cluster_addr":"172.21.15.37:6814/1160021017","heartbeat_back_addr":"172.21.15.37:6820/1160021017","heartbeat_front_addr":"172.21.15.37:6817/1160021017","state":["exists","up"]},{"osd":4,"uuid":"cd1032c6-6a83-4e33-b7b1-baddf92a83af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":374829049},{"type":"v1","addr":"172.21.15.196:6809","nonce":374829049}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":374829049},{"type":"v1","addr":"172.21.15.196:6811","nonce":374829049}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":374829049},{"type":"v1","addr":"172.21.15.196:6815","nonce":374829049}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":374829049},{"type":"v1","addr":"172.21.15.196:6813","nonce":374829049}]},"public_addr":"172.21.15.196:6809/374829049","cluster_addr":"172.21.15.196:6811/374829049","heartbeat_back_addr":"172.21.15.196:6815/374829049","heartbeat_front_addr":"172.21.15.196:6813/374829049","state":["exists","up"]},{"osd":5,"uuid":"f561d48a-5f2d-4deb-8681-4329aed36bae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":479311302},{"type":"v1","addr":"172.21.15.196:6801","nonce":479311302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":479311302},{"type":"v1","addr":"172.21.15.196:6803","nonce":479311302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":479311302},{"type":"v1","addr":"172.21.15.196:6807","nonce":479311302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":479311302},{"type":"v1","addr":"172.21.15.196:6805","nonce":479311302}]},"public_addr":"172.21.15.196:6801/479311302","cluster_addr":"172.21.15.196:6803/479311302","heartbeat_back_addr":"172.21.15.196:6807/479311302","heartbeat_front_addr":"172.21.15.196:6805/479311302","state":["exists","up"]},{"osd":6,"uuid":"1b239c7e-2504-42e0-b308-70f4e62519c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6817","nonce":691777224},{"type":"v1","addr":"172.21.15.196:6819","nonce":691777224}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6821","nonce":691777224},{"type":"v1","addr":"172.21.15.196:6823","nonce":691777224}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6829","nonce":691777224},{"type":"v1","addr":"172.21.15.196:6831","nonce":691777224}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6825","nonce":691777224},{"type":"v1","addr":"172.21.15.196:6827","nonce":691777224}]},"public_addr":"172.21.15.196:6819/691777224","cluster_addr":"172.21.15.196:6823/691777224","heartbeat_back_addr":"172.21.15.196:6831/691777224","heartbeat_front_addr":"172.21.15.196:6827/691777224","state":["exists","up"]},{"osd":7,"uuid":"084318d4-d1fd-4b58-8c33-b1d7856fe323","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":3106266066},{"type":"v1","addr":"172.21.15.196:6818","nonce":3106266066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":3106266066},{"type":"v1","addr":"172.21.15.196:6822","nonce":3106266066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":3106266066},{"type":"v1","addr":"172.21.15.196:6830","nonce":3106266066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":3106266066},{"type":"v1","addr":"172.21.15.196:6826","nonce":3106266066}]},"public_addr":"172.21.15.196:6818/3106266066","cluster_addr":"172.21.15.196:6822/3106266066","heartbeat_back_addr":"172.21.15.196:6830/3106266066","heartbeat_front_addr":"172.21.15.196:6826/3106266066","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:18:19.587791+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:18:19.706541+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:18:19.690674+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:18:19.648354+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:18:19.666671+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:18:19.560709+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:18:19.661412+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:18:19.770650+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-22T07:18:55.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.459+0000 7f96e346a640 1 -- 172.21.15.37:0/796316536 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f96c006c8f0 msgr2=0x7f96c006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:55.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.459+0000 7f96e346a640 1 --2- 172.21.15.37:0/796316536 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f96c006c8f0 0x7f96c006edb0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f96d8007fd0 tx=0x7f96d8007e80 comp rx=0 tx=0).stop 2024-04-22T07:18:55.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.459+0000 7f96e346a640 1 -- 172.21.15.37:0/796316536 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96dc15bb50 msgr2=0x7f96dc14d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:55.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.459+0000 7f96e346a640 1 --2- 172.21.15.37:0/796316536 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96dc15bb50 0x7f96dc14d350 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f96d4009d30 tx=0x7f96d400c490 comp rx=0 tx=0).stop 2024-04-22T07:18:55.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.459+0000 7f96e346a640 1 -- 172.21.15.37:0/796316536 shutdown_connections 2024-04-22T07:18:55.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.459+0000 7f96e346a640 1 --2- 172.21.15.37:0/796316536 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f96c006c8f0 0x7f96c006edb0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:55.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.459+0000 7f96e346a640 1 --2- 172.21.15.37:0/796316536 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96dc15bb50 0x7f96dc14d350 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:55.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.459+0000 7f96e346a640 1 --2- 172.21.15.37:0/796316536 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f96dc1550b0 0x7f96dc14ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:55.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.459+0000 7f96e346a640 1 --2- 172.21.15.37:0/796316536 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f96dc06c6a0 0x7f96dc14f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:55.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.459+0000 7f96e346a640 1 -- 172.21.15.37:0/796316536 >> 172.21.15.37:0/796316536 conn(0x7f96dc073630 msgr2=0x7f96dc06bae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:55.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.459+0000 7f96e346a640 1 -- 172.21.15.37:0/796316536 shutdown_connections 2024-04-22T07:18:55.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.459+0000 7f96e346a640 1 -- 172.21.15.37:0/796316536 wait complete. 2024-04-22T07:18:55.468 INFO:tasks.quiescer.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-22T07:18:24.602243+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-22T07:18:34.673639+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-22T07:18:35.055184+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-22T07:18:55.468 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-22T07:18:55.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.575+0000 7f0c1cb59640 1 Processor -- start 2024-04-22T07:18:55.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.575+0000 7f0c1cb59640 1 -- start start 2024-04-22T07:18:55.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.576+0000 7f0c1cb59640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f0c181552c0 0x7f0c180c5fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:55.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.576+0000 7f0c1cb59640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0c180cdd60 0x7f0c1815b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:55.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.576+0000 7f0c1cb59640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c180c6990 con 0x7f0c180cb010 2024-04-22T07:18:55.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.576+0000 7f0c1cb59640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f0c181556a0 con 0x7f0c180cdd60 2024-04-22T07:18:55.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.576+0000 7f0c1cb59640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f0c180c66b0 con 0x7f0c181552c0 2024-04-22T07:18:55.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.576+0000 7f0c16d9d640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0c180cdd60 0x7f0c1815b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:55.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.576+0000 7f0c15d9b640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f0c180cb010 0x7f0c180676b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:54310/0 (socket says 172.21.15.37:54310) 2024-04-22T07:18:55.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.576+0000 7f0c16d9d640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0c180cdd60 0x7f0c1815b160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39470/0 (socket says 172.21.15.37:39470) 2024-04-22T07:18:55.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.576+0000 7f0c15d9b640 1 -- 172.21.15.37:0/3039744930 learned_addr learned my addr 172.21.15.37:0/3039744930 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-04-22T07:18:55.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.576+0000 7f0c1659c640 1 --2- 172.21.15.37:0/3039744930 >> v2:172.21.15.196:3300/0 conn(0x7f0c181552c0 0x7f0c180c5fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:55.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.576+0000 7f0c16d9d640 1 -- 172.21.15.37:0/3039744930 >> v2:172.21.15.196:3300/0 conn(0x7f0c181552c0 msgr2=0x7f0c180c5fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:18:55.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.576+0000 7f0c16d9d640 1 --2- 172.21.15.37:0/3039744930 >> v2:172.21.15.196:3300/0 conn(0x7f0c181552c0 0x7f0c180c5fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:55.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.576+0000 7f0c16d9d640 1 -- 172.21.15.37:0/3039744930 >> v1:172.21.15.37:6789/0 conn(0x7f0c180cb010 legacy=0x7f0c180676b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:55.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.576+0000 7f0c16d9d640 1 -- 172.21.15.37:0/3039744930 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c180cc560 con 0x7f0c180cdd60 2024-04-22T07:18:55.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.577+0000 7f0c16d9d640 1 --2- 172.21.15.37:0/3039744930 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0c180cdd60 0x7f0c1815b160 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f0c180cd450 tx=0x7f0c0802bec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a2a1ad6dbe8861c server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:55.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.577+0000 7f0c1559a640 1 -- 172.21.15.37:0/3039744930 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c08039070 con 0x7f0c180cdd60 2024-04-22T07:18:55.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.577+0000 7f0c1559a640 1 -- 172.21.15.37:0/3039744930 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c0802cc70 con 0x7f0c180cdd60 2024-04-22T07:18:55.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.577+0000 7f0c1559a640 1 -- 172.21.15.37:0/3039744930 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c08034660 con 0x7f0c180cdd60 2024-04-22T07:18:55.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.578+0000 7f0c1cb59640 1 -- 172.21.15.37:0/3039744930 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0c180cdd60 msgr2=0x7f0c1815b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:55.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.578+0000 7f0c1cb59640 1 --2- 172.21.15.37:0/3039744930 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0c180cdd60 0x7f0c1815b160 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f0c180cd450 tx=0x7f0c0802bec0 comp rx=0 tx=0).stop 2024-04-22T07:18:55.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.578+0000 7f0c1cb59640 1 -- 172.21.15.37:0/3039744930 shutdown_connections 2024-04-22T07:18:55.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.578+0000 7f0c1cb59640 1 --2- 172.21.15.37:0/3039744930 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0c180cdd60 0x7f0c1815b160 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:55.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.578+0000 7f0c1cb59640 1 --2- 172.21.15.37:0/3039744930 >> v2:172.21.15.196:3300/0 conn(0x7f0c181552c0 0x7f0c180c5fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:55.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.578+0000 7f0c1cb59640 1 -- 172.21.15.37:0/3039744930 >> 172.21.15.37:0/3039744930 conn(0x7f0c1806d330 msgr2=0x7f0c1806c290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:55.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.578+0000 7f0c1cb59640 1 -- 172.21.15.37:0/3039744930 shutdown_connections 2024-04-22T07:18:55.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.578+0000 7f0c1cb59640 1 -- 172.21.15.37:0/3039744930 wait complete. 2024-04-22T07:18:55.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.579+0000 7f0c1cb59640 1 Processor -- start 2024-04-22T07:18:55.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.579+0000 7f0c1cb59640 1 -- start start 2024-04-22T07:18:55.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.580+0000 7f0c1cb59640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0c180cb010 0x7f0c180ce8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:55.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.580+0000 7f0c1cb59640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0c180cdd60 0x7f0c18156370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:55.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.580+0000 7f0c1cb59640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0c181552c0 0x7f0c181483d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:55.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.580+0000 7f0c1cb59640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0c180cce00 con 0x7f0c180cdd60 2024-04-22T07:18:55.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.580+0000 7f0c1cb59640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f0c180ccb20 con 0x7f0c181552c0 2024-04-22T07:18:55.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.580+0000 7f0c1cb59640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f0c18067dc0 con 0x7f0c180cb010 2024-04-22T07:18:55.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.580+0000 7f0c15d9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0c180cdd60 0x7f0c18156370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:55.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.580+0000 7f0c15d9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0c180cdd60 0x7f0c18156370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39474/0 (socket says 172.21.15.37:39474) 2024-04-22T07:18:55.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.580+0000 7f0c15d9b640 1 -- 172.21.15.37:0/2006032063 learned_addr learned my addr 172.21.15.37:0/2006032063 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:18:55.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.580+0000 7f0c16d9d640 1 --2- 172.21.15.37:0/2006032063 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0c181552c0 0x7f0c181483d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:55.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.580+0000 7f0c1659c640 1 --2- 172.21.15.37:0/2006032063 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0c180cb010 0x7f0c180ce8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:55.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.581+0000 7f0c15d9b640 1 -- 172.21.15.37:0/2006032063 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0c180cb010 msgr2=0x7f0c180ce8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:55.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.581+0000 7f0c15d9b640 1 --2- 172.21.15.37:0/2006032063 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0c180cb010 0x7f0c180ce8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:55.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.581+0000 7f0c15d9b640 1 -- 172.21.15.37:0/2006032063 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0c181552c0 msgr2=0x7f0c181483d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:55.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.581+0000 7f0c15d9b640 1 --2- 172.21.15.37:0/2006032063 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0c181552c0 0x7f0c181483d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:55.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.581+0000 7f0c15d9b640 1 -- 172.21.15.37:0/2006032063 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c18158e10 con 0x7f0c180cdd60 2024-04-22T07:18:55.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.581+0000 7f0c15d9b640 1 --2- 172.21.15.37:0/2006032063 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0c180cdd60 0x7f0c18156370 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f0c0000c3c0 tx=0x7f0c0000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:55.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.581+0000 7f0c0effd640 1 -- 172.21.15.37:0/2006032063 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c00017070 con 0x7f0c180cdd60 2024-04-22T07:18:55.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.581+0000 7f0c0effd640 1 -- 172.21.15.37:0/2006032063 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c00005ce0 con 0x7f0c180cdd60 2024-04-22T07:18:55.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.581+0000 7f0c0effd640 1 -- 172.21.15.37:0/2006032063 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c000072f0 con 0x7f0c180cdd60 2024-04-22T07:18:55.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.581+0000 7f0c1cb59640 1 -- 172.21.15.37:0/2006032063 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c1815aa50 con 0x7f0c180cdd60 2024-04-22T07:18:55.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.581+0000 7f0c1cb59640 1 -- 172.21.15.37:0/2006032063 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c18159390 con 0x7f0c180cdd60 2024-04-22T07:18:55.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.582+0000 7f0c1cb59640 1 -- 172.21.15.37:0/2006032063 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c18069cc0 con 0x7f0c180cdd60 2024-04-22T07:18:55.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.582+0000 7f0c0effd640 1 -- 172.21.15.37:0/2006032063 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0c0001a070 con 0x7f0c180cdd60 2024-04-22T07:18:55.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.583+0000 7f0c0effd640 1 --2- 172.21.15.37:0/2006032063 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f0bf806c8f0 0x7f0bf806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:55.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.583+0000 7f0c0effd640 1 -- 172.21.15.37:0/2006032063 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f0c0008ad60 con 0x7f0c180cdd60 2024-04-22T07:18:55.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.583+0000 7f0c1659c640 1 --2- 172.21.15.37:0/2006032063 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f0bf806c8f0 0x7f0bf806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:55.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.584+0000 7f0c1659c640 1 --2- 172.21.15.37:0/2006032063 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f0bf806c8f0 0x7f0bf806edb0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f0c10009b40 tx=0x7f0c10009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:55.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.587+0000 7f0c0effd640 1 -- 172.21.15.37:0/2006032063 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f0c00058bd0 con 0x7f0c180cdd60 2024-04-22T07:18:55.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.771+0000 7f0c1cb59640 1 -- 172.21.15.37:0/2006032063 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f0c1806c750 con 0x7f0c180cdd60 2024-04-22T07:18:55.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.771+0000 7f0c0effd640 1 -- 172.21.15.37:0/2006032063 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7f0c0005ced0 con 0x7f0c180cdd60 2024-04-22T07:18:55.769 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2024-04-22T07:18:55.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.773+0000 7f0c1cb59640 1 -- 172.21.15.37:0/2006032063 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f0bf806c8f0 msgr2=0x7f0bf806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:55.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.773+0000 7f0c1cb59640 1 --2- 172.21.15.37:0/2006032063 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f0bf806c8f0 0x7f0bf806edb0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f0c10009b40 tx=0x7f0c10009190 comp rx=0 tx=0).stop 2024-04-22T07:18:55.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.773+0000 7f0c1cb59640 1 -- 172.21.15.37:0/2006032063 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0c180cdd60 msgr2=0x7f0c18156370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:55.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.773+0000 7f0c1cb59640 1 --2- 172.21.15.37:0/2006032063 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0c180cdd60 0x7f0c18156370 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f0c0000c3c0 tx=0x7f0c0000c880 comp rx=0 tx=0).stop 2024-04-22T07:18:55.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.773+0000 7f0c1cb59640 1 -- 172.21.15.37:0/2006032063 shutdown_connections 2024-04-22T07:18:55.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.773+0000 7f0c1cb59640 1 --2- 172.21.15.37:0/2006032063 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f0bf806c8f0 0x7f0bf806edb0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:55.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.773+0000 7f0c1cb59640 1 --2- 172.21.15.37:0/2006032063 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0c181552c0 0x7f0c181483d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:55.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.773+0000 7f0c1cb59640 1 --2- 172.21.15.37:0/2006032063 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0c180cdd60 0x7f0c18156370 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:55.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.773+0000 7f0c1cb59640 1 --2- 172.21.15.37:0/2006032063 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0c180cb010 0x7f0c180ce8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:55.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.773+0000 7f0c1cb59640 1 -- 172.21.15.37:0/2006032063 >> 172.21.15.37:0/2006032063 conn(0x7f0c1806d330 msgr2=0x7f0c180b3d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:55.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.773+0000 7f0c1cb59640 1 -- 172.21.15.37:0/2006032063 shutdown_connections 2024-04-22T07:18:55.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.773+0000 7f0c1cb59640 1 -- 172.21.15.37:0/2006032063 wait complete. 2024-04-22T07:18:55.782 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-22T07:18:55.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.888+0000 7f8d5b115640 1 Processor -- start 2024-04-22T07:18:55.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.888+0000 7f8d5b115640 1 -- start start 2024-04-22T07:18:55.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.889+0000 7f8d5b115640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f8d541551f0 0x7f8d540cc460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:55.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.889+0000 7f8d5b115640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d541555d0 con 0x7f8d540cde00 2024-04-22T07:18:55.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.889+0000 7f8d5b115640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d540ccbc0 con 0x7f8d540cb0b0 2024-04-22T07:18:55.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.889+0000 7f8d5b115640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f8d540cc9a0 con 0x7f8d541551f0 2024-04-22T07:18:55.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.889+0000 7f8d4bfff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f8d540cde00 0x7f8d5415e4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:54312/0 (socket says 172.21.15.37:54312) 2024-04-22T07:18:55.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.889+0000 7f8d4bfff640 1 -- 172.21.15.37:0/3055338766 learned_addr learned my addr 172.21.15.37:0/3055338766 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-04-22T07:18:55.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.889+0000 7f8d58eb1640 1 --2- 172.21.15.37:0/3055338766 >> v2:172.21.15.196:3300/0 conn(0x7f8d541551f0 0x7f8d540cc460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:55.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.890+0000 7f8d4b7fe640 1 -- 172.21.15.37:0/3055338766 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3191517816 0 0) 0x7f8d541555d0 con 0x7f8d540cde00 2024-04-22T07:18:55.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.890+0000 7f8d4b7fe640 1 -- 172.21.15.37:0/3055338766 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8d3c003520 con 0x7f8d540cde00 2024-04-22T07:18:55.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.890+0000 7f8d4b7fe640 1 -- 172.21.15.37:0/3055338766 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 93795520 0 0) 0x7f8d3c003520 con 0x7f8d540cde00 2024-04-22T07:18:55.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.890+0000 7f8d4b7fe640 1 -- 172.21.15.37:0/3055338766 >> v2:172.21.15.196:3300/0 conn(0x7f8d541551f0 msgr2=0x7f8d540cc460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:18:55.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.890+0000 7f8d4b7fe640 1 --2- 172.21.15.37:0/3055338766 >> v2:172.21.15.196:3300/0 conn(0x7f8d541551f0 0x7f8d540cc460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:55.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.890+0000 7f8d4b7fe640 1 -- 172.21.15.37:0/3055338766 >> v1:172.21.15.196:6789/0 conn(0x7f8d540cb0b0 legacy=0x7f8d540730c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:55.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.890+0000 7f8d4b7fe640 1 -- 172.21.15.37:0/3055338766 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d540ccea0 con 0x7f8d540cde00 2024-04-22T07:18:55.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.890+0000 7f8d4b7fe640 1 -- 172.21.15.37:0/3055338766 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2576656170 0 0) 0x7f8d44001670 con 0x7f8d540cde00 2024-04-22T07:18:55.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.890+0000 7f8d58eb1640 1 --2- 172.21.15.37:0/3055338766 >> v2:172.21.15.196:3300/0 conn(0x7f8d541551f0 0x7f8d540cc460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-22T07:18:55.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.890+0000 7f8d4b7fe640 1 -- 172.21.15.37:0/3055338766 >> v1:172.21.15.37:6789/0 conn(0x7f8d540cde00 legacy=0x7f8d5415e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:55.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.890+0000 7f8d4b7fe640 1 --2- 172.21.15.37:0/3055338766 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8d3c0039b0 0x7f8d3c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:55.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.890+0000 7f8d4b7fe640 1 --2- 172.21.15.37:0/3055338766 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8d3c004800 0x7f8d3c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:55.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.890+0000 7f8d4b7fe640 1 --2- 172.21.15.37:0/3055338766 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d3c0051c0 0x7f8d3c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:55.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.890+0000 7f8d4b7fe640 1 -- 172.21.15.37:0/3055338766 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8d540cc9a0 con 0x7f8d3c0051c0 2024-04-22T07:18:55.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.890+0000 7f8d4b7fe640 1 -- 172.21.15.37:0/3055338766 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f8d3c00c070 con 0x7f8d3c004800 2024-04-22T07:18:55.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.890+0000 7f8d4b7fe640 1 -- 172.21.15.37:0/3055338766 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f8d3c00c270 con 0x7f8d3c0039b0 2024-04-22T07:18:55.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.890+0000 7f8d596b2640 1 --2- 172.21.15.37:0/3055338766 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d3c0051c0 0x7f8d3c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:55.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.890+0000 7f8d4bfff640 1 --2- 172.21.15.37:0/3055338766 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8d3c004800 0x7f8d3c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:55.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.890+0000 7f8d58eb1640 1 --2- 172.21.15.37:0/3055338766 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8d3c0039b0 0x7f8d3c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:55.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.890+0000 7f8d596b2640 1 -- 172.21.15.37:0/3055338766 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8d3c0039b0 msgr2=0x7f8d3c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:18:55.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.890+0000 7f8d596b2640 1 --2- 172.21.15.37:0/3055338766 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8d3c0039b0 0x7f8d3c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:55.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.890+0000 7f8d596b2640 1 -- 172.21.15.37:0/3055338766 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8d3c004800 msgr2=0x7f8d3c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:18:55.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.890+0000 7f8d596b2640 1 --2- 172.21.15.37:0/3055338766 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8d3c004800 0x7f8d3c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:55.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.890+0000 7f8d596b2640 1 -- 172.21.15.37:0/3055338766 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d3c003520 con 0x7f8d3c0051c0 2024-04-22T07:18:55.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.891+0000 7f8d596b2640 1 -- 172.21.15.37:0/3055338766 reap_dead start 2024-04-22T07:18:55.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.891+0000 7f8d596b2640 1 --2- 172.21.15.37:0/3055338766 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d3c0051c0 0x7f8d3c00b9c0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f8d4c001e50 tx=0x7f8d3c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55ef9e55754ae3f6 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:55.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.891+0000 7f8d4b7fe640 1 -- 172.21.15.37:0/3055338766 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d4c001a70 con 0x7f8d3c0051c0 2024-04-22T07:18:55.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.891+0000 7f8d4b7fe640 1 -- 172.21.15.37:0/3055338766 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d4c003bb0 con 0x7f8d3c0051c0 2024-04-22T07:18:55.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.891+0000 7f8d4b7fe640 1 -- 172.21.15.37:0/3055338766 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d4c0050d0 con 0x7f8d3c0051c0 2024-04-22T07:18:55.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.892+0000 7f8d5b115640 1 -- 172.21.15.37:0/3055338766 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d3c0051c0 msgr2=0x7f8d3c00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:55.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.892+0000 7f8d5b115640 1 --2- 172.21.15.37:0/3055338766 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d3c0051c0 0x7f8d3c00b9c0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f8d4c001e50 tx=0x7f8d3c005830 comp rx=0 tx=0).stop 2024-04-22T07:18:55.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.892+0000 7f8d5b115640 1 -- 172.21.15.37:0/3055338766 shutdown_connections 2024-04-22T07:18:55.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.892+0000 7f8d5b115640 1 --2- 172.21.15.37:0/3055338766 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d3c0051c0 0x7f8d3c00b9c0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:55.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.892+0000 7f8d5b115640 1 -- 172.21.15.37:0/3055338766 >> 172.21.15.37:0/3055338766 conn(0x7f8d5406c410 msgr2=0x7f8d540676b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:55.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.892+0000 7f8d5b115640 1 -- 172.21.15.37:0/3055338766 shutdown_connections 2024-04-22T07:18:55.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.892+0000 7f8d5b115640 1 -- 172.21.15.37:0/3055338766 wait complete. 2024-04-22T07:18:55.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.893+0000 7f8d5b115640 1 Processor -- start 2024-04-22T07:18:55.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.893+0000 7f8d5b115640 1 -- start start 2024-04-22T07:18:55.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.894+0000 7f8d5b115640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8d3c0051c0 0x7f8d54159f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:55.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.894+0000 7f8d5b115640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d541f0740 0x7f8d541538a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:55.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.894+0000 7f8d5b115640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8d54152e00 0x7f8d54153de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:55.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.894+0000 7f8d5b115640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8d5415b5c0 con 0x7f8d541f0740 2024-04-22T07:18:55.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.894+0000 7f8d5b115640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f8d5415b2e0 con 0x7f8d54152e00 2024-04-22T07:18:55.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.894+0000 7f8d5b115640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f8d5415b8a0 con 0x7f8d3c0051c0 2024-04-22T07:18:55.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.894+0000 7f8d4bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d541f0740 0x7f8d541538a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:55.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.894+0000 7f8d4bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d541f0740 0x7f8d541538a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39482/0 (socket says 172.21.15.37:39482) 2024-04-22T07:18:55.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.894+0000 7f8d4bfff640 1 -- 172.21.15.37:0/2405032916 learned_addr learned my addr 172.21.15.37:0/2405032916 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:18:55.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.894+0000 7f8d596b2640 1 --2- 172.21.15.37:0/2405032916 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8d54152e00 0x7f8d54153de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:55.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.894+0000 7f8d58eb1640 1 --2- 172.21.15.37:0/2405032916 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8d3c0051c0 0x7f8d54159f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:55.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.894+0000 7f8d4bfff640 1 -- 172.21.15.37:0/2405032916 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8d3c0051c0 msgr2=0x7f8d54159f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:55.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.894+0000 7f8d4bfff640 1 --2- 172.21.15.37:0/2405032916 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8d3c0051c0 0x7f8d54159f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:55.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.894+0000 7f8d4bfff640 1 -- 172.21.15.37:0/2405032916 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8d54152e00 msgr2=0x7f8d54153de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:55.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.894+0000 7f8d4bfff640 1 --2- 172.21.15.37:0/2405032916 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8d54152e00 0x7f8d54153de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:55.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.894+0000 7f8d4bfff640 1 -- 172.21.15.37:0/2405032916 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d54158ed0 con 0x7f8d541f0740 2024-04-22T07:18:55.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.894+0000 7f8d596b2640 1 --2- 172.21.15.37:0/2405032916 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8d54152e00 0x7f8d54153de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T07:18:55.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.894+0000 7f8d4bfff640 1 --2- 172.21.15.37:0/2405032916 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d541f0740 0x7f8d541538a0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f8d440072f0 tx=0x7f8d440077b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:55.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.895+0000 7f8d497fa640 1 -- 172.21.15.37:0/2405032916 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d4400f960 con 0x7f8d541f0740 2024-04-22T07:18:55.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.895+0000 7f8d497fa640 1 -- 172.21.15.37:0/2405032916 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d44018070 con 0x7f8d541f0740 2024-04-22T07:18:55.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.895+0000 7f8d5b115640 1 -- 172.21.15.37:0/2405032916 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d541591b0 con 0x7f8d541f0740 2024-04-22T07:18:55.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.895+0000 7f8d497fa640 1 -- 172.21.15.37:0/2405032916 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d4400fd40 con 0x7f8d541f0740 2024-04-22T07:18:55.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.895+0000 7f8d5b115640 1 -- 172.21.15.37:0/2405032916 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d54159770 con 0x7f8d541f0740 2024-04-22T07:18:55.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.896+0000 7f8d5b115640 1 -- 172.21.15.37:0/2405032916 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d54069cc0 con 0x7f8d541f0740 2024-04-22T07:18:55.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.896+0000 7f8d497fa640 1 -- 172.21.15.37:0/2405032916 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8d4401d460 con 0x7f8d541f0740 2024-04-22T07:18:55.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.897+0000 7f8d497fa640 1 --2- 172.21.15.37:0/2405032916 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f8d4006c8f0 0x7f8d4006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:55.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.897+0000 7f8d497fa640 1 -- 172.21.15.37:0/2405032916 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f8d4408bc10 con 0x7f8d541f0740 2024-04-22T07:18:55.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.897+0000 7f8d58eb1640 1 --2- 172.21.15.37:0/2405032916 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f8d4006c8f0 0x7f8d4006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:55.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.898+0000 7f8d58eb1640 1 --2- 172.21.15.37:0/2405032916 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f8d4006c8f0 0x7f8d4006edb0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f8d50009c10 tx=0x7f8d50008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:55.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:55.901+0000 7f8d497fa640 1 -- 172.21.15.37:0/2405032916 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f8d4405a040 con 0x7f8d541f0740 2024-04-22T07:18:56.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.086+0000 7f8d5b115640 1 -- 172.21.15.37:0/2405032916 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f8d540cf120 con 0x7f8d541f0740 2024-04-22T07:18:56.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.086+0000 7f8d497fa640 1 -- 172.21.15.37:0/2405032916 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7f8d44059940 con 0x7f8d541f0740 2024-04-22T07:18:56.086 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2024-04-22T07:18:56.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.088+0000 7f8d5b115640 1 -- 172.21.15.37:0/2405032916 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f8d4006c8f0 msgr2=0x7f8d4006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:56.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.088+0000 7f8d5b115640 1 --2- 172.21.15.37:0/2405032916 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f8d4006c8f0 0x7f8d4006edb0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f8d50009c10 tx=0x7f8d50008040 comp rx=0 tx=0).stop 2024-04-22T07:18:56.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.088+0000 7f8d5b115640 1 -- 172.21.15.37:0/2405032916 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d541f0740 msgr2=0x7f8d541538a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:56.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.088+0000 7f8d5b115640 1 --2- 172.21.15.37:0/2405032916 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d541f0740 0x7f8d541538a0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f8d440072f0 tx=0x7f8d440077b0 comp rx=0 tx=0).stop 2024-04-22T07:18:56.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.088+0000 7f8d5b115640 1 -- 172.21.15.37:0/2405032916 shutdown_connections 2024-04-22T07:18:56.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.088+0000 7f8d5b115640 1 --2- 172.21.15.37:0/2405032916 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f8d4006c8f0 0x7f8d4006edb0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:56.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.088+0000 7f8d5b115640 1 --2- 172.21.15.37:0/2405032916 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8d54152e00 0x7f8d54153de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:56.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.088+0000 7f8d5b115640 1 --2- 172.21.15.37:0/2405032916 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d541f0740 0x7f8d541538a0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:56.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.088+0000 7f8d5b115640 1 --2- 172.21.15.37:0/2405032916 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8d3c0051c0 0x7f8d54159f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:56.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.088+0000 7f8d5b115640 1 -- 172.21.15.37:0/2405032916 >> 172.21.15.37:0/2405032916 conn(0x7f8d5406c410 msgr2=0x7f8d540cf940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:56.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.088+0000 7f8d5b115640 1 -- 172.21.15.37:0/2405032916 shutdown_connections 2024-04-22T07:18:56.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.088+0000 7f8d5b115640 1 -- 172.21.15.37:0/2405032916 wait complete. 2024-04-22T07:18:56.096 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-22T07:18:56.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.203+0000 7f1d64031640 1 Processor -- start 2024-04-22T07:18:56.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.203+0000 7f1d64031640 1 -- start start 2024-04-22T07:18:56.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.204+0000 7f1d64031640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1d5c1552e0 0x7f1d5c0c6000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:56.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.204+0000 7f1d64031640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f1d5c0cdd80 0x7f1d5c15b180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:56.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.204+0000 7f1d64031640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1d5c0c69b0 con 0x7f1d5c0cb030 2024-04-22T07:18:56.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.204+0000 7f1d64031640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f1d5c1556c0 con 0x7f1d5c1552e0 2024-04-22T07:18:56.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.204+0000 7f1d64031640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f1d5c0c66d0 con 0x7f1d5c0cdd80 2024-04-22T07:18:56.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.204+0000 7f1d61dcd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1d5c1552e0 0x7f1d5c0c6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:56.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.204+0000 7f1d61dcd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1d5c1552e0 0x7f1d5c0c6000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39484/0 (socket says 172.21.15.37:39484) 2024-04-22T07:18:56.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.204+0000 7f1d61dcd640 1 -- 172.21.15.37:0/4115671648 learned_addr learned my addr 172.21.15.37:0/4115671648 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:18:56.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.204+0000 7f1d625ce640 1 --2- 172.21.15.37:0/4115671648 >> v2:172.21.15.196:3300/0 conn(0x7f1d5c0cdd80 0x7f1d5c15b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:56.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.204+0000 7f1d61dcd640 1 -- 172.21.15.37:0/4115671648 >> v2:172.21.15.196:3300/0 conn(0x7f1d5c0cdd80 msgr2=0x7f1d5c15b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:18:56.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.204+0000 7f1d61dcd640 1 --2- 172.21.15.37:0/4115671648 >> v2:172.21.15.196:3300/0 conn(0x7f1d5c0cdd80 0x7f1d5c15b180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:56.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.204+0000 7f1d61dcd640 1 -- 172.21.15.37:0/4115671648 >> v1:172.21.15.196:6789/0 conn(0x7f1d5c0cb030 legacy=0x7f1d5c0676b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:56.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.204+0000 7f1d61dcd640 1 -- 172.21.15.37:0/4115671648 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d5c0cc580 con 0x7f1d5c1552e0 2024-04-22T07:18:56.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.205+0000 7f1d61dcd640 1 --2- 172.21.15.37:0/4115671648 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1d5c1552e0 0x7f1d5c0c6000 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f1d5c06cee0 tx=0x7f1d5802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9cf407163e614ce server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:56.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.205+0000 7f1d60dcb640 1 -- 172.21.15.37:0/4115671648 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d58034070 con 0x7f1d5c1552e0 2024-04-22T07:18:56.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.205+0000 7f1d60dcb640 1 -- 172.21.15.37:0/4115671648 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d58030860 con 0x7f1d5c1552e0 2024-04-22T07:18:56.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.205+0000 7f1d60dcb640 1 -- 172.21.15.37:0/4115671648 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d58030c30 con 0x7f1d5c1552e0 2024-04-22T07:18:56.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.206+0000 7f1d64031640 1 -- 172.21.15.37:0/4115671648 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1d5c1552e0 msgr2=0x7f1d5c0c6000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:56.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.206+0000 7f1d64031640 1 --2- 172.21.15.37:0/4115671648 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1d5c1552e0 0x7f1d5c0c6000 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f1d5c06cee0 tx=0x7f1d5802b9a0 comp rx=0 tx=0).stop 2024-04-22T07:18:56.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.206+0000 7f1d64031640 1 -- 172.21.15.37:0/4115671648 shutdown_connections 2024-04-22T07:18:56.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.206+0000 7f1d64031640 1 --2- 172.21.15.37:0/4115671648 >> v2:172.21.15.196:3300/0 conn(0x7f1d5c0cdd80 0x7f1d5c15b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:56.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.206+0000 7f1d64031640 1 --2- 172.21.15.37:0/4115671648 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1d5c1552e0 0x7f1d5c0c6000 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:56.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.206+0000 7f1d64031640 1 -- 172.21.15.37:0/4115671648 >> 172.21.15.37:0/4115671648 conn(0x7f1d5c06d330 msgr2=0x7f1d5c06c290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:56.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.206+0000 7f1d64031640 1 -- 172.21.15.37:0/4115671648 shutdown_connections 2024-04-22T07:18:56.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.206+0000 7f1d64031640 1 -- 172.21.15.37:0/4115671648 wait complete. 2024-04-22T07:18:56.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.207+0000 7f1d64031640 1 Processor -- start 2024-04-22T07:18:56.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.207+0000 7f1d64031640 1 -- start start 2024-04-22T07:18:56.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.208+0000 7f1d64031640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1d5c0cb030 0x7f1d5c150270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:56.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.208+0000 7f1d64031640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1d5c0cdd80 0x7f1d5c1f2860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:56.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.208+0000 7f1d64031640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1d5c1552e0 0x7f1d5c1f2da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:56.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.208+0000 7f1d64031640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f1d5c0cce20 con 0x7f1d5c0cb030 2024-04-22T07:18:56.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.208+0000 7f1d64031640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f1d5c0ccb40 con 0x7f1d5c1552e0 2024-04-22T07:18:56.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.208+0000 7f1d64031640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f1d5c067dc0 con 0x7f1d5c0cdd80 2024-04-22T07:18:56.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.208+0000 7f1d61dcd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1d5c0cb030 0x7f1d5c150270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:56.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.208+0000 7f1d61dcd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1d5c0cb030 0x7f1d5c150270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39494/0 (socket says 172.21.15.37:39494) 2024-04-22T07:18:56.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.208+0000 7f1d61dcd640 1 -- 172.21.15.37:0/744674595 learned_addr learned my addr 172.21.15.37:0/744674595 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:18:56.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.208+0000 7f1d615cc640 1 --2- 172.21.15.37:0/744674595 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1d5c0cdd80 0x7f1d5c1f2860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:56.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.208+0000 7f1d625ce640 1 --2- 172.21.15.37:0/744674595 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1d5c1552e0 0x7f1d5c1f2da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:56.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.208+0000 7f1d61dcd640 1 -- 172.21.15.37:0/744674595 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1d5c0cdd80 msgr2=0x7f1d5c1f2860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:56.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.208+0000 7f1d61dcd640 1 --2- 172.21.15.37:0/744674595 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1d5c0cdd80 0x7f1d5c1f2860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:56.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.208+0000 7f1d61dcd640 1 -- 172.21.15.37:0/744674595 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1d5c1552e0 msgr2=0x7f1d5c1f2da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:56.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.208+0000 7f1d61dcd640 1 --2- 172.21.15.37:0/744674595 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1d5c1552e0 0x7f1d5c1f2da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:56.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.208+0000 7f1d61dcd640 1 -- 172.21.15.37:0/744674595 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d5c1531d0 con 0x7f1d5c0cb030 2024-04-22T07:18:56.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.208+0000 7f1d625ce640 1 --2- 172.21.15.37:0/744674595 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1d5c1552e0 0x7f1d5c1f2da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-22T07:18:56.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.208+0000 7f1d61dcd640 1 --2- 172.21.15.37:0/744674595 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1d5c0cb030 0x7f1d5c150270 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f1d5802b9e0 tx=0x7f1d58004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:56.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.209+0000 7f1d527fc640 1 -- 172.21.15.37:0/744674595 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d58048070 con 0x7f1d5c0cb030 2024-04-22T07:18:56.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.209+0000 7f1d527fc640 1 -- 172.21.15.37:0/744674595 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d58030660 con 0x7f1d5c0cb030 2024-04-22T07:18:56.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.209+0000 7f1d64031640 1 -- 172.21.15.37:0/744674595 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d5c153470 con 0x7f1d5c0cb030 2024-04-22T07:18:56.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.209+0000 7f1d527fc640 1 -- 172.21.15.37:0/744674595 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d58034040 con 0x7f1d5c0cb030 2024-04-22T07:18:56.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.209+0000 7f1d64031640 1 -- 172.21.15.37:0/744674595 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d5c153a30 con 0x7f1d5c0cb030 2024-04-22T07:18:56.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.210+0000 7f1d64031640 1 -- 172.21.15.37:0/744674595 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d5c069cc0 con 0x7f1d5c0cb030 2024-04-22T07:18:56.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.210+0000 7f1d527fc640 1 -- 172.21.15.37:0/744674595 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1d5804b070 con 0x7f1d5c0cb030 2024-04-22T07:18:56.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.211+0000 7f1d527fc640 1 --2- 172.21.15.37:0/744674595 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f1d4006c8f0 0x7f1d4006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:56.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.211+0000 7f1d527fc640 1 -- 172.21.15.37:0/744674595 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f1d580adc40 con 0x7f1d5c0cb030 2024-04-22T07:18:56.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.211+0000 7f1d615cc640 1 --2- 172.21.15.37:0/744674595 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f1d4006c8f0 0x7f1d4006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:56.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.211+0000 7f1d615cc640 1 --2- 172.21.15.37:0/744674595 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f1d4006c8f0 0x7f1d4006edb0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f1d5c14b840 tx=0x7f1d4c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:56.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.215+0000 7f1d527fc640 1 -- 172.21.15.37:0/744674595 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f1d5807c070 con 0x7f1d5c0cb030 2024-04-22T07:18:56.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.400+0000 7f1d64031640 1 -- 172.21.15.37:0/744674595 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f1d5c0cb680 con 0x7f1d5c0cb030 2024-04-22T07:18:56.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.400+0000 7f1d527fc640 1 -- 172.21.15.37:0/744674595 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7f1d5807b970 con 0x7f1d5c0cb030 2024-04-22T07:18:56.398 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 64 2024-04-22T07:18:56.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.402+0000 7f1d64031640 1 -- 172.21.15.37:0/744674595 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f1d4006c8f0 msgr2=0x7f1d4006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:56.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.402+0000 7f1d64031640 1 --2- 172.21.15.37:0/744674595 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f1d4006c8f0 0x7f1d4006edb0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f1d5c14b840 tx=0x7f1d4c009040 comp rx=0 tx=0).stop 2024-04-22T07:18:56.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.402+0000 7f1d64031640 1 -- 172.21.15.37:0/744674595 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1d5c0cb030 msgr2=0x7f1d5c150270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:56.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.402+0000 7f1d64031640 1 --2- 172.21.15.37:0/744674595 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1d5c0cb030 0x7f1d5c150270 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f1d5802b9e0 tx=0x7f1d58004730 comp rx=0 tx=0).stop 2024-04-22T07:18:56.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.402+0000 7f1d64031640 1 -- 172.21.15.37:0/744674595 shutdown_connections 2024-04-22T07:18:56.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.402+0000 7f1d64031640 1 --2- 172.21.15.37:0/744674595 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f1d4006c8f0 0x7f1d4006edb0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:56.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.402+0000 7f1d64031640 1 --2- 172.21.15.37:0/744674595 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1d5c1552e0 0x7f1d5c1f2da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:56.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.402+0000 7f1d64031640 1 --2- 172.21.15.37:0/744674595 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1d5c0cdd80 0x7f1d5c1f2860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:56.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.402+0000 7f1d64031640 1 --2- 172.21.15.37:0/744674595 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1d5c0cb030 0x7f1d5c150270 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:56.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.402+0000 7f1d64031640 1 -- 172.21.15.37:0/744674595 >> 172.21.15.37:0/744674595 conn(0x7f1d5c06d330 msgr2=0x7f1d5c0cf6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:56.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.402+0000 7f1d64031640 1 -- 172.21.15.37:0/744674595 shutdown_connections 2024-04-22T07:18:56.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.402+0000 7f1d64031640 1 -- 172.21.15.37:0/744674595 wait complete. 2024-04-22T07:18:56.410 INFO:tasks.quiescer.ceph_manager:waiting for clean 2024-04-22T07:18:56.411 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-22T07:18:56.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.513+0000 7fa1bf552640 1 Processor -- start 2024-04-22T07:18:56.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.513+0000 7fa1bf552640 1 -- start start 2024-04-22T07:18:56.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.514+0000 7fa1bf552640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa1b8158590 0x7fa1b806b970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:56.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.514+0000 7fa1bf552640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fa1b8070420 0x7fa1b80c3ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:56.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.514+0000 7fa1bf552640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa1b80c43e0 0x7fa1b806c380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:56.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.514+0000 7fa1bf552640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fa1b806ffc0 con 0x7fa1b8158590 2024-04-22T07:18:56.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.514+0000 7fa1bf552640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7fa1b815b840 con 0x7fa1b8070420 2024-04-22T07:18:56.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.514+0000 7fa1bf552640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fa1b815bb00 con 0x7fa1b80c43e0 2024-04-22T07:18:56.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.514+0000 7fa1bd2ee640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa1b8158590 0x7fa1b806b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:56.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.514+0000 7fa1bd2ee640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa1b8158590 0x7fa1b806b970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39500/0 (socket says 172.21.15.37:39500) 2024-04-22T07:18:56.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.514+0000 7fa1bd2ee640 1 -- 172.21.15.37:0/3862995390 learned_addr learned my addr 172.21.15.37:0/3862995390 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:18:56.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.514+0000 7fa1bcaed640 1 --2- 172.21.15.37:0/3862995390 >> v2:172.21.15.196:3300/0 conn(0x7fa1b8070420 0x7fa1b80c3ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:56.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.514+0000 7fa1bdaef640 1 --2- 172.21.15.37:0/3862995390 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa1b80c43e0 0x7fa1b806c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:56.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.514+0000 7fa1bd2ee640 1 -- 172.21.15.37:0/3862995390 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa1b80c43e0 msgr2=0x7fa1b806c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:18:56.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.514+0000 7fa1bd2ee640 1 --2- 172.21.15.37:0/3862995390 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa1b80c43e0 0x7fa1b806c380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:56.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.514+0000 7fa1bd2ee640 1 -- 172.21.15.37:0/3862995390 >> v2:172.21.15.196:3300/0 conn(0x7fa1b8070420 msgr2=0x7fa1b80c3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:18:56.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.514+0000 7fa1bd2ee640 1 --2- 172.21.15.37:0/3862995390 >> v2:172.21.15.196:3300/0 conn(0x7fa1b8070420 0x7fa1b80c3ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:56.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.514+0000 7fa1bd2ee640 1 -- 172.21.15.37:0/3862995390 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1b806f200 con 0x7fa1b8158590 2024-04-22T07:18:56.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.515+0000 7fa1bd2ee640 1 --2- 172.21.15.37:0/3862995390 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1b8158590 0x7fa1b806b970 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fa1b8073840 tx=0x7fa1b002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73d205397363ae2b server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:56.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.515+0000 7fa1affff640 1 -- 172.21.15.37:0/3862995390 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1b0034070 con 0x7fa1b8158590 2024-04-22T07:18:56.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.515+0000 7fa1affff640 1 -- 172.21.15.37:0/3862995390 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1b0030860 con 0x7fa1b8158590 2024-04-22T07:18:56.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.515+0000 7fa1affff640 1 -- 172.21.15.37:0/3862995390 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1b0030c30 con 0x7fa1b8158590 2024-04-22T07:18:56.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.516+0000 7fa1bf552640 1 -- 172.21.15.37:0/3862995390 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1b8158590 msgr2=0x7fa1b806b970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:56.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.516+0000 7fa1bf552640 1 --2- 172.21.15.37:0/3862995390 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1b8158590 0x7fa1b806b970 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fa1b8073840 tx=0x7fa1b002b9a0 comp rx=0 tx=0).stop 2024-04-22T07:18:56.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.516+0000 7fa1bf552640 1 -- 172.21.15.37:0/3862995390 shutdown_connections 2024-04-22T07:18:56.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.516+0000 7fa1bf552640 1 --2- 172.21.15.37:0/3862995390 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa1b80c43e0 0x7fa1b806c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:56.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.516+0000 7fa1bf552640 1 --2- 172.21.15.37:0/3862995390 >> v2:172.21.15.196:3300/0 conn(0x7fa1b8070420 0x7fa1b80c3ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:56.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.516+0000 7fa1bf552640 1 --2- 172.21.15.37:0/3862995390 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1b8158590 0x7fa1b806b970 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:56.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.516+0000 7fa1bf552640 1 -- 172.21.15.37:0/3862995390 >> 172.21.15.37:0/3862995390 conn(0x7fa1b8071580 msgr2=0x7fa1b8071960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:56.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.516+0000 7fa1bf552640 1 -- 172.21.15.37:0/3862995390 shutdown_connections 2024-04-22T07:18:56.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.516+0000 7fa1bf552640 1 -- 172.21.15.37:0/3862995390 wait complete. 2024-04-22T07:18:56.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.517+0000 7fa1bf552640 1 Processor -- start 2024-04-22T07:18:56.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.517+0000 7fa1bf552640 1 -- start start 2024-04-22T07:18:56.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.518+0000 7fa1bf552640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1b8070420 0x7fa1b80caf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:56.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.518+0000 7fa1bf552640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa1b80c43e0 0x7fa1b80b4160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:56.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.518+0000 7fa1bf552640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa1b8158590 0x7fa1b81f4230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:56.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.518+0000 7fa1bf552640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa1b806faa0 con 0x7fa1b8070420 2024-04-22T07:18:56.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.518+0000 7fa1bf552640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fa1b806f7c0 con 0x7fa1b8158590 2024-04-22T07:18:56.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.518+0000 7fa1bf552640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fa1b80c93b0 con 0x7fa1b80c43e0 2024-04-22T07:18:56.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.518+0000 7fa1bd2ee640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1b8070420 0x7fa1b80caf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:56.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.518+0000 7fa1bd2ee640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1b8070420 0x7fa1b80caf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39516/0 (socket says 172.21.15.37:39516) 2024-04-22T07:18:56.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.518+0000 7fa1bd2ee640 1 -- 172.21.15.37:0/2120037729 learned_addr learned my addr 172.21.15.37:0/2120037729 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:18:56.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.518+0000 7fa1bdaef640 1 --2- 172.21.15.37:0/2120037729 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa1b8158590 0x7fa1b81f4230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:56.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.518+0000 7fa1bcaed640 1 --2- 172.21.15.37:0/2120037729 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa1b80c43e0 0x7fa1b80b4160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:56.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.518+0000 7fa1bd2ee640 1 -- 172.21.15.37:0/2120037729 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa1b80c43e0 msgr2=0x7fa1b80b4160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:56.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.518+0000 7fa1bd2ee640 1 --2- 172.21.15.37:0/2120037729 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa1b80c43e0 0x7fa1b80b4160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:56.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.518+0000 7fa1bd2ee640 1 -- 172.21.15.37:0/2120037729 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa1b8158590 msgr2=0x7fa1b81f4230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:56.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.518+0000 7fa1bd2ee640 1 --2- 172.21.15.37:0/2120037729 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa1b8158590 0x7fa1b81f4230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:56.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.518+0000 7fa1bd2ee640 1 -- 172.21.15.37:0/2120037729 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1b80c8d00 con 0x7fa1b8070420 2024-04-22T07:18:56.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.518+0000 7fa1bcaed640 1 --2- 172.21.15.37:0/2120037729 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa1b80c43e0 0x7fa1b80b4160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T07:18:56.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.518+0000 7fa1bd2ee640 1 --2- 172.21.15.37:0/2120037729 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1b8070420 0x7fa1b80caf20 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fa1b0000c00 tx=0x7fa1b0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:56.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.519+0000 7fa1adffb640 1 -- 172.21.15.37:0/2120037729 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1b0048070 con 0x7fa1b8070420 2024-04-22T07:18:56.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.519+0000 7fa1adffb640 1 -- 172.21.15.37:0/2120037729 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1b0030660 con 0x7fa1b8070420 2024-04-22T07:18:56.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.519+0000 7fa1bf552640 1 -- 172.21.15.37:0/2120037729 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1b81f4fd0 con 0x7fa1b8070420 2024-04-22T07:18:56.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.519+0000 7fa1adffb640 1 -- 172.21.15.37:0/2120037729 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1b0034040 con 0x7fa1b8070420 2024-04-22T07:18:56.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.519+0000 7fa1bf552640 1 -- 172.21.15.37:0/2120037729 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1b80ca160 con 0x7fa1b8070420 2024-04-22T07:18:56.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.520+0000 7fa1bf552640 1 -- 172.21.15.37:0/2120037729 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1b8069cc0 con 0x7fa1b8070420 2024-04-22T07:18:56.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.520+0000 7fa1adffb640 1 -- 172.21.15.37:0/2120037729 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa1b004b070 con 0x7fa1b8070420 2024-04-22T07:18:56.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.521+0000 7fa1adffb640 1 --2- 172.21.15.37:0/2120037729 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fa19c06c8f0 0x7fa19c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:56.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.521+0000 7fa1adffb640 1 -- 172.21.15.37:0/2120037729 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fa1b00adc30 con 0x7fa1b8070420 2024-04-22T07:18:56.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.521+0000 7fa1bcaed640 1 --2- 172.21.15.37:0/2120037729 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fa19c06c8f0 0x7fa19c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:56.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.521+0000 7fa1bcaed640 1 --2- 172.21.15.37:0/2120037729 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fa19c06c8f0 0x7fa19c06edb0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fa1b8153a10 tx=0x7fa1a8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:56.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.525+0000 7fa1adffb640 1 -- 172.21.15.37:0/2120037729 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fa1b80c8d00 con 0x7fa1b8070420 2024-04-22T07:18:56.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.707+0000 7fa1bf552640 1 -- 172.21.15.37:0/2120037729 --> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa1b80c5730 con 0x7fa19c06c8f0 2024-04-22T07:18:56.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.714+0000 7fa1adffb640 1 -- 172.21.15.37:0/2120037729 <== mgr.4103 v2:172.21.15.196:6832/321987173 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251830 (secure 0 0 0) 0x7fa1b80c5730 con 0x7fa19c06c8f0 2024-04-22T07:18:56.714 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-22T07:18:56.715 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-04-22T07:18:56.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.717+0000 7fa1bf552640 1 -- 172.21.15.37:0/2120037729 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fa19c06c8f0 msgr2=0x7fa19c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:56.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.717+0000 7fa1bf552640 1 --2- 172.21.15.37:0/2120037729 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fa19c06c8f0 0x7fa19c06edb0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fa1b8153a10 tx=0x7fa1a8008040 comp rx=0 tx=0).stop 2024-04-22T07:18:56.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.717+0000 7fa1bf552640 1 -- 172.21.15.37:0/2120037729 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1b8070420 msgr2=0x7fa1b80caf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:56.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.717+0000 7fa1bf552640 1 --2- 172.21.15.37:0/2120037729 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1b8070420 0x7fa1b80caf20 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fa1b0000c00 tx=0x7fa1b0004730 comp rx=0 tx=0).stop 2024-04-22T07:18:56.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.717+0000 7fa1bf552640 1 -- 172.21.15.37:0/2120037729 shutdown_connections 2024-04-22T07:18:56.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.717+0000 7fa1bf552640 1 --2- 172.21.15.37:0/2120037729 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fa19c06c8f0 0x7fa19c06edb0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:56.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.717+0000 7fa1bf552640 1 --2- 172.21.15.37:0/2120037729 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa1b8158590 0x7fa1b81f4230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:56.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.717+0000 7fa1bf552640 1 --2- 172.21.15.37:0/2120037729 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa1b80c43e0 0x7fa1b80b4160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:56.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.717+0000 7fa1bf552640 1 --2- 172.21.15.37:0/2120037729 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1b8070420 0x7fa1b80caf20 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:56.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.717+0000 7fa1bf552640 1 -- 172.21.15.37:0/2120037729 >> 172.21.15.37:0/2120037729 conn(0x7fa1b8071580 msgr2=0x7fa1b8156e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:56.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.717+0000 7fa1bf552640 1 -- 172.21.15.37:0/2120037729 shutdown_connections 2024-04-22T07:18:56.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.717+0000 7fa1bf552640 1 -- 172.21.15.37:0/2120037729 wait complete. 2024-04-22T07:18:56.725 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":29,"stamp":"2024-04-22T07:18:56.590924+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":593034,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":205,"num_write_kb":2431,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218952,"kb_used_data":2824,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755768,"statfs":{"total":773094113280,"available":772869906432,"internally_reserved":0,"allocated":2891776,"data_stored":1753540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":256,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003687"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.937242+0000","last_change":"2024-04-22T07:18:36.765825+0000","last_active":"2024-04-22T07:18:37.937242+0000","last_peered":"2024-04-22T07:18:37.937242+0000","last_clean":"2024-04-22T07:18:37.937242+0000","last_became_active":"2024-04-22T07:18:36.765306+0000","last_became_peered":"2024-04-22T07:18:36.765306+0000","last_unstale":"2024-04-22T07:18:37.937242+0000","last_undegraded":"2024-04-22T07:18:37.937242+0000","last_fullsized":"2024-04-22T07:18:37.937242+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:00:45.046782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.757437+0000","last_change":"2024-04-22T07:18:36.772829+0000","last_active":"2024-04-22T07:18:37.757437+0000","last_peered":"2024-04-22T07:18:37.757437+0000","last_clean":"2024-04-22T07:18:37.757437+0000","last_became_active":"2024-04-22T07:18:36.772464+0000","last_became_peered":"2024-04-22T07:18:36.772464+0000","last_unstale":"2024-04-22T07:18:37.757437+0000","last_undegraded":"2024-04-22T07:18:37.757437+0000","last_fullsized":"2024-04-22T07:18:37.757437+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:09:08.040513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:38.894883+0000","last_change":"2024-04-22T07:18:36.760613+0000","last_active":"2024-04-22T07:18:38.894883+0000","last_peered":"2024-04-22T07:18:38.894883+0000","last_clean":"2024-04-22T07:18:38.894883+0000","last_became_active":"2024-04-22T07:18:36.760313+0000","last_became_peered":"2024-04-22T07:18:36.760313+0000","last_unstale":"2024-04-22T07:18:38.894883+0000","last_undegraded":"2024-04-22T07:18:38.894883+0000","last_fullsized":"2024-04-22T07:18:38.894883+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:51:10.038201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.763484+0000","last_change":"2024-04-22T07:18:36.767969+0000","last_active":"2024-04-22T07:18:37.763484+0000","last_peered":"2024-04-22T07:18:37.763484+0000","last_clean":"2024-04-22T07:18:37.763484+0000","last_became_active":"2024-04-22T07:18:36.767713+0000","last_became_peered":"2024-04-22T07:18:36.767713+0000","last_unstale":"2024-04-22T07:18:37.763484+0000","last_undegraded":"2024-04-22T07:18:37.763484+0000","last_fullsized":"2024-04-22T07:18:37.763484+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:36:53.716397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.936961+0000","last_change":"2024-04-22T07:18:36.764361+0000","last_active":"2024-04-22T07:18:37.936961+0000","last_peered":"2024-04-22T07:18:37.936961+0000","last_clean":"2024-04-22T07:18:37.936961+0000","last_became_active":"2024-04-22T07:18:36.763812+0000","last_became_peered":"2024-04-22T07:18:36.763812+0000","last_unstale":"2024-04-22T07:18:37.936961+0000","last_undegraded":"2024-04-22T07:18:37.936961+0000","last_fullsized":"2024-04-22T07:18:37.936961+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:18:59.298766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.763087+0000","last_change":"2024-04-22T07:18:36.762804+0000","last_active":"2024-04-22T07:18:37.763087+0000","last_peered":"2024-04-22T07:18:37.763087+0000","last_clean":"2024-04-22T07:18:37.763087+0000","last_became_active":"2024-04-22T07:18:36.762508+0000","last_became_peered":"2024-04-22T07:18:36.762508+0000","last_unstale":"2024-04-22T07:18:37.763087+0000","last_undegraded":"2024-04-22T07:18:37.763087+0000","last_fullsized":"2024-04-22T07:18:37.763087+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:09:08.040513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.936807+0000","last_change":"2024-04-22T07:18:36.771774+0000","last_active":"2024-04-22T07:18:37.936807+0000","last_peered":"2024-04-22T07:18:37.936807+0000","last_clean":"2024-04-22T07:18:37.936807+0000","last_became_active":"2024-04-22T07:18:36.771425+0000","last_became_peered":"2024-04-22T07:18:36.771425+0000","last_unstale":"2024-04-22T07:18:37.936807+0000","last_undegraded":"2024-04-22T07:18:37.936807+0000","last_fullsized":"2024-04-22T07:18:37.936807+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:45:27.464772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.767379+0000","last_change":"2024-04-22T07:18:36.773631+0000","last_active":"2024-04-22T07:18:37.767379+0000","last_peered":"2024-04-22T07:18:37.767379+0000","last_clean":"2024-04-22T07:18:37.767379+0000","last_became_active":"2024-04-22T07:18:36.773347+0000","last_became_peered":"2024-04-22T07:18:36.773347+0000","last_unstale":"2024-04-22T07:18:37.767379+0000","last_undegraded":"2024-04-22T07:18:37.767379+0000","last_fullsized":"2024-04-22T07:18:37.767379+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:23:03.787574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.937320+0000","last_change":"2024-04-22T07:18:36.773325+0000","last_active":"2024-04-22T07:18:37.937320+0000","last_peered":"2024-04-22T07:18:37.937320+0000","last_clean":"2024-04-22T07:18:37.937320+0000","last_became_active":"2024-04-22T07:18:36.773023+0000","last_became_peered":"2024-04-22T07:18:36.773023+0000","last_unstale":"2024-04-22T07:18:37.937320+0000","last_undegraded":"2024-04-22T07:18:37.937320+0000","last_fullsized":"2024-04-22T07:18:37.937320+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:11:55.496104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:38.394196+0000","last_change":"2024-04-22T07:18:36.769834+0000","last_active":"2024-04-22T07:18:38.394196+0000","last_peered":"2024-04-22T07:18:38.394196+0000","last_clean":"2024-04-22T07:18:38.394196+0000","last_became_active":"2024-04-22T07:18:36.769544+0000","last_became_peered":"2024-04-22T07:18:36.769544+0000","last_unstale":"2024-04-22T07:18:38.394196+0000","last_undegraded":"2024-04-22T07:18:38.394196+0000","last_fullsized":"2024-04-22T07:18:38.394196+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:30:36.755201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:38.394021+0000","last_change":"2024-04-22T07:18:36.762325+0000","last_active":"2024-04-22T07:18:38.394021+0000","last_peered":"2024-04-22T07:18:38.394021+0000","last_clean":"2024-04-22T07:18:38.394021+0000","last_became_active":"2024-04-22T07:18:36.762059+0000","last_became_peered":"2024-04-22T07:18:36.762059+0000","last_unstale":"2024-04-22T07:18:38.394021+0000","last_undegraded":"2024-04-22T07:18:38.394021+0000","last_fullsized":"2024-04-22T07:18:38.394021+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:51:10.038201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.763612+0000","last_change":"2024-04-22T07:18:36.761961+0000","last_active":"2024-04-22T07:18:37.763612+0000","last_peered":"2024-04-22T07:18:37.763612+0000","last_clean":"2024-04-22T07:18:37.763612+0000","last_became_active":"2024-04-22T07:18:36.761389+0000","last_became_peered":"2024-04-22T07:18:36.761389+0000","last_unstale":"2024-04-22T07:18:37.763612+0000","last_undegraded":"2024-04-22T07:18:37.763612+0000","last_fullsized":"2024-04-22T07:18:37.763612+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T19:09:21.533739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.767566+0000","last_change":"2024-04-22T07:18:36.767665+0000","last_active":"2024-04-22T07:18:37.767566+0000","last_peered":"2024-04-22T07:18:37.767566+0000","last_clean":"2024-04-22T07:18:37.767566+0000","last_became_active":"2024-04-22T07:18:36.767386+0000","last_became_peered":"2024-04-22T07:18:36.767386+0000","last_unstale":"2024-04-22T07:18:37.767566+0000","last_undegraded":"2024-04-22T07:18:37.767566+0000","last_fullsized":"2024-04-22T07:18:37.767566+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:09:08.040513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:38.894526+0000","last_change":"2024-04-22T07:18:36.770591+0000","last_active":"2024-04-22T07:18:38.894526+0000","last_peered":"2024-04-22T07:18:38.894526+0000","last_clean":"2024-04-22T07:18:38.894526+0000","last_became_active":"2024-04-22T07:18:36.768507+0000","last_became_peered":"2024-04-22T07:18:36.768507+0000","last_unstale":"2024-04-22T07:18:38.894526+0000","last_undegraded":"2024-04-22T07:18:38.894526+0000","last_fullsized":"2024-04-22T07:18:38.894526+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:00:52.151755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.757456+0000","last_change":"2024-04-22T07:18:36.769407+0000","last_active":"2024-04-22T07:18:37.757456+0000","last_peered":"2024-04-22T07:18:37.757456+0000","last_clean":"2024-04-22T07:18:37.757456+0000","last_became_active":"2024-04-22T07:18:36.769114+0000","last_became_peered":"2024-04-22T07:18:36.769114+0000","last_unstale":"2024-04-22T07:18:37.757456+0000","last_undegraded":"2024-04-22T07:18:37.757456+0000","last_fullsized":"2024-04-22T07:18:37.757456+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:30:36.755201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.763835+0000","last_change":"2024-04-22T07:18:36.766539+0000","last_active":"2024-04-22T07:18:37.763835+0000","last_peered":"2024-04-22T07:18:37.763835+0000","last_clean":"2024-04-22T07:18:37.763835+0000","last_became_active":"2024-04-22T07:18:36.764865+0000","last_became_peered":"2024-04-22T07:18:36.764865+0000","last_unstale":"2024-04-22T07:18:37.763835+0000","last_undegraded":"2024-04-22T07:18:37.763835+0000","last_fullsized":"2024-04-22T07:18:37.763835+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:45:27.464772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.764360+0000","last_change":"2024-04-22T07:18:36.767174+0000","last_active":"2024-04-22T07:18:37.764360+0000","last_peered":"2024-04-22T07:18:37.764360+0000","last_clean":"2024-04-22T07:18:37.764360+0000","last_became_active":"2024-04-22T07:18:36.766083+0000","last_became_peered":"2024-04-22T07:18:36.766083+0000","last_unstale":"2024-04-22T07:18:37.764360+0000","last_undegraded":"2024-04-22T07:18:37.764360+0000","last_fullsized":"2024-04-22T07:18:37.764360+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:00:45.046782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:38.894453+0000","last_change":"2024-04-22T07:18:36.764432+0000","last_active":"2024-04-22T07:18:38.894453+0000","last_peered":"2024-04-22T07:18:38.894453+0000","last_clean":"2024-04-22T07:18:38.894453+0000","last_became_active":"2024-04-22T07:18:36.764113+0000","last_became_peered":"2024-04-22T07:18:36.764113+0000","last_unstale":"2024-04-22T07:18:38.894453+0000","last_undegraded":"2024-04-22T07:18:38.894453+0000","last_fullsized":"2024-04-22T07:18:38.894453+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:32:48.474033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.937223+0000","last_change":"2024-04-22T07:18:36.772138+0000","last_active":"2024-04-22T07:18:37.937223+0000","last_peered":"2024-04-22T07:18:37.937223+0000","last_clean":"2024-04-22T07:18:37.937223+0000","last_became_active":"2024-04-22T07:18:36.771878+0000","last_became_peered":"2024-04-22T07:18:36.771878+0000","last_unstale":"2024-04-22T07:18:37.937223+0000","last_undegraded":"2024-04-22T07:18:37.937223+0000","last_fullsized":"2024-04-22T07:18:37.937223+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:36:27.097452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:38.394042+0000","last_change":"2024-04-22T07:18:36.769528+0000","last_active":"2024-04-22T07:18:38.394042+0000","last_peered":"2024-04-22T07:18:38.394042+0000","last_clean":"2024-04-22T07:18:38.394042+0000","last_became_active":"2024-04-22T07:18:36.769240+0000","last_became_peered":"2024-04-22T07:18:36.769240+0000","last_unstale":"2024-04-22T07:18:38.394042+0000","last_undegraded":"2024-04-22T07:18:38.394042+0000","last_fullsized":"2024-04-22T07:18:38.394042+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:09:08.040513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:38.894747+0000","last_change":"2024-04-22T07:18:36.766049+0000","last_active":"2024-04-22T07:18:38.894747+0000","last_peered":"2024-04-22T07:18:38.894747+0000","last_clean":"2024-04-22T07:18:38.894747+0000","last_became_active":"2024-04-22T07:18:36.765724+0000","last_became_peered":"2024-04-22T07:18:36.765724+0000","last_unstale":"2024-04-22T07:18:38.894747+0000","last_undegraded":"2024-04-22T07:18:38.894747+0000","last_fullsized":"2024-04-22T07:18:38.894747+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:32:20.374856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.763238+0000","last_change":"2024-04-22T07:18:36.765850+0000","last_active":"2024-04-22T07:18:37.763238+0000","last_peered":"2024-04-22T07:18:37.763238+0000","last_clean":"2024-04-22T07:18:37.763238+0000","last_became_active":"2024-04-22T07:18:36.765560+0000","last_became_peered":"2024-04-22T07:18:36.765560+0000","last_unstale":"2024-04-22T07:18:37.763238+0000","last_undegraded":"2024-04-22T07:18:37.763238+0000","last_fullsized":"2024-04-22T07:18:37.763238+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:30:36.755201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.767520+0000","last_change":"2024-04-22T07:18:36.769465+0000","last_active":"2024-04-22T07:18:37.767520+0000","last_peered":"2024-04-22T07:18:37.767520+0000","last_clean":"2024-04-22T07:18:37.767520+0000","last_became_active":"2024-04-22T07:18:36.769181+0000","last_became_peered":"2024-04-22T07:18:36.769181+0000","last_unstale":"2024-04-22T07:18:37.767520+0000","last_undegraded":"2024-04-22T07:18:37.767520+0000","last_fullsized":"2024-04-22T07:18:37.767520+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:51:10.038201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.764013+0000","last_change":"2024-04-22T07:18:36.763439+0000","last_active":"2024-04-22T07:18:37.764013+0000","last_peered":"2024-04-22T07:18:37.764013+0000","last_clean":"2024-04-22T07:18:37.764013+0000","last_became_active":"2024-04-22T07:18:36.763146+0000","last_became_peered":"2024-04-22T07:18:36.763146+0000","last_unstale":"2024-04-22T07:18:37.764013+0000","last_undegraded":"2024-04-22T07:18:37.764013+0000","last_fullsized":"2024-04-22T07:18:37.764013+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:18:59.298766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.768027+0000","last_change":"2024-04-22T07:18:36.769533+0000","last_active":"2024-04-22T07:18:37.768027+0000","last_peered":"2024-04-22T07:18:37.768027+0000","last_clean":"2024-04-22T07:18:37.768027+0000","last_became_active":"2024-04-22T07:18:36.769274+0000","last_became_peered":"2024-04-22T07:18:36.769274+0000","last_unstale":"2024-04-22T07:18:37.768027+0000","last_undegraded":"2024-04-22T07:18:37.768027+0000","last_fullsized":"2024-04-22T07:18:37.768027+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:03:50.228822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:38.394207+0000","last_change":"2024-04-22T07:18:36.763931+0000","last_active":"2024-04-22T07:18:38.394207+0000","last_peered":"2024-04-22T07:18:38.394207+0000","last_clean":"2024-04-22T07:18:38.394207+0000","last_became_active":"2024-04-22T07:18:36.763656+0000","last_became_peered":"2024-04-22T07:18:36.763656+0000","last_unstale":"2024-04-22T07:18:38.394207+0000","last_undegraded":"2024-04-22T07:18:38.394207+0000","last_fullsized":"2024-04-22T07:18:38.394207+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:22:58.884168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.757432+0000","last_change":"2024-04-22T07:18:36.767158+0000","last_active":"2024-04-22T07:18:37.757432+0000","last_peered":"2024-04-22T07:18:37.757432+0000","last_clean":"2024-04-22T07:18:37.757432+0000","last_became_active":"2024-04-22T07:18:36.766614+0000","last_became_peered":"2024-04-22T07:18:36.766614+0000","last_unstale":"2024-04-22T07:18:37.757432+0000","last_undegraded":"2024-04-22T07:18:37.757432+0000","last_fullsized":"2024-04-22T07:18:37.757432+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:44:30.785178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.767721+0000","last_change":"2024-04-22T07:18:36.773129+0000","last_active":"2024-04-22T07:18:37.767721+0000","last_peered":"2024-04-22T07:18:37.767721+0000","last_clean":"2024-04-22T07:18:37.767721+0000","last_became_active":"2024-04-22T07:18:36.772827+0000","last_became_peered":"2024-04-22T07:18:36.772827+0000","last_unstale":"2024-04-22T07:18:37.767721+0000","last_undegraded":"2024-04-22T07:18:37.767721+0000","last_fullsized":"2024-04-22T07:18:37.767721+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:45:27.464772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:38.894815+0000","last_change":"2024-04-22T07:18:36.763716+0000","last_active":"2024-04-22T07:18:38.894815+0000","last_peered":"2024-04-22T07:18:38.894815+0000","last_clean":"2024-04-22T07:18:38.894815+0000","last_became_active":"2024-04-22T07:18:36.762270+0000","last_became_peered":"2024-04-22T07:18:36.762270+0000","last_unstale":"2024-04-22T07:18:38.894815+0000","last_undegraded":"2024-04-22T07:18:38.894815+0000","last_fullsized":"2024-04-22T07:18:38.894815+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:23:03.787574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.763390+0000","last_change":"2024-04-22T07:18:36.764152+0000","last_active":"2024-04-22T07:18:37.763390+0000","last_peered":"2024-04-22T07:18:37.763390+0000","last_clean":"2024-04-22T07:18:37.763390+0000","last_became_active":"2024-04-22T07:18:36.763770+0000","last_became_peered":"2024-04-22T07:18:36.763770+0000","last_unstale":"2024-04-22T07:18:37.763390+0000","last_undegraded":"2024-04-22T07:18:37.763390+0000","last_fullsized":"2024-04-22T07:18:37.763390+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:22:58.884168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:38.894313+0000","last_change":"2024-04-22T07:18:36.771121+0000","last_active":"2024-04-22T07:18:38.894313+0000","last_peered":"2024-04-22T07:18:38.894313+0000","last_clean":"2024-04-22T07:18:38.894313+0000","last_became_active":"2024-04-22T07:18:36.770786+0000","last_became_peered":"2024-04-22T07:18:36.770786+0000","last_unstale":"2024-04-22T07:18:38.894313+0000","last_undegraded":"2024-04-22T07:18:38.894313+0000","last_fullsized":"2024-04-22T07:18:38.894313+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:45:15.213668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:38.393831+0000","last_change":"2024-04-22T07:18:36.765462+0000","last_active":"2024-04-22T07:18:38.393831+0000","last_peered":"2024-04-22T07:18:38.393831+0000","last_clean":"2024-04-22T07:18:38.393831+0000","last_became_active":"2024-04-22T07:18:36.765142+0000","last_became_peered":"2024-04-22T07:18:36.765142+0000","last_unstale":"2024-04-22T07:18:38.393831+0000","last_undegraded":"2024-04-22T07:18:38.393831+0000","last_fullsized":"2024-04-22T07:18:38.393831+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:32:20.374856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.763051+0000","last_change":"2024-04-22T07:18:36.768234+0000","last_active":"2024-04-22T07:18:37.763051+0000","last_peered":"2024-04-22T07:18:37.763051+0000","last_clean":"2024-04-22T07:18:37.763051+0000","last_became_active":"2024-04-22T07:18:36.767951+0000","last_became_peered":"2024-04-22T07:18:36.767951+0000","last_unstale":"2024-04-22T07:18:37.763051+0000","last_undegraded":"2024-04-22T07:18:37.763051+0000","last_fullsized":"2024-04-22T07:18:37.763051+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:08:05.611868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:39.604078+0000","last_change":"2024-04-22T07:18:35.751538+0000","last_active":"2024-04-22T07:18:39.604078+0000","last_peered":"2024-04-22T07:18:39.604078+0000","last_clean":"2024-04-22T07:18:39.604078+0000","last_became_active":"2024-04-22T07:18:35.751219+0000","last_became_peered":"2024-04-22T07:18:35.751219+0000","last_unstale":"2024-04-22T07:18:39.604078+0000","last_undegraded":"2024-04-22T07:18:39.604078+0000","last_fullsized":"2024-04-22T07:18:39.604078+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:00:10.289974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:38.894909+0000","last_change":"2024-04-22T07:18:36.757337+0000","last_active":"2024-04-22T07:18:38.894909+0000","last_peered":"2024-04-22T07:18:38.894909+0000","last_clean":"2024-04-22T07:18:38.894909+0000","last_became_active":"2024-04-22T07:18:36.757039+0000","last_became_peered":"2024-04-22T07:18:36.757039+0000","last_unstale":"2024-04-22T07:18:38.894909+0000","last_undegraded":"2024-04-22T07:18:38.894909+0000","last_fullsized":"2024-04-22T07:18:38.894909+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:09:08.040513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:39.601564+0000","last_change":"2024-04-22T07:18:35.746515+0000","last_active":"2024-04-22T07:18:39.601564+0000","last_peered":"2024-04-22T07:18:39.601564+0000","last_clean":"2024-04-22T07:18:39.601564+0000","last_became_active":"2024-04-22T07:18:35.746198+0000","last_became_peered":"2024-04-22T07:18:35.746198+0000","last_unstale":"2024-04-22T07:18:39.601564+0000","last_undegraded":"2024-04-22T07:18:39.601564+0000","last_fullsized":"2024-04-22T07:18:39.601564+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:43:54.682673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.767496+0000","last_change":"2024-04-22T07:18:35.752307+0000","last_active":"2024-04-22T07:18:37.767496+0000","last_peered":"2024-04-22T07:18:37.767496+0000","last_clean":"2024-04-22T07:18:37.767496+0000","last_became_active":"2024-04-22T07:18:35.751545+0000","last_became_peered":"2024-04-22T07:18:35.751545+0000","last_unstale":"2024-04-22T07:18:37.767496+0000","last_undegraded":"2024-04-22T07:18:37.767496+0000","last_fullsized":"2024-04-22T07:18:37.767496+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:21:55.316649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.767511+0000","last_change":"2024-04-22T07:18:36.772372+0000","last_active":"2024-04-22T07:18:37.767511+0000","last_peered":"2024-04-22T07:18:37.767511+0000","last_clean":"2024-04-22T07:18:37.767511+0000","last_became_active":"2024-04-22T07:18:36.772067+0000","last_became_peered":"2024-04-22T07:18:36.772067+0000","last_unstale":"2024-04-22T07:18:37.767511+0000","last_undegraded":"2024-04-22T07:18:37.767511+0000","last_fullsized":"2024-04-22T07:18:37.767511+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:44:30.785178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.764151+0000","last_change":"2024-04-22T07:18:35.740989+0000","last_active":"2024-04-22T07:18:37.764151+0000","last_peered":"2024-04-22T07:18:37.764151+0000","last_clean":"2024-04-22T07:18:37.764151+0000","last_became_active":"2024-04-22T07:18:35.740665+0000","last_became_peered":"2024-04-22T07:18:35.740665+0000","last_unstale":"2024-04-22T07:18:37.764151+0000","last_undegraded":"2024-04-22T07:18:37.764151+0000","last_fullsized":"2024-04-22T07:18:37.764151+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:00:10.289974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.757377+0000","last_change":"2024-04-22T07:18:36.767022+0000","last_active":"2024-04-22T07:18:37.757377+0000","last_peered":"2024-04-22T07:18:37.757377+0000","last_clean":"2024-04-22T07:18:37.757377+0000","last_became_active":"2024-04-22T07:18:36.766609+0000","last_became_peered":"2024-04-22T07:18:36.766609+0000","last_unstale":"2024-04-22T07:18:37.757377+0000","last_undegraded":"2024-04-22T07:18:37.757377+0000","last_fullsized":"2024-04-22T07:18:37.757377+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:32:20.374856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:38.394098+0000","last_change":"2024-04-22T07:18:35.752081+0000","last_active":"2024-04-22T07:18:38.394098+0000","last_peered":"2024-04-22T07:18:38.394098+0000","last_clean":"2024-04-22T07:18:38.394098+0000","last_became_active":"2024-04-22T07:18:35.751757+0000","last_became_peered":"2024-04-22T07:18:35.751757+0000","last_unstale":"2024-04-22T07:18:38.394098+0000","last_undegraded":"2024-04-22T07:18:38.394098+0000","last_fullsized":"2024-04-22T07:18:38.394098+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:21:55.316649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.764165+0000","last_change":"2024-04-22T07:18:36.765937+0000","last_active":"2024-04-22T07:18:37.764165+0000","last_peered":"2024-04-22T07:18:37.764165+0000","last_clean":"2024-04-22T07:18:37.764165+0000","last_became_active":"2024-04-22T07:18:36.765647+0000","last_became_peered":"2024-04-22T07:18:36.765647+0000","last_unstale":"2024-04-22T07:18:37.764165+0000","last_undegraded":"2024-04-22T07:18:37.764165+0000","last_fullsized":"2024-04-22T07:18:37.764165+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:59:57.688417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.763996+0000","last_change":"2024-04-22T07:18:35.747309+0000","last_active":"2024-04-22T07:18:37.763996+0000","last_peered":"2024-04-22T07:18:37.763996+0000","last_clean":"2024-04-22T07:18:37.763996+0000","last_became_active":"2024-04-22T07:18:35.747019+0000","last_became_peered":"2024-04-22T07:18:35.747019+0000","last_unstale":"2024-04-22T07:18:37.763996+0000","last_undegraded":"2024-04-22T07:18:37.763996+0000","last_fullsized":"2024-04-22T07:18:37.763996+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:21:55.316649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:38.895019+0000","last_change":"2024-04-22T07:18:36.763436+0000","last_active":"2024-04-22T07:18:38.895019+0000","last_peered":"2024-04-22T07:18:38.895019+0000","last_clean":"2024-04-22T07:18:38.895019+0000","last_became_active":"2024-04-22T07:18:36.763068+0000","last_became_peered":"2024-04-22T07:18:36.763068+0000","last_unstale":"2024-04-22T07:18:38.895019+0000","last_undegraded":"2024-04-22T07:18:38.895019+0000","last_fullsized":"2024-04-22T07:18:38.895019+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:22:58.884168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:41.767555+0000","last_change":"2024-04-22T07:18:35.750769+0000","last_active":"2024-04-22T07:18:41.767555+0000","last_peered":"2024-04-22T07:18:41.767555+0000","last_clean":"2024-04-22T07:18:41.767555+0000","last_became_active":"2024-04-22T07:18:35.750406+0000","last_became_peered":"2024-04-22T07:18:35.750406+0000","last_unstale":"2024-04-22T07:18:41.767555+0000","last_undegraded":"2024-04-22T07:18:41.767555+0000","last_fullsized":"2024-04-22T07:18:41.767555+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T19:09:20.529889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.763680+0000","last_change":"2024-04-22T07:18:36.767426+0000","last_active":"2024-04-22T07:18:37.763680+0000","last_peered":"2024-04-22T07:18:37.763680+0000","last_clean":"2024-04-22T07:18:37.763680+0000","last_became_active":"2024-04-22T07:18:36.767159+0000","last_became_peered":"2024-04-22T07:18:36.767159+0000","last_unstale":"2024-04-22T07:18:37.763680+0000","last_undegraded":"2024-04-22T07:18:37.763680+0000","last_fullsized":"2024-04-22T07:18:37.763680+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:19:49.652644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'7","reported_seq":21,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:41.770083+0000","last_change":"2024-04-22T07:18:35.752996+0000","last_active":"2024-04-22T07:18:41.770083+0000","last_peered":"2024-04-22T07:18:41.770083+0000","last_clean":"2024-04-22T07:18:41.770083+0000","last_became_active":"2024-04-22T07:18:35.752686+0000","last_became_peered":"2024-04-22T07:18:35.752686+0000","last_unstale":"2024-04-22T07:18:41.770083+0000","last_undegraded":"2024-04-22T07:18:41.770083+0000","last_fullsized":"2024-04-22T07:18:41.770083+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:36:55.684427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1868,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.937011+0000","last_change":"2024-04-22T07:18:36.767539+0000","last_active":"2024-04-22T07:18:37.937011+0000","last_peered":"2024-04-22T07:18:37.937011+0000","last_clean":"2024-04-22T07:18:37.937011+0000","last_became_active":"2024-04-22T07:18:36.767273+0000","last_became_peered":"2024-04-22T07:18:36.767273+0000","last_unstale":"2024-04-22T07:18:37.937011+0000","last_undegraded":"2024-04-22T07:18:37.937011+0000","last_fullsized":"2024-04-22T07:18:37.937011+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:03:50.228822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:41.764793+0000","last_change":"2024-04-22T07:18:35.752382+0000","last_active":"2024-04-22T07:18:41.764793+0000","last_peered":"2024-04-22T07:18:41.764793+0000","last_clean":"2024-04-22T07:18:41.764793+0000","last_became_active":"2024-04-22T07:18:35.752060+0000","last_became_peered":"2024-04-22T07:18:35.752060+0000","last_unstale":"2024-04-22T07:18:41.764793+0000","last_undegraded":"2024-04-22T07:18:41.764793+0000","last_fullsized":"2024-04-22T07:18:41.764793+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:31:33.559251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:38.894534+0000","last_change":"2024-04-22T07:18:36.764670+0000","last_active":"2024-04-22T07:18:38.894534+0000","last_peered":"2024-04-22T07:18:38.894534+0000","last_clean":"2024-04-22T07:18:38.894534+0000","last_became_active":"2024-04-22T07:18:36.763834+0000","last_became_peered":"2024-04-22T07:18:36.763834+0000","last_unstale":"2024-04-22T07:18:38.894534+0000","last_undegraded":"2024-04-22T07:18:38.894534+0000","last_fullsized":"2024-04-22T07:18:38.894534+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:41:20.703226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.763489+0000","last_change":"2024-04-22T07:18:35.752856+0000","last_active":"2024-04-22T07:18:37.763489+0000","last_peered":"2024-04-22T07:18:37.763489+0000","last_clean":"2024-04-22T07:18:37.763489+0000","last_became_active":"2024-04-22T07:18:35.752527+0000","last_became_peered":"2024-04-22T07:18:35.752527+0000","last_unstale":"2024-04-22T07:18:37.763489+0000","last_undegraded":"2024-04-22T07:18:37.763489+0000","last_fullsized":"2024-04-22T07:18:37.763489+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:40:59.305769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.937073+0000","last_change":"2024-04-22T07:18:36.769174+0000","last_active":"2024-04-22T07:18:37.937073+0000","last_peered":"2024-04-22T07:18:37.937073+0000","last_clean":"2024-04-22T07:18:37.937073+0000","last_became_active":"2024-04-22T07:18:36.768913+0000","last_became_peered":"2024-04-22T07:18:36.768913+0000","last_unstale":"2024-04-22T07:18:37.937073+0000","last_undegraded":"2024-04-22T07:18:37.937073+0000","last_fullsized":"2024-04-22T07:18:37.937073+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:45:42.674989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:38.393752+0000","last_change":"2024-04-22T07:18:35.749740+0000","last_active":"2024-04-22T07:18:38.393752+0000","last_peered":"2024-04-22T07:18:38.393752+0000","last_clean":"2024-04-22T07:18:38.393752+0000","last_became_active":"2024-04-22T07:18:35.749453+0000","last_became_peered":"2024-04-22T07:18:35.749453+0000","last_unstale":"2024-04-22T07:18:38.393752+0000","last_undegraded":"2024-04-22T07:18:38.393752+0000","last_fullsized":"2024-04-22T07:18:38.393752+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:08:04.608018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:38.393952+0000","last_change":"2024-04-22T07:18:36.771940+0000","last_active":"2024-04-22T07:18:38.393952+0000","last_peered":"2024-04-22T07:18:38.393952+0000","last_clean":"2024-04-22T07:18:38.393952+0000","last_became_active":"2024-04-22T07:18:36.771548+0000","last_became_peered":"2024-04-22T07:18:36.771548+0000","last_unstale":"2024-04-22T07:18:38.393952+0000","last_undegraded":"2024-04-22T07:18:38.393952+0000","last_fullsized":"2024-04-22T07:18:38.393952+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:23:03.787574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:41.765466+0000","last_change":"2024-04-22T07:18:35.749047+0000","last_active":"2024-04-22T07:18:41.765466+0000","last_peered":"2024-04-22T07:18:41.765466+0000","last_clean":"2024-04-22T07:18:41.765466+0000","last_became_active":"2024-04-22T07:18:35.748757+0000","last_became_peered":"2024-04-22T07:18:35.748757+0000","last_unstale":"2024-04-22T07:18:41.765466+0000","last_undegraded":"2024-04-22T07:18:41.765466+0000","last_fullsized":"2024-04-22T07:18:41.765466+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:40:59.305769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.936788+0000","last_change":"2024-04-22T07:18:36.769894+0000","last_active":"2024-04-22T07:18:37.936788+0000","last_peered":"2024-04-22T07:18:37.936788+0000","last_clean":"2024-04-22T07:18:37.936788+0000","last_became_active":"2024-04-22T07:18:36.768702+0000","last_became_peered":"2024-04-22T07:18:36.768702+0000","last_unstale":"2024-04-22T07:18:37.936788+0000","last_undegraded":"2024-04-22T07:18:37.936788+0000","last_fullsized":"2024-04-22T07:18:37.936788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:36:53.716397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:39.598923+0000","last_change":"2024-04-22T07:18:35.747536+0000","last_active":"2024-04-22T07:18:39.598923+0000","last_peered":"2024-04-22T07:18:39.598923+0000","last_clean":"2024-04-22T07:18:39.598923+0000","last_became_active":"2024-04-22T07:18:35.747271+0000","last_became_peered":"2024-04-22T07:18:35.747271+0000","last_unstale":"2024-04-22T07:18:39.598923+0000","last_undegraded":"2024-04-22T07:18:39.598923+0000","last_fullsized":"2024-04-22T07:18:39.598923+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:51:11.593642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.937304+0000","last_change":"2024-04-22T07:18:36.773033+0000","last_active":"2024-04-22T07:18:37.937304+0000","last_peered":"2024-04-22T07:18:37.937304+0000","last_clean":"2024-04-22T07:18:37.937304+0000","last_became_active":"2024-04-22T07:18:36.772537+0000","last_became_peered":"2024-04-22T07:18:36.772537+0000","last_unstale":"2024-04-22T07:18:37.937304+0000","last_undegraded":"2024-04-22T07:18:37.937304+0000","last_fullsized":"2024-04-22T07:18:37.937304+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:58:41.509248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:41.763188+0000","last_change":"2024-04-22T07:18:35.747533+0000","last_active":"2024-04-22T07:18:41.763188+0000","last_peered":"2024-04-22T07:18:41.763188+0000","last_clean":"2024-04-22T07:18:41.763188+0000","last_became_active":"2024-04-22T07:18:35.746881+0000","last_became_peered":"2024-04-22T07:18:35.746881+0000","last_unstale":"2024-04-22T07:18:41.763188+0000","last_undegraded":"2024-04-22T07:18:41.763188+0000","last_fullsized":"2024-04-22T07:18:41.763188+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:43:54.682673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.937347+0000","last_change":"2024-04-22T07:18:36.773723+0000","last_active":"2024-04-22T07:18:37.937347+0000","last_peered":"2024-04-22T07:18:37.937347+0000","last_clean":"2024-04-22T07:18:37.937347+0000","last_became_active":"2024-04-22T07:18:36.773466+0000","last_became_peered":"2024-04-22T07:18:36.773466+0000","last_unstale":"2024-04-22T07:18:37.937347+0000","last_undegraded":"2024-04-22T07:18:37.937347+0000","last_fullsized":"2024-04-22T07:18:37.937347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:42:20.611744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:39.603975+0000","last_change":"2024-04-22T07:18:35.750360+0000","last_active":"2024-04-22T07:18:39.603975+0000","last_peered":"2024-04-22T07:18:39.603975+0000","last_clean":"2024-04-22T07:18:39.603975+0000","last_became_active":"2024-04-22T07:18:35.749984+0000","last_became_peered":"2024-04-22T07:18:35.749984+0000","last_unstale":"2024-04-22T07:18:39.603975+0000","last_undegraded":"2024-04-22T07:18:39.603975+0000","last_fullsized":"2024-04-22T07:18:39.603975+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:19:48.648793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.764298+0000","last_change":"2024-04-22T07:18:36.765767+0000","last_active":"2024-04-22T07:18:37.764298+0000","last_peered":"2024-04-22T07:18:37.764298+0000","last_clean":"2024-04-22T07:18:37.764298+0000","last_became_active":"2024-04-22T07:18:36.764218+0000","last_became_peered":"2024-04-22T07:18:36.764218+0000","last_unstale":"2024-04-22T07:18:37.764298+0000","last_undegraded":"2024-04-22T07:18:37.764298+0000","last_fullsized":"2024-04-22T07:18:37.764298+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:45:42.674989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:38.894330+0000","last_change":"2024-04-22T07:18:35.743323+0000","last_active":"2024-04-22T07:18:38.894330+0000","last_peered":"2024-04-22T07:18:38.894330+0000","last_clean":"2024-04-22T07:18:38.894330+0000","last_became_active":"2024-04-22T07:18:35.743023+0000","last_became_peered":"2024-04-22T07:18:35.743023+0000","last_unstale":"2024-04-22T07:18:38.894330+0000","last_undegraded":"2024-04-22T07:18:38.894330+0000","last_fullsized":"2024-04-22T07:18:38.894330+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:08:04.608018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.937037+0000","last_change":"2024-04-22T07:18:36.771073+0000","last_active":"2024-04-22T07:18:37.937037+0000","last_peered":"2024-04-22T07:18:37.937037+0000","last_clean":"2024-04-22T07:18:37.937037+0000","last_became_active":"2024-04-22T07:18:36.770678+0000","last_became_peered":"2024-04-22T07:18:36.770678+0000","last_unstale":"2024-04-22T07:18:37.937037+0000","last_undegraded":"2024-04-22T07:18:37.937037+0000","last_fullsized":"2024-04-22T07:18:37.937037+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:59:57.688417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":170,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.936801+0000","last_change":"2024-04-22T07:18:26.518190+0000","last_active":"2024-04-22T07:18:37.936801+0000","last_peered":"2024-04-22T07:18:37.936801+0000","last_clean":"2024-04-22T07:18:37.936801+0000","last_became_active":"2024-04-22T07:18:26.515489+0000","last_became_peered":"2024-04-22T07:18:26.515489+0000","last_unstale":"2024-04-22T07:18:37.936801+0000","last_undegraded":"2024-04-22T07:18:37.936801+0000","last_fullsized":"2024-04-22T07:18:37.936801+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:24.652061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:24.652061+0000","last_clean_scrub_stamp":"2024-04-22T07:18:24.652061+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:32:54.875706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.762947+0000","last_change":"2024-04-22T07:18:35.748477+0000","last_active":"2024-04-22T07:18:37.762947+0000","last_peered":"2024-04-22T07:18:37.762947+0000","last_clean":"2024-04-22T07:18:37.762947+0000","last_became_active":"2024-04-22T07:18:35.748176+0000","last_became_peered":"2024-04-22T07:18:35.748176+0000","last_unstale":"2024-04-22T07:18:37.762947+0000","last_undegraded":"2024-04-22T07:18:37.762947+0000","last_fullsized":"2024-04-22T07:18:37.762947+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:36:55.684427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.767642+0000","last_change":"2024-04-22T07:18:36.771870+0000","last_active":"2024-04-22T07:18:37.767642+0000","last_peered":"2024-04-22T07:18:37.767642+0000","last_clean":"2024-04-22T07:18:37.767642+0000","last_became_active":"2024-04-22T07:18:36.771583+0000","last_became_peered":"2024-04-22T07:18:36.771583+0000","last_unstale":"2024-04-22T07:18:37.767642+0000","last_undegraded":"2024-04-22T07:18:37.767642+0000","last_fullsized":"2024-04-22T07:18:37.767642+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:22:58.884168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.936652+0000","last_change":"2024-04-22T07:18:35.755668+0000","last_active":"2024-04-22T07:18:37.936652+0000","last_peered":"2024-04-22T07:18:37.936652+0000","last_clean":"2024-04-22T07:18:37.936652+0000","last_became_active":"2024-04-22T07:18:35.755471+0000","last_became_peered":"2024-04-22T07:18:35.755471+0000","last_unstale":"2024-04-22T07:18:37.936652+0000","last_undegraded":"2024-04-22T07:18:37.936652+0000","last_fullsized":"2024-04-22T07:18:37.936652+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:36:55.684427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:38.894300+0000","last_change":"2024-04-22T07:18:36.758204+0000","last_active":"2024-04-22T07:18:38.894300+0000","last_peered":"2024-04-22T07:18:38.894300+0000","last_clean":"2024-04-22T07:18:38.894300+0000","last_became_active":"2024-04-22T07:18:36.757841+0000","last_became_peered":"2024-04-22T07:18:36.757841+0000","last_unstale":"2024-04-22T07:18:38.894300+0000","last_undegraded":"2024-04-22T07:18:38.894300+0000","last_fullsized":"2024-04-22T07:18:38.894300+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:43:09.058016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:38.894236+0000","last_change":"2024-04-22T07:18:35.746686+0000","last_active":"2024-04-22T07:18:38.894236+0000","last_peered":"2024-04-22T07:18:38.894236+0000","last_clean":"2024-04-22T07:18:38.894236+0000","last_became_active":"2024-04-22T07:18:35.746371+0000","last_became_peered":"2024-04-22T07:18:35.746371+0000","last_unstale":"2024-04-22T07:18:38.894236+0000","last_undegraded":"2024-04-22T07:18:38.894236+0000","last_fullsized":"2024-04-22T07:18:38.894236+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:36:55.684427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.757383+0000","last_change":"2024-04-22T07:18:36.765985+0000","last_active":"2024-04-22T07:18:37.757383+0000","last_peered":"2024-04-22T07:18:37.757383+0000","last_clean":"2024-04-22T07:18:37.757383+0000","last_became_active":"2024-04-22T07:18:36.765661+0000","last_became_peered":"2024-04-22T07:18:36.765661+0000","last_unstale":"2024-04-22T07:18:37.757383+0000","last_undegraded":"2024-04-22T07:18:37.757383+0000","last_fullsized":"2024-04-22T07:18:37.757383+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:23:03.787574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.763585+0000","last_change":"2024-04-22T07:18:35.754160+0000","last_active":"2024-04-22T07:18:37.763585+0000","last_peered":"2024-04-22T07:18:37.763585+0000","last_clean":"2024-04-22T07:18:37.763585+0000","last_became_active":"2024-04-22T07:18:35.753860+0000","last_became_peered":"2024-04-22T07:18:35.753860+0000","last_unstale":"2024-04-22T07:18:37.763585+0000","last_undegraded":"2024-04-22T07:18:37.763585+0000","last_fullsized":"2024-04-22T07:18:37.763585+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:08:04.608018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.763400+0000","last_change":"2024-04-22T07:18:36.762349+0000","last_active":"2024-04-22T07:18:37.763400+0000","last_peered":"2024-04-22T07:18:37.763400+0000","last_clean":"2024-04-22T07:18:37.763400+0000","last_became_active":"2024-04-22T07:18:36.762097+0000","last_became_peered":"2024-04-22T07:18:36.762097+0000","last_unstale":"2024-04-22T07:18:37.763400+0000","last_undegraded":"2024-04-22T07:18:37.763400+0000","last_fullsized":"2024-04-22T07:18:37.763400+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:43:55.686523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.757304+0000","last_change":"2024-04-22T07:18:35.758810+0000","last_active":"2024-04-22T07:18:37.757304+0000","last_peered":"2024-04-22T07:18:37.757304+0000","last_clean":"2024-04-22T07:18:37.757304+0000","last_became_active":"2024-04-22T07:18:35.758521+0000","last_became_peered":"2024-04-22T07:18:35.758521+0000","last_unstale":"2024-04-22T07:18:37.757304+0000","last_undegraded":"2024-04-22T07:18:37.757304+0000","last_fullsized":"2024-04-22T07:18:37.757304+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:40:59.305769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.764371+0000","last_change":"2024-04-22T07:18:36.764448+0000","last_active":"2024-04-22T07:18:37.764371+0000","last_peered":"2024-04-22T07:18:37.764371+0000","last_clean":"2024-04-22T07:18:37.764371+0000","last_became_active":"2024-04-22T07:18:36.763728+0000","last_became_peered":"2024-04-22T07:18:36.763728+0000","last_unstale":"2024-04-22T07:18:37.764371+0000","last_undegraded":"2024-04-22T07:18:37.764371+0000","last_fullsized":"2024-04-22T07:18:37.764371+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:58:41.509248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.937270+0000","last_change":"2024-04-22T07:18:35.758980+0000","last_active":"2024-04-22T07:18:37.937270+0000","last_peered":"2024-04-22T07:18:37.937270+0000","last_clean":"2024-04-22T07:18:37.937270+0000","last_became_active":"2024-04-22T07:18:35.758674+0000","last_became_peered":"2024-04-22T07:18:35.758674+0000","last_unstale":"2024-04-22T07:18:37.937270+0000","last_undegraded":"2024-04-22T07:18:37.937270+0000","last_fullsized":"2024-04-22T07:18:37.937270+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:45:14.209818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.757443+0000","last_change":"2024-04-22T07:18:36.772908+0000","last_active":"2024-04-22T07:18:37.757443+0000","last_peered":"2024-04-22T07:18:37.757443+0000","last_clean":"2024-04-22T07:18:37.757443+0000","last_became_active":"2024-04-22T07:18:36.772636+0000","last_became_peered":"2024-04-22T07:18:36.772636+0000","last_unstale":"2024-04-22T07:18:37.757443+0000","last_undegraded":"2024-04-22T07:18:37.757443+0000","last_fullsized":"2024-04-22T07:18:37.757443+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:51:10.038201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:39.603989+0000","last_change":"2024-04-22T07:18:35.753595+0000","last_active":"2024-04-22T07:18:39.603989+0000","last_peered":"2024-04-22T07:18:39.603989+0000","last_clean":"2024-04-22T07:18:39.603989+0000","last_became_active":"2024-04-22T07:18:35.753295+0000","last_became_peered":"2024-04-22T07:18:35.753295+0000","last_unstale":"2024-04-22T07:18:39.603989+0000","last_undegraded":"2024-04-22T07:18:39.603989+0000","last_fullsized":"2024-04-22T07:18:39.603989+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:08:04.608018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.768028+0000","last_change":"2024-04-22T07:18:36.768580+0000","last_active":"2024-04-22T07:18:37.768028+0000","last_peered":"2024-04-22T07:18:37.768028+0000","last_clean":"2024-04-22T07:18:37.768028+0000","last_became_active":"2024-04-22T07:18:36.767702+0000","last_became_peered":"2024-04-22T07:18:36.767702+0000","last_unstale":"2024-04-22T07:18:37.768028+0000","last_undegraded":"2024-04-22T07:18:37.768028+0000","last_fullsized":"2024-04-22T07:18:37.768028+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:59:57.688417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:41.768034+0000","last_change":"2024-04-22T07:18:35.751692+0000","last_active":"2024-04-22T07:18:41.768034+0000","last_peered":"2024-04-22T07:18:41.768034+0000","last_clean":"2024-04-22T07:18:41.768034+0000","last_became_active":"2024-04-22T07:18:35.751393+0000","last_became_peered":"2024-04-22T07:18:35.751393+0000","last_unstale":"2024-04-22T07:18:41.768034+0000","last_undegraded":"2024-04-22T07:18:41.768034+0000","last_fullsized":"2024-04-22T07:18:41.768034+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:40:59.305769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:38.894956+0000","last_change":"2024-04-22T07:18:36.768532+0000","last_active":"2024-04-22T07:18:38.894956+0000","last_peered":"2024-04-22T07:18:38.894956+0000","last_clean":"2024-04-22T07:18:38.894956+0000","last_became_active":"2024-04-22T07:18:36.768253+0000","last_became_peered":"2024-04-22T07:18:36.768253+0000","last_unstale":"2024-04-22T07:18:38.894956+0000","last_undegraded":"2024-04-22T07:18:38.894956+0000","last_fullsized":"2024-04-22T07:18:38.894956+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:30:36.755201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.936651+0000","last_change":"2024-04-22T07:18:35.758702+0000","last_active":"2024-04-22T07:18:37.936651+0000","last_peered":"2024-04-22T07:18:37.936651+0000","last_clean":"2024-04-22T07:18:37.936651+0000","last_became_active":"2024-04-22T07:18:35.758415+0000","last_became_peered":"2024-04-22T07:18:35.758415+0000","last_unstale":"2024-04-22T07:18:37.936651+0000","last_undegraded":"2024-04-22T07:18:37.936651+0000","last_fullsized":"2024-04-22T07:18:37.936651+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:08:04.608018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.763191+0000","last_change":"2024-04-22T07:18:36.763053+0000","last_active":"2024-04-22T07:18:37.763191+0000","last_peered":"2024-04-22T07:18:37.763191+0000","last_clean":"2024-04-22T07:18:37.763191+0000","last_became_active":"2024-04-22T07:18:36.762546+0000","last_became_peered":"2024-04-22T07:18:36.762546+0000","last_unstale":"2024-04-22T07:18:37.763191+0000","last_undegraded":"2024-04-22T07:18:37.763191+0000","last_fullsized":"2024-04-22T07:18:37.763191+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:36:56.688277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.757534+0000","last_change":"2024-04-22T07:18:35.748837+0000","last_active":"2024-04-22T07:18:37.757534+0000","last_peered":"2024-04-22T07:18:37.757534+0000","last_clean":"2024-04-22T07:18:37.757534+0000","last_became_active":"2024-04-22T07:18:35.748080+0000","last_became_peered":"2024-04-22T07:18:35.748080+0000","last_unstale":"2024-04-22T07:18:37.757534+0000","last_undegraded":"2024-04-22T07:18:37.757534+0000","last_fullsized":"2024-04-22T07:18:37.757534+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:36:55.684427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.767568+0000","last_change":"2024-04-22T07:18:36.769911+0000","last_active":"2024-04-22T07:18:37.767568+0000","last_peered":"2024-04-22T07:18:37.767568+0000","last_clean":"2024-04-22T07:18:37.767568+0000","last_became_active":"2024-04-22T07:18:36.768682+0000","last_became_peered":"2024-04-22T07:18:36.768682+0000","last_unstale":"2024-04-22T07:18:37.767568+0000","last_undegraded":"2024-04-22T07:18:37.767568+0000","last_fullsized":"2024-04-22T07:18:37.767568+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:30:36.755201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.757319+0000","last_change":"2024-04-22T07:18:35.753066+0000","last_active":"2024-04-22T07:18:37.757319+0000","last_peered":"2024-04-22T07:18:37.757319+0000","last_clean":"2024-04-22T07:18:37.757319+0000","last_became_active":"2024-04-22T07:18:35.752804+0000","last_became_peered":"2024-04-22T07:18:35.752804+0000","last_unstale":"2024-04-22T07:18:37.757319+0000","last_undegraded":"2024-04-22T07:18:37.757319+0000","last_fullsized":"2024-04-22T07:18:37.757319+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:43:54.682673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.767652+0000","last_change":"2024-04-22T07:18:36.774790+0000","last_active":"2024-04-22T07:18:37.767652+0000","last_peered":"2024-04-22T07:18:37.767652+0000","last_clean":"2024-04-22T07:18:37.767652+0000","last_became_active":"2024-04-22T07:18:36.774479+0000","last_became_peered":"2024-04-22T07:18:36.774479+0000","last_unstale":"2024-04-22T07:18:37.767652+0000","last_undegraded":"2024-04-22T07:18:37.767652+0000","last_fullsized":"2024-04-22T07:18:37.767652+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:36:53.716397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:41.767713+0000","last_change":"2024-04-22T07:18:35.754440+0000","last_active":"2024-04-22T07:18:41.767713+0000","last_peered":"2024-04-22T07:18:41.767713+0000","last_clean":"2024-04-22T07:18:41.767713+0000","last_became_active":"2024-04-22T07:18:35.754137+0000","last_became_peered":"2024-04-22T07:18:35.754137+0000","last_unstale":"2024-04-22T07:18:41.767713+0000","last_undegraded":"2024-04-22T07:18:41.767713+0000","last_fullsized":"2024-04-22T07:18:41.767713+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T19:09:20.529889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:38.393947+0000","last_change":"2024-04-22T07:18:36.759585+0000","last_active":"2024-04-22T07:18:38.393947+0000","last_peered":"2024-04-22T07:18:38.393947+0000","last_clean":"2024-04-22T07:18:38.393947+0000","last_became_active":"2024-04-22T07:18:36.759342+0000","last_became_peered":"2024-04-22T07:18:36.759342+0000","last_unstale":"2024-04-22T07:18:38.393947+0000","last_undegraded":"2024-04-22T07:18:38.393947+0000","last_fullsized":"2024-04-22T07:18:38.393947+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:44:30.785178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.764337+0000","last_change":"2024-04-22T07:18:36.762665+0000","last_active":"2024-04-22T07:18:37.764337+0000","last_peered":"2024-04-22T07:18:37.764337+0000","last_clean":"2024-04-22T07:18:37.764337+0000","last_became_active":"2024-04-22T07:18:36.762392+0000","last_became_peered":"2024-04-22T07:18:36.762392+0000","last_unstale":"2024-04-22T07:18:37.764337+0000","last_undegraded":"2024-04-22T07:18:37.764337+0000","last_fullsized":"2024-04-22T07:18:37.764337+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:36:27.097452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:41.767658+0000","last_change":"2024-04-22T07:18:35.755160+0000","last_active":"2024-04-22T07:18:41.767658+0000","last_peered":"2024-04-22T07:18:41.767658+0000","last_clean":"2024-04-22T07:18:41.767658+0000","last_became_active":"2024-04-22T07:18:35.754877+0000","last_became_peered":"2024-04-22T07:18:35.754877+0000","last_unstale":"2024-04-22T07:18:41.767658+0000","last_undegraded":"2024-04-22T07:18:41.767658+0000","last_fullsized":"2024-04-22T07:18:41.767658+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:43:54.682673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.764098+0000","last_change":"2024-04-22T07:18:36.761534+0000","last_active":"2024-04-22T07:18:37.764098+0000","last_peered":"2024-04-22T07:18:37.764098+0000","last_clean":"2024-04-22T07:18:37.764098+0000","last_became_active":"2024-04-22T07:18:36.761181+0000","last_became_peered":"2024-04-22T07:18:36.761181+0000","last_unstale":"2024-04-22T07:18:37.764098+0000","last_undegraded":"2024-04-22T07:18:37.764098+0000","last_fullsized":"2024-04-22T07:18:37.764098+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:03:50.228822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:41.767397+0000","last_change":"2024-04-22T07:18:35.752282+0000","last_active":"2024-04-22T07:18:41.767397+0000","last_peered":"2024-04-22T07:18:41.767397+0000","last_clean":"2024-04-22T07:18:41.767397+0000","last_became_active":"2024-04-22T07:18:35.751866+0000","last_became_peered":"2024-04-22T07:18:35.751866+0000","last_unstale":"2024-04-22T07:18:41.767397+0000","last_undegraded":"2024-04-22T07:18:41.767397+0000","last_fullsized":"2024-04-22T07:18:41.767397+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:19:48.648793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:38.894862+0000","last_change":"2024-04-22T07:18:36.763229+0000","last_active":"2024-04-22T07:18:38.894862+0000","last_peered":"2024-04-22T07:18:38.894862+0000","last_clean":"2024-04-22T07:18:38.894862+0000","last_became_active":"2024-04-22T07:18:36.762882+0000","last_became_peered":"2024-04-22T07:18:36.762882+0000","last_unstale":"2024-04-22T07:18:38.894862+0000","last_undegraded":"2024-04-22T07:18:38.894862+0000","last_fullsized":"2024-04-22T07:18:38.894862+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:44:30.785178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:39.604104+0000","last_change":"2024-04-22T07:18:35.758820+0000","last_active":"2024-04-22T07:18:39.604104+0000","last_peered":"2024-04-22T07:18:39.604104+0000","last_clean":"2024-04-22T07:18:39.604104+0000","last_became_active":"2024-04-22T07:18:35.758514+0000","last_became_peered":"2024-04-22T07:18:35.758514+0000","last_unstale":"2024-04-22T07:18:39.604104+0000","last_undegraded":"2024-04-22T07:18:39.604104+0000","last_fullsized":"2024-04-22T07:18:39.604104+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:40:59.305769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.767960+0000","last_change":"2024-04-22T07:18:36.768383+0000","last_active":"2024-04-22T07:18:37.767960+0000","last_peered":"2024-04-22T07:18:37.767960+0000","last_clean":"2024-04-22T07:18:37.767960+0000","last_became_active":"2024-04-22T07:18:36.767779+0000","last_became_peered":"2024-04-22T07:18:36.767779+0000","last_unstale":"2024-04-22T07:18:37.767960+0000","last_undegraded":"2024-04-22T07:18:37.767960+0000","last_fullsized":"2024-04-22T07:18:37.767960+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:18:59.298766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:41.768431+0000","last_change":"2024-04-22T07:18:35.754117+0000","last_active":"2024-04-22T07:18:41.768431+0000","last_peered":"2024-04-22T07:18:41.768431+0000","last_clean":"2024-04-22T07:18:41.768431+0000","last_became_active":"2024-04-22T07:18:35.753833+0000","last_became_peered":"2024-04-22T07:18:35.753833+0000","last_unstale":"2024-04-22T07:18:41.768431+0000","last_undegraded":"2024-04-22T07:18:41.768431+0000","last_fullsized":"2024-04-22T07:18:41.768431+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:54:03.123665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2666,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":5332,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":40,"ondisk_log_size":40,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574859,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27800,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344040,"statfs":{"total":96636764160,"available":96608296960,"internally_reserved":0,"allocated":802816,"data_stored":661884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574858,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":217088,"data_stored":72802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574858,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":208896,"data_stored":71024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574858,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":217088,"data_stored":71060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574859,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":217088,"data_stored":72802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574858,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27216,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":204800,"data_stored":70934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574859,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":212992,"data_stored":71094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574858,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":811008,"data_stored":661940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1868,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1868,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-22T07:18:56.730 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-22T07:18:56.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.870+0000 7fe14310d640 1 Processor -- start 2024-04-22T07:18:56.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.870+0000 7fe14310d640 1 -- start start 2024-04-22T07:18:56.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.870+0000 7fe14310d640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fe13c0ccb30 0x7fe13c0c8110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:56.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.871+0000 7fe14310d640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe13c15b990 0x7fe13c0ccf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:56.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.871+0000 7fe14310d640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe13c152170 con 0x7fe13c15e440 2024-04-22T07:18:56.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.871+0000 7fe14310d640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7fe13c15bdd0 con 0x7fe13c0ccb30 2024-04-22T07:18:56.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.871+0000 7fe14310d640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fe13c15aed0 con 0x7fe13c15b990 2024-04-22T07:18:56.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.871+0000 7fe1416aa640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fe13c15e440 0x7fe13c0c7610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:54316/0 (socket says 172.21.15.37:54316) 2024-04-22T07:18:56.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.871+0000 7fe1416aa640 1 -- 172.21.15.37:0/631949681 learned_addr learned my addr 172.21.15.37:0/631949681 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-04-22T07:18:56.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.871+0000 7fe140ea9640 1 --2- 172.21.15.37:0/631949681 >> v2:172.21.15.196:3300/0 conn(0x7fe13c0ccb30 0x7fe13c0c8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:56.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.871+0000 7fe13b7fe640 1 -- 172.21.15.37:0/631949681 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1257345199 0 0) 0x7fe13c152170 con 0x7fe13c15e440 2024-04-22T07:18:56.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.871+0000 7fe13bfff640 1 --2- 172.21.15.37:0/631949681 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe13c15b990 0x7fe13c0ccf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:56.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.871+0000 7fe13b7fe640 1 -- 172.21.15.37:0/631949681 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe12c003520 con 0x7fe13c15e440 2024-04-22T07:18:56.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.871+0000 7fe13b7fe640 1 -- 172.21.15.37:0/631949681 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1281672982 0 0) 0x7fe12c003520 con 0x7fe13c15e440 2024-04-22T07:18:56.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.871+0000 7fe13b7fe640 1 -- 172.21.15.37:0/631949681 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe13c15b990 msgr2=0x7fe13c0ccf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:18:56.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.871+0000 7fe13b7fe640 1 --2- 172.21.15.37:0/631949681 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe13c15b990 0x7fe13c0ccf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:56.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.871+0000 7fe13b7fe640 1 -- 172.21.15.37:0/631949681 >> v2:172.21.15.196:3300/0 conn(0x7fe13c0ccb30 msgr2=0x7fe13c0c8110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:18:56.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.871+0000 7fe13b7fe640 1 --2- 172.21.15.37:0/631949681 >> v2:172.21.15.196:3300/0 conn(0x7fe13c0ccb30 0x7fe13c0c8110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:56.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.871+0000 7fe13b7fe640 1 -- 172.21.15.37:0/631949681 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe13c0c7d20 con 0x7fe13c15e440 2024-04-22T07:18:56.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.871+0000 7fe13b7fe640 1 -- 172.21.15.37:0/631949681 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2576656170 0 0) 0x7fe1340019f0 con 0x7fe13c15e440 2024-04-22T07:18:56.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.871+0000 7fe13b7fe640 1 -- 172.21.15.37:0/631949681 >> v1:172.21.15.37:6789/0 conn(0x7fe13c15e440 legacy=0x7fe13c0c7610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:56.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.871+0000 7fe13b7fe640 1 --2- 172.21.15.37:0/631949681 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe12c0039b0 0x7fe12c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:56.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.871+0000 7fe13b7fe640 1 --2- 172.21.15.37:0/631949681 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe13c15b990 0x7fe12c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:56.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.871+0000 7fe13b7fe640 1 --2- 172.21.15.37:0/631949681 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe12c004d40 0x7fe12c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:56.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.871+0000 7fe13b7fe640 1 -- 172.21.15.37:0/631949681 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe13c15bdd0 con 0x7fe12c004d40 2024-04-22T07:18:56.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.871+0000 7fe13b7fe640 1 -- 172.21.15.37:0/631949681 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fe13c15aed0 con 0x7fe12c0039b0 2024-04-22T07:18:56.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.871+0000 7fe13b7fe640 1 -- 172.21.15.37:0/631949681 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fe12c00b9f0 con 0x7fe13c15b990 2024-04-22T07:18:56.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.872+0000 7fe1416aa640 1 --2- 172.21.15.37:0/631949681 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe12c004d40 0x7fe12c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:56.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.872+0000 7fe140ea9640 1 --2- 172.21.15.37:0/631949681 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe12c0039b0 0x7fe12c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:56.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.872+0000 7fe13bfff640 1 --2- 172.21.15.37:0/631949681 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe13c15b990 0x7fe12c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:56.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.872+0000 7fe140ea9640 1 -- 172.21.15.37:0/631949681 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe13c15b990 msgr2=0x7fe12c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:18:56.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.872+0000 7fe140ea9640 1 --2- 172.21.15.37:0/631949681 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe13c15b990 0x7fe12c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:56.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.872+0000 7fe140ea9640 1 -- 172.21.15.37:0/631949681 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe12c004d40 msgr2=0x7fe12c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:18:56.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.872+0000 7fe140ea9640 1 --2- 172.21.15.37:0/631949681 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe12c004d40 0x7fe12c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:56.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.872+0000 7fe140ea9640 1 -- 172.21.15.37:0/631949681 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe12c003520 con 0x7fe12c0039b0 2024-04-22T07:18:56.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.872+0000 7fe1416aa640 1 --2- 172.21.15.37:0/631949681 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe12c004d40 0x7fe12c0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-22T07:18:56.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.873+0000 7fe140ea9640 1 --2- 172.21.15.37:0/631949681 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe12c0039b0 0x7fe12c003dd0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fe130009ac0 tx=0x7fe12c005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2601717cb97e2dc5 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:56.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.873+0000 7fe13b7fe640 1 -- 172.21.15.37:0/631949681 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe130039070 con 0x7fe12c0039b0 2024-04-22T07:18:56.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.873+0000 7fe13b7fe640 1 -- 172.21.15.37:0/631949681 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe13002c710 con 0x7fe12c0039b0 2024-04-22T07:18:56.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.873+0000 7fe13b7fe640 1 -- 172.21.15.37:0/631949681 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe130009690 con 0x7fe12c0039b0 2024-04-22T07:18:56.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.873+0000 7fe14310d640 1 -- 172.21.15.37:0/631949681 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe12c0039b0 msgr2=0x7fe12c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:56.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.873+0000 7fe14310d640 1 --2- 172.21.15.37:0/631949681 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe12c0039b0 0x7fe12c003dd0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fe130009ac0 tx=0x7fe12c005830 comp rx=0 tx=0).stop 2024-04-22T07:18:56.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.873+0000 7fe1416aa640 1 -- 172.21.15.37:0/631949681 reap_dead start 2024-04-22T07:18:56.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.873+0000 7fe14310d640 1 -- 172.21.15.37:0/631949681 shutdown_connections 2024-04-22T07:18:56.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.873+0000 7fe14310d640 1 -- 172.21.15.37:0/631949681 >> 172.21.15.37:0/631949681 conn(0x7fe13c06ed30 msgr2=0x7fe13c06fc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:56.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.873+0000 7fe14310d640 1 -- 172.21.15.37:0/631949681 shutdown_connections 2024-04-22T07:18:56.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.873+0000 7fe14310d640 1 -- 172.21.15.37:0/631949681 wait complete. 2024-04-22T07:18:56.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.874+0000 7fe14310d640 1 Processor -- start 2024-04-22T07:18:56.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.875+0000 7fe14310d640 1 -- start start 2024-04-22T07:18:56.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.875+0000 7fe14310d640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe12c0039b0 0x7fe13c14d470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:56.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.875+0000 7fe14310d640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe13c15aaf0 0x7fe13c14d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:56.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.875+0000 7fe14310d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe13c1f0e70 0x7fe13c1f1320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:56.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.875+0000 7fe14310d640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe13c15f1d0 con 0x7fe13c1f0e70 2024-04-22T07:18:56.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.875+0000 7fe14310d640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fe13c15eef0 con 0x7fe12c0039b0 2024-04-22T07:18:56.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.875+0000 7fe14310d640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fe13c15b190 con 0x7fe13c15aaf0 2024-04-22T07:18:56.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.875+0000 7fe1416aa640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe13c1f0e70 0x7fe13c1f1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:56.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.875+0000 7fe1416aa640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe13c1f0e70 0x7fe13c1f1320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39526/0 (socket says 172.21.15.37:39526) 2024-04-22T07:18:56.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.875+0000 7fe1416aa640 1 -- 172.21.15.37:0/2171954061 learned_addr learned my addr 172.21.15.37:0/2171954061 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:18:56.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.876+0000 7fe140ea9640 1 --2- 172.21.15.37:0/2171954061 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe12c0039b0 0x7fe13c14d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:56.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.876+0000 7fe1416aa640 1 -- 172.21.15.37:0/2171954061 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe13c15aaf0 msgr2=0x7fe13c14d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:56.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.876+0000 7fe13bfff640 1 --2- 172.21.15.37:0/2171954061 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe13c15aaf0 0x7fe13c14d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:56.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.876+0000 7fe1416aa640 1 --2- 172.21.15.37:0/2171954061 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe13c15aaf0 0x7fe13c14d9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:56.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.876+0000 7fe1416aa640 1 -- 172.21.15.37:0/2171954061 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe12c0039b0 msgr2=0x7fe13c14d470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:56.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.876+0000 7fe1416aa640 1 --2- 172.21.15.37:0/2171954061 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe12c0039b0 0x7fe13c14d470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:56.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.876+0000 7fe1416aa640 1 -- 172.21.15.37:0/2171954061 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe13c1f0970 con 0x7fe13c1f0e70 2024-04-22T07:18:56.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.876+0000 7fe140ea9640 1 --2- 172.21.15.37:0/2171954061 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe12c0039b0 0x7fe13c14d470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-22T07:18:56.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.876+0000 7fe1416aa640 1 --2- 172.21.15.37:0/2171954061 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe13c1f0e70 0x7fe13c1f1320 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fe13c155810 tx=0x7fe134007060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:56.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.876+0000 7fe1397fa640 1 -- 172.21.15.37:0/2171954061 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe13400a4e0 con 0x7fe13c1f0e70 2024-04-22T07:18:56.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.876+0000 7fe1397fa640 1 -- 172.21.15.37:0/2171954061 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe134019070 con 0x7fe13c1f0e70 2024-04-22T07:18:56.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.876+0000 7fe14310d640 1 -- 172.21.15.37:0/2171954061 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe13c1573a0 con 0x7fe13c1f0e70 2024-04-22T07:18:56.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.876+0000 7fe1397fa640 1 -- 172.21.15.37:0/2171954061 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1340133f0 con 0x7fe13c1f0e70 2024-04-22T07:18:56.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.876+0000 7fe14310d640 1 -- 172.21.15.37:0/2171954061 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe13c155b20 con 0x7fe13c1f0e70 2024-04-22T07:18:56.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.877+0000 7fe14310d640 1 -- 172.21.15.37:0/2171954061 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe13c1f0b40 con 0x7fe13c1f0e70 2024-04-22T07:18:56.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.878+0000 7fe1397fa640 1 -- 172.21.15.37:0/2171954061 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe134013590 con 0x7fe13c1f0e70 2024-04-22T07:18:56.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.878+0000 7fe1397fa640 1 --2- 172.21.15.37:0/2171954061 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fe12006c8f0 0x7fe12006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:56.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.878+0000 7fe1397fa640 1 -- 172.21.15.37:0/2171954061 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fe13408c140 con 0x7fe13c1f0e70 2024-04-22T07:18:56.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.878+0000 7fe140ea9640 1 --2- 172.21.15.37:0/2171954061 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fe12006c8f0 0x7fe12006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:56.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.879+0000 7fe140ea9640 1 --2- 172.21.15.37:0/2171954061 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fe12006c8f0 0x7fe12006edb0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe130036000 tx=0x7fe130030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:56.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:56.882+0000 7fe1397fa640 1 -- 172.21.15.37:0/2171954061 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fe13405a570 con 0x7fe13c1f0e70 2024-04-22T07:18:57.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.063+0000 7fe14310d640 1 -- 172.21.15.37:0/2171954061 --> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe13c157150 con 0x7fe12006c8f0 2024-04-22T07:18:57.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.070+0000 7fe1397fa640 1 -- 172.21.15.37:0/2171954061 <== mgr.4103 v2:172.21.15.196:6832/321987173 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251830 (secure 0 0 0) 0x7fe13c157150 con 0x7fe12006c8f0 2024-04-22T07:18:57.071 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-22T07:18:57.072 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-04-22T07:18:57.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.073+0000 7fe14310d640 1 -- 172.21.15.37:0/2171954061 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fe12006c8f0 msgr2=0x7fe12006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:57.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.073+0000 7fe14310d640 1 --2- 172.21.15.37:0/2171954061 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fe12006c8f0 0x7fe12006edb0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe130036000 tx=0x7fe130030000 comp rx=0 tx=0).stop 2024-04-22T07:18:57.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.073+0000 7fe14310d640 1 -- 172.21.15.37:0/2171954061 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe13c1f0e70 msgr2=0x7fe13c1f1320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:57.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.073+0000 7fe14310d640 1 --2- 172.21.15.37:0/2171954061 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe13c1f0e70 0x7fe13c1f1320 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fe13c155810 tx=0x7fe134007060 comp rx=0 tx=0).stop 2024-04-22T07:18:57.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.073+0000 7fe14310d640 1 -- 172.21.15.37:0/2171954061 shutdown_connections 2024-04-22T07:18:57.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.073+0000 7fe14310d640 1 --2- 172.21.15.37:0/2171954061 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fe12006c8f0 0x7fe12006edb0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:57.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.073+0000 7fe14310d640 1 --2- 172.21.15.37:0/2171954061 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe13c1f0e70 0x7fe13c1f1320 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:57.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.073+0000 7fe14310d640 1 --2- 172.21.15.37:0/2171954061 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe13c15aaf0 0x7fe13c14d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:57.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.073+0000 7fe14310d640 1 --2- 172.21.15.37:0/2171954061 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe12c0039b0 0x7fe13c14d470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:57.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.073+0000 7fe14310d640 1 -- 172.21.15.37:0/2171954061 >> 172.21.15.37:0/2171954061 conn(0x7fe13c06ed30 msgr2=0x7fe13c0cbb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:57.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.073+0000 7fe14310d640 1 -- 172.21.15.37:0/2171954061 shutdown_connections 2024-04-22T07:18:57.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.073+0000 7fe14310d640 1 -- 172.21.15.37:0/2171954061 wait complete. 2024-04-22T07:18:57.082 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":29,"stamp":"2024-04-22T07:18:56.590924+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":593034,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":205,"num_write_kb":2431,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218952,"kb_used_data":2824,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755768,"statfs":{"total":773094113280,"available":772869906432,"internally_reserved":0,"allocated":2891776,"data_stored":1753540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":256,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003687"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.937242+0000","last_change":"2024-04-22T07:18:36.765825+0000","last_active":"2024-04-22T07:18:37.937242+0000","last_peered":"2024-04-22T07:18:37.937242+0000","last_clean":"2024-04-22T07:18:37.937242+0000","last_became_active":"2024-04-22T07:18:36.765306+0000","last_became_peered":"2024-04-22T07:18:36.765306+0000","last_unstale":"2024-04-22T07:18:37.937242+0000","last_undegraded":"2024-04-22T07:18:37.937242+0000","last_fullsized":"2024-04-22T07:18:37.937242+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:00:45.046782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.757437+0000","last_change":"2024-04-22T07:18:36.772829+0000","last_active":"2024-04-22T07:18:37.757437+0000","last_peered":"2024-04-22T07:18:37.757437+0000","last_clean":"2024-04-22T07:18:37.757437+0000","last_became_active":"2024-04-22T07:18:36.772464+0000","last_became_peered":"2024-04-22T07:18:36.772464+0000","last_unstale":"2024-04-22T07:18:37.757437+0000","last_undegraded":"2024-04-22T07:18:37.757437+0000","last_fullsized":"2024-04-22T07:18:37.757437+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:09:08.040513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:38.894883+0000","last_change":"2024-04-22T07:18:36.760613+0000","last_active":"2024-04-22T07:18:38.894883+0000","last_peered":"2024-04-22T07:18:38.894883+0000","last_clean":"2024-04-22T07:18:38.894883+0000","last_became_active":"2024-04-22T07:18:36.760313+0000","last_became_peered":"2024-04-22T07:18:36.760313+0000","last_unstale":"2024-04-22T07:18:38.894883+0000","last_undegraded":"2024-04-22T07:18:38.894883+0000","last_fullsized":"2024-04-22T07:18:38.894883+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:51:10.038201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.763484+0000","last_change":"2024-04-22T07:18:36.767969+0000","last_active":"2024-04-22T07:18:37.763484+0000","last_peered":"2024-04-22T07:18:37.763484+0000","last_clean":"2024-04-22T07:18:37.763484+0000","last_became_active":"2024-04-22T07:18:36.767713+0000","last_became_peered":"2024-04-22T07:18:36.767713+0000","last_unstale":"2024-04-22T07:18:37.763484+0000","last_undegraded":"2024-04-22T07:18:37.763484+0000","last_fullsized":"2024-04-22T07:18:37.763484+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:36:53.716397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.936961+0000","last_change":"2024-04-22T07:18:36.764361+0000","last_active":"2024-04-22T07:18:37.936961+0000","last_peered":"2024-04-22T07:18:37.936961+0000","last_clean":"2024-04-22T07:18:37.936961+0000","last_became_active":"2024-04-22T07:18:36.763812+0000","last_became_peered":"2024-04-22T07:18:36.763812+0000","last_unstale":"2024-04-22T07:18:37.936961+0000","last_undegraded":"2024-04-22T07:18:37.936961+0000","last_fullsized":"2024-04-22T07:18:37.936961+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:18:59.298766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.763087+0000","last_change":"2024-04-22T07:18:36.762804+0000","last_active":"2024-04-22T07:18:37.763087+0000","last_peered":"2024-04-22T07:18:37.763087+0000","last_clean":"2024-04-22T07:18:37.763087+0000","last_became_active":"2024-04-22T07:18:36.762508+0000","last_became_peered":"2024-04-22T07:18:36.762508+0000","last_unstale":"2024-04-22T07:18:37.763087+0000","last_undegraded":"2024-04-22T07:18:37.763087+0000","last_fullsized":"2024-04-22T07:18:37.763087+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:09:08.040513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.936807+0000","last_change":"2024-04-22T07:18:36.771774+0000","last_active":"2024-04-22T07:18:37.936807+0000","last_peered":"2024-04-22T07:18:37.936807+0000","last_clean":"2024-04-22T07:18:37.936807+0000","last_became_active":"2024-04-22T07:18:36.771425+0000","last_became_peered":"2024-04-22T07:18:36.771425+0000","last_unstale":"2024-04-22T07:18:37.936807+0000","last_undegraded":"2024-04-22T07:18:37.936807+0000","last_fullsized":"2024-04-22T07:18:37.936807+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:45:27.464772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.767379+0000","last_change":"2024-04-22T07:18:36.773631+0000","last_active":"2024-04-22T07:18:37.767379+0000","last_peered":"2024-04-22T07:18:37.767379+0000","last_clean":"2024-04-22T07:18:37.767379+0000","last_became_active":"2024-04-22T07:18:36.773347+0000","last_became_peered":"2024-04-22T07:18:36.773347+0000","last_unstale":"2024-04-22T07:18:37.767379+0000","last_undegraded":"2024-04-22T07:18:37.767379+0000","last_fullsized":"2024-04-22T07:18:37.767379+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:23:03.787574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.937320+0000","last_change":"2024-04-22T07:18:36.773325+0000","last_active":"2024-04-22T07:18:37.937320+0000","last_peered":"2024-04-22T07:18:37.937320+0000","last_clean":"2024-04-22T07:18:37.937320+0000","last_became_active":"2024-04-22T07:18:36.773023+0000","last_became_peered":"2024-04-22T07:18:36.773023+0000","last_unstale":"2024-04-22T07:18:37.937320+0000","last_undegraded":"2024-04-22T07:18:37.937320+0000","last_fullsized":"2024-04-22T07:18:37.937320+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:11:55.496104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:38.394196+0000","last_change":"2024-04-22T07:18:36.769834+0000","last_active":"2024-04-22T07:18:38.394196+0000","last_peered":"2024-04-22T07:18:38.394196+0000","last_clean":"2024-04-22T07:18:38.394196+0000","last_became_active":"2024-04-22T07:18:36.769544+0000","last_became_peered":"2024-04-22T07:18:36.769544+0000","last_unstale":"2024-04-22T07:18:38.394196+0000","last_undegraded":"2024-04-22T07:18:38.394196+0000","last_fullsized":"2024-04-22T07:18:38.394196+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:30:36.755201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:38.394021+0000","last_change":"2024-04-22T07:18:36.762325+0000","last_active":"2024-04-22T07:18:38.394021+0000","last_peered":"2024-04-22T07:18:38.394021+0000","last_clean":"2024-04-22T07:18:38.394021+0000","last_became_active":"2024-04-22T07:18:36.762059+0000","last_became_peered":"2024-04-22T07:18:36.762059+0000","last_unstale":"2024-04-22T07:18:38.394021+0000","last_undegraded":"2024-04-22T07:18:38.394021+0000","last_fullsized":"2024-04-22T07:18:38.394021+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:51:10.038201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.763612+0000","last_change":"2024-04-22T07:18:36.761961+0000","last_active":"2024-04-22T07:18:37.763612+0000","last_peered":"2024-04-22T07:18:37.763612+0000","last_clean":"2024-04-22T07:18:37.763612+0000","last_became_active":"2024-04-22T07:18:36.761389+0000","last_became_peered":"2024-04-22T07:18:36.761389+0000","last_unstale":"2024-04-22T07:18:37.763612+0000","last_undegraded":"2024-04-22T07:18:37.763612+0000","last_fullsized":"2024-04-22T07:18:37.763612+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T19:09:21.533739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.767566+0000","last_change":"2024-04-22T07:18:36.767665+0000","last_active":"2024-04-22T07:18:37.767566+0000","last_peered":"2024-04-22T07:18:37.767566+0000","last_clean":"2024-04-22T07:18:37.767566+0000","last_became_active":"2024-04-22T07:18:36.767386+0000","last_became_peered":"2024-04-22T07:18:36.767386+0000","last_unstale":"2024-04-22T07:18:37.767566+0000","last_undegraded":"2024-04-22T07:18:37.767566+0000","last_fullsized":"2024-04-22T07:18:37.767566+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:09:08.040513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:38.894526+0000","last_change":"2024-04-22T07:18:36.770591+0000","last_active":"2024-04-22T07:18:38.894526+0000","last_peered":"2024-04-22T07:18:38.894526+0000","last_clean":"2024-04-22T07:18:38.894526+0000","last_became_active":"2024-04-22T07:18:36.768507+0000","last_became_peered":"2024-04-22T07:18:36.768507+0000","last_unstale":"2024-04-22T07:18:38.894526+0000","last_undegraded":"2024-04-22T07:18:38.894526+0000","last_fullsized":"2024-04-22T07:18:38.894526+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:00:52.151755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.757456+0000","last_change":"2024-04-22T07:18:36.769407+0000","last_active":"2024-04-22T07:18:37.757456+0000","last_peered":"2024-04-22T07:18:37.757456+0000","last_clean":"2024-04-22T07:18:37.757456+0000","last_became_active":"2024-04-22T07:18:36.769114+0000","last_became_peered":"2024-04-22T07:18:36.769114+0000","last_unstale":"2024-04-22T07:18:37.757456+0000","last_undegraded":"2024-04-22T07:18:37.757456+0000","last_fullsized":"2024-04-22T07:18:37.757456+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:30:36.755201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.763835+0000","last_change":"2024-04-22T07:18:36.766539+0000","last_active":"2024-04-22T07:18:37.763835+0000","last_peered":"2024-04-22T07:18:37.763835+0000","last_clean":"2024-04-22T07:18:37.763835+0000","last_became_active":"2024-04-22T07:18:36.764865+0000","last_became_peered":"2024-04-22T07:18:36.764865+0000","last_unstale":"2024-04-22T07:18:37.763835+0000","last_undegraded":"2024-04-22T07:18:37.763835+0000","last_fullsized":"2024-04-22T07:18:37.763835+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:45:27.464772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.764360+0000","last_change":"2024-04-22T07:18:36.767174+0000","last_active":"2024-04-22T07:18:37.764360+0000","last_peered":"2024-04-22T07:18:37.764360+0000","last_clean":"2024-04-22T07:18:37.764360+0000","last_became_active":"2024-04-22T07:18:36.766083+0000","last_became_peered":"2024-04-22T07:18:36.766083+0000","last_unstale":"2024-04-22T07:18:37.764360+0000","last_undegraded":"2024-04-22T07:18:37.764360+0000","last_fullsized":"2024-04-22T07:18:37.764360+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:00:45.046782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:38.894453+0000","last_change":"2024-04-22T07:18:36.764432+0000","last_active":"2024-04-22T07:18:38.894453+0000","last_peered":"2024-04-22T07:18:38.894453+0000","last_clean":"2024-04-22T07:18:38.894453+0000","last_became_active":"2024-04-22T07:18:36.764113+0000","last_became_peered":"2024-04-22T07:18:36.764113+0000","last_unstale":"2024-04-22T07:18:38.894453+0000","last_undegraded":"2024-04-22T07:18:38.894453+0000","last_fullsized":"2024-04-22T07:18:38.894453+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:32:48.474033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.937223+0000","last_change":"2024-04-22T07:18:36.772138+0000","last_active":"2024-04-22T07:18:37.937223+0000","last_peered":"2024-04-22T07:18:37.937223+0000","last_clean":"2024-04-22T07:18:37.937223+0000","last_became_active":"2024-04-22T07:18:36.771878+0000","last_became_peered":"2024-04-22T07:18:36.771878+0000","last_unstale":"2024-04-22T07:18:37.937223+0000","last_undegraded":"2024-04-22T07:18:37.937223+0000","last_fullsized":"2024-04-22T07:18:37.937223+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:36:27.097452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:38.394042+0000","last_change":"2024-04-22T07:18:36.769528+0000","last_active":"2024-04-22T07:18:38.394042+0000","last_peered":"2024-04-22T07:18:38.394042+0000","last_clean":"2024-04-22T07:18:38.394042+0000","last_became_active":"2024-04-22T07:18:36.769240+0000","last_became_peered":"2024-04-22T07:18:36.769240+0000","last_unstale":"2024-04-22T07:18:38.394042+0000","last_undegraded":"2024-04-22T07:18:38.394042+0000","last_fullsized":"2024-04-22T07:18:38.394042+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:09:08.040513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:38.894747+0000","last_change":"2024-04-22T07:18:36.766049+0000","last_active":"2024-04-22T07:18:38.894747+0000","last_peered":"2024-04-22T07:18:38.894747+0000","last_clean":"2024-04-22T07:18:38.894747+0000","last_became_active":"2024-04-22T07:18:36.765724+0000","last_became_peered":"2024-04-22T07:18:36.765724+0000","last_unstale":"2024-04-22T07:18:38.894747+0000","last_undegraded":"2024-04-22T07:18:38.894747+0000","last_fullsized":"2024-04-22T07:18:38.894747+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:32:20.374856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.763238+0000","last_change":"2024-04-22T07:18:36.765850+0000","last_active":"2024-04-22T07:18:37.763238+0000","last_peered":"2024-04-22T07:18:37.763238+0000","last_clean":"2024-04-22T07:18:37.763238+0000","last_became_active":"2024-04-22T07:18:36.765560+0000","last_became_peered":"2024-04-22T07:18:36.765560+0000","last_unstale":"2024-04-22T07:18:37.763238+0000","last_undegraded":"2024-04-22T07:18:37.763238+0000","last_fullsized":"2024-04-22T07:18:37.763238+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:30:36.755201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.767520+0000","last_change":"2024-04-22T07:18:36.769465+0000","last_active":"2024-04-22T07:18:37.767520+0000","last_peered":"2024-04-22T07:18:37.767520+0000","last_clean":"2024-04-22T07:18:37.767520+0000","last_became_active":"2024-04-22T07:18:36.769181+0000","last_became_peered":"2024-04-22T07:18:36.769181+0000","last_unstale":"2024-04-22T07:18:37.767520+0000","last_undegraded":"2024-04-22T07:18:37.767520+0000","last_fullsized":"2024-04-22T07:18:37.767520+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:51:10.038201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.764013+0000","last_change":"2024-04-22T07:18:36.763439+0000","last_active":"2024-04-22T07:18:37.764013+0000","last_peered":"2024-04-22T07:18:37.764013+0000","last_clean":"2024-04-22T07:18:37.764013+0000","last_became_active":"2024-04-22T07:18:36.763146+0000","last_became_peered":"2024-04-22T07:18:36.763146+0000","last_unstale":"2024-04-22T07:18:37.764013+0000","last_undegraded":"2024-04-22T07:18:37.764013+0000","last_fullsized":"2024-04-22T07:18:37.764013+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:18:59.298766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.768027+0000","last_change":"2024-04-22T07:18:36.769533+0000","last_active":"2024-04-22T07:18:37.768027+0000","last_peered":"2024-04-22T07:18:37.768027+0000","last_clean":"2024-04-22T07:18:37.768027+0000","last_became_active":"2024-04-22T07:18:36.769274+0000","last_became_peered":"2024-04-22T07:18:36.769274+0000","last_unstale":"2024-04-22T07:18:37.768027+0000","last_undegraded":"2024-04-22T07:18:37.768027+0000","last_fullsized":"2024-04-22T07:18:37.768027+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:03:50.228822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:38.394207+0000","last_change":"2024-04-22T07:18:36.763931+0000","last_active":"2024-04-22T07:18:38.394207+0000","last_peered":"2024-04-22T07:18:38.394207+0000","last_clean":"2024-04-22T07:18:38.394207+0000","last_became_active":"2024-04-22T07:18:36.763656+0000","last_became_peered":"2024-04-22T07:18:36.763656+0000","last_unstale":"2024-04-22T07:18:38.394207+0000","last_undegraded":"2024-04-22T07:18:38.394207+0000","last_fullsized":"2024-04-22T07:18:38.394207+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:22:58.884168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.757432+0000","last_change":"2024-04-22T07:18:36.767158+0000","last_active":"2024-04-22T07:18:37.757432+0000","last_peered":"2024-04-22T07:18:37.757432+0000","last_clean":"2024-04-22T07:18:37.757432+0000","last_became_active":"2024-04-22T07:18:36.766614+0000","last_became_peered":"2024-04-22T07:18:36.766614+0000","last_unstale":"2024-04-22T07:18:37.757432+0000","last_undegraded":"2024-04-22T07:18:37.757432+0000","last_fullsized":"2024-04-22T07:18:37.757432+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:44:30.785178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.767721+0000","last_change":"2024-04-22T07:18:36.773129+0000","last_active":"2024-04-22T07:18:37.767721+0000","last_peered":"2024-04-22T07:18:37.767721+0000","last_clean":"2024-04-22T07:18:37.767721+0000","last_became_active":"2024-04-22T07:18:36.772827+0000","last_became_peered":"2024-04-22T07:18:36.772827+0000","last_unstale":"2024-04-22T07:18:37.767721+0000","last_undegraded":"2024-04-22T07:18:37.767721+0000","last_fullsized":"2024-04-22T07:18:37.767721+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:45:27.464772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:38.894815+0000","last_change":"2024-04-22T07:18:36.763716+0000","last_active":"2024-04-22T07:18:38.894815+0000","last_peered":"2024-04-22T07:18:38.894815+0000","last_clean":"2024-04-22T07:18:38.894815+0000","last_became_active":"2024-04-22T07:18:36.762270+0000","last_became_peered":"2024-04-22T07:18:36.762270+0000","last_unstale":"2024-04-22T07:18:38.894815+0000","last_undegraded":"2024-04-22T07:18:38.894815+0000","last_fullsized":"2024-04-22T07:18:38.894815+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:23:03.787574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.763390+0000","last_change":"2024-04-22T07:18:36.764152+0000","last_active":"2024-04-22T07:18:37.763390+0000","last_peered":"2024-04-22T07:18:37.763390+0000","last_clean":"2024-04-22T07:18:37.763390+0000","last_became_active":"2024-04-22T07:18:36.763770+0000","last_became_peered":"2024-04-22T07:18:36.763770+0000","last_unstale":"2024-04-22T07:18:37.763390+0000","last_undegraded":"2024-04-22T07:18:37.763390+0000","last_fullsized":"2024-04-22T07:18:37.763390+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:22:58.884168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:38.894313+0000","last_change":"2024-04-22T07:18:36.771121+0000","last_active":"2024-04-22T07:18:38.894313+0000","last_peered":"2024-04-22T07:18:38.894313+0000","last_clean":"2024-04-22T07:18:38.894313+0000","last_became_active":"2024-04-22T07:18:36.770786+0000","last_became_peered":"2024-04-22T07:18:36.770786+0000","last_unstale":"2024-04-22T07:18:38.894313+0000","last_undegraded":"2024-04-22T07:18:38.894313+0000","last_fullsized":"2024-04-22T07:18:38.894313+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:45:15.213668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:38.393831+0000","last_change":"2024-04-22T07:18:36.765462+0000","last_active":"2024-04-22T07:18:38.393831+0000","last_peered":"2024-04-22T07:18:38.393831+0000","last_clean":"2024-04-22T07:18:38.393831+0000","last_became_active":"2024-04-22T07:18:36.765142+0000","last_became_peered":"2024-04-22T07:18:36.765142+0000","last_unstale":"2024-04-22T07:18:38.393831+0000","last_undegraded":"2024-04-22T07:18:38.393831+0000","last_fullsized":"2024-04-22T07:18:38.393831+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:32:20.374856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.763051+0000","last_change":"2024-04-22T07:18:36.768234+0000","last_active":"2024-04-22T07:18:37.763051+0000","last_peered":"2024-04-22T07:18:37.763051+0000","last_clean":"2024-04-22T07:18:37.763051+0000","last_became_active":"2024-04-22T07:18:36.767951+0000","last_became_peered":"2024-04-22T07:18:36.767951+0000","last_unstale":"2024-04-22T07:18:37.763051+0000","last_undegraded":"2024-04-22T07:18:37.763051+0000","last_fullsized":"2024-04-22T07:18:37.763051+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:08:05.611868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:39.604078+0000","last_change":"2024-04-22T07:18:35.751538+0000","last_active":"2024-04-22T07:18:39.604078+0000","last_peered":"2024-04-22T07:18:39.604078+0000","last_clean":"2024-04-22T07:18:39.604078+0000","last_became_active":"2024-04-22T07:18:35.751219+0000","last_became_peered":"2024-04-22T07:18:35.751219+0000","last_unstale":"2024-04-22T07:18:39.604078+0000","last_undegraded":"2024-04-22T07:18:39.604078+0000","last_fullsized":"2024-04-22T07:18:39.604078+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:00:10.289974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:38.894909+0000","last_change":"2024-04-22T07:18:36.757337+0000","last_active":"2024-04-22T07:18:38.894909+0000","last_peered":"2024-04-22T07:18:38.894909+0000","last_clean":"2024-04-22T07:18:38.894909+0000","last_became_active":"2024-04-22T07:18:36.757039+0000","last_became_peered":"2024-04-22T07:18:36.757039+0000","last_unstale":"2024-04-22T07:18:38.894909+0000","last_undegraded":"2024-04-22T07:18:38.894909+0000","last_fullsized":"2024-04-22T07:18:38.894909+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:09:08.040513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:39.601564+0000","last_change":"2024-04-22T07:18:35.746515+0000","last_active":"2024-04-22T07:18:39.601564+0000","last_peered":"2024-04-22T07:18:39.601564+0000","last_clean":"2024-04-22T07:18:39.601564+0000","last_became_active":"2024-04-22T07:18:35.746198+0000","last_became_peered":"2024-04-22T07:18:35.746198+0000","last_unstale":"2024-04-22T07:18:39.601564+0000","last_undegraded":"2024-04-22T07:18:39.601564+0000","last_fullsized":"2024-04-22T07:18:39.601564+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:43:54.682673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.767496+0000","last_change":"2024-04-22T07:18:35.752307+0000","last_active":"2024-04-22T07:18:37.767496+0000","last_peered":"2024-04-22T07:18:37.767496+0000","last_clean":"2024-04-22T07:18:37.767496+0000","last_became_active":"2024-04-22T07:18:35.751545+0000","last_became_peered":"2024-04-22T07:18:35.751545+0000","last_unstale":"2024-04-22T07:18:37.767496+0000","last_undegraded":"2024-04-22T07:18:37.767496+0000","last_fullsized":"2024-04-22T07:18:37.767496+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:21:55.316649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.767511+0000","last_change":"2024-04-22T07:18:36.772372+0000","last_active":"2024-04-22T07:18:37.767511+0000","last_peered":"2024-04-22T07:18:37.767511+0000","last_clean":"2024-04-22T07:18:37.767511+0000","last_became_active":"2024-04-22T07:18:36.772067+0000","last_became_peered":"2024-04-22T07:18:36.772067+0000","last_unstale":"2024-04-22T07:18:37.767511+0000","last_undegraded":"2024-04-22T07:18:37.767511+0000","last_fullsized":"2024-04-22T07:18:37.767511+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:44:30.785178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.764151+0000","last_change":"2024-04-22T07:18:35.740989+0000","last_active":"2024-04-22T07:18:37.764151+0000","last_peered":"2024-04-22T07:18:37.764151+0000","last_clean":"2024-04-22T07:18:37.764151+0000","last_became_active":"2024-04-22T07:18:35.740665+0000","last_became_peered":"2024-04-22T07:18:35.740665+0000","last_unstale":"2024-04-22T07:18:37.764151+0000","last_undegraded":"2024-04-22T07:18:37.764151+0000","last_fullsized":"2024-04-22T07:18:37.764151+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:00:10.289974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.757377+0000","last_change":"2024-04-22T07:18:36.767022+0000","last_active":"2024-04-22T07:18:37.757377+0000","last_peered":"2024-04-22T07:18:37.757377+0000","last_clean":"2024-04-22T07:18:37.757377+0000","last_became_active":"2024-04-22T07:18:36.766609+0000","last_became_peered":"2024-04-22T07:18:36.766609+0000","last_unstale":"2024-04-22T07:18:37.757377+0000","last_undegraded":"2024-04-22T07:18:37.757377+0000","last_fullsized":"2024-04-22T07:18:37.757377+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:32:20.374856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:38.394098+0000","last_change":"2024-04-22T07:18:35.752081+0000","last_active":"2024-04-22T07:18:38.394098+0000","last_peered":"2024-04-22T07:18:38.394098+0000","last_clean":"2024-04-22T07:18:38.394098+0000","last_became_active":"2024-04-22T07:18:35.751757+0000","last_became_peered":"2024-04-22T07:18:35.751757+0000","last_unstale":"2024-04-22T07:18:38.394098+0000","last_undegraded":"2024-04-22T07:18:38.394098+0000","last_fullsized":"2024-04-22T07:18:38.394098+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:21:55.316649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.764165+0000","last_change":"2024-04-22T07:18:36.765937+0000","last_active":"2024-04-22T07:18:37.764165+0000","last_peered":"2024-04-22T07:18:37.764165+0000","last_clean":"2024-04-22T07:18:37.764165+0000","last_became_active":"2024-04-22T07:18:36.765647+0000","last_became_peered":"2024-04-22T07:18:36.765647+0000","last_unstale":"2024-04-22T07:18:37.764165+0000","last_undegraded":"2024-04-22T07:18:37.764165+0000","last_fullsized":"2024-04-22T07:18:37.764165+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:59:57.688417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.763996+0000","last_change":"2024-04-22T07:18:35.747309+0000","last_active":"2024-04-22T07:18:37.763996+0000","last_peered":"2024-04-22T07:18:37.763996+0000","last_clean":"2024-04-22T07:18:37.763996+0000","last_became_active":"2024-04-22T07:18:35.747019+0000","last_became_peered":"2024-04-22T07:18:35.747019+0000","last_unstale":"2024-04-22T07:18:37.763996+0000","last_undegraded":"2024-04-22T07:18:37.763996+0000","last_fullsized":"2024-04-22T07:18:37.763996+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:21:55.316649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:38.895019+0000","last_change":"2024-04-22T07:18:36.763436+0000","last_active":"2024-04-22T07:18:38.895019+0000","last_peered":"2024-04-22T07:18:38.895019+0000","last_clean":"2024-04-22T07:18:38.895019+0000","last_became_active":"2024-04-22T07:18:36.763068+0000","last_became_peered":"2024-04-22T07:18:36.763068+0000","last_unstale":"2024-04-22T07:18:38.895019+0000","last_undegraded":"2024-04-22T07:18:38.895019+0000","last_fullsized":"2024-04-22T07:18:38.895019+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:22:58.884168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:41.767555+0000","last_change":"2024-04-22T07:18:35.750769+0000","last_active":"2024-04-22T07:18:41.767555+0000","last_peered":"2024-04-22T07:18:41.767555+0000","last_clean":"2024-04-22T07:18:41.767555+0000","last_became_active":"2024-04-22T07:18:35.750406+0000","last_became_peered":"2024-04-22T07:18:35.750406+0000","last_unstale":"2024-04-22T07:18:41.767555+0000","last_undegraded":"2024-04-22T07:18:41.767555+0000","last_fullsized":"2024-04-22T07:18:41.767555+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T19:09:20.529889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.763680+0000","last_change":"2024-04-22T07:18:36.767426+0000","last_active":"2024-04-22T07:18:37.763680+0000","last_peered":"2024-04-22T07:18:37.763680+0000","last_clean":"2024-04-22T07:18:37.763680+0000","last_became_active":"2024-04-22T07:18:36.767159+0000","last_became_peered":"2024-04-22T07:18:36.767159+0000","last_unstale":"2024-04-22T07:18:37.763680+0000","last_undegraded":"2024-04-22T07:18:37.763680+0000","last_fullsized":"2024-04-22T07:18:37.763680+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:19:49.652644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'7","reported_seq":21,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:41.770083+0000","last_change":"2024-04-22T07:18:35.752996+0000","last_active":"2024-04-22T07:18:41.770083+0000","last_peered":"2024-04-22T07:18:41.770083+0000","last_clean":"2024-04-22T07:18:41.770083+0000","last_became_active":"2024-04-22T07:18:35.752686+0000","last_became_peered":"2024-04-22T07:18:35.752686+0000","last_unstale":"2024-04-22T07:18:41.770083+0000","last_undegraded":"2024-04-22T07:18:41.770083+0000","last_fullsized":"2024-04-22T07:18:41.770083+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:36:55.684427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1868,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.937011+0000","last_change":"2024-04-22T07:18:36.767539+0000","last_active":"2024-04-22T07:18:37.937011+0000","last_peered":"2024-04-22T07:18:37.937011+0000","last_clean":"2024-04-22T07:18:37.937011+0000","last_became_active":"2024-04-22T07:18:36.767273+0000","last_became_peered":"2024-04-22T07:18:36.767273+0000","last_unstale":"2024-04-22T07:18:37.937011+0000","last_undegraded":"2024-04-22T07:18:37.937011+0000","last_fullsized":"2024-04-22T07:18:37.937011+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:03:50.228822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:41.764793+0000","last_change":"2024-04-22T07:18:35.752382+0000","last_active":"2024-04-22T07:18:41.764793+0000","last_peered":"2024-04-22T07:18:41.764793+0000","last_clean":"2024-04-22T07:18:41.764793+0000","last_became_active":"2024-04-22T07:18:35.752060+0000","last_became_peered":"2024-04-22T07:18:35.752060+0000","last_unstale":"2024-04-22T07:18:41.764793+0000","last_undegraded":"2024-04-22T07:18:41.764793+0000","last_fullsized":"2024-04-22T07:18:41.764793+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:31:33.559251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:38.894534+0000","last_change":"2024-04-22T07:18:36.764670+0000","last_active":"2024-04-22T07:18:38.894534+0000","last_peered":"2024-04-22T07:18:38.894534+0000","last_clean":"2024-04-22T07:18:38.894534+0000","last_became_active":"2024-04-22T07:18:36.763834+0000","last_became_peered":"2024-04-22T07:18:36.763834+0000","last_unstale":"2024-04-22T07:18:38.894534+0000","last_undegraded":"2024-04-22T07:18:38.894534+0000","last_fullsized":"2024-04-22T07:18:38.894534+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:41:20.703226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.763489+0000","last_change":"2024-04-22T07:18:35.752856+0000","last_active":"2024-04-22T07:18:37.763489+0000","last_peered":"2024-04-22T07:18:37.763489+0000","last_clean":"2024-04-22T07:18:37.763489+0000","last_became_active":"2024-04-22T07:18:35.752527+0000","last_became_peered":"2024-04-22T07:18:35.752527+0000","last_unstale":"2024-04-22T07:18:37.763489+0000","last_undegraded":"2024-04-22T07:18:37.763489+0000","last_fullsized":"2024-04-22T07:18:37.763489+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:40:59.305769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.937073+0000","last_change":"2024-04-22T07:18:36.769174+0000","last_active":"2024-04-22T07:18:37.937073+0000","last_peered":"2024-04-22T07:18:37.937073+0000","last_clean":"2024-04-22T07:18:37.937073+0000","last_became_active":"2024-04-22T07:18:36.768913+0000","last_became_peered":"2024-04-22T07:18:36.768913+0000","last_unstale":"2024-04-22T07:18:37.937073+0000","last_undegraded":"2024-04-22T07:18:37.937073+0000","last_fullsized":"2024-04-22T07:18:37.937073+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:45:42.674989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:38.393752+0000","last_change":"2024-04-22T07:18:35.749740+0000","last_active":"2024-04-22T07:18:38.393752+0000","last_peered":"2024-04-22T07:18:38.393752+0000","last_clean":"2024-04-22T07:18:38.393752+0000","last_became_active":"2024-04-22T07:18:35.749453+0000","last_became_peered":"2024-04-22T07:18:35.749453+0000","last_unstale":"2024-04-22T07:18:38.393752+0000","last_undegraded":"2024-04-22T07:18:38.393752+0000","last_fullsized":"2024-04-22T07:18:38.393752+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:08:04.608018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:38.393952+0000","last_change":"2024-04-22T07:18:36.771940+0000","last_active":"2024-04-22T07:18:38.393952+0000","last_peered":"2024-04-22T07:18:38.393952+0000","last_clean":"2024-04-22T07:18:38.393952+0000","last_became_active":"2024-04-22T07:18:36.771548+0000","last_became_peered":"2024-04-22T07:18:36.771548+0000","last_unstale":"2024-04-22T07:18:38.393952+0000","last_undegraded":"2024-04-22T07:18:38.393952+0000","last_fullsized":"2024-04-22T07:18:38.393952+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:23:03.787574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:41.765466+0000","last_change":"2024-04-22T07:18:35.749047+0000","last_active":"2024-04-22T07:18:41.765466+0000","last_peered":"2024-04-22T07:18:41.765466+0000","last_clean":"2024-04-22T07:18:41.765466+0000","last_became_active":"2024-04-22T07:18:35.748757+0000","last_became_peered":"2024-04-22T07:18:35.748757+0000","last_unstale":"2024-04-22T07:18:41.765466+0000","last_undegraded":"2024-04-22T07:18:41.765466+0000","last_fullsized":"2024-04-22T07:18:41.765466+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:40:59.305769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.936788+0000","last_change":"2024-04-22T07:18:36.769894+0000","last_active":"2024-04-22T07:18:37.936788+0000","last_peered":"2024-04-22T07:18:37.936788+0000","last_clean":"2024-04-22T07:18:37.936788+0000","last_became_active":"2024-04-22T07:18:36.768702+0000","last_became_peered":"2024-04-22T07:18:36.768702+0000","last_unstale":"2024-04-22T07:18:37.936788+0000","last_undegraded":"2024-04-22T07:18:37.936788+0000","last_fullsized":"2024-04-22T07:18:37.936788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:36:53.716397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:39.598923+0000","last_change":"2024-04-22T07:18:35.747536+0000","last_active":"2024-04-22T07:18:39.598923+0000","last_peered":"2024-04-22T07:18:39.598923+0000","last_clean":"2024-04-22T07:18:39.598923+0000","last_became_active":"2024-04-22T07:18:35.747271+0000","last_became_peered":"2024-04-22T07:18:35.747271+0000","last_unstale":"2024-04-22T07:18:39.598923+0000","last_undegraded":"2024-04-22T07:18:39.598923+0000","last_fullsized":"2024-04-22T07:18:39.598923+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:51:11.593642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.937304+0000","last_change":"2024-04-22T07:18:36.773033+0000","last_active":"2024-04-22T07:18:37.937304+0000","last_peered":"2024-04-22T07:18:37.937304+0000","last_clean":"2024-04-22T07:18:37.937304+0000","last_became_active":"2024-04-22T07:18:36.772537+0000","last_became_peered":"2024-04-22T07:18:36.772537+0000","last_unstale":"2024-04-22T07:18:37.937304+0000","last_undegraded":"2024-04-22T07:18:37.937304+0000","last_fullsized":"2024-04-22T07:18:37.937304+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:58:41.509248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:41.763188+0000","last_change":"2024-04-22T07:18:35.747533+0000","last_active":"2024-04-22T07:18:41.763188+0000","last_peered":"2024-04-22T07:18:41.763188+0000","last_clean":"2024-04-22T07:18:41.763188+0000","last_became_active":"2024-04-22T07:18:35.746881+0000","last_became_peered":"2024-04-22T07:18:35.746881+0000","last_unstale":"2024-04-22T07:18:41.763188+0000","last_undegraded":"2024-04-22T07:18:41.763188+0000","last_fullsized":"2024-04-22T07:18:41.763188+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:43:54.682673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.937347+0000","last_change":"2024-04-22T07:18:36.773723+0000","last_active":"2024-04-22T07:18:37.937347+0000","last_peered":"2024-04-22T07:18:37.937347+0000","last_clean":"2024-04-22T07:18:37.937347+0000","last_became_active":"2024-04-22T07:18:36.773466+0000","last_became_peered":"2024-04-22T07:18:36.773466+0000","last_unstale":"2024-04-22T07:18:37.937347+0000","last_undegraded":"2024-04-22T07:18:37.937347+0000","last_fullsized":"2024-04-22T07:18:37.937347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:42:20.611744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:39.603975+0000","last_change":"2024-04-22T07:18:35.750360+0000","last_active":"2024-04-22T07:18:39.603975+0000","last_peered":"2024-04-22T07:18:39.603975+0000","last_clean":"2024-04-22T07:18:39.603975+0000","last_became_active":"2024-04-22T07:18:35.749984+0000","last_became_peered":"2024-04-22T07:18:35.749984+0000","last_unstale":"2024-04-22T07:18:39.603975+0000","last_undegraded":"2024-04-22T07:18:39.603975+0000","last_fullsized":"2024-04-22T07:18:39.603975+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:19:48.648793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.764298+0000","last_change":"2024-04-22T07:18:36.765767+0000","last_active":"2024-04-22T07:18:37.764298+0000","last_peered":"2024-04-22T07:18:37.764298+0000","last_clean":"2024-04-22T07:18:37.764298+0000","last_became_active":"2024-04-22T07:18:36.764218+0000","last_became_peered":"2024-04-22T07:18:36.764218+0000","last_unstale":"2024-04-22T07:18:37.764298+0000","last_undegraded":"2024-04-22T07:18:37.764298+0000","last_fullsized":"2024-04-22T07:18:37.764298+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:45:42.674989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:38.894330+0000","last_change":"2024-04-22T07:18:35.743323+0000","last_active":"2024-04-22T07:18:38.894330+0000","last_peered":"2024-04-22T07:18:38.894330+0000","last_clean":"2024-04-22T07:18:38.894330+0000","last_became_active":"2024-04-22T07:18:35.743023+0000","last_became_peered":"2024-04-22T07:18:35.743023+0000","last_unstale":"2024-04-22T07:18:38.894330+0000","last_undegraded":"2024-04-22T07:18:38.894330+0000","last_fullsized":"2024-04-22T07:18:38.894330+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:08:04.608018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.937037+0000","last_change":"2024-04-22T07:18:36.771073+0000","last_active":"2024-04-22T07:18:37.937037+0000","last_peered":"2024-04-22T07:18:37.937037+0000","last_clean":"2024-04-22T07:18:37.937037+0000","last_became_active":"2024-04-22T07:18:36.770678+0000","last_became_peered":"2024-04-22T07:18:36.770678+0000","last_unstale":"2024-04-22T07:18:37.937037+0000","last_undegraded":"2024-04-22T07:18:37.937037+0000","last_fullsized":"2024-04-22T07:18:37.937037+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:59:57.688417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":170,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.936801+0000","last_change":"2024-04-22T07:18:26.518190+0000","last_active":"2024-04-22T07:18:37.936801+0000","last_peered":"2024-04-22T07:18:37.936801+0000","last_clean":"2024-04-22T07:18:37.936801+0000","last_became_active":"2024-04-22T07:18:26.515489+0000","last_became_peered":"2024-04-22T07:18:26.515489+0000","last_unstale":"2024-04-22T07:18:37.936801+0000","last_undegraded":"2024-04-22T07:18:37.936801+0000","last_fullsized":"2024-04-22T07:18:37.936801+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:24.652061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:24.652061+0000","last_clean_scrub_stamp":"2024-04-22T07:18:24.652061+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:32:54.875706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.762947+0000","last_change":"2024-04-22T07:18:35.748477+0000","last_active":"2024-04-22T07:18:37.762947+0000","last_peered":"2024-04-22T07:18:37.762947+0000","last_clean":"2024-04-22T07:18:37.762947+0000","last_became_active":"2024-04-22T07:18:35.748176+0000","last_became_peered":"2024-04-22T07:18:35.748176+0000","last_unstale":"2024-04-22T07:18:37.762947+0000","last_undegraded":"2024-04-22T07:18:37.762947+0000","last_fullsized":"2024-04-22T07:18:37.762947+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:36:55.684427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.767642+0000","last_change":"2024-04-22T07:18:36.771870+0000","last_active":"2024-04-22T07:18:37.767642+0000","last_peered":"2024-04-22T07:18:37.767642+0000","last_clean":"2024-04-22T07:18:37.767642+0000","last_became_active":"2024-04-22T07:18:36.771583+0000","last_became_peered":"2024-04-22T07:18:36.771583+0000","last_unstale":"2024-04-22T07:18:37.767642+0000","last_undegraded":"2024-04-22T07:18:37.767642+0000","last_fullsized":"2024-04-22T07:18:37.767642+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:22:58.884168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.936652+0000","last_change":"2024-04-22T07:18:35.755668+0000","last_active":"2024-04-22T07:18:37.936652+0000","last_peered":"2024-04-22T07:18:37.936652+0000","last_clean":"2024-04-22T07:18:37.936652+0000","last_became_active":"2024-04-22T07:18:35.755471+0000","last_became_peered":"2024-04-22T07:18:35.755471+0000","last_unstale":"2024-04-22T07:18:37.936652+0000","last_undegraded":"2024-04-22T07:18:37.936652+0000","last_fullsized":"2024-04-22T07:18:37.936652+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:36:55.684427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:38.894300+0000","last_change":"2024-04-22T07:18:36.758204+0000","last_active":"2024-04-22T07:18:38.894300+0000","last_peered":"2024-04-22T07:18:38.894300+0000","last_clean":"2024-04-22T07:18:38.894300+0000","last_became_active":"2024-04-22T07:18:36.757841+0000","last_became_peered":"2024-04-22T07:18:36.757841+0000","last_unstale":"2024-04-22T07:18:38.894300+0000","last_undegraded":"2024-04-22T07:18:38.894300+0000","last_fullsized":"2024-04-22T07:18:38.894300+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:43:09.058016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:38.894236+0000","last_change":"2024-04-22T07:18:35.746686+0000","last_active":"2024-04-22T07:18:38.894236+0000","last_peered":"2024-04-22T07:18:38.894236+0000","last_clean":"2024-04-22T07:18:38.894236+0000","last_became_active":"2024-04-22T07:18:35.746371+0000","last_became_peered":"2024-04-22T07:18:35.746371+0000","last_unstale":"2024-04-22T07:18:38.894236+0000","last_undegraded":"2024-04-22T07:18:38.894236+0000","last_fullsized":"2024-04-22T07:18:38.894236+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:36:55.684427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.757383+0000","last_change":"2024-04-22T07:18:36.765985+0000","last_active":"2024-04-22T07:18:37.757383+0000","last_peered":"2024-04-22T07:18:37.757383+0000","last_clean":"2024-04-22T07:18:37.757383+0000","last_became_active":"2024-04-22T07:18:36.765661+0000","last_became_peered":"2024-04-22T07:18:36.765661+0000","last_unstale":"2024-04-22T07:18:37.757383+0000","last_undegraded":"2024-04-22T07:18:37.757383+0000","last_fullsized":"2024-04-22T07:18:37.757383+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:23:03.787574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.763585+0000","last_change":"2024-04-22T07:18:35.754160+0000","last_active":"2024-04-22T07:18:37.763585+0000","last_peered":"2024-04-22T07:18:37.763585+0000","last_clean":"2024-04-22T07:18:37.763585+0000","last_became_active":"2024-04-22T07:18:35.753860+0000","last_became_peered":"2024-04-22T07:18:35.753860+0000","last_unstale":"2024-04-22T07:18:37.763585+0000","last_undegraded":"2024-04-22T07:18:37.763585+0000","last_fullsized":"2024-04-22T07:18:37.763585+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:08:04.608018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.763400+0000","last_change":"2024-04-22T07:18:36.762349+0000","last_active":"2024-04-22T07:18:37.763400+0000","last_peered":"2024-04-22T07:18:37.763400+0000","last_clean":"2024-04-22T07:18:37.763400+0000","last_became_active":"2024-04-22T07:18:36.762097+0000","last_became_peered":"2024-04-22T07:18:36.762097+0000","last_unstale":"2024-04-22T07:18:37.763400+0000","last_undegraded":"2024-04-22T07:18:37.763400+0000","last_fullsized":"2024-04-22T07:18:37.763400+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:43:55.686523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.757304+0000","last_change":"2024-04-22T07:18:35.758810+0000","last_active":"2024-04-22T07:18:37.757304+0000","last_peered":"2024-04-22T07:18:37.757304+0000","last_clean":"2024-04-22T07:18:37.757304+0000","last_became_active":"2024-04-22T07:18:35.758521+0000","last_became_peered":"2024-04-22T07:18:35.758521+0000","last_unstale":"2024-04-22T07:18:37.757304+0000","last_undegraded":"2024-04-22T07:18:37.757304+0000","last_fullsized":"2024-04-22T07:18:37.757304+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:40:59.305769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.764371+0000","last_change":"2024-04-22T07:18:36.764448+0000","last_active":"2024-04-22T07:18:37.764371+0000","last_peered":"2024-04-22T07:18:37.764371+0000","last_clean":"2024-04-22T07:18:37.764371+0000","last_became_active":"2024-04-22T07:18:36.763728+0000","last_became_peered":"2024-04-22T07:18:36.763728+0000","last_unstale":"2024-04-22T07:18:37.764371+0000","last_undegraded":"2024-04-22T07:18:37.764371+0000","last_fullsized":"2024-04-22T07:18:37.764371+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:58:41.509248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.937270+0000","last_change":"2024-04-22T07:18:35.758980+0000","last_active":"2024-04-22T07:18:37.937270+0000","last_peered":"2024-04-22T07:18:37.937270+0000","last_clean":"2024-04-22T07:18:37.937270+0000","last_became_active":"2024-04-22T07:18:35.758674+0000","last_became_peered":"2024-04-22T07:18:35.758674+0000","last_unstale":"2024-04-22T07:18:37.937270+0000","last_undegraded":"2024-04-22T07:18:37.937270+0000","last_fullsized":"2024-04-22T07:18:37.937270+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:45:14.209818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.757443+0000","last_change":"2024-04-22T07:18:36.772908+0000","last_active":"2024-04-22T07:18:37.757443+0000","last_peered":"2024-04-22T07:18:37.757443+0000","last_clean":"2024-04-22T07:18:37.757443+0000","last_became_active":"2024-04-22T07:18:36.772636+0000","last_became_peered":"2024-04-22T07:18:36.772636+0000","last_unstale":"2024-04-22T07:18:37.757443+0000","last_undegraded":"2024-04-22T07:18:37.757443+0000","last_fullsized":"2024-04-22T07:18:37.757443+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:51:10.038201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:39.603989+0000","last_change":"2024-04-22T07:18:35.753595+0000","last_active":"2024-04-22T07:18:39.603989+0000","last_peered":"2024-04-22T07:18:39.603989+0000","last_clean":"2024-04-22T07:18:39.603989+0000","last_became_active":"2024-04-22T07:18:35.753295+0000","last_became_peered":"2024-04-22T07:18:35.753295+0000","last_unstale":"2024-04-22T07:18:39.603989+0000","last_undegraded":"2024-04-22T07:18:39.603989+0000","last_fullsized":"2024-04-22T07:18:39.603989+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:08:04.608018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.768028+0000","last_change":"2024-04-22T07:18:36.768580+0000","last_active":"2024-04-22T07:18:37.768028+0000","last_peered":"2024-04-22T07:18:37.768028+0000","last_clean":"2024-04-22T07:18:37.768028+0000","last_became_active":"2024-04-22T07:18:36.767702+0000","last_became_peered":"2024-04-22T07:18:36.767702+0000","last_unstale":"2024-04-22T07:18:37.768028+0000","last_undegraded":"2024-04-22T07:18:37.768028+0000","last_fullsized":"2024-04-22T07:18:37.768028+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:59:57.688417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:41.768034+0000","last_change":"2024-04-22T07:18:35.751692+0000","last_active":"2024-04-22T07:18:41.768034+0000","last_peered":"2024-04-22T07:18:41.768034+0000","last_clean":"2024-04-22T07:18:41.768034+0000","last_became_active":"2024-04-22T07:18:35.751393+0000","last_became_peered":"2024-04-22T07:18:35.751393+0000","last_unstale":"2024-04-22T07:18:41.768034+0000","last_undegraded":"2024-04-22T07:18:41.768034+0000","last_fullsized":"2024-04-22T07:18:41.768034+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:40:59.305769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:38.894956+0000","last_change":"2024-04-22T07:18:36.768532+0000","last_active":"2024-04-22T07:18:38.894956+0000","last_peered":"2024-04-22T07:18:38.894956+0000","last_clean":"2024-04-22T07:18:38.894956+0000","last_became_active":"2024-04-22T07:18:36.768253+0000","last_became_peered":"2024-04-22T07:18:36.768253+0000","last_unstale":"2024-04-22T07:18:38.894956+0000","last_undegraded":"2024-04-22T07:18:38.894956+0000","last_fullsized":"2024-04-22T07:18:38.894956+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:30:36.755201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.936651+0000","last_change":"2024-04-22T07:18:35.758702+0000","last_active":"2024-04-22T07:18:37.936651+0000","last_peered":"2024-04-22T07:18:37.936651+0000","last_clean":"2024-04-22T07:18:37.936651+0000","last_became_active":"2024-04-22T07:18:35.758415+0000","last_became_peered":"2024-04-22T07:18:35.758415+0000","last_unstale":"2024-04-22T07:18:37.936651+0000","last_undegraded":"2024-04-22T07:18:37.936651+0000","last_fullsized":"2024-04-22T07:18:37.936651+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:08:04.608018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.763191+0000","last_change":"2024-04-22T07:18:36.763053+0000","last_active":"2024-04-22T07:18:37.763191+0000","last_peered":"2024-04-22T07:18:37.763191+0000","last_clean":"2024-04-22T07:18:37.763191+0000","last_became_active":"2024-04-22T07:18:36.762546+0000","last_became_peered":"2024-04-22T07:18:36.762546+0000","last_unstale":"2024-04-22T07:18:37.763191+0000","last_undegraded":"2024-04-22T07:18:37.763191+0000","last_fullsized":"2024-04-22T07:18:37.763191+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:36:56.688277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.757534+0000","last_change":"2024-04-22T07:18:35.748837+0000","last_active":"2024-04-22T07:18:37.757534+0000","last_peered":"2024-04-22T07:18:37.757534+0000","last_clean":"2024-04-22T07:18:37.757534+0000","last_became_active":"2024-04-22T07:18:35.748080+0000","last_became_peered":"2024-04-22T07:18:35.748080+0000","last_unstale":"2024-04-22T07:18:37.757534+0000","last_undegraded":"2024-04-22T07:18:37.757534+0000","last_fullsized":"2024-04-22T07:18:37.757534+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:36:55.684427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.767568+0000","last_change":"2024-04-22T07:18:36.769911+0000","last_active":"2024-04-22T07:18:37.767568+0000","last_peered":"2024-04-22T07:18:37.767568+0000","last_clean":"2024-04-22T07:18:37.767568+0000","last_became_active":"2024-04-22T07:18:36.768682+0000","last_became_peered":"2024-04-22T07:18:36.768682+0000","last_unstale":"2024-04-22T07:18:37.767568+0000","last_undegraded":"2024-04-22T07:18:37.767568+0000","last_fullsized":"2024-04-22T07:18:37.767568+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:30:36.755201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.757319+0000","last_change":"2024-04-22T07:18:35.753066+0000","last_active":"2024-04-22T07:18:37.757319+0000","last_peered":"2024-04-22T07:18:37.757319+0000","last_clean":"2024-04-22T07:18:37.757319+0000","last_became_active":"2024-04-22T07:18:35.752804+0000","last_became_peered":"2024-04-22T07:18:35.752804+0000","last_unstale":"2024-04-22T07:18:37.757319+0000","last_undegraded":"2024-04-22T07:18:37.757319+0000","last_fullsized":"2024-04-22T07:18:37.757319+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:43:54.682673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.767652+0000","last_change":"2024-04-22T07:18:36.774790+0000","last_active":"2024-04-22T07:18:37.767652+0000","last_peered":"2024-04-22T07:18:37.767652+0000","last_clean":"2024-04-22T07:18:37.767652+0000","last_became_active":"2024-04-22T07:18:36.774479+0000","last_became_peered":"2024-04-22T07:18:36.774479+0000","last_unstale":"2024-04-22T07:18:37.767652+0000","last_undegraded":"2024-04-22T07:18:37.767652+0000","last_fullsized":"2024-04-22T07:18:37.767652+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:36:53.716397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:41.767713+0000","last_change":"2024-04-22T07:18:35.754440+0000","last_active":"2024-04-22T07:18:41.767713+0000","last_peered":"2024-04-22T07:18:41.767713+0000","last_clean":"2024-04-22T07:18:41.767713+0000","last_became_active":"2024-04-22T07:18:35.754137+0000","last_became_peered":"2024-04-22T07:18:35.754137+0000","last_unstale":"2024-04-22T07:18:41.767713+0000","last_undegraded":"2024-04-22T07:18:41.767713+0000","last_fullsized":"2024-04-22T07:18:41.767713+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T19:09:20.529889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:38.393947+0000","last_change":"2024-04-22T07:18:36.759585+0000","last_active":"2024-04-22T07:18:38.393947+0000","last_peered":"2024-04-22T07:18:38.393947+0000","last_clean":"2024-04-22T07:18:38.393947+0000","last_became_active":"2024-04-22T07:18:36.759342+0000","last_became_peered":"2024-04-22T07:18:36.759342+0000","last_unstale":"2024-04-22T07:18:38.393947+0000","last_undegraded":"2024-04-22T07:18:38.393947+0000","last_fullsized":"2024-04-22T07:18:38.393947+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:44:30.785178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.764337+0000","last_change":"2024-04-22T07:18:36.762665+0000","last_active":"2024-04-22T07:18:37.764337+0000","last_peered":"2024-04-22T07:18:37.764337+0000","last_clean":"2024-04-22T07:18:37.764337+0000","last_became_active":"2024-04-22T07:18:36.762392+0000","last_became_peered":"2024-04-22T07:18:36.762392+0000","last_unstale":"2024-04-22T07:18:37.764337+0000","last_undegraded":"2024-04-22T07:18:37.764337+0000","last_fullsized":"2024-04-22T07:18:37.764337+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:36:27.097452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:41.767658+0000","last_change":"2024-04-22T07:18:35.755160+0000","last_active":"2024-04-22T07:18:41.767658+0000","last_peered":"2024-04-22T07:18:41.767658+0000","last_clean":"2024-04-22T07:18:41.767658+0000","last_became_active":"2024-04-22T07:18:35.754877+0000","last_became_peered":"2024-04-22T07:18:35.754877+0000","last_unstale":"2024-04-22T07:18:41.767658+0000","last_undegraded":"2024-04-22T07:18:41.767658+0000","last_fullsized":"2024-04-22T07:18:41.767658+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:43:54.682673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.764098+0000","last_change":"2024-04-22T07:18:36.761534+0000","last_active":"2024-04-22T07:18:37.764098+0000","last_peered":"2024-04-22T07:18:37.764098+0000","last_clean":"2024-04-22T07:18:37.764098+0000","last_became_active":"2024-04-22T07:18:36.761181+0000","last_became_peered":"2024-04-22T07:18:36.761181+0000","last_unstale":"2024-04-22T07:18:37.764098+0000","last_undegraded":"2024-04-22T07:18:37.764098+0000","last_fullsized":"2024-04-22T07:18:37.764098+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:03:50.228822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:41.767397+0000","last_change":"2024-04-22T07:18:35.752282+0000","last_active":"2024-04-22T07:18:41.767397+0000","last_peered":"2024-04-22T07:18:41.767397+0000","last_clean":"2024-04-22T07:18:41.767397+0000","last_became_active":"2024-04-22T07:18:35.751866+0000","last_became_peered":"2024-04-22T07:18:35.751866+0000","last_unstale":"2024-04-22T07:18:41.767397+0000","last_undegraded":"2024-04-22T07:18:41.767397+0000","last_fullsized":"2024-04-22T07:18:41.767397+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:19:48.648793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:38.894862+0000","last_change":"2024-04-22T07:18:36.763229+0000","last_active":"2024-04-22T07:18:38.894862+0000","last_peered":"2024-04-22T07:18:38.894862+0000","last_clean":"2024-04-22T07:18:38.894862+0000","last_became_active":"2024-04-22T07:18:36.762882+0000","last_became_peered":"2024-04-22T07:18:36.762882+0000","last_unstale":"2024-04-22T07:18:38.894862+0000","last_undegraded":"2024-04-22T07:18:38.894862+0000","last_fullsized":"2024-04-22T07:18:38.894862+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:44:30.785178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:39.604104+0000","last_change":"2024-04-22T07:18:35.758820+0000","last_active":"2024-04-22T07:18:39.604104+0000","last_peered":"2024-04-22T07:18:39.604104+0000","last_clean":"2024-04-22T07:18:39.604104+0000","last_became_active":"2024-04-22T07:18:35.758514+0000","last_became_peered":"2024-04-22T07:18:35.758514+0000","last_unstale":"2024-04-22T07:18:39.604104+0000","last_undegraded":"2024-04-22T07:18:39.604104+0000","last_fullsized":"2024-04-22T07:18:39.604104+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:40:59.305769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.767960+0000","last_change":"2024-04-22T07:18:36.768383+0000","last_active":"2024-04-22T07:18:37.767960+0000","last_peered":"2024-04-22T07:18:37.767960+0000","last_clean":"2024-04-22T07:18:37.767960+0000","last_became_active":"2024-04-22T07:18:36.767779+0000","last_became_peered":"2024-04-22T07:18:36.767779+0000","last_unstale":"2024-04-22T07:18:37.767960+0000","last_undegraded":"2024-04-22T07:18:37.767960+0000","last_fullsized":"2024-04-22T07:18:37.767960+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:18:59.298766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:41.768431+0000","last_change":"2024-04-22T07:18:35.754117+0000","last_active":"2024-04-22T07:18:41.768431+0000","last_peered":"2024-04-22T07:18:41.768431+0000","last_clean":"2024-04-22T07:18:41.768431+0000","last_became_active":"2024-04-22T07:18:35.753833+0000","last_became_peered":"2024-04-22T07:18:35.753833+0000","last_unstale":"2024-04-22T07:18:41.768431+0000","last_undegraded":"2024-04-22T07:18:41.768431+0000","last_fullsized":"2024-04-22T07:18:41.768431+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:54:03.123665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2666,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":5332,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":40,"ondisk_log_size":40,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574859,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27800,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344040,"statfs":{"total":96636764160,"available":96608296960,"internally_reserved":0,"allocated":802816,"data_stored":661884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574858,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":217088,"data_stored":72802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574858,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":208896,"data_stored":71024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574858,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":217088,"data_stored":71060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574859,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":217088,"data_stored":72802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574858,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27216,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":204800,"data_stored":70934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574859,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":212992,"data_stored":71094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574858,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":811008,"data_stored":661940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1868,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1868,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-22T07:18:57.086 INFO:tasks.quiescer.ceph_manager:clean! 2024-04-22T07:18:57.086 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-22T07:18:57.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.224+0000 7fc4d270e640 1 Processor -- start 2024-04-22T07:18:57.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.224+0000 7fc4d270e640 1 -- start start 2024-04-22T07:18:57.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.225+0000 7fc4d270e640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc4cc152e70 0x7fc4cc0c3e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:57.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.225+0000 7fc4d270e640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fc4cc159520 0x7fc4cc0c4380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:57.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.225+0000 7fc4d270e640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc4cc0c8e80 0x7fc4cc0ca190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:57.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.225+0000 7fc4d270e640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fc4cc153250 con 0x7fc4cc152e70 2024-04-22T07:18:57.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.225+0000 7fc4d270e640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7fc4cc1599b0 con 0x7fc4cc159520 2024-04-22T07:18:57.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.225+0000 7fc4d270e640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fc4cc15c140 con 0x7fc4cc0c8e80 2024-04-22T07:18:57.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.225+0000 7fc4cbfff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc4cc152e70 0x7fc4cc0c3e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:57.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.225+0000 7fc4cbfff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc4cc152e70 0x7fc4cc0c3e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39534/0 (socket says 172.21.15.37:39534) 2024-04-22T07:18:57.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.225+0000 7fc4cbfff640 1 -- 172.21.15.37:0/2443438745 learned_addr learned my addr 172.21.15.37:0/2443438745 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:18:57.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.225+0000 7fc4cb7fe640 1 --2- 172.21.15.37:0/2443438745 >> v2:172.21.15.196:3300/0 conn(0x7fc4cc159520 0x7fc4cc0c4380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:57.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.225+0000 7fc4d0cab640 1 --2- 172.21.15.37:0/2443438745 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc4cc0c8e80 0x7fc4cc0ca190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:57.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.226+0000 7fc4cbfff640 1 -- 172.21.15.37:0/2443438745 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc4cc0c8e80 msgr2=0x7fc4cc0ca190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:18:57.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.226+0000 7fc4cbfff640 1 --2- 172.21.15.37:0/2443438745 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc4cc0c8e80 0x7fc4cc0ca190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:57.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.226+0000 7fc4cbfff640 1 -- 172.21.15.37:0/2443438745 >> v2:172.21.15.196:3300/0 conn(0x7fc4cc159520 msgr2=0x7fc4cc0c4380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:18:57.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.226+0000 7fc4cbfff640 1 --2- 172.21.15.37:0/2443438745 >> v2:172.21.15.196:3300/0 conn(0x7fc4cc159520 0x7fc4cc0c4380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:57.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.226+0000 7fc4cbfff640 1 -- 172.21.15.37:0/2443438745 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4cc15c420 con 0x7fc4cc152e70 2024-04-22T07:18:57.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.226+0000 7fc4d0cab640 1 --2- 172.21.15.37:0/2443438745 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc4cc0c8e80 0x7fc4cc0ca190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T07:18:57.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.226+0000 7fc4cbfff640 1 --2- 172.21.15.37:0/2443438745 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc4cc152e70 0x7fc4cc0c3e40 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fc4cc0cbf30 tx=0x7fc4bc02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f1100d0ee55f367 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:57.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.227+0000 7fc4caffd640 1 -- 172.21.15.37:0/2443438745 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4bc035020 con 0x7fc4cc152e70 2024-04-22T07:18:57.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.227+0000 7fc4caffd640 1 -- 172.21.15.37:0/2443438745 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4bc031870 con 0x7fc4cc152e70 2024-04-22T07:18:57.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.227+0000 7fc4caffd640 1 -- 172.21.15.37:0/2443438745 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4bc031c40 con 0x7fc4cc152e70 2024-04-22T07:18:57.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.227+0000 7fc4d270e640 1 -- 172.21.15.37:0/2443438745 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc4cc152e70 msgr2=0x7fc4cc0c3e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:57.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.227+0000 7fc4d270e640 1 --2- 172.21.15.37:0/2443438745 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc4cc152e70 0x7fc4cc0c3e40 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fc4cc0cbf30 tx=0x7fc4bc02b910 comp rx=0 tx=0).stop 2024-04-22T07:18:57.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.227+0000 7fc4d270e640 1 -- 172.21.15.37:0/2443438745 shutdown_connections 2024-04-22T07:18:57.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.227+0000 7fc4d270e640 1 --2- 172.21.15.37:0/2443438745 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc4cc0c8e80 0x7fc4cc0ca190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:57.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.227+0000 7fc4d270e640 1 --2- 172.21.15.37:0/2443438745 >> v2:172.21.15.196:3300/0 conn(0x7fc4cc159520 0x7fc4cc0c4380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:57.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.227+0000 7fc4d270e640 1 --2- 172.21.15.37:0/2443438745 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc4cc152e70 0x7fc4cc0c3e40 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:57.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.227+0000 7fc4d270e640 1 -- 172.21.15.37:0/2443438745 >> 172.21.15.37:0/2443438745 conn(0x7fc4cc06e370 msgr2=0x7fc4cc071540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:57.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.227+0000 7fc4d270e640 1 -- 172.21.15.37:0/2443438745 shutdown_connections 2024-04-22T07:18:57.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.227+0000 7fc4d270e640 1 -- 172.21.15.37:0/2443438745 wait complete. 2024-04-22T07:18:57.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.228+0000 7fc4d270e640 1 Processor -- start 2024-04-22T07:18:57.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.229+0000 7fc4d270e640 1 -- start start 2024-04-22T07:18:57.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.229+0000 7fc4d270e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc4cc0c8e80 0x7fc4cc1e2d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:57.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.229+0000 7fc4d270e640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc4cc152e70 0x7fc4cc0b2cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:57.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.229+0000 7fc4d270e640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc4cc0b21c0 0x7fc4cc1e3cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:57.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.229+0000 7fc4d270e640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc4cc070ed0 con 0x7fc4cc0c8e80 2024-04-22T07:18:57.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.229+0000 7fc4d270e640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fc4cc15c9e0 con 0x7fc4cc152e70 2024-04-22T07:18:57.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.229+0000 7fc4d270e640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fc4cc071050 con 0x7fc4cc0b21c0 2024-04-22T07:18:57.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.229+0000 7fc4cbfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc4cc0c8e80 0x7fc4cc1e2d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:57.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.229+0000 7fc4cbfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc4cc0c8e80 0x7fc4cc1e2d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39536/0 (socket says 172.21.15.37:39536) 2024-04-22T07:18:57.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.229+0000 7fc4cbfff640 1 -- 172.21.15.37:0/2484920652 learned_addr learned my addr 172.21.15.37:0/2484920652 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:18:57.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.229+0000 7fc4cb7fe640 1 --2- 172.21.15.37:0/2484920652 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc4cc152e70 0x7fc4cc0b2cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:57.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.229+0000 7fc4d0cab640 1 --2- 172.21.15.37:0/2484920652 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc4cc0b21c0 0x7fc4cc1e3cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:57.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.230+0000 7fc4cbfff640 1 -- 172.21.15.37:0/2484920652 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc4cc0b21c0 msgr2=0x7fc4cc1e3cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:57.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.230+0000 7fc4cbfff640 1 --2- 172.21.15.37:0/2484920652 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc4cc0b21c0 0x7fc4cc1e3cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:57.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.230+0000 7fc4cbfff640 1 -- 172.21.15.37:0/2484920652 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc4cc152e70 msgr2=0x7fc4cc0b2cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:57.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.230+0000 7fc4cbfff640 1 --2- 172.21.15.37:0/2484920652 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc4cc152e70 0x7fc4cc0b2cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:57.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.230+0000 7fc4cbfff640 1 -- 172.21.15.37:0/2484920652 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4cc1eef10 con 0x7fc4cc0c8e80 2024-04-22T07:18:57.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.230+0000 7fc4cbfff640 1 --2- 172.21.15.37:0/2484920652 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc4cc0c8e80 0x7fc4cc1e2d90 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fc4bc000c00 tx=0x7fc4bc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:57.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.230+0000 7fc4c8ff9640 1 -- 172.21.15.37:0/2484920652 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4bc035040 con 0x7fc4cc0c8e80 2024-04-22T07:18:57.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.230+0000 7fc4c8ff9640 1 -- 172.21.15.37:0/2484920652 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4bc030d00 con 0x7fc4cc0c8e80 2024-04-22T07:18:57.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.230+0000 7fc4c8ff9640 1 -- 172.21.15.37:0/2484920652 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4bc0456a0 con 0x7fc4cc0c8e80 2024-04-22T07:18:57.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.230+0000 7fc4d270e640 1 -- 172.21.15.37:0/2484920652 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4cc1ef180 con 0x7fc4cc0c8e80 2024-04-22T07:18:57.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.230+0000 7fc4d270e640 1 -- 172.21.15.37:0/2484920652 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4cc1e2590 con 0x7fc4cc0c8e80 2024-04-22T07:18:57.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.231+0000 7fc4d270e640 1 -- 172.21.15.37:0/2484920652 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4cc068b20 con 0x7fc4cc0c8e80 2024-04-22T07:18:57.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.232+0000 7fc4c8ff9640 1 -- 172.21.15.37:0/2484920652 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc4bc038020 con 0x7fc4cc0c8e80 2024-04-22T07:18:57.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.232+0000 7fc4c8ff9640 1 --2- 172.21.15.37:0/2484920652 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fc4b806c920 0x7fc4b806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:57.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.232+0000 7fc4c8ff9640 1 -- 172.21.15.37:0/2484920652 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fc4bc0adc30 con 0x7fc4cc0c8e80 2024-04-22T07:18:57.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.233+0000 7fc4cb7fe640 1 --2- 172.21.15.37:0/2484920652 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fc4b806c920 0x7fc4b806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:57.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.233+0000 7fc4cb7fe640 1 --2- 172.21.15.37:0/2484920652 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fc4b806c920 0x7fc4b806ede0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fc4cc0b16d0 tx=0x7fc4c0009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:57.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.237+0000 7fc4c8ff9640 1 -- 172.21.15.37:0/2484920652 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc4bc07baa0 con 0x7fc4cc0c8e80 2024-04-22T07:18:57.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.417+0000 7fc4d270e640 1 -- 172.21.15.37:0/2484920652 --> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc4cc0c96d0 con 0x7fc4b806c920 2024-04-22T07:18:57.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.424+0000 7fc4c8ff9640 1 -- 172.21.15.37:0/2484920652 <== mgr.4103 v2:172.21.15.196:6832/321987173 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251830 (secure 0 0 0) 0x7fc4cc0c96d0 con 0x7fc4b806c920 2024-04-22T07:18:57.424 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-22T07:18:57.425 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-04-22T07:18:57.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.426+0000 7fc4d270e640 1 -- 172.21.15.37:0/2484920652 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fc4b806c920 msgr2=0x7fc4b806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:57.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.426+0000 7fc4d270e640 1 --2- 172.21.15.37:0/2484920652 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fc4b806c920 0x7fc4b806ede0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fc4cc0b16d0 tx=0x7fc4c0009190 comp rx=0 tx=0).stop 2024-04-22T07:18:57.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.426+0000 7fc4d270e640 1 -- 172.21.15.37:0/2484920652 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc4cc0c8e80 msgr2=0x7fc4cc1e2d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:57.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.426+0000 7fc4d270e640 1 --2- 172.21.15.37:0/2484920652 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc4cc0c8e80 0x7fc4cc1e2d90 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fc4bc000c00 tx=0x7fc4bc0046c0 comp rx=0 tx=0).stop 2024-04-22T07:18:57.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.427+0000 7fc4d270e640 1 -- 172.21.15.37:0/2484920652 shutdown_connections 2024-04-22T07:18:57.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.427+0000 7fc4d270e640 1 --2- 172.21.15.37:0/2484920652 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fc4b806c920 0x7fc4b806ede0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:57.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.427+0000 7fc4d270e640 1 --2- 172.21.15.37:0/2484920652 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc4cc0b21c0 0x7fc4cc1e3cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:57.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.427+0000 7fc4d270e640 1 --2- 172.21.15.37:0/2484920652 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc4cc152e70 0x7fc4cc0b2cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:57.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.427+0000 7fc4d270e640 1 --2- 172.21.15.37:0/2484920652 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc4cc0c8e80 0x7fc4cc1e2d90 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:57.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.427+0000 7fc4d270e640 1 -- 172.21.15.37:0/2484920652 >> 172.21.15.37:0/2484920652 conn(0x7fc4cc06e370 msgr2=0x7fc4cc157e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:57.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.427+0000 7fc4d270e640 1 -- 172.21.15.37:0/2484920652 shutdown_connections 2024-04-22T07:18:57.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.427+0000 7fc4d270e640 1 -- 172.21.15.37:0/2484920652 wait complete. 2024-04-22T07:18:57.435 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":29,"stamp":"2024-04-22T07:18:56.590924+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":593034,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":205,"num_write_kb":2431,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218952,"kb_used_data":2824,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755768,"statfs":{"total":773094113280,"available":772869906432,"internally_reserved":0,"allocated":2891776,"data_stored":1753540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":256,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003687"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.937242+0000","last_change":"2024-04-22T07:18:36.765825+0000","last_active":"2024-04-22T07:18:37.937242+0000","last_peered":"2024-04-22T07:18:37.937242+0000","last_clean":"2024-04-22T07:18:37.937242+0000","last_became_active":"2024-04-22T07:18:36.765306+0000","last_became_peered":"2024-04-22T07:18:36.765306+0000","last_unstale":"2024-04-22T07:18:37.937242+0000","last_undegraded":"2024-04-22T07:18:37.937242+0000","last_fullsized":"2024-04-22T07:18:37.937242+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:00:45.046782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.757437+0000","last_change":"2024-04-22T07:18:36.772829+0000","last_active":"2024-04-22T07:18:37.757437+0000","last_peered":"2024-04-22T07:18:37.757437+0000","last_clean":"2024-04-22T07:18:37.757437+0000","last_became_active":"2024-04-22T07:18:36.772464+0000","last_became_peered":"2024-04-22T07:18:36.772464+0000","last_unstale":"2024-04-22T07:18:37.757437+0000","last_undegraded":"2024-04-22T07:18:37.757437+0000","last_fullsized":"2024-04-22T07:18:37.757437+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:09:08.040513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:38.894883+0000","last_change":"2024-04-22T07:18:36.760613+0000","last_active":"2024-04-22T07:18:38.894883+0000","last_peered":"2024-04-22T07:18:38.894883+0000","last_clean":"2024-04-22T07:18:38.894883+0000","last_became_active":"2024-04-22T07:18:36.760313+0000","last_became_peered":"2024-04-22T07:18:36.760313+0000","last_unstale":"2024-04-22T07:18:38.894883+0000","last_undegraded":"2024-04-22T07:18:38.894883+0000","last_fullsized":"2024-04-22T07:18:38.894883+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:51:10.038201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.763484+0000","last_change":"2024-04-22T07:18:36.767969+0000","last_active":"2024-04-22T07:18:37.763484+0000","last_peered":"2024-04-22T07:18:37.763484+0000","last_clean":"2024-04-22T07:18:37.763484+0000","last_became_active":"2024-04-22T07:18:36.767713+0000","last_became_peered":"2024-04-22T07:18:36.767713+0000","last_unstale":"2024-04-22T07:18:37.763484+0000","last_undegraded":"2024-04-22T07:18:37.763484+0000","last_fullsized":"2024-04-22T07:18:37.763484+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:36:53.716397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.936961+0000","last_change":"2024-04-22T07:18:36.764361+0000","last_active":"2024-04-22T07:18:37.936961+0000","last_peered":"2024-04-22T07:18:37.936961+0000","last_clean":"2024-04-22T07:18:37.936961+0000","last_became_active":"2024-04-22T07:18:36.763812+0000","last_became_peered":"2024-04-22T07:18:36.763812+0000","last_unstale":"2024-04-22T07:18:37.936961+0000","last_undegraded":"2024-04-22T07:18:37.936961+0000","last_fullsized":"2024-04-22T07:18:37.936961+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:18:59.298766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.763087+0000","last_change":"2024-04-22T07:18:36.762804+0000","last_active":"2024-04-22T07:18:37.763087+0000","last_peered":"2024-04-22T07:18:37.763087+0000","last_clean":"2024-04-22T07:18:37.763087+0000","last_became_active":"2024-04-22T07:18:36.762508+0000","last_became_peered":"2024-04-22T07:18:36.762508+0000","last_unstale":"2024-04-22T07:18:37.763087+0000","last_undegraded":"2024-04-22T07:18:37.763087+0000","last_fullsized":"2024-04-22T07:18:37.763087+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:09:08.040513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.936807+0000","last_change":"2024-04-22T07:18:36.771774+0000","last_active":"2024-04-22T07:18:37.936807+0000","last_peered":"2024-04-22T07:18:37.936807+0000","last_clean":"2024-04-22T07:18:37.936807+0000","last_became_active":"2024-04-22T07:18:36.771425+0000","last_became_peered":"2024-04-22T07:18:36.771425+0000","last_unstale":"2024-04-22T07:18:37.936807+0000","last_undegraded":"2024-04-22T07:18:37.936807+0000","last_fullsized":"2024-04-22T07:18:37.936807+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:45:27.464772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.767379+0000","last_change":"2024-04-22T07:18:36.773631+0000","last_active":"2024-04-22T07:18:37.767379+0000","last_peered":"2024-04-22T07:18:37.767379+0000","last_clean":"2024-04-22T07:18:37.767379+0000","last_became_active":"2024-04-22T07:18:36.773347+0000","last_became_peered":"2024-04-22T07:18:36.773347+0000","last_unstale":"2024-04-22T07:18:37.767379+0000","last_undegraded":"2024-04-22T07:18:37.767379+0000","last_fullsized":"2024-04-22T07:18:37.767379+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:23:03.787574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.937320+0000","last_change":"2024-04-22T07:18:36.773325+0000","last_active":"2024-04-22T07:18:37.937320+0000","last_peered":"2024-04-22T07:18:37.937320+0000","last_clean":"2024-04-22T07:18:37.937320+0000","last_became_active":"2024-04-22T07:18:36.773023+0000","last_became_peered":"2024-04-22T07:18:36.773023+0000","last_unstale":"2024-04-22T07:18:37.937320+0000","last_undegraded":"2024-04-22T07:18:37.937320+0000","last_fullsized":"2024-04-22T07:18:37.937320+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:11:55.496104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:38.394196+0000","last_change":"2024-04-22T07:18:36.769834+0000","last_active":"2024-04-22T07:18:38.394196+0000","last_peered":"2024-04-22T07:18:38.394196+0000","last_clean":"2024-04-22T07:18:38.394196+0000","last_became_active":"2024-04-22T07:18:36.769544+0000","last_became_peered":"2024-04-22T07:18:36.769544+0000","last_unstale":"2024-04-22T07:18:38.394196+0000","last_undegraded":"2024-04-22T07:18:38.394196+0000","last_fullsized":"2024-04-22T07:18:38.394196+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:30:36.755201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:38.394021+0000","last_change":"2024-04-22T07:18:36.762325+0000","last_active":"2024-04-22T07:18:38.394021+0000","last_peered":"2024-04-22T07:18:38.394021+0000","last_clean":"2024-04-22T07:18:38.394021+0000","last_became_active":"2024-04-22T07:18:36.762059+0000","last_became_peered":"2024-04-22T07:18:36.762059+0000","last_unstale":"2024-04-22T07:18:38.394021+0000","last_undegraded":"2024-04-22T07:18:38.394021+0000","last_fullsized":"2024-04-22T07:18:38.394021+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:51:10.038201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.763612+0000","last_change":"2024-04-22T07:18:36.761961+0000","last_active":"2024-04-22T07:18:37.763612+0000","last_peered":"2024-04-22T07:18:37.763612+0000","last_clean":"2024-04-22T07:18:37.763612+0000","last_became_active":"2024-04-22T07:18:36.761389+0000","last_became_peered":"2024-04-22T07:18:36.761389+0000","last_unstale":"2024-04-22T07:18:37.763612+0000","last_undegraded":"2024-04-22T07:18:37.763612+0000","last_fullsized":"2024-04-22T07:18:37.763612+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T19:09:21.533739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.767566+0000","last_change":"2024-04-22T07:18:36.767665+0000","last_active":"2024-04-22T07:18:37.767566+0000","last_peered":"2024-04-22T07:18:37.767566+0000","last_clean":"2024-04-22T07:18:37.767566+0000","last_became_active":"2024-04-22T07:18:36.767386+0000","last_became_peered":"2024-04-22T07:18:36.767386+0000","last_unstale":"2024-04-22T07:18:37.767566+0000","last_undegraded":"2024-04-22T07:18:37.767566+0000","last_fullsized":"2024-04-22T07:18:37.767566+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:09:08.040513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:38.894526+0000","last_change":"2024-04-22T07:18:36.770591+0000","last_active":"2024-04-22T07:18:38.894526+0000","last_peered":"2024-04-22T07:18:38.894526+0000","last_clean":"2024-04-22T07:18:38.894526+0000","last_became_active":"2024-04-22T07:18:36.768507+0000","last_became_peered":"2024-04-22T07:18:36.768507+0000","last_unstale":"2024-04-22T07:18:38.894526+0000","last_undegraded":"2024-04-22T07:18:38.894526+0000","last_fullsized":"2024-04-22T07:18:38.894526+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:00:52.151755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.757456+0000","last_change":"2024-04-22T07:18:36.769407+0000","last_active":"2024-04-22T07:18:37.757456+0000","last_peered":"2024-04-22T07:18:37.757456+0000","last_clean":"2024-04-22T07:18:37.757456+0000","last_became_active":"2024-04-22T07:18:36.769114+0000","last_became_peered":"2024-04-22T07:18:36.769114+0000","last_unstale":"2024-04-22T07:18:37.757456+0000","last_undegraded":"2024-04-22T07:18:37.757456+0000","last_fullsized":"2024-04-22T07:18:37.757456+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:30:36.755201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.763835+0000","last_change":"2024-04-22T07:18:36.766539+0000","last_active":"2024-04-22T07:18:37.763835+0000","last_peered":"2024-04-22T07:18:37.763835+0000","last_clean":"2024-04-22T07:18:37.763835+0000","last_became_active":"2024-04-22T07:18:36.764865+0000","last_became_peered":"2024-04-22T07:18:36.764865+0000","last_unstale":"2024-04-22T07:18:37.763835+0000","last_undegraded":"2024-04-22T07:18:37.763835+0000","last_fullsized":"2024-04-22T07:18:37.763835+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:45:27.464772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.764360+0000","last_change":"2024-04-22T07:18:36.767174+0000","last_active":"2024-04-22T07:18:37.764360+0000","last_peered":"2024-04-22T07:18:37.764360+0000","last_clean":"2024-04-22T07:18:37.764360+0000","last_became_active":"2024-04-22T07:18:36.766083+0000","last_became_peered":"2024-04-22T07:18:36.766083+0000","last_unstale":"2024-04-22T07:18:37.764360+0000","last_undegraded":"2024-04-22T07:18:37.764360+0000","last_fullsized":"2024-04-22T07:18:37.764360+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:00:45.046782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:38.894453+0000","last_change":"2024-04-22T07:18:36.764432+0000","last_active":"2024-04-22T07:18:38.894453+0000","last_peered":"2024-04-22T07:18:38.894453+0000","last_clean":"2024-04-22T07:18:38.894453+0000","last_became_active":"2024-04-22T07:18:36.764113+0000","last_became_peered":"2024-04-22T07:18:36.764113+0000","last_unstale":"2024-04-22T07:18:38.894453+0000","last_undegraded":"2024-04-22T07:18:38.894453+0000","last_fullsized":"2024-04-22T07:18:38.894453+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:32:48.474033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.937223+0000","last_change":"2024-04-22T07:18:36.772138+0000","last_active":"2024-04-22T07:18:37.937223+0000","last_peered":"2024-04-22T07:18:37.937223+0000","last_clean":"2024-04-22T07:18:37.937223+0000","last_became_active":"2024-04-22T07:18:36.771878+0000","last_became_peered":"2024-04-22T07:18:36.771878+0000","last_unstale":"2024-04-22T07:18:37.937223+0000","last_undegraded":"2024-04-22T07:18:37.937223+0000","last_fullsized":"2024-04-22T07:18:37.937223+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:36:27.097452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:38.394042+0000","last_change":"2024-04-22T07:18:36.769528+0000","last_active":"2024-04-22T07:18:38.394042+0000","last_peered":"2024-04-22T07:18:38.394042+0000","last_clean":"2024-04-22T07:18:38.394042+0000","last_became_active":"2024-04-22T07:18:36.769240+0000","last_became_peered":"2024-04-22T07:18:36.769240+0000","last_unstale":"2024-04-22T07:18:38.394042+0000","last_undegraded":"2024-04-22T07:18:38.394042+0000","last_fullsized":"2024-04-22T07:18:38.394042+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:09:08.040513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:38.894747+0000","last_change":"2024-04-22T07:18:36.766049+0000","last_active":"2024-04-22T07:18:38.894747+0000","last_peered":"2024-04-22T07:18:38.894747+0000","last_clean":"2024-04-22T07:18:38.894747+0000","last_became_active":"2024-04-22T07:18:36.765724+0000","last_became_peered":"2024-04-22T07:18:36.765724+0000","last_unstale":"2024-04-22T07:18:38.894747+0000","last_undegraded":"2024-04-22T07:18:38.894747+0000","last_fullsized":"2024-04-22T07:18:38.894747+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:32:20.374856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.763238+0000","last_change":"2024-04-22T07:18:36.765850+0000","last_active":"2024-04-22T07:18:37.763238+0000","last_peered":"2024-04-22T07:18:37.763238+0000","last_clean":"2024-04-22T07:18:37.763238+0000","last_became_active":"2024-04-22T07:18:36.765560+0000","last_became_peered":"2024-04-22T07:18:36.765560+0000","last_unstale":"2024-04-22T07:18:37.763238+0000","last_undegraded":"2024-04-22T07:18:37.763238+0000","last_fullsized":"2024-04-22T07:18:37.763238+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:30:36.755201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.767520+0000","last_change":"2024-04-22T07:18:36.769465+0000","last_active":"2024-04-22T07:18:37.767520+0000","last_peered":"2024-04-22T07:18:37.767520+0000","last_clean":"2024-04-22T07:18:37.767520+0000","last_became_active":"2024-04-22T07:18:36.769181+0000","last_became_peered":"2024-04-22T07:18:36.769181+0000","last_unstale":"2024-04-22T07:18:37.767520+0000","last_undegraded":"2024-04-22T07:18:37.767520+0000","last_fullsized":"2024-04-22T07:18:37.767520+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:51:10.038201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.764013+0000","last_change":"2024-04-22T07:18:36.763439+0000","last_active":"2024-04-22T07:18:37.764013+0000","last_peered":"2024-04-22T07:18:37.764013+0000","last_clean":"2024-04-22T07:18:37.764013+0000","last_became_active":"2024-04-22T07:18:36.763146+0000","last_became_peered":"2024-04-22T07:18:36.763146+0000","last_unstale":"2024-04-22T07:18:37.764013+0000","last_undegraded":"2024-04-22T07:18:37.764013+0000","last_fullsized":"2024-04-22T07:18:37.764013+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:18:59.298766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.768027+0000","last_change":"2024-04-22T07:18:36.769533+0000","last_active":"2024-04-22T07:18:37.768027+0000","last_peered":"2024-04-22T07:18:37.768027+0000","last_clean":"2024-04-22T07:18:37.768027+0000","last_became_active":"2024-04-22T07:18:36.769274+0000","last_became_peered":"2024-04-22T07:18:36.769274+0000","last_unstale":"2024-04-22T07:18:37.768027+0000","last_undegraded":"2024-04-22T07:18:37.768027+0000","last_fullsized":"2024-04-22T07:18:37.768027+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:03:50.228822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:38.394207+0000","last_change":"2024-04-22T07:18:36.763931+0000","last_active":"2024-04-22T07:18:38.394207+0000","last_peered":"2024-04-22T07:18:38.394207+0000","last_clean":"2024-04-22T07:18:38.394207+0000","last_became_active":"2024-04-22T07:18:36.763656+0000","last_became_peered":"2024-04-22T07:18:36.763656+0000","last_unstale":"2024-04-22T07:18:38.394207+0000","last_undegraded":"2024-04-22T07:18:38.394207+0000","last_fullsized":"2024-04-22T07:18:38.394207+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:22:58.884168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.757432+0000","last_change":"2024-04-22T07:18:36.767158+0000","last_active":"2024-04-22T07:18:37.757432+0000","last_peered":"2024-04-22T07:18:37.757432+0000","last_clean":"2024-04-22T07:18:37.757432+0000","last_became_active":"2024-04-22T07:18:36.766614+0000","last_became_peered":"2024-04-22T07:18:36.766614+0000","last_unstale":"2024-04-22T07:18:37.757432+0000","last_undegraded":"2024-04-22T07:18:37.757432+0000","last_fullsized":"2024-04-22T07:18:37.757432+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:44:30.785178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.767721+0000","last_change":"2024-04-22T07:18:36.773129+0000","last_active":"2024-04-22T07:18:37.767721+0000","last_peered":"2024-04-22T07:18:37.767721+0000","last_clean":"2024-04-22T07:18:37.767721+0000","last_became_active":"2024-04-22T07:18:36.772827+0000","last_became_peered":"2024-04-22T07:18:36.772827+0000","last_unstale":"2024-04-22T07:18:37.767721+0000","last_undegraded":"2024-04-22T07:18:37.767721+0000","last_fullsized":"2024-04-22T07:18:37.767721+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:45:27.464772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:38.894815+0000","last_change":"2024-04-22T07:18:36.763716+0000","last_active":"2024-04-22T07:18:38.894815+0000","last_peered":"2024-04-22T07:18:38.894815+0000","last_clean":"2024-04-22T07:18:38.894815+0000","last_became_active":"2024-04-22T07:18:36.762270+0000","last_became_peered":"2024-04-22T07:18:36.762270+0000","last_unstale":"2024-04-22T07:18:38.894815+0000","last_undegraded":"2024-04-22T07:18:38.894815+0000","last_fullsized":"2024-04-22T07:18:38.894815+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:23:03.787574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.763390+0000","last_change":"2024-04-22T07:18:36.764152+0000","last_active":"2024-04-22T07:18:37.763390+0000","last_peered":"2024-04-22T07:18:37.763390+0000","last_clean":"2024-04-22T07:18:37.763390+0000","last_became_active":"2024-04-22T07:18:36.763770+0000","last_became_peered":"2024-04-22T07:18:36.763770+0000","last_unstale":"2024-04-22T07:18:37.763390+0000","last_undegraded":"2024-04-22T07:18:37.763390+0000","last_fullsized":"2024-04-22T07:18:37.763390+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:22:58.884168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:38.894313+0000","last_change":"2024-04-22T07:18:36.771121+0000","last_active":"2024-04-22T07:18:38.894313+0000","last_peered":"2024-04-22T07:18:38.894313+0000","last_clean":"2024-04-22T07:18:38.894313+0000","last_became_active":"2024-04-22T07:18:36.770786+0000","last_became_peered":"2024-04-22T07:18:36.770786+0000","last_unstale":"2024-04-22T07:18:38.894313+0000","last_undegraded":"2024-04-22T07:18:38.894313+0000","last_fullsized":"2024-04-22T07:18:38.894313+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:45:15.213668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:38.393831+0000","last_change":"2024-04-22T07:18:36.765462+0000","last_active":"2024-04-22T07:18:38.393831+0000","last_peered":"2024-04-22T07:18:38.393831+0000","last_clean":"2024-04-22T07:18:38.393831+0000","last_became_active":"2024-04-22T07:18:36.765142+0000","last_became_peered":"2024-04-22T07:18:36.765142+0000","last_unstale":"2024-04-22T07:18:38.393831+0000","last_undegraded":"2024-04-22T07:18:38.393831+0000","last_fullsized":"2024-04-22T07:18:38.393831+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:32:20.374856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.763051+0000","last_change":"2024-04-22T07:18:36.768234+0000","last_active":"2024-04-22T07:18:37.763051+0000","last_peered":"2024-04-22T07:18:37.763051+0000","last_clean":"2024-04-22T07:18:37.763051+0000","last_became_active":"2024-04-22T07:18:36.767951+0000","last_became_peered":"2024-04-22T07:18:36.767951+0000","last_unstale":"2024-04-22T07:18:37.763051+0000","last_undegraded":"2024-04-22T07:18:37.763051+0000","last_fullsized":"2024-04-22T07:18:37.763051+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:08:05.611868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:39.604078+0000","last_change":"2024-04-22T07:18:35.751538+0000","last_active":"2024-04-22T07:18:39.604078+0000","last_peered":"2024-04-22T07:18:39.604078+0000","last_clean":"2024-04-22T07:18:39.604078+0000","last_became_active":"2024-04-22T07:18:35.751219+0000","last_became_peered":"2024-04-22T07:18:35.751219+0000","last_unstale":"2024-04-22T07:18:39.604078+0000","last_undegraded":"2024-04-22T07:18:39.604078+0000","last_fullsized":"2024-04-22T07:18:39.604078+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:00:10.289974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:38.894909+0000","last_change":"2024-04-22T07:18:36.757337+0000","last_active":"2024-04-22T07:18:38.894909+0000","last_peered":"2024-04-22T07:18:38.894909+0000","last_clean":"2024-04-22T07:18:38.894909+0000","last_became_active":"2024-04-22T07:18:36.757039+0000","last_became_peered":"2024-04-22T07:18:36.757039+0000","last_unstale":"2024-04-22T07:18:38.894909+0000","last_undegraded":"2024-04-22T07:18:38.894909+0000","last_fullsized":"2024-04-22T07:18:38.894909+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:09:08.040513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:39.601564+0000","last_change":"2024-04-22T07:18:35.746515+0000","last_active":"2024-04-22T07:18:39.601564+0000","last_peered":"2024-04-22T07:18:39.601564+0000","last_clean":"2024-04-22T07:18:39.601564+0000","last_became_active":"2024-04-22T07:18:35.746198+0000","last_became_peered":"2024-04-22T07:18:35.746198+0000","last_unstale":"2024-04-22T07:18:39.601564+0000","last_undegraded":"2024-04-22T07:18:39.601564+0000","last_fullsized":"2024-04-22T07:18:39.601564+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:43:54.682673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.767496+0000","last_change":"2024-04-22T07:18:35.752307+0000","last_active":"2024-04-22T07:18:37.767496+0000","last_peered":"2024-04-22T07:18:37.767496+0000","last_clean":"2024-04-22T07:18:37.767496+0000","last_became_active":"2024-04-22T07:18:35.751545+0000","last_became_peered":"2024-04-22T07:18:35.751545+0000","last_unstale":"2024-04-22T07:18:37.767496+0000","last_undegraded":"2024-04-22T07:18:37.767496+0000","last_fullsized":"2024-04-22T07:18:37.767496+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:21:55.316649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.767511+0000","last_change":"2024-04-22T07:18:36.772372+0000","last_active":"2024-04-22T07:18:37.767511+0000","last_peered":"2024-04-22T07:18:37.767511+0000","last_clean":"2024-04-22T07:18:37.767511+0000","last_became_active":"2024-04-22T07:18:36.772067+0000","last_became_peered":"2024-04-22T07:18:36.772067+0000","last_unstale":"2024-04-22T07:18:37.767511+0000","last_undegraded":"2024-04-22T07:18:37.767511+0000","last_fullsized":"2024-04-22T07:18:37.767511+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:44:30.785178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.764151+0000","last_change":"2024-04-22T07:18:35.740989+0000","last_active":"2024-04-22T07:18:37.764151+0000","last_peered":"2024-04-22T07:18:37.764151+0000","last_clean":"2024-04-22T07:18:37.764151+0000","last_became_active":"2024-04-22T07:18:35.740665+0000","last_became_peered":"2024-04-22T07:18:35.740665+0000","last_unstale":"2024-04-22T07:18:37.764151+0000","last_undegraded":"2024-04-22T07:18:37.764151+0000","last_fullsized":"2024-04-22T07:18:37.764151+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:00:10.289974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.757377+0000","last_change":"2024-04-22T07:18:36.767022+0000","last_active":"2024-04-22T07:18:37.757377+0000","last_peered":"2024-04-22T07:18:37.757377+0000","last_clean":"2024-04-22T07:18:37.757377+0000","last_became_active":"2024-04-22T07:18:36.766609+0000","last_became_peered":"2024-04-22T07:18:36.766609+0000","last_unstale":"2024-04-22T07:18:37.757377+0000","last_undegraded":"2024-04-22T07:18:37.757377+0000","last_fullsized":"2024-04-22T07:18:37.757377+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:32:20.374856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:38.394098+0000","last_change":"2024-04-22T07:18:35.752081+0000","last_active":"2024-04-22T07:18:38.394098+0000","last_peered":"2024-04-22T07:18:38.394098+0000","last_clean":"2024-04-22T07:18:38.394098+0000","last_became_active":"2024-04-22T07:18:35.751757+0000","last_became_peered":"2024-04-22T07:18:35.751757+0000","last_unstale":"2024-04-22T07:18:38.394098+0000","last_undegraded":"2024-04-22T07:18:38.394098+0000","last_fullsized":"2024-04-22T07:18:38.394098+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:21:55.316649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.764165+0000","last_change":"2024-04-22T07:18:36.765937+0000","last_active":"2024-04-22T07:18:37.764165+0000","last_peered":"2024-04-22T07:18:37.764165+0000","last_clean":"2024-04-22T07:18:37.764165+0000","last_became_active":"2024-04-22T07:18:36.765647+0000","last_became_peered":"2024-04-22T07:18:36.765647+0000","last_unstale":"2024-04-22T07:18:37.764165+0000","last_undegraded":"2024-04-22T07:18:37.764165+0000","last_fullsized":"2024-04-22T07:18:37.764165+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:59:57.688417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.763996+0000","last_change":"2024-04-22T07:18:35.747309+0000","last_active":"2024-04-22T07:18:37.763996+0000","last_peered":"2024-04-22T07:18:37.763996+0000","last_clean":"2024-04-22T07:18:37.763996+0000","last_became_active":"2024-04-22T07:18:35.747019+0000","last_became_peered":"2024-04-22T07:18:35.747019+0000","last_unstale":"2024-04-22T07:18:37.763996+0000","last_undegraded":"2024-04-22T07:18:37.763996+0000","last_fullsized":"2024-04-22T07:18:37.763996+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:21:55.316649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:38.895019+0000","last_change":"2024-04-22T07:18:36.763436+0000","last_active":"2024-04-22T07:18:38.895019+0000","last_peered":"2024-04-22T07:18:38.895019+0000","last_clean":"2024-04-22T07:18:38.895019+0000","last_became_active":"2024-04-22T07:18:36.763068+0000","last_became_peered":"2024-04-22T07:18:36.763068+0000","last_unstale":"2024-04-22T07:18:38.895019+0000","last_undegraded":"2024-04-22T07:18:38.895019+0000","last_fullsized":"2024-04-22T07:18:38.895019+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:22:58.884168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:41.767555+0000","last_change":"2024-04-22T07:18:35.750769+0000","last_active":"2024-04-22T07:18:41.767555+0000","last_peered":"2024-04-22T07:18:41.767555+0000","last_clean":"2024-04-22T07:18:41.767555+0000","last_became_active":"2024-04-22T07:18:35.750406+0000","last_became_peered":"2024-04-22T07:18:35.750406+0000","last_unstale":"2024-04-22T07:18:41.767555+0000","last_undegraded":"2024-04-22T07:18:41.767555+0000","last_fullsized":"2024-04-22T07:18:41.767555+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T19:09:20.529889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.763680+0000","last_change":"2024-04-22T07:18:36.767426+0000","last_active":"2024-04-22T07:18:37.763680+0000","last_peered":"2024-04-22T07:18:37.763680+0000","last_clean":"2024-04-22T07:18:37.763680+0000","last_became_active":"2024-04-22T07:18:36.767159+0000","last_became_peered":"2024-04-22T07:18:36.767159+0000","last_unstale":"2024-04-22T07:18:37.763680+0000","last_undegraded":"2024-04-22T07:18:37.763680+0000","last_fullsized":"2024-04-22T07:18:37.763680+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:19:49.652644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'7","reported_seq":21,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:41.770083+0000","last_change":"2024-04-22T07:18:35.752996+0000","last_active":"2024-04-22T07:18:41.770083+0000","last_peered":"2024-04-22T07:18:41.770083+0000","last_clean":"2024-04-22T07:18:41.770083+0000","last_became_active":"2024-04-22T07:18:35.752686+0000","last_became_peered":"2024-04-22T07:18:35.752686+0000","last_unstale":"2024-04-22T07:18:41.770083+0000","last_undegraded":"2024-04-22T07:18:41.770083+0000","last_fullsized":"2024-04-22T07:18:41.770083+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:36:55.684427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1868,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.937011+0000","last_change":"2024-04-22T07:18:36.767539+0000","last_active":"2024-04-22T07:18:37.937011+0000","last_peered":"2024-04-22T07:18:37.937011+0000","last_clean":"2024-04-22T07:18:37.937011+0000","last_became_active":"2024-04-22T07:18:36.767273+0000","last_became_peered":"2024-04-22T07:18:36.767273+0000","last_unstale":"2024-04-22T07:18:37.937011+0000","last_undegraded":"2024-04-22T07:18:37.937011+0000","last_fullsized":"2024-04-22T07:18:37.937011+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:03:50.228822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:41.764793+0000","last_change":"2024-04-22T07:18:35.752382+0000","last_active":"2024-04-22T07:18:41.764793+0000","last_peered":"2024-04-22T07:18:41.764793+0000","last_clean":"2024-04-22T07:18:41.764793+0000","last_became_active":"2024-04-22T07:18:35.752060+0000","last_became_peered":"2024-04-22T07:18:35.752060+0000","last_unstale":"2024-04-22T07:18:41.764793+0000","last_undegraded":"2024-04-22T07:18:41.764793+0000","last_fullsized":"2024-04-22T07:18:41.764793+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:31:33.559251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:38.894534+0000","last_change":"2024-04-22T07:18:36.764670+0000","last_active":"2024-04-22T07:18:38.894534+0000","last_peered":"2024-04-22T07:18:38.894534+0000","last_clean":"2024-04-22T07:18:38.894534+0000","last_became_active":"2024-04-22T07:18:36.763834+0000","last_became_peered":"2024-04-22T07:18:36.763834+0000","last_unstale":"2024-04-22T07:18:38.894534+0000","last_undegraded":"2024-04-22T07:18:38.894534+0000","last_fullsized":"2024-04-22T07:18:38.894534+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:41:20.703226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.763489+0000","last_change":"2024-04-22T07:18:35.752856+0000","last_active":"2024-04-22T07:18:37.763489+0000","last_peered":"2024-04-22T07:18:37.763489+0000","last_clean":"2024-04-22T07:18:37.763489+0000","last_became_active":"2024-04-22T07:18:35.752527+0000","last_became_peered":"2024-04-22T07:18:35.752527+0000","last_unstale":"2024-04-22T07:18:37.763489+0000","last_undegraded":"2024-04-22T07:18:37.763489+0000","last_fullsized":"2024-04-22T07:18:37.763489+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:40:59.305769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.937073+0000","last_change":"2024-04-22T07:18:36.769174+0000","last_active":"2024-04-22T07:18:37.937073+0000","last_peered":"2024-04-22T07:18:37.937073+0000","last_clean":"2024-04-22T07:18:37.937073+0000","last_became_active":"2024-04-22T07:18:36.768913+0000","last_became_peered":"2024-04-22T07:18:36.768913+0000","last_unstale":"2024-04-22T07:18:37.937073+0000","last_undegraded":"2024-04-22T07:18:37.937073+0000","last_fullsized":"2024-04-22T07:18:37.937073+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:45:42.674989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:38.393752+0000","last_change":"2024-04-22T07:18:35.749740+0000","last_active":"2024-04-22T07:18:38.393752+0000","last_peered":"2024-04-22T07:18:38.393752+0000","last_clean":"2024-04-22T07:18:38.393752+0000","last_became_active":"2024-04-22T07:18:35.749453+0000","last_became_peered":"2024-04-22T07:18:35.749453+0000","last_unstale":"2024-04-22T07:18:38.393752+0000","last_undegraded":"2024-04-22T07:18:38.393752+0000","last_fullsized":"2024-04-22T07:18:38.393752+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:08:04.608018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:38.393952+0000","last_change":"2024-04-22T07:18:36.771940+0000","last_active":"2024-04-22T07:18:38.393952+0000","last_peered":"2024-04-22T07:18:38.393952+0000","last_clean":"2024-04-22T07:18:38.393952+0000","last_became_active":"2024-04-22T07:18:36.771548+0000","last_became_peered":"2024-04-22T07:18:36.771548+0000","last_unstale":"2024-04-22T07:18:38.393952+0000","last_undegraded":"2024-04-22T07:18:38.393952+0000","last_fullsized":"2024-04-22T07:18:38.393952+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:23:03.787574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:41.765466+0000","last_change":"2024-04-22T07:18:35.749047+0000","last_active":"2024-04-22T07:18:41.765466+0000","last_peered":"2024-04-22T07:18:41.765466+0000","last_clean":"2024-04-22T07:18:41.765466+0000","last_became_active":"2024-04-22T07:18:35.748757+0000","last_became_peered":"2024-04-22T07:18:35.748757+0000","last_unstale":"2024-04-22T07:18:41.765466+0000","last_undegraded":"2024-04-22T07:18:41.765466+0000","last_fullsized":"2024-04-22T07:18:41.765466+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:40:59.305769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.936788+0000","last_change":"2024-04-22T07:18:36.769894+0000","last_active":"2024-04-22T07:18:37.936788+0000","last_peered":"2024-04-22T07:18:37.936788+0000","last_clean":"2024-04-22T07:18:37.936788+0000","last_became_active":"2024-04-22T07:18:36.768702+0000","last_became_peered":"2024-04-22T07:18:36.768702+0000","last_unstale":"2024-04-22T07:18:37.936788+0000","last_undegraded":"2024-04-22T07:18:37.936788+0000","last_fullsized":"2024-04-22T07:18:37.936788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:36:53.716397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:39.598923+0000","last_change":"2024-04-22T07:18:35.747536+0000","last_active":"2024-04-22T07:18:39.598923+0000","last_peered":"2024-04-22T07:18:39.598923+0000","last_clean":"2024-04-22T07:18:39.598923+0000","last_became_active":"2024-04-22T07:18:35.747271+0000","last_became_peered":"2024-04-22T07:18:35.747271+0000","last_unstale":"2024-04-22T07:18:39.598923+0000","last_undegraded":"2024-04-22T07:18:39.598923+0000","last_fullsized":"2024-04-22T07:18:39.598923+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:51:11.593642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.937304+0000","last_change":"2024-04-22T07:18:36.773033+0000","last_active":"2024-04-22T07:18:37.937304+0000","last_peered":"2024-04-22T07:18:37.937304+0000","last_clean":"2024-04-22T07:18:37.937304+0000","last_became_active":"2024-04-22T07:18:36.772537+0000","last_became_peered":"2024-04-22T07:18:36.772537+0000","last_unstale":"2024-04-22T07:18:37.937304+0000","last_undegraded":"2024-04-22T07:18:37.937304+0000","last_fullsized":"2024-04-22T07:18:37.937304+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:58:41.509248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:41.763188+0000","last_change":"2024-04-22T07:18:35.747533+0000","last_active":"2024-04-22T07:18:41.763188+0000","last_peered":"2024-04-22T07:18:41.763188+0000","last_clean":"2024-04-22T07:18:41.763188+0000","last_became_active":"2024-04-22T07:18:35.746881+0000","last_became_peered":"2024-04-22T07:18:35.746881+0000","last_unstale":"2024-04-22T07:18:41.763188+0000","last_undegraded":"2024-04-22T07:18:41.763188+0000","last_fullsized":"2024-04-22T07:18:41.763188+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:43:54.682673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.937347+0000","last_change":"2024-04-22T07:18:36.773723+0000","last_active":"2024-04-22T07:18:37.937347+0000","last_peered":"2024-04-22T07:18:37.937347+0000","last_clean":"2024-04-22T07:18:37.937347+0000","last_became_active":"2024-04-22T07:18:36.773466+0000","last_became_peered":"2024-04-22T07:18:36.773466+0000","last_unstale":"2024-04-22T07:18:37.937347+0000","last_undegraded":"2024-04-22T07:18:37.937347+0000","last_fullsized":"2024-04-22T07:18:37.937347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:42:20.611744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:39.603975+0000","last_change":"2024-04-22T07:18:35.750360+0000","last_active":"2024-04-22T07:18:39.603975+0000","last_peered":"2024-04-22T07:18:39.603975+0000","last_clean":"2024-04-22T07:18:39.603975+0000","last_became_active":"2024-04-22T07:18:35.749984+0000","last_became_peered":"2024-04-22T07:18:35.749984+0000","last_unstale":"2024-04-22T07:18:39.603975+0000","last_undegraded":"2024-04-22T07:18:39.603975+0000","last_fullsized":"2024-04-22T07:18:39.603975+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:19:48.648793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.764298+0000","last_change":"2024-04-22T07:18:36.765767+0000","last_active":"2024-04-22T07:18:37.764298+0000","last_peered":"2024-04-22T07:18:37.764298+0000","last_clean":"2024-04-22T07:18:37.764298+0000","last_became_active":"2024-04-22T07:18:36.764218+0000","last_became_peered":"2024-04-22T07:18:36.764218+0000","last_unstale":"2024-04-22T07:18:37.764298+0000","last_undegraded":"2024-04-22T07:18:37.764298+0000","last_fullsized":"2024-04-22T07:18:37.764298+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:45:42.674989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:38.894330+0000","last_change":"2024-04-22T07:18:35.743323+0000","last_active":"2024-04-22T07:18:38.894330+0000","last_peered":"2024-04-22T07:18:38.894330+0000","last_clean":"2024-04-22T07:18:38.894330+0000","last_became_active":"2024-04-22T07:18:35.743023+0000","last_became_peered":"2024-04-22T07:18:35.743023+0000","last_unstale":"2024-04-22T07:18:38.894330+0000","last_undegraded":"2024-04-22T07:18:38.894330+0000","last_fullsized":"2024-04-22T07:18:38.894330+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:08:04.608018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.937037+0000","last_change":"2024-04-22T07:18:36.771073+0000","last_active":"2024-04-22T07:18:37.937037+0000","last_peered":"2024-04-22T07:18:37.937037+0000","last_clean":"2024-04-22T07:18:37.937037+0000","last_became_active":"2024-04-22T07:18:36.770678+0000","last_became_peered":"2024-04-22T07:18:36.770678+0000","last_unstale":"2024-04-22T07:18:37.937037+0000","last_undegraded":"2024-04-22T07:18:37.937037+0000","last_fullsized":"2024-04-22T07:18:37.937037+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:59:57.688417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":170,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.936801+0000","last_change":"2024-04-22T07:18:26.518190+0000","last_active":"2024-04-22T07:18:37.936801+0000","last_peered":"2024-04-22T07:18:37.936801+0000","last_clean":"2024-04-22T07:18:37.936801+0000","last_became_active":"2024-04-22T07:18:26.515489+0000","last_became_peered":"2024-04-22T07:18:26.515489+0000","last_unstale":"2024-04-22T07:18:37.936801+0000","last_undegraded":"2024-04-22T07:18:37.936801+0000","last_fullsized":"2024-04-22T07:18:37.936801+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:24.652061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:24.652061+0000","last_clean_scrub_stamp":"2024-04-22T07:18:24.652061+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:32:54.875706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.762947+0000","last_change":"2024-04-22T07:18:35.748477+0000","last_active":"2024-04-22T07:18:37.762947+0000","last_peered":"2024-04-22T07:18:37.762947+0000","last_clean":"2024-04-22T07:18:37.762947+0000","last_became_active":"2024-04-22T07:18:35.748176+0000","last_became_peered":"2024-04-22T07:18:35.748176+0000","last_unstale":"2024-04-22T07:18:37.762947+0000","last_undegraded":"2024-04-22T07:18:37.762947+0000","last_fullsized":"2024-04-22T07:18:37.762947+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:36:55.684427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.767642+0000","last_change":"2024-04-22T07:18:36.771870+0000","last_active":"2024-04-22T07:18:37.767642+0000","last_peered":"2024-04-22T07:18:37.767642+0000","last_clean":"2024-04-22T07:18:37.767642+0000","last_became_active":"2024-04-22T07:18:36.771583+0000","last_became_peered":"2024-04-22T07:18:36.771583+0000","last_unstale":"2024-04-22T07:18:37.767642+0000","last_undegraded":"2024-04-22T07:18:37.767642+0000","last_fullsized":"2024-04-22T07:18:37.767642+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:22:58.884168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.936652+0000","last_change":"2024-04-22T07:18:35.755668+0000","last_active":"2024-04-22T07:18:37.936652+0000","last_peered":"2024-04-22T07:18:37.936652+0000","last_clean":"2024-04-22T07:18:37.936652+0000","last_became_active":"2024-04-22T07:18:35.755471+0000","last_became_peered":"2024-04-22T07:18:35.755471+0000","last_unstale":"2024-04-22T07:18:37.936652+0000","last_undegraded":"2024-04-22T07:18:37.936652+0000","last_fullsized":"2024-04-22T07:18:37.936652+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:36:55.684427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:38.894300+0000","last_change":"2024-04-22T07:18:36.758204+0000","last_active":"2024-04-22T07:18:38.894300+0000","last_peered":"2024-04-22T07:18:38.894300+0000","last_clean":"2024-04-22T07:18:38.894300+0000","last_became_active":"2024-04-22T07:18:36.757841+0000","last_became_peered":"2024-04-22T07:18:36.757841+0000","last_unstale":"2024-04-22T07:18:38.894300+0000","last_undegraded":"2024-04-22T07:18:38.894300+0000","last_fullsized":"2024-04-22T07:18:38.894300+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:43:09.058016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:38.894236+0000","last_change":"2024-04-22T07:18:35.746686+0000","last_active":"2024-04-22T07:18:38.894236+0000","last_peered":"2024-04-22T07:18:38.894236+0000","last_clean":"2024-04-22T07:18:38.894236+0000","last_became_active":"2024-04-22T07:18:35.746371+0000","last_became_peered":"2024-04-22T07:18:35.746371+0000","last_unstale":"2024-04-22T07:18:38.894236+0000","last_undegraded":"2024-04-22T07:18:38.894236+0000","last_fullsized":"2024-04-22T07:18:38.894236+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:36:55.684427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.757383+0000","last_change":"2024-04-22T07:18:36.765985+0000","last_active":"2024-04-22T07:18:37.757383+0000","last_peered":"2024-04-22T07:18:37.757383+0000","last_clean":"2024-04-22T07:18:37.757383+0000","last_became_active":"2024-04-22T07:18:36.765661+0000","last_became_peered":"2024-04-22T07:18:36.765661+0000","last_unstale":"2024-04-22T07:18:37.757383+0000","last_undegraded":"2024-04-22T07:18:37.757383+0000","last_fullsized":"2024-04-22T07:18:37.757383+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:23:03.787574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.763585+0000","last_change":"2024-04-22T07:18:35.754160+0000","last_active":"2024-04-22T07:18:37.763585+0000","last_peered":"2024-04-22T07:18:37.763585+0000","last_clean":"2024-04-22T07:18:37.763585+0000","last_became_active":"2024-04-22T07:18:35.753860+0000","last_became_peered":"2024-04-22T07:18:35.753860+0000","last_unstale":"2024-04-22T07:18:37.763585+0000","last_undegraded":"2024-04-22T07:18:37.763585+0000","last_fullsized":"2024-04-22T07:18:37.763585+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:08:04.608018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.763400+0000","last_change":"2024-04-22T07:18:36.762349+0000","last_active":"2024-04-22T07:18:37.763400+0000","last_peered":"2024-04-22T07:18:37.763400+0000","last_clean":"2024-04-22T07:18:37.763400+0000","last_became_active":"2024-04-22T07:18:36.762097+0000","last_became_peered":"2024-04-22T07:18:36.762097+0000","last_unstale":"2024-04-22T07:18:37.763400+0000","last_undegraded":"2024-04-22T07:18:37.763400+0000","last_fullsized":"2024-04-22T07:18:37.763400+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:43:55.686523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.757304+0000","last_change":"2024-04-22T07:18:35.758810+0000","last_active":"2024-04-22T07:18:37.757304+0000","last_peered":"2024-04-22T07:18:37.757304+0000","last_clean":"2024-04-22T07:18:37.757304+0000","last_became_active":"2024-04-22T07:18:35.758521+0000","last_became_peered":"2024-04-22T07:18:35.758521+0000","last_unstale":"2024-04-22T07:18:37.757304+0000","last_undegraded":"2024-04-22T07:18:37.757304+0000","last_fullsized":"2024-04-22T07:18:37.757304+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:40:59.305769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.764371+0000","last_change":"2024-04-22T07:18:36.764448+0000","last_active":"2024-04-22T07:18:37.764371+0000","last_peered":"2024-04-22T07:18:37.764371+0000","last_clean":"2024-04-22T07:18:37.764371+0000","last_became_active":"2024-04-22T07:18:36.763728+0000","last_became_peered":"2024-04-22T07:18:36.763728+0000","last_unstale":"2024-04-22T07:18:37.764371+0000","last_undegraded":"2024-04-22T07:18:37.764371+0000","last_fullsized":"2024-04-22T07:18:37.764371+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:58:41.509248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.937270+0000","last_change":"2024-04-22T07:18:35.758980+0000","last_active":"2024-04-22T07:18:37.937270+0000","last_peered":"2024-04-22T07:18:37.937270+0000","last_clean":"2024-04-22T07:18:37.937270+0000","last_became_active":"2024-04-22T07:18:35.758674+0000","last_became_peered":"2024-04-22T07:18:35.758674+0000","last_unstale":"2024-04-22T07:18:37.937270+0000","last_undegraded":"2024-04-22T07:18:37.937270+0000","last_fullsized":"2024-04-22T07:18:37.937270+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:45:14.209818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.757443+0000","last_change":"2024-04-22T07:18:36.772908+0000","last_active":"2024-04-22T07:18:37.757443+0000","last_peered":"2024-04-22T07:18:37.757443+0000","last_clean":"2024-04-22T07:18:37.757443+0000","last_became_active":"2024-04-22T07:18:36.772636+0000","last_became_peered":"2024-04-22T07:18:36.772636+0000","last_unstale":"2024-04-22T07:18:37.757443+0000","last_undegraded":"2024-04-22T07:18:37.757443+0000","last_fullsized":"2024-04-22T07:18:37.757443+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:51:10.038201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:39.603989+0000","last_change":"2024-04-22T07:18:35.753595+0000","last_active":"2024-04-22T07:18:39.603989+0000","last_peered":"2024-04-22T07:18:39.603989+0000","last_clean":"2024-04-22T07:18:39.603989+0000","last_became_active":"2024-04-22T07:18:35.753295+0000","last_became_peered":"2024-04-22T07:18:35.753295+0000","last_unstale":"2024-04-22T07:18:39.603989+0000","last_undegraded":"2024-04-22T07:18:39.603989+0000","last_fullsized":"2024-04-22T07:18:39.603989+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:08:04.608018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.768028+0000","last_change":"2024-04-22T07:18:36.768580+0000","last_active":"2024-04-22T07:18:37.768028+0000","last_peered":"2024-04-22T07:18:37.768028+0000","last_clean":"2024-04-22T07:18:37.768028+0000","last_became_active":"2024-04-22T07:18:36.767702+0000","last_became_peered":"2024-04-22T07:18:36.767702+0000","last_unstale":"2024-04-22T07:18:37.768028+0000","last_undegraded":"2024-04-22T07:18:37.768028+0000","last_fullsized":"2024-04-22T07:18:37.768028+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:59:57.688417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:41.768034+0000","last_change":"2024-04-22T07:18:35.751692+0000","last_active":"2024-04-22T07:18:41.768034+0000","last_peered":"2024-04-22T07:18:41.768034+0000","last_clean":"2024-04-22T07:18:41.768034+0000","last_became_active":"2024-04-22T07:18:35.751393+0000","last_became_peered":"2024-04-22T07:18:35.751393+0000","last_unstale":"2024-04-22T07:18:41.768034+0000","last_undegraded":"2024-04-22T07:18:41.768034+0000","last_fullsized":"2024-04-22T07:18:41.768034+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:40:59.305769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:38.894956+0000","last_change":"2024-04-22T07:18:36.768532+0000","last_active":"2024-04-22T07:18:38.894956+0000","last_peered":"2024-04-22T07:18:38.894956+0000","last_clean":"2024-04-22T07:18:38.894956+0000","last_became_active":"2024-04-22T07:18:36.768253+0000","last_became_peered":"2024-04-22T07:18:36.768253+0000","last_unstale":"2024-04-22T07:18:38.894956+0000","last_undegraded":"2024-04-22T07:18:38.894956+0000","last_fullsized":"2024-04-22T07:18:38.894956+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:30:36.755201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.936651+0000","last_change":"2024-04-22T07:18:35.758702+0000","last_active":"2024-04-22T07:18:37.936651+0000","last_peered":"2024-04-22T07:18:37.936651+0000","last_clean":"2024-04-22T07:18:37.936651+0000","last_became_active":"2024-04-22T07:18:35.758415+0000","last_became_peered":"2024-04-22T07:18:35.758415+0000","last_unstale":"2024-04-22T07:18:37.936651+0000","last_undegraded":"2024-04-22T07:18:37.936651+0000","last_fullsized":"2024-04-22T07:18:37.936651+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:08:04.608018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.763191+0000","last_change":"2024-04-22T07:18:36.763053+0000","last_active":"2024-04-22T07:18:37.763191+0000","last_peered":"2024-04-22T07:18:37.763191+0000","last_clean":"2024-04-22T07:18:37.763191+0000","last_became_active":"2024-04-22T07:18:36.762546+0000","last_became_peered":"2024-04-22T07:18:36.762546+0000","last_unstale":"2024-04-22T07:18:37.763191+0000","last_undegraded":"2024-04-22T07:18:37.763191+0000","last_fullsized":"2024-04-22T07:18:37.763191+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:36:56.688277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.757534+0000","last_change":"2024-04-22T07:18:35.748837+0000","last_active":"2024-04-22T07:18:37.757534+0000","last_peered":"2024-04-22T07:18:37.757534+0000","last_clean":"2024-04-22T07:18:37.757534+0000","last_became_active":"2024-04-22T07:18:35.748080+0000","last_became_peered":"2024-04-22T07:18:35.748080+0000","last_unstale":"2024-04-22T07:18:37.757534+0000","last_undegraded":"2024-04-22T07:18:37.757534+0000","last_fullsized":"2024-04-22T07:18:37.757534+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:36:55.684427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.767568+0000","last_change":"2024-04-22T07:18:36.769911+0000","last_active":"2024-04-22T07:18:37.767568+0000","last_peered":"2024-04-22T07:18:37.767568+0000","last_clean":"2024-04-22T07:18:37.767568+0000","last_became_active":"2024-04-22T07:18:36.768682+0000","last_became_peered":"2024-04-22T07:18:36.768682+0000","last_unstale":"2024-04-22T07:18:37.767568+0000","last_undegraded":"2024-04-22T07:18:37.767568+0000","last_fullsized":"2024-04-22T07:18:37.767568+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:30:36.755201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.757319+0000","last_change":"2024-04-22T07:18:35.753066+0000","last_active":"2024-04-22T07:18:37.757319+0000","last_peered":"2024-04-22T07:18:37.757319+0000","last_clean":"2024-04-22T07:18:37.757319+0000","last_became_active":"2024-04-22T07:18:35.752804+0000","last_became_peered":"2024-04-22T07:18:35.752804+0000","last_unstale":"2024-04-22T07:18:37.757319+0000","last_undegraded":"2024-04-22T07:18:37.757319+0000","last_fullsized":"2024-04-22T07:18:37.757319+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:43:54.682673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.767652+0000","last_change":"2024-04-22T07:18:36.774790+0000","last_active":"2024-04-22T07:18:37.767652+0000","last_peered":"2024-04-22T07:18:37.767652+0000","last_clean":"2024-04-22T07:18:37.767652+0000","last_became_active":"2024-04-22T07:18:36.774479+0000","last_became_peered":"2024-04-22T07:18:36.774479+0000","last_unstale":"2024-04-22T07:18:37.767652+0000","last_undegraded":"2024-04-22T07:18:37.767652+0000","last_fullsized":"2024-04-22T07:18:37.767652+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:36:53.716397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:41.767713+0000","last_change":"2024-04-22T07:18:35.754440+0000","last_active":"2024-04-22T07:18:41.767713+0000","last_peered":"2024-04-22T07:18:41.767713+0000","last_clean":"2024-04-22T07:18:41.767713+0000","last_became_active":"2024-04-22T07:18:35.754137+0000","last_became_peered":"2024-04-22T07:18:35.754137+0000","last_unstale":"2024-04-22T07:18:41.767713+0000","last_undegraded":"2024-04-22T07:18:41.767713+0000","last_fullsized":"2024-04-22T07:18:41.767713+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T19:09:20.529889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:38.393947+0000","last_change":"2024-04-22T07:18:36.759585+0000","last_active":"2024-04-22T07:18:38.393947+0000","last_peered":"2024-04-22T07:18:38.393947+0000","last_clean":"2024-04-22T07:18:38.393947+0000","last_became_active":"2024-04-22T07:18:36.759342+0000","last_became_peered":"2024-04-22T07:18:36.759342+0000","last_unstale":"2024-04-22T07:18:38.393947+0000","last_undegraded":"2024-04-22T07:18:38.393947+0000","last_fullsized":"2024-04-22T07:18:38.393947+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:44:30.785178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.764337+0000","last_change":"2024-04-22T07:18:36.762665+0000","last_active":"2024-04-22T07:18:37.764337+0000","last_peered":"2024-04-22T07:18:37.764337+0000","last_clean":"2024-04-22T07:18:37.764337+0000","last_became_active":"2024-04-22T07:18:36.762392+0000","last_became_peered":"2024-04-22T07:18:36.762392+0000","last_unstale":"2024-04-22T07:18:37.764337+0000","last_undegraded":"2024-04-22T07:18:37.764337+0000","last_fullsized":"2024-04-22T07:18:37.764337+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:36:27.097452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:41.767658+0000","last_change":"2024-04-22T07:18:35.755160+0000","last_active":"2024-04-22T07:18:41.767658+0000","last_peered":"2024-04-22T07:18:41.767658+0000","last_clean":"2024-04-22T07:18:41.767658+0000","last_became_active":"2024-04-22T07:18:35.754877+0000","last_became_peered":"2024-04-22T07:18:35.754877+0000","last_unstale":"2024-04-22T07:18:41.767658+0000","last_undegraded":"2024-04-22T07:18:41.767658+0000","last_fullsized":"2024-04-22T07:18:41.767658+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:43:54.682673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.764098+0000","last_change":"2024-04-22T07:18:36.761534+0000","last_active":"2024-04-22T07:18:37.764098+0000","last_peered":"2024-04-22T07:18:37.764098+0000","last_clean":"2024-04-22T07:18:37.764098+0000","last_became_active":"2024-04-22T07:18:36.761181+0000","last_became_peered":"2024-04-22T07:18:36.761181+0000","last_unstale":"2024-04-22T07:18:37.764098+0000","last_undegraded":"2024-04-22T07:18:37.764098+0000","last_fullsized":"2024-04-22T07:18:37.764098+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:03:50.228822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:41.767397+0000","last_change":"2024-04-22T07:18:35.752282+0000","last_active":"2024-04-22T07:18:41.767397+0000","last_peered":"2024-04-22T07:18:41.767397+0000","last_clean":"2024-04-22T07:18:41.767397+0000","last_became_active":"2024-04-22T07:18:35.751866+0000","last_became_peered":"2024-04-22T07:18:35.751866+0000","last_unstale":"2024-04-22T07:18:41.767397+0000","last_undegraded":"2024-04-22T07:18:41.767397+0000","last_fullsized":"2024-04-22T07:18:41.767397+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:19:48.648793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:38.894862+0000","last_change":"2024-04-22T07:18:36.763229+0000","last_active":"2024-04-22T07:18:38.894862+0000","last_peered":"2024-04-22T07:18:38.894862+0000","last_clean":"2024-04-22T07:18:38.894862+0000","last_became_active":"2024-04-22T07:18:36.762882+0000","last_became_peered":"2024-04-22T07:18:36.762882+0000","last_unstale":"2024-04-22T07:18:38.894862+0000","last_undegraded":"2024-04-22T07:18:38.894862+0000","last_fullsized":"2024-04-22T07:18:38.894862+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:44:30.785178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:39.604104+0000","last_change":"2024-04-22T07:18:35.758820+0000","last_active":"2024-04-22T07:18:39.604104+0000","last_peered":"2024-04-22T07:18:39.604104+0000","last_clean":"2024-04-22T07:18:39.604104+0000","last_became_active":"2024-04-22T07:18:35.758514+0000","last_became_peered":"2024-04-22T07:18:35.758514+0000","last_unstale":"2024-04-22T07:18:39.604104+0000","last_undegraded":"2024-04-22T07:18:39.604104+0000","last_fullsized":"2024-04-22T07:18:39.604104+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:40:59.305769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:37.767960+0000","last_change":"2024-04-22T07:18:36.768383+0000","last_active":"2024-04-22T07:18:37.767960+0000","last_peered":"2024-04-22T07:18:37.767960+0000","last_clean":"2024-04-22T07:18:37.767960+0000","last_became_active":"2024-04-22T07:18:36.767779+0000","last_became_peered":"2024-04-22T07:18:36.767779+0000","last_unstale":"2024-04-22T07:18:37.767960+0000","last_undegraded":"2024-04-22T07:18:37.767960+0000","last_fullsized":"2024-04-22T07:18:37.767960+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:18:59.298766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-22T07:18:41.768431+0000","last_change":"2024-04-22T07:18:35.754117+0000","last_active":"2024-04-22T07:18:41.768431+0000","last_peered":"2024-04-22T07:18:41.768431+0000","last_clean":"2024-04-22T07:18:41.768431+0000","last_became_active":"2024-04-22T07:18:35.753833+0000","last_became_peered":"2024-04-22T07:18:35.753833+0000","last_unstale":"2024-04-22T07:18:41.768431+0000","last_undegraded":"2024-04-22T07:18:41.768431+0000","last_fullsized":"2024-04-22T07:18:41.768431+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:54:03.123665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2666,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":5332,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":40,"ondisk_log_size":40,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574859,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27800,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344040,"statfs":{"total":96636764160,"available":96608296960,"internally_reserved":0,"allocated":802816,"data_stored":661884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574858,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":217088,"data_stored":72802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574858,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":208896,"data_stored":71024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574858,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":217088,"data_stored":71060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574859,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":217088,"data_stored":72802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574858,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27216,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":204800,"data_stored":70934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574859,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":212992,"data_stored":71094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574858,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":811008,"data_stored":661940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1868,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1868,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-22T07:18:57.442 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-22T07:18:57.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.578+0000 7fccf80d2640 1 Processor -- start 2024-04-22T07:18:57.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.578+0000 7fccf80d2640 1 -- start start 2024-04-22T07:18:57.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.579+0000 7fccf80d2640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fccf01552f0 0x7fccf00cb430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:57.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.579+0000 7fccf80d2640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fccf00b38f0 0x7fccf015aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:57.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.579+0000 7fccf80d2640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fccf015f280 con 0x7fccf015b3f0 2024-04-22T07:18:57.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.579+0000 7fccf80d2640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fccf00b3100 con 0x7fccf01552f0 2024-04-22T07:18:57.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.579+0000 7fccf80d2640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fccf00cda00 con 0x7fccf00b38f0 2024-04-22T07:18:57.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.579+0000 7fccf5e6e640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fccf01552f0 0x7fccf00cb430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:57.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.579+0000 7fccf5e6e640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fccf01552f0 0x7fccf00cb430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39548/0 (socket says 172.21.15.37:39548) 2024-04-22T07:18:57.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.579+0000 7fccf5e6e640 1 -- 172.21.15.37:0/1190242980 learned_addr learned my addr 172.21.15.37:0/1190242980 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:18:57.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.579+0000 7fccf566d640 1 --2- 172.21.15.37:0/1190242980 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fccf00b38f0 0x7fccf015aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:57.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.579+0000 7fccf5e6e640 1 -- 172.21.15.37:0/1190242980 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fccf00b38f0 msgr2=0x7fccf015aeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:18:57.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.579+0000 7fccf5e6e640 1 --2- 172.21.15.37:0/1190242980 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fccf00b38f0 0x7fccf015aeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:57.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.579+0000 7fccf5e6e640 1 -- 172.21.15.37:0/1190242980 >> v1:172.21.15.196:6789/0 conn(0x7fccf015b3f0 legacy=0x7fccf00ccd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:57.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.579+0000 7fccf5e6e640 1 -- 172.21.15.37:0/1190242980 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccf00b3350 con 0x7fccf01552f0 2024-04-22T07:18:57.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.580+0000 7fccf5e6e640 1 --2- 172.21.15.37:0/1190242980 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fccf01552f0 0x7fccf00cb430 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fccec009870 tx=0x7fccec02b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5725bef581c96fb server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:57.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.580+0000 7fccf4e6c640 1 -- 172.21.15.37:0/1190242980 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccec034070 con 0x7fccf01552f0 2024-04-22T07:18:57.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.580+0000 7fccf4e6c640 1 -- 172.21.15.37:0/1190242980 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fccec030840 con 0x7fccf01552f0 2024-04-22T07:18:57.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.580+0000 7fccf4e6c640 1 -- 172.21.15.37:0/1190242980 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccec030c10 con 0x7fccf01552f0 2024-04-22T07:18:57.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.581+0000 7fccf80d2640 1 -- 172.21.15.37:0/1190242980 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fccf01552f0 msgr2=0x7fccf00cb430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:57.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.581+0000 7fccf80d2640 1 --2- 172.21.15.37:0/1190242980 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fccf01552f0 0x7fccf00cb430 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fccec009870 tx=0x7fccec02b980 comp rx=0 tx=0).stop 2024-04-22T07:18:57.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.581+0000 7fccf80d2640 1 -- 172.21.15.37:0/1190242980 shutdown_connections 2024-04-22T07:18:57.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.581+0000 7fccf80d2640 1 --2- 172.21.15.37:0/1190242980 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fccf00b38f0 0x7fccf015aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:57.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.581+0000 7fccf80d2640 1 --2- 172.21.15.37:0/1190242980 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fccf01552f0 0x7fccf00cb430 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:57.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.581+0000 7fccf80d2640 1 -- 172.21.15.37:0/1190242980 >> 172.21.15.37:0/1190242980 conn(0x7fccf0071f90 msgr2=0x7fccf00723a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:57.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.581+0000 7fccf80d2640 1 -- 172.21.15.37:0/1190242980 shutdown_connections 2024-04-22T07:18:57.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.581+0000 7fccf80d2640 1 -- 172.21.15.37:0/1190242980 wait complete. 2024-04-22T07:18:57.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.582+0000 7fccf80d2640 1 Processor -- start 2024-04-22T07:18:57.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.582+0000 7fccf80d2640 1 -- start start 2024-04-22T07:18:57.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.583+0000 7fccf80d2640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fccf00b38f0 0x7fccf01519c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:57.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.583+0000 7fccf80d2640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fccf01552f0 0x7fccf014cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:57.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.583+0000 7fccf80d2640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fccf015b3f0 0x7fccf014d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:57.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.583+0000 7fccf80d2640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fccf015e7a0 con 0x7fccf015b3f0 2024-04-22T07:18:57.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.583+0000 7fccf80d2640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fccf015e4c0 con 0x7fccf01552f0 2024-04-22T07:18:57.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.583+0000 7fccf80d2640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fccf015ea80 con 0x7fccf00b38f0 2024-04-22T07:18:57.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.583+0000 7fccf666f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fccf015b3f0 0x7fccf014d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:57.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.583+0000 7fccf666f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fccf015b3f0 0x7fccf014d180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39558/0 (socket says 172.21.15.37:39558) 2024-04-22T07:18:57.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.583+0000 7fccf666f640 1 -- 172.21.15.37:0/4041705632 learned_addr learned my addr 172.21.15.37:0/4041705632 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:18:57.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.583+0000 7fccf566d640 1 --2- 172.21.15.37:0/4041705632 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fccf01552f0 0x7fccf014cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:57.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.583+0000 7fccf5e6e640 1 --2- 172.21.15.37:0/4041705632 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fccf00b38f0 0x7fccf01519c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:57.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.583+0000 7fccf666f640 1 -- 172.21.15.37:0/4041705632 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fccf00b38f0 msgr2=0x7fccf01519c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:57.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.583+0000 7fccf666f640 1 --2- 172.21.15.37:0/4041705632 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fccf00b38f0 0x7fccf01519c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:57.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.583+0000 7fccf666f640 1 -- 172.21.15.37:0/4041705632 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fccf01552f0 msgr2=0x7fccf014cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:57.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.583+0000 7fccf666f640 1 --2- 172.21.15.37:0/4041705632 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fccf01552f0 0x7fccf014cc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:57.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.583+0000 7fccf666f640 1 -- 172.21.15.37:0/4041705632 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccf01562c0 con 0x7fccf015b3f0 2024-04-22T07:18:57.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.583+0000 7fccf666f640 1 --2- 172.21.15.37:0/4041705632 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fccf015b3f0 0x7fccf014d180 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fcce800c6b0 tx=0x7fcce800cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:57.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.583+0000 7fcce67fc640 1 -- 172.21.15.37:0/4041705632 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcce8003b70 con 0x7fccf015b3f0 2024-04-22T07:18:57.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.584+0000 7fcce67fc640 1 -- 172.21.15.37:0/4041705632 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcce8003d30 con 0x7fccf015b3f0 2024-04-22T07:18:57.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.584+0000 7fccf80d2640 1 -- 172.21.15.37:0/4041705632 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fccf0159d60 con 0x7fccf015b3f0 2024-04-22T07:18:57.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.584+0000 7fcce67fc640 1 -- 172.21.15.37:0/4041705632 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcce8005310 con 0x7fccf015b3f0 2024-04-22T07:18:57.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.584+0000 7fccf80d2640 1 -- 172.21.15.37:0/4041705632 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fccf015a320 con 0x7fccf015b3f0 2024-04-22T07:18:57.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.585+0000 7fccf80d2640 1 -- 172.21.15.37:0/4041705632 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fccf0069cc0 con 0x7fccf015b3f0 2024-04-22T07:18:57.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.585+0000 7fcce67fc640 1 -- 172.21.15.37:0/4041705632 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fcce80054b0 con 0x7fccf015b3f0 2024-04-22T07:18:57.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.585+0000 7fcce67fc640 1 --2- 172.21.15.37:0/4041705632 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fccd406c8f0 0x7fccd406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:57.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.586+0000 7fcce67fc640 1 -- 172.21.15.37:0/4041705632 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fcce808b9b0 con 0x7fccf015b3f0 2024-04-22T07:18:57.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.586+0000 7fccf5e6e640 1 --2- 172.21.15.37:0/4041705632 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fccd406c8f0 0x7fccd406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:57.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.586+0000 7fccf5e6e640 1 --2- 172.21.15.37:0/4041705632 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fccd406c8f0 0x7fccd406edb0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fccec036000 tx=0x7fccec03b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:57.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.590+0000 7fcce67fc640 1 -- 172.21.15.37:0/4041705632 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fccf01562c0 con 0x7fccf015b3f0 2024-04-22T07:18:57.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.812+0000 7fccf80d2640 1 -- 172.21.15.37:0/4041705632 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fccf00cbfe0 con 0x7fccf015b3f0 2024-04-22T07:18:57.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.813+0000 7fcce67fc640 1 -- 172.21.15.37:0/4041705632 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6827 (secure 0 0 0) 0x7fcce8059de0 con 0x7fccf015b3f0 2024-04-22T07:18:57.811 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-22T07:18:57.811 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4265,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6839/671847354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6835","nonce":671847354},{"type":"v1","addr":"172.21.15.196:6839","nonce":671847354}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6833/1549427395","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1549427395},{"type":"v1","addr":"172.21.15.37:6833","nonce":1549427395}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6836/3825988951","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":3825988951},{"type":"v1","addr":"172.21.15.37:6836","nonce":3825988951}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4272,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/611771502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6835","nonce":611771502},{"type":"v1","addr":"172.21.15.37:6837","nonce":611771502}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4291,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6837/3055080225","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6834","nonce":3055080225},{"type":"v1","addr":"172.21.15.196:6837","nonce":3055080225}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-22T07:18:36.111618+0000","modified":"2024-04-22T07:18:41.783857+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.196:6838/3264179771","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6836","nonce":3264179771},{"type":"v1","addr":"172.21.15.196:6838","nonce":3264179771}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4294,"qdb_cluster":[4294]},"id":1}]} 2024-04-22T07:18:57.811 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 8 2024-04-22T07:18:57.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.815+0000 7fccf80d2640 1 -- 172.21.15.37:0/4041705632 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fccd406c8f0 msgr2=0x7fccd406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:57.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.815+0000 7fccf80d2640 1 --2- 172.21.15.37:0/4041705632 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fccd406c8f0 0x7fccd406edb0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fccec036000 tx=0x7fccec03b040 comp rx=0 tx=0).stop 2024-04-22T07:18:57.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.815+0000 7fccf80d2640 1 -- 172.21.15.37:0/4041705632 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fccf015b3f0 msgr2=0x7fccf014d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:57.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.815+0000 7fccf80d2640 1 --2- 172.21.15.37:0/4041705632 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fccf015b3f0 0x7fccf014d180 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fcce800c6b0 tx=0x7fcce800cb70 comp rx=0 tx=0).stop 2024-04-22T07:18:57.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.815+0000 7fccf80d2640 1 -- 172.21.15.37:0/4041705632 shutdown_connections 2024-04-22T07:18:57.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.815+0000 7fccf80d2640 1 --2- 172.21.15.37:0/4041705632 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fccd406c8f0 0x7fccd406edb0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:57.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.815+0000 7fccf80d2640 1 --2- 172.21.15.37:0/4041705632 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fccf015b3f0 0x7fccf014d180 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:57.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.815+0000 7fccf80d2640 1 --2- 172.21.15.37:0/4041705632 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fccf01552f0 0x7fccf014cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:57.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.815+0000 7fccf80d2640 1 --2- 172.21.15.37:0/4041705632 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fccf00b38f0 0x7fccf01519c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:57.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.815+0000 7fccf80d2640 1 -- 172.21.15.37:0/4041705632 >> 172.21.15.37:0/4041705632 conn(0x7fccf0071f90 msgr2=0x7fccf01532d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:57.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.815+0000 7fccf80d2640 1 -- 172.21.15.37:0/4041705632 shutdown_connections 2024-04-22T07:18:57.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.815+0000 7fccf80d2640 1 -- 172.21.15.37:0/4041705632 wait complete. 2024-04-22T07:18:57.823 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-22T07:18:57.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.926+0000 7fab770d2640 1 Processor -- start 2024-04-22T07:18:57.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.926+0000 7fab770d2640 1 -- start start 2024-04-22T07:18:57.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.927+0000 7fab770d2640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fab701552f0 0x7fab700cb430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:57.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.927+0000 7fab770d2640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fab700ccd10 0x7fab700cd150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:57.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.927+0000 7fab770d2640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab7015f280 con 0x7fab700b38f0 2024-04-22T07:18:57.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.927+0000 7fab770d2640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fab700b3100 con 0x7fab701552f0 2024-04-22T07:18:57.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.927+0000 7fab770d2640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fab700cda00 con 0x7fab700ccd10 2024-04-22T07:18:57.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.927+0000 7fab74e6e640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fab701552f0 0x7fab700cb430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:57.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.927+0000 7fab74e6e640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fab701552f0 0x7fab700cb430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39564/0 (socket says 172.21.15.37:39564) 2024-04-22T07:18:57.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.927+0000 7fab74e6e640 1 -- 172.21.15.37:0/2334041362 learned_addr learned my addr 172.21.15.37:0/2334041362 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:18:57.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.927+0000 7fab7566f640 1 --2- 172.21.15.37:0/2334041362 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fab700ccd10 0x7fab700cd150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:57.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.928+0000 7fab74e6e640 1 -- 172.21.15.37:0/2334041362 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fab700ccd10 msgr2=0x7fab700cd150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:18:57.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.928+0000 7fab74e6e640 1 --2- 172.21.15.37:0/2334041362 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fab700ccd10 0x7fab700cd150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:57.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.928+0000 7fab74e6e640 1 -- 172.21.15.37:0/2334041362 >> v1:172.21.15.196:6789/0 conn(0x7fab700b38f0 legacy=0x7fab7015aeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:57.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.928+0000 7fab74e6e640 1 -- 172.21.15.37:0/2334041362 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab700b3350 con 0x7fab701552f0 2024-04-22T07:18:57.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.928+0000 7fab74e6e640 1 --2- 172.21.15.37:0/2334041362 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fab701552f0 0x7fab700cb430 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fab68009e50 tx=0x7fab6802bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bc71e506c135982 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:57.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.928+0000 7fab6f7fe640 1 -- 172.21.15.37:0/2334041362 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab6802cb00 con 0x7fab701552f0 2024-04-22T07:18:57.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.928+0000 7fab6f7fe640 1 -- 172.21.15.37:0/2334041362 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab6802cca0 con 0x7fab701552f0 2024-04-22T07:18:57.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.929+0000 7fab6f7fe640 1 -- 172.21.15.37:0/2334041362 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab68034610 con 0x7fab701552f0 2024-04-22T07:18:57.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.929+0000 7fab770d2640 1 -- 172.21.15.37:0/2334041362 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fab701552f0 msgr2=0x7fab700cb430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:57.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.929+0000 7fab770d2640 1 --2- 172.21.15.37:0/2334041362 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fab701552f0 0x7fab700cb430 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fab68009e50 tx=0x7fab6802bf60 comp rx=0 tx=0).stop 2024-04-22T07:18:57.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.929+0000 7fab770d2640 1 -- 172.21.15.37:0/2334041362 shutdown_connections 2024-04-22T07:18:57.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.929+0000 7fab770d2640 1 --2- 172.21.15.37:0/2334041362 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fab700ccd10 0x7fab700cd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:57.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.929+0000 7fab770d2640 1 --2- 172.21.15.37:0/2334041362 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fab701552f0 0x7fab700cb430 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:57.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.929+0000 7fab770d2640 1 -- 172.21.15.37:0/2334041362 >> 172.21.15.37:0/2334041362 conn(0x7fab70071f90 msgr2=0x7fab700723a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:57.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.929+0000 7fab770d2640 1 -- 172.21.15.37:0/2334041362 shutdown_connections 2024-04-22T07:18:57.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.929+0000 7fab770d2640 1 -- 172.21.15.37:0/2334041362 wait complete. 2024-04-22T07:18:57.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.930+0000 7fab770d2640 1 Processor -- start 2024-04-22T07:18:57.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.930+0000 7fab770d2640 1 -- start start 2024-04-22T07:18:57.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.931+0000 7fab770d2640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fab700b38f0 0x7fab70149dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:57.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.931+0000 7fab770d2640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fab700ccd10 0x7fab700c9780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:57.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.931+0000 7fab770d2640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fab701552f0 0x7fab7015d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:57.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.931+0000 7fab770d2640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fab7015e7a0 con 0x7fab701552f0 2024-04-22T07:18:57.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.931+0000 7fab770d2640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fab7015e4c0 con 0x7fab700ccd10 2024-04-22T07:18:57.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.931+0000 7fab770d2640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fab7015ea80 con 0x7fab700b38f0 2024-04-22T07:18:57.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.931+0000 7fab7566f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fab701552f0 0x7fab7015d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:57.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.931+0000 7fab7566f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fab701552f0 0x7fab7015d6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39568/0 (socket says 172.21.15.37:39568) 2024-04-22T07:18:57.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.931+0000 7fab7566f640 1 -- 172.21.15.37:0/1735876684 learned_addr learned my addr 172.21.15.37:0/1735876684 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:18:57.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.931+0000 7fab74e6e640 1 --2- 172.21.15.37:0/1735876684 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fab700b38f0 0x7fab70149dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:57.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.931+0000 7fab6ffff640 1 --2- 172.21.15.37:0/1735876684 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fab700ccd10 0x7fab700c9780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:57.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.931+0000 7fab7566f640 1 -- 172.21.15.37:0/1735876684 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fab700b38f0 msgr2=0x7fab70149dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:57.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.931+0000 7fab7566f640 1 --2- 172.21.15.37:0/1735876684 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fab700b38f0 0x7fab70149dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:57.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.931+0000 7fab7566f640 1 -- 172.21.15.37:0/1735876684 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fab700ccd10 msgr2=0x7fab700c9780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:57.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.931+0000 7fab7566f640 1 --2- 172.21.15.37:0/1735876684 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fab700ccd10 0x7fab700c9780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:57.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.932+0000 7fab7566f640 1 -- 172.21.15.37:0/1735876684 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab7014a310 con 0x7fab701552f0 2024-04-22T07:18:57.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.932+0000 7fab74e6e640 1 --2- 172.21.15.37:0/1735876684 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fab700b38f0 0x7fab70149dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-22T07:18:57.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.932+0000 7fab6ffff640 1 --2- 172.21.15.37:0/1735876684 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fab700ccd10 0x7fab700c9780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-22T07:18:57.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.932+0000 7fab7566f640 1 --2- 172.21.15.37:0/1735876684 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fab701552f0 0x7fab7015d6c0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fab5800e930 tx=0x7fab5800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:57.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.932+0000 7fab6d7fa640 1 -- 172.21.15.37:0/1735876684 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab58017070 con 0x7fab701552f0 2024-04-22T07:18:57.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.932+0000 7fab6d7fa640 1 -- 172.21.15.37:0/1735876684 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab5800c860 con 0x7fab701552f0 2024-04-22T07:18:57.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.932+0000 7fab6d7fa640 1 -- 172.21.15.37:0/1735876684 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab5800cc50 con 0x7fab701552f0 2024-04-22T07:18:57.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.932+0000 7fab770d2640 1 -- 172.21.15.37:0/1735876684 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab700c9cc0 con 0x7fab701552f0 2024-04-22T07:18:57.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.932+0000 7fab770d2640 1 -- 172.21.15.37:0/1735876684 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab700d1140 con 0x7fab701552f0 2024-04-22T07:18:57.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.933+0000 7fab770d2640 1 -- 172.21.15.37:0/1735876684 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab70069cc0 con 0x7fab701552f0 2024-04-22T07:18:57.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.933+0000 7fab6d7fa640 1 -- 172.21.15.37:0/1735876684 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fab5801a070 con 0x7fab701552f0 2024-04-22T07:18:57.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.934+0000 7fab6d7fa640 1 --2- 172.21.15.37:0/1735876684 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fab5006c920 0x7fab5006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:57.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.934+0000 7fab6d7fa640 1 -- 172.21.15.37:0/1735876684 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fab5808ba70 con 0x7fab701552f0 2024-04-22T07:18:57.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.934+0000 7fab74e6e640 1 --2- 172.21.15.37:0/1735876684 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fab5006c920 0x7fab5006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:57.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.935+0000 7fab74e6e640 1 --2- 172.21.15.37:0/1735876684 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fab5006c920 0x7fab5006ede0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fab68035000 tx=0x7fab68030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:57.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:57.938+0000 7fab6d7fa640 1 -- 172.21.15.37:0/1735876684 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fab7014a310 con 0x7fab701552f0 2024-04-22T07:18:58.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.123+0000 7fab770d2640 1 -- 172.21.15.37:0/1735876684 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fab700cbfe0 con 0x7fab701552f0 2024-04-22T07:18:58.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.124+0000 7fab6d7fa640 1 -- 172.21.15.37:0/1735876684 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16581 (secure 0 0 0) 0x7fab58059f30 con 0x7fab701552f0 2024-04-22T07:18:58.122 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-22T07:18:58.123 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":20,"fsid":"10d90a41-52d3-4e09-8022-c8ac67897ad1","created":"2024-04-22T07:18:12.420756+0000","modified":"2024-04-22T07:18:37.754119+0000","last_up_change":"2024-04-22T07:18:23.649808+0000","last_in_change":"2024-04-22T07:18:14.506974+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-22T07:18:24.602243+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-22T07:18:34.673639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-22T07:18:35.055184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e248f6e1-13ad-48e0-a8f8-ec3059995654","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":1488290385},{"type":"v1","addr":"172.21.15.37:6801","nonce":1488290385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1488290385},{"type":"v1","addr":"172.21.15.37:6803","nonce":1488290385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1488290385},{"type":"v1","addr":"172.21.15.37:6807","nonce":1488290385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1488290385},{"type":"v1","addr":"172.21.15.37:6805","nonce":1488290385}]},"public_addr":"172.21.15.37:6801/1488290385","cluster_addr":"172.21.15.37:6803/1488290385","heartbeat_back_addr":"172.21.15.37:6807/1488290385","heartbeat_front_addr":"172.21.15.37:6805/1488290385","state":["exists","up"]},{"osd":1,"uuid":"01c71ab7-1326-432b-b73a-e5847abe5132","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3918584183},{"type":"v1","addr":"172.21.15.37:6811","nonce":3918584183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6813","nonce":3918584183},{"type":"v1","addr":"172.21.15.37:6816","nonce":3918584183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":3918584183},{"type":"v1","addr":"172.21.15.37:6823","nonce":3918584183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":3918584183},{"type":"v1","addr":"172.21.15.37:6821","nonce":3918584183}]},"public_addr":"172.21.15.37:6811/3918584183","cluster_addr":"172.21.15.37:6816/3918584183","heartbeat_back_addr":"172.21.15.37:6823/3918584183","heartbeat_front_addr":"172.21.15.37:6821/3918584183","state":["exists","up"]},{"osd":2,"uuid":"33a780fd-013a-41c8-9970-136c9e080897","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1895439419},{"type":"v1","addr":"172.21.15.37:6825","nonce":1895439419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1895439419},{"type":"v1","addr":"172.21.15.37:6827","nonce":1895439419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1895439419},{"type":"v1","addr":"172.21.15.37:6831","nonce":1895439419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1895439419},{"type":"v1","addr":"172.21.15.37:6829","nonce":1895439419}]},"public_addr":"172.21.15.37:6825/1895439419","cluster_addr":"172.21.15.37:6827/1895439419","heartbeat_back_addr":"172.21.15.37:6831/1895439419","heartbeat_front_addr":"172.21.15.37:6829/1895439419","state":["exists","up"]},{"osd":3,"uuid":"b46e53c4-e5b9-4098-b243-ab5a0f1f3885","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6809","nonce":1160021017},{"type":"v1","addr":"172.21.15.37:6810","nonce":1160021017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1160021017},{"type":"v1","addr":"172.21.15.37:6814","nonce":1160021017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":1160021017},{"type":"v1","addr":"172.21.15.37:6820","nonce":1160021017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6815","nonce":1160021017},{"type":"v1","addr":"172.21.15.37:6817","nonce":1160021017}]},"public_addr":"172.21.15.37:6810/1160021017","cluster_addr":"172.21.15.37:6814/1160021017","heartbeat_back_addr":"172.21.15.37:6820/1160021017","heartbeat_front_addr":"172.21.15.37:6817/1160021017","state":["exists","up"]},{"osd":4,"uuid":"cd1032c6-6a83-4e33-b7b1-baddf92a83af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":374829049},{"type":"v1","addr":"172.21.15.196:6809","nonce":374829049}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":374829049},{"type":"v1","addr":"172.21.15.196:6811","nonce":374829049}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":374829049},{"type":"v1","addr":"172.21.15.196:6815","nonce":374829049}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":374829049},{"type":"v1","addr":"172.21.15.196:6813","nonce":374829049}]},"public_addr":"172.21.15.196:6809/374829049","cluster_addr":"172.21.15.196:6811/374829049","heartbeat_back_addr":"172.21.15.196:6815/374829049","heartbeat_front_addr":"172.21.15.196:6813/374829049","state":["exists","up"]},{"osd":5,"uuid":"f561d48a-5f2d-4deb-8681-4329aed36bae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":479311302},{"type":"v1","addr":"172.21.15.196:6801","nonce":479311302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":479311302},{"type":"v1","addr":"172.21.15.196:6803","nonce":479311302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":479311302},{"type":"v1","addr":"172.21.15.196:6807","nonce":479311302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":479311302},{"type":"v1","addr":"172.21.15.196:6805","nonce":479311302}]},"public_addr":"172.21.15.196:6801/479311302","cluster_addr":"172.21.15.196:6803/479311302","heartbeat_back_addr":"172.21.15.196:6807/479311302","heartbeat_front_addr":"172.21.15.196:6805/479311302","state":["exists","up"]},{"osd":6,"uuid":"1b239c7e-2504-42e0-b308-70f4e62519c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6817","nonce":691777224},{"type":"v1","addr":"172.21.15.196:6819","nonce":691777224}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6821","nonce":691777224},{"type":"v1","addr":"172.21.15.196:6823","nonce":691777224}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6829","nonce":691777224},{"type":"v1","addr":"172.21.15.196:6831","nonce":691777224}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6825","nonce":691777224},{"type":"v1","addr":"172.21.15.196:6827","nonce":691777224}]},"public_addr":"172.21.15.196:6819/691777224","cluster_addr":"172.21.15.196:6823/691777224","heartbeat_back_addr":"172.21.15.196:6831/691777224","heartbeat_front_addr":"172.21.15.196:6827/691777224","state":["exists","up"]},{"osd":7,"uuid":"084318d4-d1fd-4b58-8c33-b1d7856fe323","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":3106266066},{"type":"v1","addr":"172.21.15.196:6818","nonce":3106266066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":3106266066},{"type":"v1","addr":"172.21.15.196:6822","nonce":3106266066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":3106266066},{"type":"v1","addr":"172.21.15.196:6830","nonce":3106266066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":3106266066},{"type":"v1","addr":"172.21.15.196:6826","nonce":3106266066}]},"public_addr":"172.21.15.196:6818/3106266066","cluster_addr":"172.21.15.196:6822/3106266066","heartbeat_back_addr":"172.21.15.196:6830/3106266066","heartbeat_front_addr":"172.21.15.196:6826/3106266066","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:18:19.587791+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:18:19.706541+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:18:19.690674+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:18:19.648354+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:18:19.666671+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:18:19.560709+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:18:19.661412+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:18:19.770650+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-22T07:18:58.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.126+0000 7fab770d2640 1 -- 172.21.15.37:0/1735876684 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fab5006c920 msgr2=0x7fab5006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:58.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.126+0000 7fab770d2640 1 --2- 172.21.15.37:0/1735876684 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fab5006c920 0x7fab5006ede0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fab68035000 tx=0x7fab68030000 comp rx=0 tx=0).stop 2024-04-22T07:18:58.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.126+0000 7fab770d2640 1 -- 172.21.15.37:0/1735876684 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fab701552f0 msgr2=0x7fab7015d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:58.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.126+0000 7fab770d2640 1 --2- 172.21.15.37:0/1735876684 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fab701552f0 0x7fab7015d6c0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fab5800e930 tx=0x7fab5800edf0 comp rx=0 tx=0).stop 2024-04-22T07:18:58.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.126+0000 7fab770d2640 1 -- 172.21.15.37:0/1735876684 shutdown_connections 2024-04-22T07:18:58.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.126+0000 7fab770d2640 1 --2- 172.21.15.37:0/1735876684 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fab5006c920 0x7fab5006ede0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:58.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.126+0000 7fab770d2640 1 --2- 172.21.15.37:0/1735876684 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fab701552f0 0x7fab7015d6c0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:58.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.126+0000 7fab770d2640 1 --2- 172.21.15.37:0/1735876684 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fab700ccd10 0x7fab700c9780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:58.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.126+0000 7fab770d2640 1 --2- 172.21.15.37:0/1735876684 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fab700b38f0 0x7fab70149dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:58.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.126+0000 7fab770d2640 1 -- 172.21.15.37:0/1735876684 >> 172.21.15.37:0/1735876684 conn(0x7fab70071f90 msgr2=0x7fab701541c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:58.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.126+0000 7fab770d2640 1 -- 172.21.15.37:0/1735876684 shutdown_connections 2024-04-22T07:18:58.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.126+0000 7fab770d2640 1 -- 172.21.15.37:0/1735876684 wait complete. 2024-04-22T07:18:58.135 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-22T07:18:24.602243+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-22T07:18:34.673639+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-22T07:18:35.055184+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-22T07:18:58.136 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-22T07:18:58.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.242+0000 7fa834db2640 1 Processor -- start 2024-04-22T07:18:58.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.242+0000 7fa834db2640 1 -- start start 2024-04-22T07:18:58.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.243+0000 7fa834db2640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fa8300ccdd0 0x7fa8300cb5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:58.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.243+0000 7fa834db2640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa8300cd1b0 0x7fa83015b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:58.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.243+0000 7fa834db2640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa83015bcf0 con 0x7fa830154b50 2024-04-22T07:18:58.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.243+0000 7fa834db2640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fa83015e4d0 con 0x7fa8300cd1b0 2024-04-22T07:18:58.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.243+0000 7fa834db2640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7fa83015e7b0 con 0x7fa8300ccdd0 2024-04-22T07:18:58.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.243+0000 7fa825d9b640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa8300cd1b0 0x7fa83015b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:58.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.243+0000 7fa82ed9d640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fa830154b50 0x7fa83015c350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:54324/0 (socket says 172.21.15.37:54324) 2024-04-22T07:18:58.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.243+0000 7fa82ed9d640 1 -- 172.21.15.37:0/3907573852 learned_addr learned my addr 172.21.15.37:0/3907573852 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-04-22T07:18:58.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.243+0000 7fa825d9b640 1 --2- 172.21.15.37:0/3907573852 >> v2:172.21.15.37:3300/0 conn(0x7fa8300cd1b0 0x7fa83015b7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39584/0 (socket says 172.21.15.37:39584) 2024-04-22T07:18:58.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.243+0000 7fa82e59c640 1 --2- 172.21.15.37:0/3907573852 >> v2:172.21.15.196:3300/0 conn(0x7fa8300ccdd0 0x7fa8300cb5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:58.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.243+0000 7fa825d9b640 1 -- 172.21.15.37:0/3907573852 >> v2:172.21.15.196:3300/0 conn(0x7fa8300ccdd0 msgr2=0x7fa8300cb5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:18:58.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.243+0000 7fa825d9b640 1 --2- 172.21.15.37:0/3907573852 >> v2:172.21.15.196:3300/0 conn(0x7fa8300ccdd0 0x7fa8300cb5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:58.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.243+0000 7fa825d9b640 1 -- 172.21.15.37:0/3907573852 >> v1:172.21.15.37:6789/0 conn(0x7fa830154b50 legacy=0x7fa83015c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:58.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.243+0000 7fa82dd9b640 1 -- 172.21.15.37:0/3907573852 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 202038928 0 0) 0x7fa83015bcf0 con 0x7fa830154b50 2024-04-22T07:18:58.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.243+0000 7fa825d9b640 1 -- 172.21.15.37:0/3907573852 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa83015ea90 con 0x7fa8300cd1b0 2024-04-22T07:18:58.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.243+0000 7fa82e59c640 1 --2- 172.21.15.37:0/3907573852 >> v2:172.21.15.196:3300/0 conn(0x7fa8300ccdd0 0x7fa8300cb5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-22T07:18:58.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.244+0000 7fa825d9b640 1 --2- 172.21.15.37:0/3907573852 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa8300cd1b0 0x7fa83015b7b0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fa83008e0d0 tx=0x7fa81802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9836ebda1acac87 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:58.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.244+0000 7fa82dd9b640 1 -- 172.21.15.37:0/3907573852 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa818035020 con 0x7fa8300cd1b0 2024-04-22T07:18:58.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.244+0000 7fa82dd9b640 1 -- 172.21.15.37:0/3907573852 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa818031830 con 0x7fa8300cd1b0 2024-04-22T07:18:58.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.244+0000 7fa82dd9b640 1 -- 172.21.15.37:0/3907573852 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa818031c00 con 0x7fa8300cd1b0 2024-04-22T07:18:58.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.245+0000 7fa834db2640 1 -- 172.21.15.37:0/3907573852 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa8300cd1b0 msgr2=0x7fa83015b7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:58.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.245+0000 7fa834db2640 1 --2- 172.21.15.37:0/3907573852 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa8300cd1b0 0x7fa83015b7b0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fa83008e0d0 tx=0x7fa81802b8d0 comp rx=0 tx=0).stop 2024-04-22T07:18:58.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.245+0000 7fa834db2640 1 -- 172.21.15.37:0/3907573852 shutdown_connections 2024-04-22T07:18:58.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.245+0000 7fa834db2640 1 --2- 172.21.15.37:0/3907573852 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa8300cd1b0 0x7fa83015b7b0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:58.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.245+0000 7fa834db2640 1 --2- 172.21.15.37:0/3907573852 >> v2:172.21.15.196:3300/0 conn(0x7fa8300ccdd0 0x7fa8300cb5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:58.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.245+0000 7fa834db2640 1 -- 172.21.15.37:0/3907573852 >> 172.21.15.37:0/3907573852 conn(0x7fa830071f90 msgr2=0x7fa8300723a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:58.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.245+0000 7fa834db2640 1 -- 172.21.15.37:0/3907573852 shutdown_connections 2024-04-22T07:18:58.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.245+0000 7fa834db2640 1 -- 172.21.15.37:0/3907573852 wait complete. 2024-04-22T07:18:58.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.246+0000 7fa834db2640 1 Processor -- start 2024-04-22T07:18:58.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.246+0000 7fa834db2640 1 -- start start 2024-04-22T07:18:58.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.247+0000 7fa834db2640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa8300ccdd0 0x7fa83014dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:58.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.247+0000 7fa834db2640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa8300cd1b0 0x7fa83014a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:58.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.247+0000 7fa834db2640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa830154b50 0x7fa8301f4090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:58.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.247+0000 7fa834db2640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa8300cd810 con 0x7fa8300ccdd0 2024-04-22T07:18:58.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.247+0000 7fa834db2640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fa83015f050 con 0x7fa830154b50 2024-04-22T07:18:58.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.247+0000 7fa834db2640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fa8300cd990 con 0x7fa8300cd1b0 2024-04-22T07:18:58.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.247+0000 7fa82e59c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa8300ccdd0 0x7fa83014dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:58.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.247+0000 7fa82e59c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa8300ccdd0 0x7fa83014dd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39600/0 (socket says 172.21.15.37:39600) 2024-04-22T07:18:58.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.247+0000 7fa82e59c640 1 -- 172.21.15.37:0/1688773022 learned_addr learned my addr 172.21.15.37:0/1688773022 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:18:58.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.247+0000 7fa825d9b640 1 --2- 172.21.15.37:0/1688773022 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa8300cd1b0 0x7fa83014a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:58.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.247+0000 7fa82ed9d640 1 --2- 172.21.15.37:0/1688773022 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa830154b50 0x7fa8301f4090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:58.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.247+0000 7fa82e59c640 1 -- 172.21.15.37:0/1688773022 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa8300cd1b0 msgr2=0x7fa83014a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:58.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.247+0000 7fa82e59c640 1 --2- 172.21.15.37:0/1688773022 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa8300cd1b0 0x7fa83014a100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:58.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.247+0000 7fa82e59c640 1 -- 172.21.15.37:0/1688773022 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa830154b50 msgr2=0x7fa8301f4090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:58.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.247+0000 7fa82e59c640 1 --2- 172.21.15.37:0/1688773022 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa830154b50 0x7fa8301f4090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:58.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.247+0000 7fa82e59c640 1 -- 172.21.15.37:0/1688773022 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa83014b9b0 con 0x7fa8300ccdd0 2024-04-22T07:18:58.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.247+0000 7fa825d9b640 1 --2- 172.21.15.37:0/1688773022 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa8300cd1b0 0x7fa83014a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T07:18:58.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.248+0000 7fa82e59c640 1 --2- 172.21.15.37:0/1688773022 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa8300ccdd0 0x7fa83014dd50 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fa82000c820 tx=0x7fa82000cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:58.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.248+0000 7fa8277fe640 1 -- 172.21.15.37:0/1688773022 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa820015070 con 0x7fa8300ccdd0 2024-04-22T07:18:58.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.248+0000 7fa8277fe640 1 -- 172.21.15.37:0/1688773022 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa820007a30 con 0x7fa8300ccdd0 2024-04-22T07:18:58.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.248+0000 7fa834db2640 1 -- 172.21.15.37:0/1688773022 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa83014ae30 con 0x7fa8300ccdd0 2024-04-22T07:18:58.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.248+0000 7fa8277fe640 1 -- 172.21.15.37:0/1688773022 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa820007e00 con 0x7fa8300ccdd0 2024-04-22T07:18:58.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.248+0000 7fa834db2640 1 -- 172.21.15.37:0/1688773022 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa83014b3f0 con 0x7fa8300ccdd0 2024-04-22T07:18:58.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.249+0000 7fa834db2640 1 -- 172.21.15.37:0/1688773022 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa830069cc0 con 0x7fa8300ccdd0 2024-04-22T07:18:58.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.249+0000 7fa8277fe640 1 -- 172.21.15.37:0/1688773022 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa820018070 con 0x7fa8300ccdd0 2024-04-22T07:18:58.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.250+0000 7fa8277fe640 1 --2- 172.21.15.37:0/1688773022 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fa81006c8f0 0x7fa81006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:58.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.250+0000 7fa8277fe640 1 -- 172.21.15.37:0/1688773022 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fa82008ba90 con 0x7fa8300ccdd0 2024-04-22T07:18:58.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.250+0000 7fa825d9b640 1 --2- 172.21.15.37:0/1688773022 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fa81006c8f0 0x7fa81006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:58.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.251+0000 7fa825d9b640 1 --2- 172.21.15.37:0/1688773022 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fa81006c8f0 0x7fa81006edb0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fa818036000 tx=0x7fa818008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:58.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.254+0000 7fa8277fe640 1 -- 172.21.15.37:0/1688773022 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fa820059f50 con 0x7fa8300ccdd0 2024-04-22T07:18:58.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.440+0000 7fa834db2640 1 -- 172.21.15.37:0/1688773022 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fa8301545e0 con 0x7fa8300ccdd0 2024-04-22T07:18:58.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.441+0000 7fa8277fe640 1 -- 172.21.15.37:0/1688773022 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7fa820059850 con 0x7fa8300ccdd0 2024-04-22T07:18:58.439 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2024-04-22T07:18:58.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.443+0000 7fa834db2640 1 -- 172.21.15.37:0/1688773022 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fa81006c8f0 msgr2=0x7fa81006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:58.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.443+0000 7fa834db2640 1 --2- 172.21.15.37:0/1688773022 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fa81006c8f0 0x7fa81006edb0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fa818036000 tx=0x7fa818008030 comp rx=0 tx=0).stop 2024-04-22T07:18:58.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.443+0000 7fa834db2640 1 -- 172.21.15.37:0/1688773022 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa8300ccdd0 msgr2=0x7fa83014dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:58.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.443+0000 7fa834db2640 1 --2- 172.21.15.37:0/1688773022 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa8300ccdd0 0x7fa83014dd50 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fa82000c820 tx=0x7fa82000cc20 comp rx=0 tx=0).stop 2024-04-22T07:18:58.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.443+0000 7fa834db2640 1 -- 172.21.15.37:0/1688773022 shutdown_connections 2024-04-22T07:18:58.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.443+0000 7fa834db2640 1 --2- 172.21.15.37:0/1688773022 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fa81006c8f0 0x7fa81006edb0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:58.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.443+0000 7fa834db2640 1 --2- 172.21.15.37:0/1688773022 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa830154b50 0x7fa8301f4090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:58.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.443+0000 7fa834db2640 1 --2- 172.21.15.37:0/1688773022 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa8300cd1b0 0x7fa83014a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:58.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.443+0000 7fa834db2640 1 --2- 172.21.15.37:0/1688773022 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa8300ccdd0 0x7fa83014dd50 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:58.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.443+0000 7fa834db2640 1 -- 172.21.15.37:0/1688773022 >> 172.21.15.37:0/1688773022 conn(0x7fa830071f90 msgr2=0x7fa8300c6bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:58.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.443+0000 7fa834db2640 1 -- 172.21.15.37:0/1688773022 shutdown_connections 2024-04-22T07:18:58.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.443+0000 7fa834db2640 1 -- 172.21.15.37:0/1688773022 wait complete. 2024-04-22T07:18:58.451 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-22T07:18:58.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.557+0000 7fec7f4f2640 1 Processor -- start 2024-04-22T07:18:58.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.557+0000 7fec7f4f2640 1 -- start start 2024-04-22T07:18:58.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.558+0000 7fec7f4f2640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fec781552c0 0x7fec780c5fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:58.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.558+0000 7fec7f4f2640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fec780cdd60 0x7fec7815b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:58.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.558+0000 7fec7f4f2640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec780c6990 con 0x7fec780cb010 2024-04-22T07:18:58.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.558+0000 7fec7f4f2640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fec781556a0 con 0x7fec780cdd60 2024-04-22T07:18:58.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.558+0000 7fec7f4f2640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fec780c66b0 con 0x7fec781552c0 2024-04-22T07:18:58.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.558+0000 7fec7da8f640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fec780cdd60 0x7fec7815b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:58.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.558+0000 7fec7da8f640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fec780cdd60 0x7fec7815b160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39614/0 (socket says 172.21.15.37:39614) 2024-04-22T07:18:58.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.558+0000 7fec7da8f640 1 -- 172.21.15.37:0/664630641 learned_addr learned my addr 172.21.15.37:0/664630641 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:18:58.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.558+0000 7fec7d28e640 1 --2- 172.21.15.37:0/664630641 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fec781552c0 0x7fec780c5fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:58.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.558+0000 7fec7da8f640 1 -- 172.21.15.37:0/664630641 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fec781552c0 msgr2=0x7fec780c5fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:18:58.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.558+0000 7fec7da8f640 1 --2- 172.21.15.37:0/664630641 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fec781552c0 0x7fec780c5fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:58.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.558+0000 7fec7da8f640 1 -- 172.21.15.37:0/664630641 >> v1:172.21.15.196:6789/0 conn(0x7fec780cb010 legacy=0x7fec780676b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:58.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.558+0000 7fec7da8f640 1 -- 172.21.15.37:0/664630641 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec780cc560 con 0x7fec780cdd60 2024-04-22T07:18:58.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.559+0000 7fec7da8f640 1 --2- 172.21.15.37:0/664630641 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fec780cdd60 0x7fec7815b160 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fec70009e50 tx=0x7fec7002bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6499c553446e326d server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:58.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.559+0000 7fec6ffff640 1 -- 172.21.15.37:0/664630641 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec7002cb00 con 0x7fec780cdd60 2024-04-22T07:18:58.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.559+0000 7fec6ffff640 1 -- 172.21.15.37:0/664630641 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec7002cca0 con 0x7fec780cdd60 2024-04-22T07:18:58.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.559+0000 7fec6ffff640 1 -- 172.21.15.37:0/664630641 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec70034610 con 0x7fec780cdd60 2024-04-22T07:18:58.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.560+0000 7fec7f4f2640 1 -- 172.21.15.37:0/664630641 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fec780cdd60 msgr2=0x7fec7815b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:58.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.560+0000 7fec7f4f2640 1 --2- 172.21.15.37:0/664630641 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fec780cdd60 0x7fec7815b160 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fec70009e50 tx=0x7fec7002bf60 comp rx=0 tx=0).stop 2024-04-22T07:18:58.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.560+0000 7fec7f4f2640 1 -- 172.21.15.37:0/664630641 shutdown_connections 2024-04-22T07:18:58.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.560+0000 7fec7f4f2640 1 --2- 172.21.15.37:0/664630641 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fec780cdd60 0x7fec7815b160 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:58.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.560+0000 7fec7f4f2640 1 --2- 172.21.15.37:0/664630641 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fec781552c0 0x7fec780c5fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:58.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.560+0000 7fec7f4f2640 1 -- 172.21.15.37:0/664630641 >> 172.21.15.37:0/664630641 conn(0x7fec7806d330 msgr2=0x7fec7806c290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:58.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.560+0000 7fec7f4f2640 1 -- 172.21.15.37:0/664630641 shutdown_connections 2024-04-22T07:18:58.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.560+0000 7fec7f4f2640 1 -- 172.21.15.37:0/664630641 wait complete. 2024-04-22T07:18:58.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.561+0000 7fec7f4f2640 1 Processor -- start 2024-04-22T07:18:58.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.561+0000 7fec7f4f2640 1 -- start start 2024-04-22T07:18:58.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.562+0000 7fec7f4f2640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fec780cb010 0x7fec780ceb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:58.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.562+0000 7fec7f4f2640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fec780cdd60 0x7fec780cf090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:58.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.562+0000 7fec7f4f2640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fec781552c0 0x7fec781f4210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:58.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.562+0000 7fec7f4f2640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fec780cce00 con 0x7fec781552c0 2024-04-22T07:18:58.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.562+0000 7fec7f4f2640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fec780ccb20 con 0x7fec780cb010 2024-04-22T07:18:58.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.562+0000 7fec7f4f2640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fec78067dc0 con 0x7fec780cdd60 2024-04-22T07:18:58.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.562+0000 7fec7da8f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fec781552c0 0x7fec781f4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:58.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.562+0000 7fec7da8f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fec781552c0 0x7fec781f4210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39622/0 (socket says 172.21.15.37:39622) 2024-04-22T07:18:58.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.562+0000 7fec7da8f640 1 -- 172.21.15.37:0/1788958172 learned_addr learned my addr 172.21.15.37:0/1788958172 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:18:58.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.562+0000 7fec7d28e640 1 --2- 172.21.15.37:0/1788958172 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fec780cb010 0x7fec780ceb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:58.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.562+0000 7fec7ca8d640 1 --2- 172.21.15.37:0/1788958172 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fec780cdd60 0x7fec780cf090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:58.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.562+0000 7fec7da8f640 1 -- 172.21.15.37:0/1788958172 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fec780cdd60 msgr2=0x7fec780cf090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:58.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.562+0000 7fec7da8f640 1 --2- 172.21.15.37:0/1788958172 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fec780cdd60 0x7fec780cf090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:58.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.562+0000 7fec7da8f640 1 -- 172.21.15.37:0/1788958172 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fec780cb010 msgr2=0x7fec780ceb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:58.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.562+0000 7fec7da8f640 1 --2- 172.21.15.37:0/1788958172 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fec780cb010 0x7fec780ceb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:58.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.562+0000 7fec7da8f640 1 -- 172.21.15.37:0/1788958172 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec781f4ec0 con 0x7fec781552c0 2024-04-22T07:18:58.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.562+0000 7fec7d28e640 1 --2- 172.21.15.37:0/1788958172 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fec780cb010 0x7fec780ceb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T07:18:58.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.562+0000 7fec7da8f640 1 --2- 172.21.15.37:0/1788958172 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fec781552c0 0x7fec781f4210 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fec70009e50 tx=0x7fec70004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:58.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.562+0000 7fec6dffb640 1 -- 172.21.15.37:0/1788958172 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec70043020 con 0x7fec781552c0 2024-04-22T07:18:58.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.562+0000 7fec6dffb640 1 -- 172.21.15.37:0/1788958172 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec7002ce50 con 0x7fec781552c0 2024-04-22T07:18:58.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.563+0000 7fec7f4f2640 1 -- 172.21.15.37:0/1788958172 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec781581f0 con 0x7fec781552c0 2024-04-22T07:18:58.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.563+0000 7fec6dffb640 1 -- 172.21.15.37:0/1788958172 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec70009510 con 0x7fec781552c0 2024-04-22T07:18:58.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.563+0000 7fec7f4f2640 1 -- 172.21.15.37:0/1788958172 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec780d1040 con 0x7fec781552c0 2024-04-22T07:18:58.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.564+0000 7fec7f4f2640 1 -- 172.21.15.37:0/1788958172 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec78069cc0 con 0x7fec781552c0 2024-04-22T07:18:58.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.564+0000 7fec6dffb640 1 -- 172.21.15.37:0/1788958172 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fec70046020 con 0x7fec781552c0 2024-04-22T07:18:58.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.565+0000 7fec6dffb640 1 --2- 172.21.15.37:0/1788958172 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fec5c06c8f0 0x7fec5c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:58.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.565+0000 7fec6dffb640 1 -- 172.21.15.37:0/1788958172 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fec700ae070 con 0x7fec781552c0 2024-04-22T07:18:58.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.565+0000 7fec7d28e640 1 --2- 172.21.15.37:0/1788958172 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fec5c06c8f0 0x7fec5c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:58.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.566+0000 7fec7d28e640 1 --2- 172.21.15.37:0/1788958172 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fec5c06c8f0 0x7fec5c06edb0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fec74009b90 tx=0x7fec74008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:58.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.569+0000 7fec6dffb640 1 -- 172.21.15.37:0/1788958172 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fec7004d030 con 0x7fec781552c0 2024-04-22T07:18:58.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.755+0000 7fec7f4f2640 1 -- 172.21.15.37:0/1788958172 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fec780cb660 con 0x7fec781552c0 2024-04-22T07:18:58.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.755+0000 7fec6dffb640 1 -- 172.21.15.37:0/1788958172 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7fec7007c530 con 0x7fec781552c0 2024-04-22T07:18:58.753 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2024-04-22T07:18:58.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.757+0000 7fec7f4f2640 1 -- 172.21.15.37:0/1788958172 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fec5c06c8f0 msgr2=0x7fec5c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:58.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.757+0000 7fec7f4f2640 1 --2- 172.21.15.37:0/1788958172 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fec5c06c8f0 0x7fec5c06edb0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fec74009b90 tx=0x7fec74008040 comp rx=0 tx=0).stop 2024-04-22T07:18:58.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.757+0000 7fec7f4f2640 1 -- 172.21.15.37:0/1788958172 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fec781552c0 msgr2=0x7fec781f4210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:58.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.757+0000 7fec7f4f2640 1 --2- 172.21.15.37:0/1788958172 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fec781552c0 0x7fec781f4210 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fec70009e50 tx=0x7fec70004a40 comp rx=0 tx=0).stop 2024-04-22T07:18:58.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.757+0000 7fec7f4f2640 1 -- 172.21.15.37:0/1788958172 shutdown_connections 2024-04-22T07:18:58.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.757+0000 7fec7f4f2640 1 --2- 172.21.15.37:0/1788958172 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fec5c06c8f0 0x7fec5c06edb0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:58.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.757+0000 7fec7f4f2640 1 --2- 172.21.15.37:0/1788958172 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fec781552c0 0x7fec781f4210 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:58.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.757+0000 7fec7f4f2640 1 --2- 172.21.15.37:0/1788958172 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fec780cdd60 0x7fec780cf090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:58.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.757+0000 7fec7f4f2640 1 --2- 172.21.15.37:0/1788958172 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fec780cb010 0x7fec780ceb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:58.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.757+0000 7fec7f4f2640 1 -- 172.21.15.37:0/1788958172 >> 172.21.15.37:0/1788958172 conn(0x7fec7806d330 msgr2=0x7fec780c6e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:58.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.757+0000 7fec7f4f2640 1 -- 172.21.15.37:0/1788958172 shutdown_connections 2024-04-22T07:18:58.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.757+0000 7fec7f4f2640 1 -- 172.21.15.37:0/1788958172 wait complete. 2024-04-22T07:18:58.766 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-22T07:18:58.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.873+0000 7f0838984640 1 Processor -- start 2024-04-22T07:18:58.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.873+0000 7f0838984640 1 -- start start 2024-04-22T07:18:58.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.874+0000 7f0838984640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f08341552e0 0x7f08340c6000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:58.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.874+0000 7f0838984640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f08340cdd80 0x7f083415b180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:58.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.874+0000 7f0838984640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08340c69b0 con 0x7f08340cb030 2024-04-22T07:18:58.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.874+0000 7f0838984640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f08341556c0 con 0x7f08341552e0 2024-04-22T07:18:58.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.874+0000 7f0838984640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f08340c66d0 con 0x7f08340cdd80 2024-04-22T07:18:58.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.874+0000 7f083259c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f08341552e0 0x7f08340c6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:58.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.874+0000 7f083259c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f08341552e0 0x7f08340c6000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39628/0 (socket says 172.21.15.37:39628) 2024-04-22T07:18:58.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.874+0000 7f083259c640 1 -- 172.21.15.37:0/1699056374 learned_addr learned my addr 172.21.15.37:0/1699056374 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:18:58.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.874+0000 7f0832d9d640 1 --2- 172.21.15.37:0/1699056374 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f08340cdd80 0x7f083415b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:58.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.874+0000 7f083259c640 1 -- 172.21.15.37:0/1699056374 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f08340cdd80 msgr2=0x7f083415b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:18:58.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.874+0000 7f083259c640 1 --2- 172.21.15.37:0/1699056374 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f08340cdd80 0x7f083415b180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:58.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.874+0000 7f083259c640 1 -- 172.21.15.37:0/1699056374 >> v1:172.21.15.196:6789/0 conn(0x7f08340cb030 legacy=0x7f08340676b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:18:58.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.874+0000 7f083259c640 1 -- 172.21.15.37:0/1699056374 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08340cc580 con 0x7f08341552e0 2024-04-22T07:18:58.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.874+0000 7f0832d9d640 1 --2- 172.21.15.37:0/1699056374 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f08340cdd80 0x7f083415b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-22T07:18:58.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.875+0000 7f083259c640 1 --2- 172.21.15.37:0/1699056374 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08341552e0 0x7f08340c6000 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f0824009870 tx=0x7f082402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cee6eac4f8e610aa server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:58.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.875+0000 7f0831d9b640 1 -- 172.21.15.37:0/1699056374 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0824035020 con 0x7f08341552e0 2024-04-22T07:18:58.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.875+0000 7f0831d9b640 1 -- 172.21.15.37:0/1699056374 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0824031640 con 0x7f08341552e0 2024-04-22T07:18:58.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.875+0000 7f0831d9b640 1 -- 172.21.15.37:0/1699056374 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f082402d040 con 0x7f08341552e0 2024-04-22T07:18:58.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.875+0000 7f0838984640 1 -- 172.21.15.37:0/1699056374 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08341552e0 msgr2=0x7f08340c6000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:58.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.875+0000 7f0838984640 1 --2- 172.21.15.37:0/1699056374 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08341552e0 0x7f08340c6000 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f0824009870 tx=0x7f082402b8f0 comp rx=0 tx=0).stop 2024-04-22T07:18:58.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.876+0000 7f0838984640 1 -- 172.21.15.37:0/1699056374 shutdown_connections 2024-04-22T07:18:58.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.876+0000 7f0838984640 1 --2- 172.21.15.37:0/1699056374 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f08340cdd80 0x7f083415b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:58.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.876+0000 7f0838984640 1 --2- 172.21.15.37:0/1699056374 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08341552e0 0x7f08340c6000 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:58.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.876+0000 7f0838984640 1 -- 172.21.15.37:0/1699056374 >> 172.21.15.37:0/1699056374 conn(0x7f083406d330 msgr2=0x7f083406c290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:58.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.876+0000 7f0838984640 1 -- 172.21.15.37:0/1699056374 shutdown_connections 2024-04-22T07:18:58.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.876+0000 7f0838984640 1 -- 172.21.15.37:0/1699056374 wait complete. 2024-04-22T07:18:58.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.877+0000 7f0838984640 1 Processor -- start 2024-04-22T07:18:58.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.877+0000 7f0838984640 1 -- start start 2024-04-22T07:18:58.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.877+0000 7f0838984640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f08340cb030 0x7f08340c7950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:58.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.878+0000 7f0838984640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f08340cdd80 0x7f0834153dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:58.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.878+0000 7f0838984640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08341552e0 0x7f08340d0620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:58.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.878+0000 7f0838984640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f08340cce20 con 0x7f08341552e0 2024-04-22T07:18:58.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.878+0000 7f0838984640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f08340ccb40 con 0x7f08340cb030 2024-04-22T07:18:58.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.878+0000 7f0838984640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f0834067dc0 con 0x7f08340cdd80 2024-04-22T07:18:58.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.878+0000 7f0832d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08341552e0 0x7f08340d0620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:58.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.878+0000 7f0832d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08341552e0 0x7f08340d0620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39632/0 (socket says 172.21.15.37:39632) 2024-04-22T07:18:58.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.878+0000 7f0832d9d640 1 -- 172.21.15.37:0/2942402528 learned_addr learned my addr 172.21.15.37:0/2942402528 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:18:58.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.878+0000 7f083259c640 1 --2- 172.21.15.37:0/2942402528 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f08340cb030 0x7f08340c7950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:58.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.878+0000 7f082bfff640 1 --2- 172.21.15.37:0/2942402528 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f08340cdd80 0x7f0834153dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:58.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.878+0000 7f0832d9d640 1 -- 172.21.15.37:0/2942402528 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f08340cdd80 msgr2=0x7f0834153dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:58.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.878+0000 7f0832d9d640 1 --2- 172.21.15.37:0/2942402528 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f08340cdd80 0x7f0834153dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:58.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.878+0000 7f0832d9d640 1 -- 172.21.15.37:0/2942402528 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f08340cb030 msgr2=0x7f08340c7950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:58.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.878+0000 7f0832d9d640 1 --2- 172.21.15.37:0/2942402528 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f08340cb030 0x7f08340c7950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:58.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.878+0000 7f0832d9d640 1 -- 172.21.15.37:0/2942402528 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08340cfe40 con 0x7f08341552e0 2024-04-22T07:18:58.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.878+0000 7f0832d9d640 1 --2- 172.21.15.37:0/2942402528 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08341552e0 0x7f08340d0620 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f082c00cef0 tx=0x7f082c00a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:58.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.878+0000 7f082affd640 1 -- 172.21.15.37:0/2942402528 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f082c01a070 con 0x7f08341552e0 2024-04-22T07:18:58.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.878+0000 7f082affd640 1 -- 172.21.15.37:0/2942402528 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f082c00d860 con 0x7f08341552e0 2024-04-22T07:18:58.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.878+0000 7f082affd640 1 -- 172.21.15.37:0/2942402528 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f082c00dc50 con 0x7f08341552e0 2024-04-22T07:18:58.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.878+0000 7f0838984640 1 -- 172.21.15.37:0/2942402528 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08340cf050 con 0x7f08341552e0 2024-04-22T07:18:58.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.878+0000 7f0838984640 1 -- 172.21.15.37:0/2942402528 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08340cf610 con 0x7f08341552e0 2024-04-22T07:18:58.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.879+0000 7f0838984640 1 -- 172.21.15.37:0/2942402528 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0834069cc0 con 0x7f08341552e0 2024-04-22T07:18:58.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.880+0000 7f082affd640 1 -- 172.21.15.37:0/2942402528 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f082c01d070 con 0x7f08341552e0 2024-04-22T07:18:58.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.880+0000 7f082affd640 1 --2- 172.21.15.37:0/2942402528 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f081406c8f0 0x7f081406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:58.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.881+0000 7f082affd640 1 -- 172.21.15.37:0/2942402528 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f082c08c2a0 con 0x7f08341552e0 2024-04-22T07:18:58.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.881+0000 7f083259c640 1 --2- 172.21.15.37:0/2942402528 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f081406c8f0 0x7f081406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:58.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.881+0000 7f083259c640 1 --2- 172.21.15.37:0/2942402528 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f081406c8f0 0x7f081406edb0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f0824036000 tx=0x7f082403c040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:58.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:58.885+0000 7f082affd640 1 -- 172.21.15.37:0/2942402528 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f082c05a1d0 con 0x7f08341552e0 2024-04-22T07:18:59.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.068+0000 7f0838984640 1 -- 172.21.15.37:0/2942402528 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f08340cb680 con 0x7f08341552e0 2024-04-22T07:18:59.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.069+0000 7f082affd640 1 -- 172.21.15.37:0/2942402528 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7f082c08c0c0 con 0x7f08341552e0 2024-04-22T07:18:59.067 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 64 2024-04-22T07:18:59.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.071+0000 7f0838984640 1 -- 172.21.15.37:0/2942402528 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f081406c8f0 msgr2=0x7f081406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:59.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.071+0000 7f0838984640 1 --2- 172.21.15.37:0/2942402528 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f081406c8f0 0x7f081406edb0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f0824036000 tx=0x7f082403c040 comp rx=0 tx=0).stop 2024-04-22T07:18:59.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.071+0000 7f0838984640 1 -- 172.21.15.37:0/2942402528 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08341552e0 msgr2=0x7f08340d0620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:59.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.071+0000 7f0838984640 1 --2- 172.21.15.37:0/2942402528 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08341552e0 0x7f08340d0620 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f082c00cef0 tx=0x7f082c00a710 comp rx=0 tx=0).stop 2024-04-22T07:18:59.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.071+0000 7f0838984640 1 -- 172.21.15.37:0/2942402528 shutdown_connections 2024-04-22T07:18:59.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.071+0000 7f0838984640 1 --2- 172.21.15.37:0/2942402528 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f081406c8f0 0x7f081406edb0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:59.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.071+0000 7f0838984640 1 --2- 172.21.15.37:0/2942402528 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08341552e0 0x7f08340d0620 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:59.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.071+0000 7f0838984640 1 --2- 172.21.15.37:0/2942402528 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f08340cdd80 0x7f0834153dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:59.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.071+0000 7f0838984640 1 --2- 172.21.15.37:0/2942402528 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f08340cb030 0x7f08340c7950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:59.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.071+0000 7f0838984640 1 -- 172.21.15.37:0/2942402528 >> 172.21.15.37:0/2942402528 conn(0x7f083406d330 msgr2=0x7f0834152f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:59.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.071+0000 7f0838984640 1 -- 172.21.15.37:0/2942402528 shutdown_connections 2024-04-22T07:18:59.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.071+0000 7f0838984640 1 -- 172.21.15.37:0/2942402528 wait complete. 2024-04-22T07:18:59.080 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-22T07:18:59.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.182+0000 7fefae5ce640 1 Processor -- start 2024-04-22T07:18:59.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.182+0000 7fefae5ce640 1 -- start start 2024-04-22T07:18:59.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.183+0000 7fefae5ce640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fefa8152e20 0x7fefa815ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:59.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.183+0000 7fefae5ce640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fefa80c9000 0x7fefa80ca090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:59.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.183+0000 7fefae5ce640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fefa80ca5d0 0x7fefa80c3ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:59.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.183+0000 7fefae5ce640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fefa8153200 con 0x7fefa80c9000 2024-04-22T07:18:59.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.183+0000 7fefae5ce640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7fefa8159a90 con 0x7fefa80ca5d0 2024-04-22T07:18:59.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.183+0000 7fefae5ce640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fefa80706b0 con 0x7fefa8152e20 2024-04-22T07:18:59.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.183+0000 7fefa77fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fefa80c9000 0x7fefa80ca090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:59.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.183+0000 7fefa77fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fefa80c9000 0x7fefa80ca090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39636/0 (socket says 172.21.15.37:39636) 2024-04-22T07:18:59.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.183+0000 7fefa77fe640 1 -- 172.21.15.37:0/3207059403 learned_addr learned my addr 172.21.15.37:0/3207059403 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:18:59.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.183+0000 7fefa7fff640 1 --2- 172.21.15.37:0/3207059403 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fefa8152e20 0x7fefa815ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:59.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.183+0000 7fefacb6b640 1 --2- 172.21.15.37:0/3207059403 >> v2:172.21.15.196:3300/0 conn(0x7fefa80ca5d0 0x7fefa80c3ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:59.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.183+0000 7fefa77fe640 1 -- 172.21.15.37:0/3207059403 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fefa8152e20 msgr2=0x7fefa815ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:18:59.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.183+0000 7fefa77fe640 1 --2- 172.21.15.37:0/3207059403 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fefa8152e20 0x7fefa815ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:59.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.183+0000 7fefa77fe640 1 -- 172.21.15.37:0/3207059403 >> v2:172.21.15.196:3300/0 conn(0x7fefa80ca5d0 msgr2=0x7fefa80c3ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:18:59.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.183+0000 7fefa77fe640 1 --2- 172.21.15.37:0/3207059403 >> v2:172.21.15.196:3300/0 conn(0x7fefa80ca5d0 0x7fefa80c3ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:59.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.183+0000 7fefa77fe640 1 -- 172.21.15.37:0/3207059403 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefa80c3980 con 0x7fefa80c9000 2024-04-22T07:18:59.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.183+0000 7fefacb6b640 1 --2- 172.21.15.37:0/3207059403 >> v2:172.21.15.196:3300/0 conn(0x7fefa80ca5d0 0x7fefa80c3ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-22T07:18:59.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.184+0000 7fefa77fe640 1 --2- 172.21.15.37:0/3207059403 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fefa80c9000 0x7fefa80ca090 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fefa8073980 tx=0x7fef9802b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8372d4d4421c53a8 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:59.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.184+0000 7fefa6ffd640 1 -- 172.21.15.37:0/3207059403 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef98034070 con 0x7fefa80c9000 2024-04-22T07:18:59.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.184+0000 7fefa6ffd640 1 -- 172.21.15.37:0/3207059403 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef98030850 con 0x7fefa80c9000 2024-04-22T07:18:59.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.184+0000 7fefa6ffd640 1 -- 172.21.15.37:0/3207059403 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef98030c20 con 0x7fefa80c9000 2024-04-22T07:18:59.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.185+0000 7fefae5ce640 1 -- 172.21.15.37:0/3207059403 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fefa80c9000 msgr2=0x7fefa80ca090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:59.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.185+0000 7fefae5ce640 1 --2- 172.21.15.37:0/3207059403 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fefa80c9000 0x7fefa80ca090 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fefa8073980 tx=0x7fef9802b990 comp rx=0 tx=0).stop 2024-04-22T07:18:59.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.185+0000 7fefae5ce640 1 -- 172.21.15.37:0/3207059403 shutdown_connections 2024-04-22T07:18:59.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.185+0000 7fefae5ce640 1 --2- 172.21.15.37:0/3207059403 >> v2:172.21.15.196:3300/0 conn(0x7fefa80ca5d0 0x7fefa80c3ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:59.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.185+0000 7fefae5ce640 1 --2- 172.21.15.37:0/3207059403 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fefa80c9000 0x7fefa80ca090 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:59.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.185+0000 7fefae5ce640 1 --2- 172.21.15.37:0/3207059403 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fefa8152e20 0x7fefa815ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:59.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.185+0000 7fefae5ce640 1 -- 172.21.15.37:0/3207059403 >> 172.21.15.37:0/3207059403 conn(0x7fefa8071580 msgr2=0x7fefa8071960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:59.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.185+0000 7fefae5ce640 1 -- 172.21.15.37:0/3207059403 shutdown_connections 2024-04-22T07:18:59.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.185+0000 7fefae5ce640 1 -- 172.21.15.37:0/3207059403 wait complete. 2024-04-22T07:18:59.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.186+0000 7fefae5ce640 1 Processor -- start 2024-04-22T07:18:59.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.186+0000 7fefae5ce640 1 -- start start 2024-04-22T07:18:59.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.187+0000 7fefae5ce640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fefa80c9000 0x7fefa815ba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:59.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.187+0000 7fefae5ce640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fefa80ca5d0 0x7fefa815b150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:59.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.187+0000 7fefae5ce640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fefa8152e20 0x7fefa8153610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:59.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.187+0000 7fefae5ce640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fefa8159290 con 0x7fefa8152e20 2024-04-22T07:18:59.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.187+0000 7fefae5ce640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fefa8158fb0 con 0x7fefa80c9000 2024-04-22T07:18:59.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.187+0000 7fefae5ce640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fefa8159570 con 0x7fefa80ca5d0 2024-04-22T07:18:59.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.187+0000 7fefacb6b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fefa8152e20 0x7fefa8153610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:59.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.187+0000 7fefacb6b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fefa8152e20 0x7fefa8153610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39646/0 (socket says 172.21.15.37:39646) 2024-04-22T07:18:59.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.187+0000 7fefacb6b640 1 -- 172.21.15.37:0/2128618590 learned_addr learned my addr 172.21.15.37:0/2128618590 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:18:59.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.187+0000 7fefa7fff640 1 --2- 172.21.15.37:0/2128618590 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fefa80c9000 0x7fefa815ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:59.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.187+0000 7fefa77fe640 1 --2- 172.21.15.37:0/2128618590 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fefa80ca5d0 0x7fefa815b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:59.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.187+0000 7fefacb6b640 1 -- 172.21.15.37:0/2128618590 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fefa80ca5d0 msgr2=0x7fefa815b150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:59.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.187+0000 7fefacb6b640 1 --2- 172.21.15.37:0/2128618590 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fefa80ca5d0 0x7fefa815b150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:59.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.187+0000 7fefacb6b640 1 -- 172.21.15.37:0/2128618590 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fefa80c9000 msgr2=0x7fefa815ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:59.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.187+0000 7fefacb6b640 1 --2- 172.21.15.37:0/2128618590 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fefa80c9000 0x7fefa815ba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:59.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.187+0000 7fefacb6b640 1 -- 172.21.15.37:0/2128618590 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefa815bfd0 con 0x7fefa8152e20 2024-04-22T07:18:59.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.187+0000 7fefacb6b640 1 --2- 172.21.15.37:0/2128618590 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fefa8152e20 0x7fefa8153610 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fefa000ce80 tx=0x7fefa000a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:59.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.187+0000 7fefa4ff9640 1 -- 172.21.15.37:0/2128618590 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefa001a070 con 0x7fefa8152e20 2024-04-22T07:18:59.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.187+0000 7fefa4ff9640 1 -- 172.21.15.37:0/2128618590 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fefa000d880 con 0x7fefa8152e20 2024-04-22T07:18:59.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.187+0000 7fefae5ce640 1 -- 172.21.15.37:0/2128618590 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fefa80cc630 con 0x7fefa8152e20 2024-04-22T07:18:59.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.187+0000 7fefa4ff9640 1 -- 172.21.15.37:0/2128618590 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefa000dc70 con 0x7fefa8152e20 2024-04-22T07:18:59.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.188+0000 7fefae5ce640 1 -- 172.21.15.37:0/2128618590 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fefa80ccbf0 con 0x7fefa8152e20 2024-04-22T07:18:59.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.188+0000 7fefae5ce640 1 -- 172.21.15.37:0/2128618590 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fefa80c3620 con 0x7fefa8152e20 2024-04-22T07:18:59.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.189+0000 7fefa4ff9640 1 -- 172.21.15.37:0/2128618590 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fefa001d070 con 0x7fefa8152e20 2024-04-22T07:18:59.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.189+0000 7fefa4ff9640 1 --2- 172.21.15.37:0/2128618590 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fef9406c8f0 0x7fef9406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:59.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.189+0000 7fefa4ff9640 1 -- 172.21.15.37:0/2128618590 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fefa008c290 con 0x7fefa8152e20 2024-04-22T07:18:59.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.190+0000 7fefa7fff640 1 --2- 172.21.15.37:0/2128618590 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fef9406c8f0 0x7fef9406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:59.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.190+0000 7fefa7fff640 1 --2- 172.21.15.37:0/2128618590 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fef9406c8f0 0x7fef9406edb0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fef9c007920 tx=0x7fef9c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:59.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.194+0000 7fefa4ff9640 1 -- 172.21.15.37:0/2128618590 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fefa80c3620 con 0x7fefa8152e20 2024-04-22T07:18:59.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.415+0000 7fefae5ce640 1 -- 172.21.15.37:0/2128618590 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fefa8069cc0 con 0x7fefa8152e20 2024-04-22T07:18:59.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.416+0000 7fefa4ff9640 1 -- 172.21.15.37:0/2128618590 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6827 (secure 0 0 0) 0x7fefa005a080 con 0x7fefa8152e20 2024-04-22T07:18:59.414 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-22T07:18:59.414 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4265,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6839/671847354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6835","nonce":671847354},{"type":"v1","addr":"172.21.15.196:6839","nonce":671847354}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6833/1549427395","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1549427395},{"type":"v1","addr":"172.21.15.37:6833","nonce":1549427395}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6836/3825988951","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":3825988951},{"type":"v1","addr":"172.21.15.37:6836","nonce":3825988951}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4272,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/611771502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6835","nonce":611771502},{"type":"v1","addr":"172.21.15.37:6837","nonce":611771502}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4291,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6837/3055080225","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6834","nonce":3055080225},{"type":"v1","addr":"172.21.15.196:6837","nonce":3055080225}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-22T07:18:36.111618+0000","modified":"2024-04-22T07:18:41.783857+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.196:6838/3264179771","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6836","nonce":3264179771},{"type":"v1","addr":"172.21.15.196:6838","nonce":3264179771}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4294,"qdb_cluster":[4294]},"id":1}]} 2024-04-22T07:18:59.415 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 8 2024-04-22T07:18:59.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.418+0000 7fefae5ce640 1 -- 172.21.15.37:0/2128618590 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fef9406c8f0 msgr2=0x7fef9406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:59.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.418+0000 7fefae5ce640 1 --2- 172.21.15.37:0/2128618590 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fef9406c8f0 0x7fef9406edb0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fef9c007920 tx=0x7fef9c008040 comp rx=0 tx=0).stop 2024-04-22T07:18:59.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.418+0000 7fefae5ce640 1 -- 172.21.15.37:0/2128618590 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fefa8152e20 msgr2=0x7fefa8153610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:59.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.418+0000 7fefae5ce640 1 --2- 172.21.15.37:0/2128618590 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fefa8152e20 0x7fefa8153610 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fefa000ce80 tx=0x7fefa000a710 comp rx=0 tx=0).stop 2024-04-22T07:18:59.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.418+0000 7fefae5ce640 1 -- 172.21.15.37:0/2128618590 shutdown_connections 2024-04-22T07:18:59.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.418+0000 7fefae5ce640 1 --2- 172.21.15.37:0/2128618590 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fef9406c8f0 0x7fef9406edb0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:59.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.418+0000 7fefae5ce640 1 --2- 172.21.15.37:0/2128618590 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fefa8152e20 0x7fefa8153610 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:59.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.418+0000 7fefae5ce640 1 --2- 172.21.15.37:0/2128618590 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fefa80ca5d0 0x7fefa815b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:59.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.418+0000 7fefae5ce640 1 --2- 172.21.15.37:0/2128618590 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fefa80c9000 0x7fefa815ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:59.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.418+0000 7fefae5ce640 1 -- 172.21.15.37:0/2128618590 >> 172.21.15.37:0/2128618590 conn(0x7fefa8071580 msgr2=0x7fefa814f270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:59.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.418+0000 7fefae5ce640 1 -- 172.21.15.37:0/2128618590 shutdown_connections 2024-04-22T07:18:59.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.418+0000 7fefae5ce640 1 -- 172.21.15.37:0/2128618590 wait complete. 2024-04-22T07:18:59.427 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-22T07:18:59.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.530+0000 7f75a9455640 1 Processor -- start 2024-04-22T07:18:59.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.530+0000 7f75a9455640 1 -- start start 2024-04-22T07:18:59.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.531+0000 7f75a9455640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f75a40ca5a0 0x7f75a406e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:59.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.531+0000 7f75a9455640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75a40c7910 con 0x7f75a414f660 2024-04-22T07:18:59.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.531+0000 7f75a9455640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75a4062f20 con 0x7f75a414f280 2024-04-22T07:18:59.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.531+0000 7f75a9455640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f75a406ee80 con 0x7f75a40ca5a0 2024-04-22T07:18:59.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.531+0000 7f75a37fe640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f75a414f660 0x7f75a406fa80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:54332/0 (socket says 172.21.15.37:54332) 2024-04-22T07:18:59.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.531+0000 7f75a37fe640 1 -- 172.21.15.37:0/1742844392 learned_addr learned my addr 172.21.15.37:0/1742844392 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-04-22T07:18:59.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.531+0000 7f75a27fc640 1 --2- 172.21.15.37:0/1742844392 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f75a40ca5a0 0x7f75a406e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:59.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.532+0000 7f75a1ffb640 1 -- 172.21.15.37:0/1742844392 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2099781181 0 0) 0x7f75a40c7910 con 0x7f75a414f660 2024-04-22T07:18:59.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.532+0000 7f75a1ffb640 1 -- 172.21.15.37:0/1742844392 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f758c003520 con 0x7f75a414f660 2024-04-22T07:18:59.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.532+0000 7f75a27fc640 1 -- 172.21.15.37:0/1742844392 >> v1:172.21.15.196:6789/0 conn(0x7f75a414f280 legacy=0x7f75a41589d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:59.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.532+0000 7f75a1ffb640 1 -- 172.21.15.37:0/1742844392 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4019508517 0 0) 0x7f75a4062f20 con 0x7f75a414f280 2024-04-22T07:18:59.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.532+0000 7f75a27fc640 1 -- 172.21.15.37:0/1742844392 >> v1:172.21.15.37:6789/0 conn(0x7f75a414f660 legacy=0x7f75a406fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:59.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.532+0000 7f75a27fc640 1 -- 172.21.15.37:0/1742844392 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75a40c7b80 con 0x7f75a40ca5a0 2024-04-22T07:18:59.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.533+0000 7f75a27fc640 1 --2- 172.21.15.37:0/1742844392 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f75a40ca5a0 0x7f75a406e940 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f75980097d0 tx=0x7f759802b9c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5de6a649abc5564f server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:59.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.533+0000 7f75a1ffb640 1 -- 172.21.15.37:0/1742844392 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7598034070 con 0x7f75a40ca5a0 2024-04-22T07:18:59.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.533+0000 7f75a1ffb640 1 -- 172.21.15.37:0/1742844392 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7598030880 con 0x7f75a40ca5a0 2024-04-22T07:18:59.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.533+0000 7f75a1ffb640 1 -- 172.21.15.37:0/1742844392 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7598030c30 con 0x7f75a40ca5a0 2024-04-22T07:18:59.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.533+0000 7f75a9455640 1 -- 172.21.15.37:0/1742844392 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f75a40ca5a0 msgr2=0x7f75a406e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:59.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.533+0000 7f75a9455640 1 --2- 172.21.15.37:0/1742844392 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f75a40ca5a0 0x7f75a406e940 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f75980097d0 tx=0x7f759802b9c0 comp rx=0 tx=0).stop 2024-04-22T07:18:59.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.533+0000 7f75a9455640 1 -- 172.21.15.37:0/1742844392 shutdown_connections 2024-04-22T07:18:59.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.533+0000 7f75a9455640 1 --2- 172.21.15.37:0/1742844392 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f75a40ca5a0 0x7f75a406e940 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:59.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.533+0000 7f75a9455640 1 -- 172.21.15.37:0/1742844392 >> 172.21.15.37:0/1742844392 conn(0x7f75a40cd4a0 msgr2=0x7f75a40c9970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:59.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.533+0000 7f75a9455640 1 -- 172.21.15.37:0/1742844392 shutdown_connections 2024-04-22T07:18:59.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.533+0000 7f75a9455640 1 -- 172.21.15.37:0/1742844392 wait complete. 2024-04-22T07:18:59.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.535+0000 7f75a9455640 1 Processor -- start 2024-04-22T07:18:59.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.535+0000 7f75a9455640 1 -- start start 2024-04-22T07:18:59.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.535+0000 7f75a9455640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f75a40ca5a0 0x7f75a4155ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:59.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.535+0000 7f75a9455640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75a414f280 0x7f75a4157670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:59.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.535+0000 7f75a9455640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f75a414f660 0x7f75a4157bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:59.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.535+0000 7f75a9455640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f75a40ca080 con 0x7f75a414f280 2024-04-22T07:18:59.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.535+0000 7f75a9455640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f75a4062cd0 con 0x7f75a414f660 2024-04-22T07:18:59.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.535+0000 7f75a9455640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f75a40c7250 con 0x7f75a40ca5a0 2024-04-22T07:18:59.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.536+0000 7f75a27fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75a414f280 0x7f75a4157670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:59.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.536+0000 7f75a27fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75a414f280 0x7f75a4157670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39660/0 (socket says 172.21.15.37:39660) 2024-04-22T07:18:59.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.536+0000 7f75a27fc640 1 -- 172.21.15.37:0/185007499 learned_addr learned my addr 172.21.15.37:0/185007499 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:18:59.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.536+0000 7f75a37fe640 1 --2- 172.21.15.37:0/185007499 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f75a414f660 0x7f75a4157bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:59.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.536+0000 7f75a2ffd640 1 --2- 172.21.15.37:0/185007499 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f75a40ca5a0 0x7f75a4155ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:59.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.536+0000 7f75a27fc640 1 -- 172.21.15.37:0/185007499 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f75a40ca5a0 msgr2=0x7f75a4155ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:59.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.536+0000 7f75a27fc640 1 --2- 172.21.15.37:0/185007499 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f75a40ca5a0 0x7f75a4155ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:59.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.536+0000 7f75a27fc640 1 -- 172.21.15.37:0/185007499 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f75a414f660 msgr2=0x7f75a4157bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:59.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.536+0000 7f75a27fc640 1 --2- 172.21.15.37:0/185007499 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f75a414f660 0x7f75a4157bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:59.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.536+0000 7f75a27fc640 1 -- 172.21.15.37:0/185007499 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75a4156410 con 0x7f75a414f280 2024-04-22T07:18:59.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.536+0000 7f75a27fc640 1 --2- 172.21.15.37:0/185007499 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75a414f280 0x7f75a4157670 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f7598000c00 tx=0x7f75980046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:59.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.536+0000 7f758b7fe640 1 -- 172.21.15.37:0/185007499 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7598048070 con 0x7f75a414f280 2024-04-22T07:18:59.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.536+0000 7f758b7fe640 1 -- 172.21.15.37:0/185007499 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7598030680 con 0x7f75a414f280 2024-04-22T07:18:59.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.536+0000 7f75a9455640 1 -- 172.21.15.37:0/185007499 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75a41f0a50 con 0x7f75a414f280 2024-04-22T07:18:59.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.536+0000 7f758b7fe640 1 -- 172.21.15.37:0/185007499 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7598034040 con 0x7f75a414f280 2024-04-22T07:18:59.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.536+0000 7f75a9455640 1 -- 172.21.15.37:0/185007499 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75a41f1010 con 0x7f75a414f280 2024-04-22T07:18:59.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.537+0000 7f75a9455640 1 -- 172.21.15.37:0/185007499 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75a4068b20 con 0x7f75a414f280 2024-04-22T07:18:59.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.538+0000 7f758b7fe640 1 -- 172.21.15.37:0/185007499 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7598037070 con 0x7f75a414f280 2024-04-22T07:18:59.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.538+0000 7f758b7fe640 1 --2- 172.21.15.37:0/185007499 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f759006c920 0x7f759006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:59.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.538+0000 7f758b7fe640 1 -- 172.21.15.37:0/185007499 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f75980ad330 con 0x7f75a414f280 2024-04-22T07:18:59.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.538+0000 7f75a2ffd640 1 --2- 172.21.15.37:0/185007499 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f759006c920 0x7f759006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:59.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.539+0000 7f75a2ffd640 1 --2- 172.21.15.37:0/185007499 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f759006c920 0x7f759006ede0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f759c000f60 tx=0x7f759c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:59.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.543+0000 7f758b7fe640 1 -- 172.21.15.37:0/185007499 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f759807afe0 con 0x7f75a414f280 2024-04-22T07:18:59.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.728+0000 7f75a9455640 1 -- 172.21.15.37:0/185007499 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f75a415acb0 con 0x7f75a414f280 2024-04-22T07:18:59.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.729+0000 7f758b7fe640 1 -- 172.21.15.37:0/185007499 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16581 (secure 0 0 0) 0x7f75a415acb0 con 0x7f75a414f280 2024-04-22T07:18:59.727 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-22T07:18:59.727 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":20,"fsid":"10d90a41-52d3-4e09-8022-c8ac67897ad1","created":"2024-04-22T07:18:12.420756+0000","modified":"2024-04-22T07:18:37.754119+0000","last_up_change":"2024-04-22T07:18:23.649808+0000","last_in_change":"2024-04-22T07:18:14.506974+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-22T07:18:24.602243+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-22T07:18:34.673639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-22T07:18:35.055184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e248f6e1-13ad-48e0-a8f8-ec3059995654","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":1488290385},{"type":"v1","addr":"172.21.15.37:6801","nonce":1488290385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1488290385},{"type":"v1","addr":"172.21.15.37:6803","nonce":1488290385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1488290385},{"type":"v1","addr":"172.21.15.37:6807","nonce":1488290385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1488290385},{"type":"v1","addr":"172.21.15.37:6805","nonce":1488290385}]},"public_addr":"172.21.15.37:6801/1488290385","cluster_addr":"172.21.15.37:6803/1488290385","heartbeat_back_addr":"172.21.15.37:6807/1488290385","heartbeat_front_addr":"172.21.15.37:6805/1488290385","state":["exists","up"]},{"osd":1,"uuid":"01c71ab7-1326-432b-b73a-e5847abe5132","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3918584183},{"type":"v1","addr":"172.21.15.37:6811","nonce":3918584183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6813","nonce":3918584183},{"type":"v1","addr":"172.21.15.37:6816","nonce":3918584183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":3918584183},{"type":"v1","addr":"172.21.15.37:6823","nonce":3918584183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":3918584183},{"type":"v1","addr":"172.21.15.37:6821","nonce":3918584183}]},"public_addr":"172.21.15.37:6811/3918584183","cluster_addr":"172.21.15.37:6816/3918584183","heartbeat_back_addr":"172.21.15.37:6823/3918584183","heartbeat_front_addr":"172.21.15.37:6821/3918584183","state":["exists","up"]},{"osd":2,"uuid":"33a780fd-013a-41c8-9970-136c9e080897","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1895439419},{"type":"v1","addr":"172.21.15.37:6825","nonce":1895439419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1895439419},{"type":"v1","addr":"172.21.15.37:6827","nonce":1895439419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1895439419},{"type":"v1","addr":"172.21.15.37:6831","nonce":1895439419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1895439419},{"type":"v1","addr":"172.21.15.37:6829","nonce":1895439419}]},"public_addr":"172.21.15.37:6825/1895439419","cluster_addr":"172.21.15.37:6827/1895439419","heartbeat_back_addr":"172.21.15.37:6831/1895439419","heartbeat_front_addr":"172.21.15.37:6829/1895439419","state":["exists","up"]},{"osd":3,"uuid":"b46e53c4-e5b9-4098-b243-ab5a0f1f3885","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6809","nonce":1160021017},{"type":"v1","addr":"172.21.15.37:6810","nonce":1160021017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1160021017},{"type":"v1","addr":"172.21.15.37:6814","nonce":1160021017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":1160021017},{"type":"v1","addr":"172.21.15.37:6820","nonce":1160021017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6815","nonce":1160021017},{"type":"v1","addr":"172.21.15.37:6817","nonce":1160021017}]},"public_addr":"172.21.15.37:6810/1160021017","cluster_addr":"172.21.15.37:6814/1160021017","heartbeat_back_addr":"172.21.15.37:6820/1160021017","heartbeat_front_addr":"172.21.15.37:6817/1160021017","state":["exists","up"]},{"osd":4,"uuid":"cd1032c6-6a83-4e33-b7b1-baddf92a83af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":374829049},{"type":"v1","addr":"172.21.15.196:6809","nonce":374829049}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":374829049},{"type":"v1","addr":"172.21.15.196:6811","nonce":374829049}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":374829049},{"type":"v1","addr":"172.21.15.196:6815","nonce":374829049}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":374829049},{"type":"v1","addr":"172.21.15.196:6813","nonce":374829049}]},"public_addr":"172.21.15.196:6809/374829049","cluster_addr":"172.21.15.196:6811/374829049","heartbeat_back_addr":"172.21.15.196:6815/374829049","heartbeat_front_addr":"172.21.15.196:6813/374829049","state":["exists","up"]},{"osd":5,"uuid":"f561d48a-5f2d-4deb-8681-4329aed36bae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":479311302},{"type":"v1","addr":"172.21.15.196:6801","nonce":479311302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":479311302},{"type":"v1","addr":"172.21.15.196:6803","nonce":479311302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":479311302},{"type":"v1","addr":"172.21.15.196:6807","nonce":479311302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":479311302},{"type":"v1","addr":"172.21.15.196:6805","nonce":479311302}]},"public_addr":"172.21.15.196:6801/479311302","cluster_addr":"172.21.15.196:6803/479311302","heartbeat_back_addr":"172.21.15.196:6807/479311302","heartbeat_front_addr":"172.21.15.196:6805/479311302","state":["exists","up"]},{"osd":6,"uuid":"1b239c7e-2504-42e0-b308-70f4e62519c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6817","nonce":691777224},{"type":"v1","addr":"172.21.15.196:6819","nonce":691777224}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6821","nonce":691777224},{"type":"v1","addr":"172.21.15.196:6823","nonce":691777224}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6829","nonce":691777224},{"type":"v1","addr":"172.21.15.196:6831","nonce":691777224}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6825","nonce":691777224},{"type":"v1","addr":"172.21.15.196:6827","nonce":691777224}]},"public_addr":"172.21.15.196:6819/691777224","cluster_addr":"172.21.15.196:6823/691777224","heartbeat_back_addr":"172.21.15.196:6831/691777224","heartbeat_front_addr":"172.21.15.196:6827/691777224","state":["exists","up"]},{"osd":7,"uuid":"084318d4-d1fd-4b58-8c33-b1d7856fe323","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":3106266066},{"type":"v1","addr":"172.21.15.196:6818","nonce":3106266066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":3106266066},{"type":"v1","addr":"172.21.15.196:6822","nonce":3106266066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":3106266066},{"type":"v1","addr":"172.21.15.196:6830","nonce":3106266066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":3106266066},{"type":"v1","addr":"172.21.15.196:6826","nonce":3106266066}]},"public_addr":"172.21.15.196:6818/3106266066","cluster_addr":"172.21.15.196:6822/3106266066","heartbeat_back_addr":"172.21.15.196:6830/3106266066","heartbeat_front_addr":"172.21.15.196:6826/3106266066","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:18:19.587791+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:18:19.706541+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:18:19.690674+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:18:19.648354+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:18:19.666671+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:18:19.560709+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:18:19.661412+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:18:19.770650+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-22T07:18:59.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.731+0000 7f75a9455640 1 -- 172.21.15.37:0/185007499 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f759006c920 msgr2=0x7f759006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:59.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.731+0000 7f75a9455640 1 --2- 172.21.15.37:0/185007499 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f759006c920 0x7f759006ede0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f759c000f60 tx=0x7f759c009040 comp rx=0 tx=0).stop 2024-04-22T07:18:59.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.731+0000 7f75a9455640 1 -- 172.21.15.37:0/185007499 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75a414f280 msgr2=0x7f75a4157670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:59.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.731+0000 7f75a9455640 1 --2- 172.21.15.37:0/185007499 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75a414f280 0x7f75a4157670 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f7598000c00 tx=0x7f75980046c0 comp rx=0 tx=0).stop 2024-04-22T07:18:59.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.731+0000 7f75a9455640 1 -- 172.21.15.37:0/185007499 shutdown_connections 2024-04-22T07:18:59.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.731+0000 7f75a9455640 1 --2- 172.21.15.37:0/185007499 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f759006c920 0x7f759006ede0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:59.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.731+0000 7f75a9455640 1 --2- 172.21.15.37:0/185007499 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f75a414f660 0x7f75a4157bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:59.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.731+0000 7f75a9455640 1 --2- 172.21.15.37:0/185007499 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75a414f280 0x7f75a4157670 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:59.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.731+0000 7f75a9455640 1 --2- 172.21.15.37:0/185007499 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f75a40ca5a0 0x7f75a4155ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:59.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.731+0000 7f75a9455640 1 -- 172.21.15.37:0/185007499 >> 172.21.15.37:0/185007499 conn(0x7f75a40cd4a0 msgr2=0x7f75a40cb610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:59.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.731+0000 7f75a9455640 1 -- 172.21.15.37:0/185007499 shutdown_connections 2024-04-22T07:18:59.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.731+0000 7f75a9455640 1 -- 172.21.15.37:0/185007499 wait complete. 2024-04-22T07:18:59.740 INFO:tasks.quiescer.fs.[cephfs]:Initializing Quiescer with random seed 611001 2024-04-22T07:18:59.740 DEBUG:tasks.quiescer:Yielding 2024-04-22T07:18:59.741 INFO:teuthology.run_tasks:Running task workunit... 2024-04-22T07:18:59.753 INFO:tasks.workunit:Pulling workunits from ref 86f7587a5a09af35f0895e1a2d08527638fae697 2024-04-22T07:18:59.754 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-04-22T07:18:59.754 INFO:tasks.workunit:timeout=3h 2024-04-22T07:18:59.754 INFO:tasks.workunit:cleanup=True 2024-04-22T07:18:59.754 DEBUG:teuthology.orchestra.run.smithi037:> stat -- /home/ubuntu/cephtest/mnt.0 2024-04-22T07:18:59.755 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-22T07:18:59.771 INFO:teuthology.orchestra.run.smithi037.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-04-22T07:18:59.771 INFO:teuthology.orchestra.run.smithi037.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-04-22T07:18:59.771 INFO:teuthology.orchestra.run.smithi037.stdout:Device: 2bh/43d Inode: 1 Links: 2 2024-04-22T07:18:59.771 INFO:teuthology.orchestra.run.smithi037.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-22T07:18:59.771 INFO:teuthology.orchestra.run.smithi037.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-04-22T07:18:59.771 INFO:teuthology.orchestra.run.smithi037.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-04-22T07:18:59.771 INFO:teuthology.orchestra.run.smithi037.stdout:Modify: 2024-04-22 07:18:41.756642474 +0000 2024-04-22T07:18:59.771 INFO:teuthology.orchestra.run.smithi037.stdout:Change: 2024-04-22 07:18:53.515224935 +0000 2024-04-22T07:18:59.771 INFO:teuthology.orchestra.run.smithi037.stdout: Birth: 2024-04-22 07:18:41.756642474 +0000 2024-04-22T07:18:59.772 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-04-22T07:18:59.772 DEBUG:teuthology.orchestra.run.smithi037:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-04-22T07:18:59.839 DEBUG:teuthology.orchestra.run.smithi037:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 86f7587a5a09af35f0895e1a2d08527638fae697 2024-04-22T07:18:59.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.860+0000 7f00aa6a8640 1 Processor -- start 2024-04-22T07:18:59.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.860+0000 7f00aa6a8640 1 -- start start 2024-04-22T07:18:59.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.861+0000 7f00aa6a8640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f00a41552f0 0x7f00a40cb430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:59.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.861+0000 7f00aa6a8640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f00a415f280 con 0x7f00a40b38f0 2024-04-22T07:18:59.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.861+0000 7f00aa6a8640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f00a40cda00 con 0x7f00a40ccd10 2024-04-22T07:18:59.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.861+0000 7f00aa6a8640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f00a40b3100 con 0x7f00a41552f0 2024-04-22T07:18:59.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.861+0000 7f00a37fe640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f00a40b38f0 0x7f00a415aeb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:45044/0 (socket says 172.21.15.37:45044) 2024-04-22T07:18:59.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.861+0000 7f00a37fe640 1 -- 172.21.15.37:0/3135788003 learned_addr learned my addr 172.21.15.37:0/3135788003 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-04-22T07:18:59.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.861+0000 7f00a3fff640 1 --2- 172.21.15.37:0/3135788003 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f00a41552f0 0x7f00a40cb430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:59.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.861+0000 7f00a2ffd640 1 -- 172.21.15.37:0/3135788003 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2013909871 0 0) 0x7f00a415f280 con 0x7f00a40b38f0 2024-04-22T07:18:59.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.861+0000 7f00a2ffd640 1 -- 172.21.15.37:0/3135788003 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f008c003520 con 0x7f00a40b38f0 2024-04-22T07:18:59.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.861+0000 7f00a2ffd640 1 -- 172.21.15.37:0/3135788003 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3351469538 0 0) 0x7f008c003520 con 0x7f00a40b38f0 2024-04-22T07:18:59.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.861+0000 7f00a2ffd640 1 -- 172.21.15.37:0/3135788003 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f00a41552f0 msgr2=0x7f00a40cb430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:18:59.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.861+0000 7f00a2ffd640 1 --2- 172.21.15.37:0/3135788003 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f00a41552f0 0x7f00a40cb430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:59.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.861+0000 7f00a2ffd640 1 -- 172.21.15.37:0/3135788003 >> v1:172.21.15.196:6789/0 conn(0x7f00a40ccd10 legacy=0x7f00a4165750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:59.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.861+0000 7f00a2ffd640 1 -- 172.21.15.37:0/3135788003 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00a40b3350 con 0x7f00a40b38f0 2024-04-22T07:18:59.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.862+0000 7f00a2ffd640 1 -- 172.21.15.37:0/3135788003 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2576656170 0 0) 0x7f0098001670 con 0x7f00a40b38f0 2024-04-22T07:18:59.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.862+0000 7f00a2ffd640 1 -- 172.21.15.37:0/3135788003 >> v1:172.21.15.37:6789/0 conn(0x7f00a40b38f0 legacy=0x7f00a415aeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:59.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.862+0000 7f00a2ffd640 1 --2- 172.21.15.37:0/3135788003 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f008c0039e0 0x7f008c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:59.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.862+0000 7f00a2ffd640 1 --2- 172.21.15.37:0/3135788003 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f008c004390 0x7f008c004860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:59.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.862+0000 7f00a2ffd640 1 --2- 172.21.15.37:0/3135788003 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f00a41552f0 0x7f008c0050c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:59.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.862+0000 7f00a2ffd640 1 -- 172.21.15.37:0/3135788003 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f00a40b3100 con 0x7f008c004390 2024-04-22T07:18:59.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.862+0000 7f00a2ffd640 1 -- 172.21.15.37:0/3135788003 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f008c00b9c0 con 0x7f008c0039e0 2024-04-22T07:18:59.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.862+0000 7f00a2ffd640 1 -- 172.21.15.37:0/3135788003 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f008c00bbc0 con 0x7f00a41552f0 2024-04-22T07:18:59.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.862+0000 7f00a37fe640 1 --2- 172.21.15.37:0/3135788003 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f008c004390 0x7f008c004860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:59.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.862+0000 7f00a3fff640 1 --2- 172.21.15.37:0/3135788003 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f008c0039e0 0x7f008c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:59.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.862+0000 7f00a8c45640 1 --2- 172.21.15.37:0/3135788003 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f00a41552f0 0x7f008c0050c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:59.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.862+0000 7f00a37fe640 1 -- 172.21.15.37:0/3135788003 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f00a41552f0 msgr2=0x7f008c0050c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:18:59.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.862+0000 7f00a37fe640 1 --2- 172.21.15.37:0/3135788003 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f00a41552f0 0x7f008c0050c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:59.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.862+0000 7f00a37fe640 1 -- 172.21.15.37:0/3135788003 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f008c0039e0 msgr2=0x7f008c003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:18:59.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.862+0000 7f00a37fe640 1 --2- 172.21.15.37:0/3135788003 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f008c0039e0 0x7f008c003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:59.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.862+0000 7f00a37fe640 1 -- 172.21.15.37:0/3135788003 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f008c003520 con 0x7f008c004390 2024-04-22T07:18:59.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.863+0000 7f00a37fe640 1 --2- 172.21.15.37:0/3135788003 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f008c004390 0x7f008c004860 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f009800c190 tx=0x7f008c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f28335dc3e813222 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:59.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.863+0000 7f00a2ffd640 1 -- 172.21.15.37:0/3135788003 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0098007cc0 con 0x7f008c004390 2024-04-22T07:18:59.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.863+0000 7f00a2ffd640 1 -- 172.21.15.37:0/3135788003 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0098030070 con 0x7f008c004390 2024-04-22T07:18:59.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.863+0000 7f00a2ffd640 1 -- 172.21.15.37:0/3135788003 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0098005d10 con 0x7f008c004390 2024-04-22T07:18:59.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.864+0000 7f00aa6a8640 1 -- 172.21.15.37:0/3135788003 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f008c004390 msgr2=0x7f008c004860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:59.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.864+0000 7f00aa6a8640 1 --2- 172.21.15.37:0/3135788003 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f008c004390 0x7f008c004860 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f009800c190 tx=0x7f008c005830 comp rx=0 tx=0).stop 2024-04-22T07:18:59.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.864+0000 7f00a8c45640 1 -- 172.21.15.37:0/3135788003 reap_dead start 2024-04-22T07:18:59.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.864+0000 7f00aa6a8640 1 -- 172.21.15.37:0/3135788003 shutdown_connections 2024-04-22T07:18:59.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.864+0000 7f00aa6a8640 1 -- 172.21.15.37:0/3135788003 >> 172.21.15.37:0/3135788003 conn(0x7f00a4071f90 msgr2=0x7f00a40723a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:18:59.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.864+0000 7f00aa6a8640 1 -- 172.21.15.37:0/3135788003 shutdown_connections 2024-04-22T07:18:59.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.864+0000 7f00aa6a8640 1 -- 172.21.15.37:0/3135788003 wait complete. 2024-04-22T07:18:59.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.865+0000 7f00aa6a8640 1 Processor -- start 2024-04-22T07:18:59.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.865+0000 7f00aa6a8640 1 -- start start 2024-04-22T07:18:59.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.866+0000 7f00aa6a8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f008c004390 0x7f00a4157270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:59.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.866+0000 7f00aa6a8640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f00a4155c70 0x7f00a41f1570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:59.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.866+0000 7f00aa6a8640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f00a4157860 0x7f00a4156930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:59.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.866+0000 7f00aa6a8640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f00a415e7a0 con 0x7f008c004390 2024-04-22T07:18:59.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.866+0000 7f00aa6a8640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f00a415e4c0 con 0x7f00a4155c70 2024-04-22T07:18:59.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.866+0000 7f00aa6a8640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f00a415ea80 con 0x7f00a4157860 2024-04-22T07:18:59.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.866+0000 7f00a3fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f008c004390 0x7f00a4157270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:59.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.866+0000 7f00a3fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f008c004390 0x7f00a4157270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34860/0 (socket says 172.21.15.37:34860) 2024-04-22T07:18:59.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.866+0000 7f00a3fff640 1 -- 172.21.15.37:0/3883730390 learned_addr learned my addr 172.21.15.37:0/3883730390 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:18:59.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.866+0000 7f00a37fe640 1 --2- 172.21.15.37:0/3883730390 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f00a4155c70 0x7f00a41f1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:59.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.866+0000 7f00a8c45640 1 --2- 172.21.15.37:0/3883730390 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f00a4157860 0x7f00a4156930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:59.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.866+0000 7f00a3fff640 1 -- 172.21.15.37:0/3883730390 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f00a4157860 msgr2=0x7f00a4156930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:59.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.866+0000 7f00a3fff640 1 --2- 172.21.15.37:0/3883730390 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f00a4157860 0x7f00a4156930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:59.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.866+0000 7f00a3fff640 1 -- 172.21.15.37:0/3883730390 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f00a4155c70 msgr2=0x7f00a41f1570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:18:59.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.866+0000 7f00a3fff640 1 --2- 172.21.15.37:0/3883730390 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f00a4155c70 0x7f00a41f1570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:18:59.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.866+0000 7f00a3fff640 1 -- 172.21.15.37:0/3883730390 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00a40c62b0 con 0x7f008c004390 2024-04-22T07:18:59.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.867+0000 7f00a3fff640 1 --2- 172.21.15.37:0/3883730390 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f008c004390 0x7f00a4157270 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f0094011a00 tx=0x7f0094011ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:59.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.867+0000 7f00a0ff9640 1 -- 172.21.15.37:0/3883730390 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f009400faf0 con 0x7f008c004390 2024-04-22T07:18:59.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.867+0000 7f00a0ff9640 1 -- 172.21.15.37:0/3883730390 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f009400fc90 con 0x7f008c004390 2024-04-22T07:18:59.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.867+0000 7f00aa6a8640 1 -- 172.21.15.37:0/3883730390 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00a40c6590 con 0x7f008c004390 2024-04-22T07:18:59.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.867+0000 7f00a0ff9640 1 -- 172.21.15.37:0/3883730390 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0094014440 con 0x7f008c004390 2024-04-22T07:18:59.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.867+0000 7f00aa6a8640 1 -- 172.21.15.37:0/3883730390 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00a40c6b50 con 0x7f008c004390 2024-04-22T07:18:59.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.868+0000 7f00aa6a8640 1 -- 172.21.15.37:0/3883730390 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00a4069cc0 con 0x7f008c004390 2024-04-22T07:18:59.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.868+0000 7f00a0ff9640 1 -- 172.21.15.37:0/3883730390 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0094012040 con 0x7f008c004390 2024-04-22T07:18:59.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.869+0000 7f00a0ff9640 1 --2- 172.21.15.37:0/3883730390 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f009006c920 0x7f009006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:18:59.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.869+0000 7f00a0ff9640 1 -- 172.21.15.37:0/3883730390 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f009408c060 con 0x7f008c004390 2024-04-22T07:18:59.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.869+0000 7f00a37fe640 1 --2- 172.21.15.37:0/3883730390 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f009006c920 0x7f009006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:18:59.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.870+0000 7f00a37fe640 1 --2- 172.21.15.37:0/3883730390 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f009006c920 0x7f009006ede0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f009800c190 tx=0x7f0098009030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:18:59.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:18:59.873+0000 7f00a0ff9640 1 -- 172.21.15.37:0/3883730390 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f0094019030 con 0x7f008c004390 2024-04-22T07:18:59.874 INFO:tasks.workunit.client.0.smithi037.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-04-22T07:19:00.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.100+0000 7f00aa6a8640 1 -- 172.21.15.37:0/3883730390 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f00a40cf200 con 0x7f008c004390 2024-04-22T07:19:00.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.101+0000 7f00a0ff9640 1 -- 172.21.15.37:0/3883730390 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6827 (secure 0 0 0) 0x7f0094059db0 con 0x7f008c004390 2024-04-22T07:19:00.099 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-22T07:19:00.099 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4265,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6839/671847354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6835","nonce":671847354},{"type":"v1","addr":"172.21.15.196:6839","nonce":671847354}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6833/1549427395","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1549427395},{"type":"v1","addr":"172.21.15.37:6833","nonce":1549427395}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6836/3825988951","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":3825988951},{"type":"v1","addr":"172.21.15.37:6836","nonce":3825988951}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4272,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/611771502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6835","nonce":611771502},{"type":"v1","addr":"172.21.15.37:6837","nonce":611771502}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4291,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6837/3055080225","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6834","nonce":3055080225},{"type":"v1","addr":"172.21.15.196:6837","nonce":3055080225}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-22T07:18:36.111618+0000","modified":"2024-04-22T07:18:41.783857+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.196:6838/3264179771","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6836","nonce":3264179771},{"type":"v1","addr":"172.21.15.196:6838","nonce":3264179771}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4294,"qdb_cluster":[4294]},"id":1}]} 2024-04-22T07:19:00.099 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 8 2024-04-22T07:19:00.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.103+0000 7f00aa6a8640 1 -- 172.21.15.37:0/3883730390 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f009006c920 msgr2=0x7f009006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:19:00.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.103+0000 7f00aa6a8640 1 --2- 172.21.15.37:0/3883730390 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f009006c920 0x7f009006ede0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f009800c190 tx=0x7f0098009030 comp rx=0 tx=0).stop 2024-04-22T07:19:00.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.103+0000 7f00aa6a8640 1 -- 172.21.15.37:0/3883730390 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f008c004390 msgr2=0x7f00a4157270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:19:00.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.103+0000 7f00aa6a8640 1 --2- 172.21.15.37:0/3883730390 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f008c004390 0x7f00a4157270 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f0094011a00 tx=0x7f0094011ec0 comp rx=0 tx=0).stop 2024-04-22T07:19:00.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.103+0000 7f00aa6a8640 1 -- 172.21.15.37:0/3883730390 shutdown_connections 2024-04-22T07:19:00.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.103+0000 7f00aa6a8640 1 --2- 172.21.15.37:0/3883730390 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f009006c920 0x7f009006ede0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:19:00.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.103+0000 7f00aa6a8640 1 --2- 172.21.15.37:0/3883730390 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f00a4157860 0x7f00a4156930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:19:00.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.103+0000 7f00aa6a8640 1 --2- 172.21.15.37:0/3883730390 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f00a4155c70 0x7f00a41f1570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:19:00.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.103+0000 7f00aa6a8640 1 --2- 172.21.15.37:0/3883730390 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f008c004390 0x7f00a4157270 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:19:00.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.103+0000 7f00aa6a8640 1 -- 172.21.15.37:0/3883730390 >> 172.21.15.37:0/3883730390 conn(0x7f00a4071f90 msgr2=0x7f00a40cd0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:19:00.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.103+0000 7f00aa6a8640 1 -- 172.21.15.37:0/3883730390 shutdown_connections 2024-04-22T07:19:00.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.103+0000 7f00aa6a8640 1 -- 172.21.15.37:0/3883730390 wait complete. 2024-04-22T07:19:00.717 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-22T07:18:36.111618+0000', 'modified': '2024-04-22T07:18:41.783857+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4294}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4294': {'gid': 4294, 'name': 'f', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.196:6838/3264179771', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.196:6836', 'nonce': 3264179771}, {'type': 'v1', 'addr': '172.21.15.196:6838', 'nonce': 3264179771}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4294, 'qdb_cluster': [4294]} 2024-04-22T07:19:00.717 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-22T07:19:00.717 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.f status 2024-04-22T07:19:00.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.830+0000 7f52daa3e640 1 Processor -- start 2024-04-22T07:19:00.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.830+0000 7f52daa3e640 1 -- start start 2024-04-22T07:19:00.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.830+0000 7f52daa3e640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f52d4155250 0x7f52d415af40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:19:00.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.830+0000 7f52daa3e640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f52d40b3190 0x7f52d40b35b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:19:00.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.831+0000 7f52daa3e640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f52d40b3bd0 con 0x7f52d40ccd20 2024-04-22T07:19:00.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.831+0000 7f52daa3e640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f52d40cb6a0 con 0x7f52d4155250 2024-04-22T07:19:00.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.831+0000 7f52daa3e640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f52d415e4b0 con 0x7f52d40b3190 2024-04-22T07:19:00.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.831+0000 7f52d3fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f52d4155250 0x7f52d415af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:19:00.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.831+0000 7f52d3fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f52d4155250 0x7f52d415af40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34862/0 (socket says 172.21.15.37:34862) 2024-04-22T07:19:00.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.831+0000 7f52d3fff640 1 -- 172.21.15.37:0/4276861792 learned_addr learned my addr 172.21.15.37:0/4276861792 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:19:00.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.831+0000 7f52d37fe640 1 --2- 172.21.15.37:0/4276861792 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f52d40b3190 0x7f52d40b35b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:19:00.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.831+0000 7f52d3fff640 1 -- 172.21.15.37:0/4276861792 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f52d40b3190 msgr2=0x7f52d40b35b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:19:00.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.831+0000 7f52d3fff640 1 --2- 172.21.15.37:0/4276861792 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f52d40b3190 0x7f52d40b35b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:19:00.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.831+0000 7f52d3fff640 1 -- 172.21.15.37:0/4276861792 >> v1:172.21.15.196:6789/0 conn(0x7f52d40ccd20 legacy=0x7f52d40cd1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:19:00.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.831+0000 7f52d3fff640 1 -- 172.21.15.37:0/4276861792 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52d40b3eb0 con 0x7f52d4155250 2024-04-22T07:19:00.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.832+0000 7f52d3fff640 1 --2- 172.21.15.37:0/4276861792 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52d4155250 0x7f52d415af40 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f52c4009870 tx=0x7f52c402b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5dbe69418912a83 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:19:00.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.832+0000 7f52d2ffd640 1 -- 172.21.15.37:0/4276861792 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52c4034070 con 0x7f52d4155250 2024-04-22T07:19:00.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.832+0000 7f52d2ffd640 1 -- 172.21.15.37:0/4276861792 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52c4030840 con 0x7f52d4155250 2024-04-22T07:19:00.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.832+0000 7f52d2ffd640 1 -- 172.21.15.37:0/4276861792 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52c4030c10 con 0x7f52d4155250 2024-04-22T07:19:00.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.832+0000 7f52daa3e640 1 -- 172.21.15.37:0/4276861792 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52d4155250 msgr2=0x7f52d415af40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:19:00.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.832+0000 7f52daa3e640 1 --2- 172.21.15.37:0/4276861792 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52d4155250 0x7f52d415af40 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f52c4009870 tx=0x7f52c402b980 comp rx=0 tx=0).stop 2024-04-22T07:19:00.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.833+0000 7f52daa3e640 1 -- 172.21.15.37:0/4276861792 shutdown_connections 2024-04-22T07:19:00.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.833+0000 7f52daa3e640 1 --2- 172.21.15.37:0/4276861792 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f52d40b3190 0x7f52d40b35b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:19:00.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.833+0000 7f52daa3e640 1 --2- 172.21.15.37:0/4276861792 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52d4155250 0x7f52d415af40 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:19:00.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.833+0000 7f52daa3e640 1 -- 172.21.15.37:0/4276861792 >> 172.21.15.37:0/4276861792 conn(0x7f52d4071f90 msgr2=0x7f52d40723a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:19:00.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.833+0000 7f52daa3e640 1 -- 172.21.15.37:0/4276861792 shutdown_connections 2024-04-22T07:19:00.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.833+0000 7f52daa3e640 1 -- 172.21.15.37:0/4276861792 wait complete. 2024-04-22T07:19:00.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.834+0000 7f52daa3e640 1 Processor -- start 2024-04-22T07:19:00.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.834+0000 7f52daa3e640 1 -- start start 2024-04-22T07:19:00.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.835+0000 7f52daa3e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52d40b3190 0x7f52d41569f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:19:00.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.835+0000 7f52daa3e640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f52d40ccd20 0x7f52d40cf7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:19:00.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.835+0000 7f52daa3e640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f52d4155250 0x7f52d4155f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:19:00.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.835+0000 7f52daa3e640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f52d415ecc0 con 0x7f52d40b3190 2024-04-22T07:19:00.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.835+0000 7f52daa3e640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f52d415e9e0 con 0x7f52d40ccd20 2024-04-22T07:19:00.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.835+0000 7f52daa3e640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f52d4155630 con 0x7f52d4155250 2024-04-22T07:19:00.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.835+0000 7f52d3fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52d40b3190 0x7f52d41569f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:19:00.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.835+0000 7f52d3fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52d40b3190 0x7f52d41569f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34874/0 (socket says 172.21.15.37:34874) 2024-04-22T07:19:00.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.835+0000 7f52d3fff640 1 -- 172.21.15.37:0/34635991 learned_addr learned my addr 172.21.15.37:0/34635991 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:19:00.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.835+0000 7f52d37fe640 1 --2- 172.21.15.37:0/34635991 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f52d40ccd20 0x7f52d40cf7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:19:00.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.835+0000 7f52d8fdb640 1 --2- 172.21.15.37:0/34635991 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f52d4155250 0x7f52d4155f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:19:00.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.835+0000 7f52d3fff640 1 -- 172.21.15.37:0/34635991 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f52d4155250 msgr2=0x7f52d4155f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:19:00.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.835+0000 7f52d3fff640 1 --2- 172.21.15.37:0/34635991 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f52d4155250 0x7f52d4155f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:19:00.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.835+0000 7f52d3fff640 1 -- 172.21.15.37:0/34635991 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f52d40ccd20 msgr2=0x7f52d40cf7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:19:00.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.835+0000 7f52d3fff640 1 --2- 172.21.15.37:0/34635991 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f52d40ccd20 0x7f52d40cf7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:19:00.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.835+0000 7f52d3fff640 1 -- 172.21.15.37:0/34635991 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52d415a6b0 con 0x7f52d40b3190 2024-04-22T07:19:00.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.835+0000 7f52d3fff640 1 --2- 172.21.15.37:0/34635991 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52d40b3190 0x7f52d41569f0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f52c402b9c0 tx=0x7f52c4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:19:00.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.835+0000 7f52d0ff9640 1 -- 172.21.15.37:0/34635991 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52c4048070 con 0x7f52d40b3190 2024-04-22T07:19:00.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.835+0000 7f52d0ff9640 1 -- 172.21.15.37:0/34635991 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52c4030640 con 0x7f52d40b3190 2024-04-22T07:19:00.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.835+0000 7f52daa3e640 1 -- 172.21.15.37:0/34635991 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52d415a990 con 0x7f52d40b3190 2024-04-22T07:19:00.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.835+0000 7f52d0ff9640 1 -- 172.21.15.37:0/34635991 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52c4034040 con 0x7f52d40b3190 2024-04-22T07:19:00.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.835+0000 7f52daa3e640 1 -- 172.21.15.37:0/34635991 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52d415af50 con 0x7f52d40b3190 2024-04-22T07:19:00.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.837+0000 7f52d0ff9640 1 -- 172.21.15.37:0/34635991 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f52c404b070 con 0x7f52d40b3190 2024-04-22T07:19:00.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.837+0000 7f52d0ff9640 1 --2- 172.21.15.37:0/34635991 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f52c006c8f0 0x7f52c006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:19:00.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.837+0000 7f52d0ff9640 1 -- 172.21.15.37:0/34635991 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f52c40adbe0 con 0x7f52d40b3190 2024-04-22T07:19:00.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.837+0000 7f52d37fe640 1 --2- 172.21.15.37:0/34635991 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f52c006c8f0 0x7f52c006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:19:00.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.838+0000 7f52d37fe640 1 --2- 172.21.15.37:0/34635991 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f52c006c8f0 0x7f52c006edb0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f52c8006fd0 tx=0x7f52c8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:19:00.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.838+0000 7f52dd62a740 1 Processor -- start 2024-04-22T07:19:00.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.838+0000 7f52dd62a740 1 -- start start 2024-04-22T07:19:00.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.839+0000 7f52dd62a740 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x5604b805de40 0x5604b8066f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:19:00.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.839+0000 7f52dd62a740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5604b801eec0 0x5604b80674a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:19:00.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.839+0000 7f52dd62a740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5604b801aca0 0x5604b8042ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:19:00.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.839+0000 7f52dd62a740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5604b7f81b10 con 0x5604b801aca0 2024-04-22T07:19:00.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.839+0000 7f52dd62a740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x5604b7f1f240 con 0x5604b801eec0 2024-04-22T07:19:00.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.839+0000 7f52dd62a740 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x5604b7f7dad0 con 0x5604b805de40 2024-04-22T07:19:00.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.839+0000 7f52d8fdb640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5604b801aca0 0x5604b8042ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:19:00.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.839+0000 7f52d8fdb640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5604b801aca0 0x5604b8042ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34880/0 (socket says 172.21.15.37:34880) 2024-04-22T07:19:00.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.839+0000 7f52d8fdb640 1 -- 172.21.15.37:0/3198799120 learned_addr learned my addr 172.21.15.37:0/3198799120 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:19:00.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.839+0000 7f52d3fff640 1 --2- 172.21.15.37:0/3198799120 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x5604b805de40 0x5604b8066f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:19:00.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.839+0000 7f52d37fe640 1 --2- 172.21.15.37:0/3198799120 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5604b801eec0 0x5604b80674a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:19:00.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.839+0000 7f52d8fdb640 1 -- 172.21.15.37:0/3198799120 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x5604b805de40 msgr2=0x5604b8066f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:19:00.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.839+0000 7f52d8fdb640 1 --2- 172.21.15.37:0/3198799120 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x5604b805de40 0x5604b8066f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:19:00.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.839+0000 7f52d8fdb640 1 -- 172.21.15.37:0/3198799120 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5604b801eec0 msgr2=0x5604b80674a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:19:00.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.839+0000 7f52d8fdb640 1 --2- 172.21.15.37:0/3198799120 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5604b801eec0 0x5604b80674a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:19:00.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.839+0000 7f52d8fdb640 1 -- 172.21.15.37:0/3198799120 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5604b7c942d0 con 0x5604b801aca0 2024-04-22T07:19:00.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.840+0000 7f52d8fdb640 1 --2- 172.21.15.37:0/3198799120 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5604b801aca0 0x5604b8042ee0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f52cc001c70 tx=0x7f52cc002130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7471d7bdea50569c server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:19:00.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.840+0000 7f52b9ffb640 1 -- 172.21.15.37:0/3198799120 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52cc019070 con 0x5604b801aca0 2024-04-22T07:19:00.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.840+0000 7f52b9ffb640 1 -- 172.21.15.37:0/3198799120 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52cc003b80 con 0x5604b801aca0 2024-04-22T07:19:00.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.840+0000 7f52b9ffb640 1 -- 172.21.15.37:0/3198799120 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52cc00e860 con 0x5604b801aca0 2024-04-22T07:19:00.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.840+0000 7f52dd62a740 1 -- 172.21.15.37:0/3198799120 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5604b801aca0 msgr2=0x5604b8042ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:19:00.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.840+0000 7f52dd62a740 1 --2- 172.21.15.37:0/3198799120 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5604b801aca0 0x5604b8042ee0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f52cc001c70 tx=0x7f52cc002130 comp rx=0 tx=0).stop 2024-04-22T07:19:00.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.840+0000 7f52dd62a740 1 -- 172.21.15.37:0/3198799120 shutdown_connections 2024-04-22T07:19:00.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.840+0000 7f52dd62a740 1 --2- 172.21.15.37:0/3198799120 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5604b801aca0 0x5604b8042ee0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:19:00.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.840+0000 7f52dd62a740 1 --2- 172.21.15.37:0/3198799120 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5604b801eec0 0x5604b80674a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:19:00.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.840+0000 7f52dd62a740 1 --2- 172.21.15.37:0/3198799120 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x5604b805de40 0x5604b8066f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:19:00.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.840+0000 7f52dd62a740 1 -- 172.21.15.37:0/3198799120 >> 172.21.15.37:0/3198799120 conn(0x5604b8019990 msgr2=0x5604b801c290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:19:00.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.841+0000 7f52dd62a740 1 -- 172.21.15.37:0/3198799120 shutdown_connections 2024-04-22T07:19:00.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.841+0000 7f52dd62a740 1 -- 172.21.15.37:0/3198799120 wait complete. 2024-04-22T07:19:00.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.841+0000 7f52dd62a740 1 -- start start 2024-04-22T07:19:00.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.841+0000 7f52dd62a740 1 Processor -- start 2024-04-22T07:19:00.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.842+0000 7f52dd62a740 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x5604b801eec0 0x5604b805b790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:19:00.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.842+0000 7f52dd62a740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5604b805de40 0x5604b8016170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:19:00.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.842+0000 7f52dd62a740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5604b8032140 0x5604b80431c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:19:00.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.842+0000 7f52dd62a740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5604b801d250 con 0x5604b8032140 2024-04-22T07:19:00.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.842+0000 7f52dd62a740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x5604b7f0a190 con 0x5604b805de40 2024-04-22T07:19:00.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.842+0000 7f52dd62a740 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x5604b801d530 con 0x5604b801eec0 2024-04-22T07:19:00.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.842+0000 7f52dd62a740 10 client.0 _ll_register_callbacks cb 0x5604b7f058b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-22T07:19:00.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.842+0000 7f52d8fdb640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5604b8032140 0x5604b80431c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:19:00.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.842+0000 7f52d3fff640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x5604b801eec0 0x5604b805b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:19:00.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.842+0000 7f52d8fdb640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5604b8032140 0x5604b80431c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34892/0 (socket says 172.21.15.37:34892) 2024-04-22T07:19:00.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.842+0000 7f52d37fe640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5604b805de40 0x5604b8016170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:19:00.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.842+0000 7f52d8fdb640 1 -- 172.21.15.37:0/796091355 learned_addr learned my addr 172.21.15.37:0/796091355 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:19:00.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.843+0000 7f52d8fdb640 1 -- 172.21.15.37:0/796091355 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x5604b801eec0 msgr2=0x5604b805b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:19:00.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.843+0000 7f52d8fdb640 1 --2- 172.21.15.37:0/796091355 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x5604b801eec0 0x5604b805b790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:19:00.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.843+0000 7f52d8fdb640 1 -- 172.21.15.37:0/796091355 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5604b805de40 msgr2=0x5604b8016170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:19:00.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.843+0000 7f52d8fdb640 1 --2- 172.21.15.37:0/796091355 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5604b805de40 0x5604b8016170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:19:00.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.843+0000 7f52d8fdb640 1 -- 172.21.15.37:0/796091355 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5604b7d5e6b0 con 0x5604b8032140 2024-04-22T07:19:00.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.843+0000 7f52d8fdb640 1 --2- 172.21.15.37:0/796091355 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5604b8032140 0x5604b80431c0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f52cc00e530 tx=0x7f52cc001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0ac9eed473cf01a server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:19:00.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.843+0000 7f52b2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-04-22T07:19:00.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.843+0000 7f52b2ffd640 1 -- 172.21.15.37:0/796091355 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52cc022060 con 0x5604b8032140 2024-04-22T07:19:00.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.843+0000 7f52b2ffd640 1 -- 172.21.15.37:0/796091355 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f52cc00e860 con 0x5604b8032140 2024-04-22T07:19:00.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.843+0000 7f52dd62a740 1 -- 172.21.15.37:0/796091355 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f52cc003b80 con 0x5604b8032140 2024-04-22T07:19:00.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.843+0000 7f52b2ffd640 1 -- 172.21.15.37:0/796091355 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7f52cc028050 con 0x5604b8032140 2024-04-22T07:19:00.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.843+0000 7f52dd62a740 10 client.4830 fetch_fsmap learned FSMap version 8 2024-04-22T07:19:00.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.843+0000 7f52dd62a740 1 -- 172.21.15.37:0/796091355 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x5604b80632d0 con 0x5604b8032140 2024-04-22T07:19:00.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.843+0000 7f52b2ffd640 1 -- 172.21.15.37:0/796091355 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52cc003b80 con 0x5604b8032140 2024-04-22T07:19:00.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.843+0000 7f52b2ffd640 1 -- 172.21.15.37:0/796091355 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 8) ==== 4704+0+0 (secure 0 0 0) 0x7f52cc02b020 con 0x5604b8032140 2024-04-22T07:19:00.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.844+0000 7f52dd62a740 10 client.4830 fetch_fsmap finished waiting for FSMap version 8 2024-04-22T07:19:00.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.844+0000 7f52dd62a740 10 client.4830 resolve_mds: resolved name 'f' to daemon mds.f 2024-04-22T07:19:00.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.844+0000 7f52dd62a740 20 client.4830 populate_metadata read hostname 'smithi037' 2024-04-22T07:19:00.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.844+0000 7f52dd62a740 1 --2- 172.21.15.37:0/796091355 >> [v2:172.21.15.196:6836/3264179771,v1:172.21.15.196:6838/3264179771] conn(0x5604b8057e90 0x5604b807dc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:19:00.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.844+0000 7f52dd62a740 4 client.4830 mds_command: new command op to 4294 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-22T07:19:00.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.844+0000 7f52dd62a740 1 -- 172.21.15.37:0/796091355 --> [v2:172.21.15.196:6836/3264179771,v1:172.21.15.196:6838/3264179771] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5604b7f8f530 con 0x5604b8057e90 2024-04-22T07:19:00.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.844+0000 7f52d3fff640 1 --2- 172.21.15.37:0/796091355 >> [v2:172.21.15.196:6836/3264179771,v1:172.21.15.196:6838/3264179771] conn(0x5604b8057e90 0x5604b807dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:19:00.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.844+0000 7f52d3fff640 1 --2- 172.21.15.37:0/796091355 >> [v2:172.21.15.196:6836/3264179771,v1:172.21.15.196:6838/3264179771] conn(0x5604b8057e90 0x5604b807dc10 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3e944793777deea0 server_cookie=a374392eb8de07cb in_seq=0 out_seq=0 2024-04-22T07:19:00.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.844+0000 7f52b2ffd640 10 client.4830 ms_handle_connect on v2:172.21.15.196:6836/3264179771 2024-04-22T07:19:00.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.845+0000 7f52b2ffd640 1 -- 172.21.15.37:0/796091355 <== mds.0 v2:172.21.15.196:6836/3264179771 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5604b7f8f530 con 0x5604b8057e90 2024-04-22T07:19:00.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.845+0000 7f52b2ffd640 10 client.4830 handle_command_reply: tid=0 2024-04-22T07:19:00.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.845+0000 7f52dd62a740 1 client.4830 shutdown 2024-04-22T07:19:00.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.845+0000 7f52dd62a740 1 -- 172.21.15.37:0/796091355 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5604b8032140 msgr2=0x5604b80431c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:19:00.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.845+0000 7f52dd62a740 1 --2- 172.21.15.37:0/796091355 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5604b8032140 0x5604b80431c0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f52cc00e530 tx=0x7f52cc001250 comp rx=0 tx=0).stop 2024-04-22T07:19:00.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.845+0000 7f52dd62a740 1 -- 172.21.15.37:0/796091355 shutdown_connections 2024-04-22T07:19:00.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.845+0000 7f52dd62a740 1 --2- 172.21.15.37:0/796091355 >> [v2:172.21.15.196:6836/3264179771,v1:172.21.15.196:6838/3264179771] conn(0x5604b8057e90 0x5604b807dc10 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:19:00.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.845+0000 7f52dd62a740 1 --2- 172.21.15.37:0/796091355 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5604b8032140 0x5604b80431c0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:19:00.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.845+0000 7f52dd62a740 1 --2- 172.21.15.37:0/796091355 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5604b805de40 0x5604b8016170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:19:00.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.845+0000 7f52b2ffd640 0 client.4830 ms_handle_reset on v2:172.21.15.196:6836/3264179771 2024-04-22T07:19:00.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.845+0000 7f52dd62a740 1 --2- 172.21.15.37:0/796091355 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x5604b801eec0 0x5604b805b790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:19:00.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.845+0000 7f52dd62a740 1 -- 172.21.15.37:0/796091355 >> 172.21.15.37:0/796091355 conn(0x5604b801aca0 msgr2=0x5604b8066ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:19:00.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.845+0000 7f52dd62a740 1 -- 172.21.15.37:0/796091355 shutdown_connections 2024-04-22T07:19:00.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.845+0000 7f52dd62a740 1 -- 172.21.15.37:0/796091355 wait complete. 2024-04-22T07:19:00.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.846+0000 7f52dd62a740 20 client.4830 trim_cache size 0 max 16384 2024-04-22T07:19:00.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.864+0000 7f52dd62a740 1 Processor -- start 2024-04-22T07:19:00.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.864+0000 7f52dd62a740 1 -- start start 2024-04-22T07:19:00.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.864+0000 7f52dd62a740 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x5604b801eec0 0x5604b801b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:19:00.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.864+0000 7f52dd62a740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5604b8032140 0x5604b801b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:19:00.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.865+0000 7f52dd62a740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5604b805de40 0x5604b8066e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:19:00.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.865+0000 7f52dd62a740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f52d41f4d50 con 0x5604b8032140 2024-04-22T07:19:00.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.865+0000 7f52dd62a740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x5604b80635b0 con 0x5604b805de40 2024-04-22T07:19:00.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.865+0000 7f52dd62a740 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x5604b8016be0 con 0x5604b801eec0 2024-04-22T07:19:00.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.865+0000 7f52d37fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5604b8032140 0x5604b801b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:19:00.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.865+0000 7f52d37fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5604b8032140 0x5604b801b5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34894/0 (socket says 172.21.15.37:34894) 2024-04-22T07:19:00.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.865+0000 7f52d37fe640 1 -- 172.21.15.37:0/553672066 learned_addr learned my addr 172.21.15.37:0/553672066 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:19:00.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.865+0000 7f52d8fdb640 1 --2- 172.21.15.37:0/553672066 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5604b805de40 0x5604b8066e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:19:00.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.865+0000 7f52d3fff640 1 --2- 172.21.15.37:0/553672066 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x5604b801eec0 0x5604b801b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:19:00.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.865+0000 7f52d37fe640 1 -- 172.21.15.37:0/553672066 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x5604b801eec0 msgr2=0x5604b801b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:19:00.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.865+0000 7f52d37fe640 1 --2- 172.21.15.37:0/553672066 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x5604b801eec0 0x5604b801b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:19:00.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.865+0000 7f52d37fe640 1 -- 172.21.15.37:0/553672066 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5604b805de40 msgr2=0x5604b8066e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:19:00.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.865+0000 7f52d37fe640 1 --2- 172.21.15.37:0/553672066 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5604b805de40 0x5604b8066e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:19:00.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.865+0000 7f52d37fe640 1 -- 172.21.15.37:0/553672066 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5604b80164e0 con 0x5604b8032140 2024-04-22T07:19:00.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.865+0000 7f52d3fff640 1 --2- 172.21.15.37:0/553672066 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x5604b801eec0 0x5604b801b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-22T07:19:00.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.865+0000 7f52d37fe640 1 --2- 172.21.15.37:0/553672066 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5604b8032140 0x5604b801b5c0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f52d41f2050 tx=0x7f52c8012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e815170ae0e70a60 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:19:00.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.865+0000 7f52b97fa640 1 -- 172.21.15.37:0/553672066 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52c801b040 con 0x5604b8032140 2024-04-22T07:19:00.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.865+0000 7f52b97fa640 1 -- 172.21.15.37:0/553672066 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52c801c040 con 0x5604b8032140 2024-04-22T07:19:00.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.865+0000 7f52b97fa640 1 -- 172.21.15.37:0/553672066 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52c8023440 con 0x5604b8032140 2024-04-22T07:19:00.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.866+0000 7f52dd62a740 1 -- 172.21.15.37:0/553672066 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5604b8032140 msgr2=0x5604b801b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:19:00.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.866+0000 7f52dd62a740 1 --2- 172.21.15.37:0/553672066 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5604b8032140 0x5604b801b5c0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f52d41f2050 tx=0x7f52c8012000 comp rx=0 tx=0).stop 2024-04-22T07:19:00.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.866+0000 7f52dd62a740 1 -- 172.21.15.37:0/553672066 shutdown_connections 2024-04-22T07:19:00.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.866+0000 7f52dd62a740 1 --2- 172.21.15.37:0/553672066 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5604b805de40 0x5604b8066e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:19:00.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.866+0000 7f52dd62a740 1 --2- 172.21.15.37:0/553672066 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5604b8032140 0x5604b801b5c0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:19:00.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.866+0000 7f52dd62a740 1 --2- 172.21.15.37:0/553672066 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x5604b801eec0 0x5604b801b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:19:00.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.866+0000 7f52dd62a740 1 -- 172.21.15.37:0/553672066 >> 172.21.15.37:0/553672066 conn(0x5604b801aca0 msgr2=0x5604b8042fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:19:00.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.866+0000 7f52dd62a740 1 -- 172.21.15.37:0/553672066 shutdown_connections 2024-04-22T07:19:00.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.866+0000 7f52dd62a740 1 -- 172.21.15.37:0/553672066 wait complete. 2024-04-22T07:19:00.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.866+0000 7f52dd62a740 1 -- start start 2024-04-22T07:19:00.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.867+0000 7f52dd62a740 1 Processor -- start 2024-04-22T07:19:00.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.867+0000 7f52dd62a740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5604b801eec0 0x5604b8061260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:19:00.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.867+0000 7f52dd62a740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5604b8032140 0x5604b8031730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:19:00.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.867+0000 7f52dd62a740 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x5604b805de40 0x5604b8067190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:19:00.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.867+0000 7f52dd62a740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5604b8072260 con 0x5604b8032140 2024-04-22T07:19:00.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.867+0000 7f52dd62a740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x5604b8057d10 con 0x5604b801eec0 2024-04-22T07:19:00.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.867+0000 7f52dd62a740 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x5604b80728b0 con 0x5604b805de40 2024-04-22T07:19:00.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.867+0000 7f52dd62a740 10 client.0 _ll_register_callbacks cb 0x7f52cc017070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-22T07:19:00.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.868+0000 7f52d37fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5604b8032140 0x5604b8031730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:19:00.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.868+0000 7f52d37fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5604b8032140 0x5604b8031730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34908/0 (socket says 172.21.15.37:34908) 2024-04-22T07:19:00.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.868+0000 7f52d37fe640 1 -- 172.21.15.37:0/42674375 learned_addr learned my addr 172.21.15.37:0/42674375 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:19:00.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.868+0000 7f52d3fff640 1 --2- 172.21.15.37:0/42674375 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5604b801eec0 0x5604b8061260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:19:00.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.868+0000 7f52d8fdb640 1 --2- 172.21.15.37:0/42674375 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x5604b805de40 0x5604b8067190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:19:00.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.868+0000 7f52d37fe640 1 -- 172.21.15.37:0/42674375 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x5604b805de40 msgr2=0x5604b8067190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:19:00.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.868+0000 7f52d37fe640 1 --2- 172.21.15.37:0/42674375 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x5604b805de40 0x5604b8067190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:19:00.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.868+0000 7f52d37fe640 1 -- 172.21.15.37:0/42674375 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5604b801eec0 msgr2=0x5604b8061260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:19:00.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.868+0000 7f52d37fe640 1 --2- 172.21.15.37:0/42674375 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5604b801eec0 0x5604b8061260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:19:00.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.868+0000 7f52d37fe640 1 -- 172.21.15.37:0/42674375 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5604b801ecf0 con 0x5604b8032140 2024-04-22T07:19:00.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.868+0000 7f52d37fe640 1 --2- 172.21.15.37:0/42674375 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5604b8032140 0x5604b8031730 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f52c8006f00 tx=0x7f52c8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d0c6a341ff1ab41 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:19:00.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.868+0000 7f52b2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-04-22T07:19:00.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.868+0000 7f52b2ffd640 1 -- 172.21.15.37:0/42674375 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52c803a060 con 0x5604b8032140 2024-04-22T07:19:00.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.868+0000 7f52b2ffd640 1 -- 172.21.15.37:0/42674375 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f52c8023850 con 0x5604b8032140 2024-04-22T07:19:00.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.868+0000 7f52dd62a740 1 -- 172.21.15.37:0/42674375 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f52c801c040 con 0x5604b8032140 2024-04-22T07:19:00.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.868+0000 7f52b2ffd640 1 -- 172.21.15.37:0/42674375 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7f52c8040050 con 0x5604b8032140 2024-04-22T07:19:00.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.868+0000 7f52dd62a740 10 client.4836 fetch_fsmap learned FSMap version 8 2024-04-22T07:19:00.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.868+0000 7f52dd62a740 1 -- 172.21.15.37:0/42674375 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x5604b801b790 con 0x5604b8032140 2024-04-22T07:19:00.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.869+0000 7f52b2ffd640 1 -- 172.21.15.37:0/42674375 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52c801c040 con 0x5604b8032140 2024-04-22T07:19:00.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.869+0000 7f52b2ffd640 1 -- 172.21.15.37:0/42674375 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 8) ==== 4704+0+0 (secure 0 0 0) 0x7f52c8023a50 con 0x5604b8032140 2024-04-22T07:19:00.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.869+0000 7f52dd62a740 10 client.4836 fetch_fsmap finished waiting for FSMap version 8 2024-04-22T07:19:00.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.869+0000 7f52dd62a740 10 client.4836 resolve_mds: resolved name 'f' to daemon mds.f 2024-04-22T07:19:00.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.869+0000 7f52dd62a740 20 client.4836 populate_metadata read hostname 'smithi037' 2024-04-22T07:19:00.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.869+0000 7f52dd62a740 1 --2- 172.21.15.37:0/42674375 >> [v2:172.21.15.196:6836/3264179771,v1:172.21.15.196:6838/3264179771] conn(0x5604b80dcd40 0x5604b80e5940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:19:00.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.869+0000 7f52dd62a740 4 client.4836 mds_command: new command op to 4294 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-22T07:19:00.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.869+0000 7f52dd62a740 1 -- 172.21.15.37:0/42674375 --> [v2:172.21.15.196:6836/3264179771,v1:172.21.15.196:6838/3264179771] -- command(tid 0: {"prefix": "status"}) -- 0x5604b7f893a0 con 0x5604b80dcd40 2024-04-22T07:19:00.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.869+0000 7f52d3fff640 1 --2- 172.21.15.37:0/42674375 >> [v2:172.21.15.196:6836/3264179771,v1:172.21.15.196:6838/3264179771] conn(0x5604b80dcd40 0x5604b80e5940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:19:00.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.869+0000 7f52b2ffd640 10 client.4836 ms_handle_connect on v2:172.21.15.196:6836/3264179771 2024-04-22T07:19:00.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.869+0000 7f52d3fff640 1 --2- 172.21.15.37:0/42674375 >> [v2:172.21.15.196:6836/3264179771,v1:172.21.15.196:6838/3264179771] conn(0x5604b80dcd40 0x5604b80e5940 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=61fb2a935965343d server_cookie=328da19716a1b1cd in_seq=0 out_seq=0 2024-04-22T07:19:00.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.870+0000 7f52b2ffd640 1 -- 172.21.15.37:0/42674375 <== mds.0 v2:172.21.15.196:6836/3264179771 1 ==== command_reply(tid 0: 0 ) ==== 8+0+318 (crc 0 0 0) 0x5604b7f893a0 con 0x5604b80dcd40 2024-04-22T07:19:00.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.870+0000 7f52b2ffd640 10 client.4836 handle_command_reply: tid=0 2024-04-22T07:19:00.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.870+0000 7f52dd62a740 1 client.4836 shutdown 2024-04-22T07:19:00.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.870+0000 7f52dd62a740 1 -- 172.21.15.37:0/42674375 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5604b8032140 msgr2=0x5604b8031730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:19:00.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.870+0000 7f52dd62a740 1 --2- 172.21.15.37:0/42674375 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5604b8032140 0x5604b8031730 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f52c8006f00 tx=0x7f52c8004730 comp rx=0 tx=0).stop 2024-04-22T07:19:00.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.870+0000 7f52dd62a740 1 -- 172.21.15.37:0/42674375 shutdown_connections 2024-04-22T07:19:00.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.870+0000 7f52dd62a740 1 --2- 172.21.15.37:0/42674375 >> [v2:172.21.15.196:6836/3264179771,v1:172.21.15.196:6838/3264179771] conn(0x5604b80dcd40 0x5604b80e5940 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:19:00.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.870+0000 7f52dd62a740 1 --2- 172.21.15.37:0/42674375 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x5604b805de40 0x5604b8067190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:19:00.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.870+0000 7f52dd62a740 1 --2- 172.21.15.37:0/42674375 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5604b8032140 0x5604b8031730 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:19:00.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.870+0000 7f52b2ffd640 0 client.4836 ms_handle_reset on v2:172.21.15.196:6836/3264179771 2024-04-22T07:19:00.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.870+0000 7f52dd62a740 1 --2- 172.21.15.37:0/42674375 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5604b801eec0 0x5604b8061260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:19:00.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.870+0000 7f52dd62a740 1 -- 172.21.15.37:0/42674375 >> 172.21.15.37:0/42674375 conn(0x5604b801aca0 msgr2=0x5604b801b080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:19:00.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.870+0000 7f52dd62a740 1 -- 172.21.15.37:0/42674375 shutdown_connections 2024-04-22T07:19:00.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.870+0000 7f52dd62a740 1 -- 172.21.15.37:0/42674375 wait complete. 2024-04-22T07:19:00.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.870+0000 7f52dd62a740 20 client.4836 trim_cache size 0 max 16384 2024-04-22T07:19:00.874 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-04-22T07:19:00.875 INFO:teuthology.orchestra.run.smithi037.stdout: "cluster_fsid": "10d90a41-52d3-4e09-8022-c8ac67897ad1", 2024-04-22T07:19:00.875 INFO:teuthology.orchestra.run.smithi037.stdout: "whoami": 0, 2024-04-22T07:19:00.875 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 4294, 2024-04-22T07:19:00.875 INFO:teuthology.orchestra.run.smithi037.stdout: "want_state": "up:active", 2024-04-22T07:19:00.875 INFO:teuthology.orchestra.run.smithi037.stdout: "state": "up:active", 2024-04-22T07:19:00.875 INFO:teuthology.orchestra.run.smithi037.stdout: "fs_name": "cephfs", 2024-04-22T07:19:00.875 INFO:teuthology.orchestra.run.smithi037.stdout: "rank_uptime": 24.115170701, 2024-04-22T07:19:00.875 INFO:teuthology.orchestra.run.smithi037.stdout: "mdsmap_epoch": 8, 2024-04-22T07:19:00.875 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch": 20, 2024-04-22T07:19:00.875 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch_barrier": 20, 2024-04-22T07:19:00.875 INFO:teuthology.orchestra.run.smithi037.stdout: "uptime": 30.710853726 2024-04-22T07:19:00.875 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-04-22T07:19:00.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.870+0000 7f52daa3e640 1 -- 172.21.15.37:0/34635991 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f52c006c8f0 msgr2=0x7f52c006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:19:00.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.870+0000 7f52daa3e640 1 --2- 172.21.15.37:0/34635991 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f52c006c8f0 0x7f52c006edb0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f52c8006fd0 tx=0x7f52c8008040 comp rx=0 tx=0).stop 2024-04-22T07:19:00.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.870+0000 7f52daa3e640 1 -- 172.21.15.37:0/34635991 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52d40b3190 msgr2=0x7f52d41569f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:19:00.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.870+0000 7f52daa3e640 1 --2- 172.21.15.37:0/34635991 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52d40b3190 0x7f52d41569f0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f52c402b9c0 tx=0x7f52c4004730 comp rx=0 tx=0).stop 2024-04-22T07:19:00.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.870+0000 7f52daa3e640 1 -- 172.21.15.37:0/34635991 shutdown_connections 2024-04-22T07:19:00.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.870+0000 7f52daa3e640 1 --2- 172.21.15.37:0/34635991 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f52c006c8f0 0x7f52c006edb0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:19:00.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.870+0000 7f52daa3e640 1 --2- 172.21.15.37:0/34635991 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f52d4155250 0x7f52d4155f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:19:00.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.870+0000 7f52daa3e640 1 --2- 172.21.15.37:0/34635991 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f52d40ccd20 0x7f52d40cf7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:19:00.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.870+0000 7f52daa3e640 1 --2- 172.21.15.37:0/34635991 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52d40b3190 0x7f52d41569f0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:19:00.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.870+0000 7f52daa3e640 1 -- 172.21.15.37:0/34635991 >> 172.21.15.37:0/34635991 conn(0x7f52d4071f90 msgr2=0x7f52d41538d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:19:00.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.871+0000 7f52daa3e640 1 -- 172.21.15.37:0/34635991 shutdown_connections 2024-04-22T07:19:00.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:00.871+0000 7f52daa3e640 1 -- 172.21.15.37:0/34635991 wait complete. 2024-04-22T07:19:00.879 INFO:tasks.quiescer:Ready to start quiesce thrashing; initial delay: 15 sec 2024-04-22T07:19:06.654 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-22T07:19:06.657 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-22T07:19:15.880 INFO:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 29.9 2024-04-22T07:19:15.880 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-22T07:19:15.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:15.995+0000 7f0a2da14640 1 Processor -- start 2024-04-22T07:19:15.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:15.995+0000 7f0a2da14640 1 -- start start 2024-04-22T07:19:15.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:15.996+0000 7f0a2da14640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0a280c5360 0x7f0a2815b420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:19:15.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:15.996+0000 7f0a2da14640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f0a280c9ea0 0x7f0a2815b960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:19:15.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:15.996+0000 7f0a2da14640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a280c9040 con 0x7f0a281550c0 2024-04-22T07:19:15.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:15.996+0000 7f0a2da14640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f0a280c8e10 con 0x7f0a280c9ea0 2024-04-22T07:19:15.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:15.996+0000 7f0a2da14640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f0a2806b970 con 0x7f0a280c5360 2024-04-22T07:19:15.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:15.996+0000 7f0a26ffd640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f0a281550c0 0x7f0a280ce360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:47212/0 (socket says 172.21.15.37:47212) 2024-04-22T07:19:15.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:15.996+0000 7f0a26ffd640 1 -- 172.21.15.37:0/1497924529 learned_addr learned my addr 172.21.15.37:0/1497924529 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-04-22T07:19:15.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:15.996+0000 7f0a267fc640 1 --2- 172.21.15.37:0/1497924529 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0a280c5360 0x7f0a2815b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:19:15.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:15.996+0000 7f0a277fe640 1 --2- 172.21.15.37:0/1497924529 >> v2:172.21.15.196:3300/0 conn(0x7f0a280c9ea0 0x7f0a2815b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:19:15.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:15.996+0000 7f0a25ffb640 1 -- 172.21.15.37:0/1497924529 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1641956099 0 0) 0x7f0a280c9040 con 0x7f0a281550c0 2024-04-22T07:19:15.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:15.997+0000 7f0a25ffb640 1 -- 172.21.15.37:0/1497924529 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0a10003520 con 0x7f0a281550c0 2024-04-22T07:19:15.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:15.997+0000 7f0a25ffb640 1 -- 172.21.15.37:0/1497924529 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2158204707 0 0) 0x7f0a10003520 con 0x7f0a281550c0 2024-04-22T07:19:15.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:15.997+0000 7f0a25ffb640 1 -- 172.21.15.37:0/1497924529 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0a280c5360 msgr2=0x7f0a2815b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:19:15.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:15.997+0000 7f0a25ffb640 1 --2- 172.21.15.37:0/1497924529 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0a280c5360 0x7f0a2815b420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:19:15.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:15.997+0000 7f0a25ffb640 1 -- 172.21.15.37:0/1497924529 >> v2:172.21.15.196:3300/0 conn(0x7f0a280c9ea0 msgr2=0x7f0a2815b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:19:15.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:15.997+0000 7f0a25ffb640 1 --2- 172.21.15.37:0/1497924529 >> v2:172.21.15.196:3300/0 conn(0x7f0a280c9ea0 0x7f0a2815b960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:19:15.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:15.997+0000 7f0a25ffb640 1 -- 172.21.15.37:0/1497924529 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a2806bc50 con 0x7f0a281550c0 2024-04-22T07:19:15.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:15.997+0000 7f0a25ffb640 1 -- 172.21.15.37:0/1497924529 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2576656170 0 0) 0x7f0a18001670 con 0x7f0a281550c0 2024-04-22T07:19:15.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:15.997+0000 7f0a25ffb640 1 -- 172.21.15.37:0/1497924529 >> v1:172.21.15.37:6789/0 conn(0x7f0a281550c0 legacy=0x7f0a280ce360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:19:15.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:15.997+0000 7f0a25ffb640 1 --2- 172.21.15.37:0/1497924529 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a100039b0 0x7f0a10003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:19:15.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:15.997+0000 7f0a25ffb640 1 --2- 172.21.15.37:0/1497924529 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0a280c5360 0x7f0a10004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:19:15.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:15.997+0000 7f0a25ffb640 1 --2- 172.21.15.37:0/1497924529 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0a10004d40 0x7f0a100051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:19:15.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:15.997+0000 7f0a25ffb640 1 -- 172.21.15.37:0/1497924529 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0a2806b970 con 0x7f0a100039b0 2024-04-22T07:19:15.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:15.997+0000 7f0a25ffb640 1 -- 172.21.15.37:0/1497924529 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f0a1000b9c0 con 0x7f0a10004d40 2024-04-22T07:19:15.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:15.997+0000 7f0a25ffb640 1 -- 172.21.15.37:0/1497924529 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f0a1000bb40 con 0x7f0a280c5360 2024-04-22T07:19:15.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:15.997+0000 7f0a26ffd640 1 --2- 172.21.15.37:0/1497924529 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a100039b0 0x7f0a10003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:19:15.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:15.997+0000 7f0a267fc640 1 --2- 172.21.15.37:0/1497924529 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0a280c5360 0x7f0a10004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:19:15.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:15.997+0000 7f0a277fe640 1 --2- 172.21.15.37:0/1497924529 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0a10004d40 0x7f0a100051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:19:16.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:15.997+0000 7f0a26ffd640 1 -- 172.21.15.37:0/1497924529 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0a280c5360 msgr2=0x7f0a10004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:19:16.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:15.997+0000 7f0a26ffd640 1 --2- 172.21.15.37:0/1497924529 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0a280c5360 0x7f0a10004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:19:16.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:15.997+0000 7f0a26ffd640 1 -- 172.21.15.37:0/1497924529 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0a10004d40 msgr2=0x7f0a100051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:19:16.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:15.997+0000 7f0a26ffd640 1 --2- 172.21.15.37:0/1497924529 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0a10004d40 0x7f0a100051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:19:16.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:15.997+0000 7f0a26ffd640 1 -- 172.21.15.37:0/1497924529 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a10003520 con 0x7f0a100039b0 2024-04-22T07:19:16.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:15.998+0000 7f0a26ffd640 1 --2- 172.21.15.37:0/1497924529 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a100039b0 0x7f0a10003dd0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f0a1800c240 tx=0x7f0a10005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74832f634f2d5d05 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:19:16.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:15.998+0000 7f0a25ffb640 1 -- 172.21.15.37:0/1497924529 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a18007d30 con 0x7f0a100039b0 2024-04-22T07:19:16.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:15.998+0000 7f0a25ffb640 1 -- 172.21.15.37:0/1497924529 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a18030070 con 0x7f0a100039b0 2024-04-22T07:19:16.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:15.998+0000 7f0a25ffb640 1 -- 172.21.15.37:0/1497924529 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a1802cd60 con 0x7f0a100039b0 2024-04-22T07:19:16.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:15.999+0000 7f0a2da14640 1 -- 172.21.15.37:0/1497924529 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a100039b0 msgr2=0x7f0a10003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:19:16.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:15.999+0000 7f0a2da14640 1 --2- 172.21.15.37:0/1497924529 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a100039b0 0x7f0a10003dd0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f0a1800c240 tx=0x7f0a10005830 comp rx=0 tx=0).stop 2024-04-22T07:19:16.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:15.999+0000 7f0a277fe640 1 -- 172.21.15.37:0/1497924529 reap_dead start 2024-04-22T07:19:16.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:15.999+0000 7f0a2da14640 1 -- 172.21.15.37:0/1497924529 shutdown_connections 2024-04-22T07:19:16.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:15.999+0000 7f0a2da14640 1 -- 172.21.15.37:0/1497924529 >> 172.21.15.37:0/1497924529 conn(0x7f0a2806db80 msgr2=0x7f0a2806df60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:19:16.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:15.999+0000 7f0a2da14640 1 -- 172.21.15.37:0/1497924529 shutdown_connections 2024-04-22T07:19:16.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:15.999+0000 7f0a2da14640 1 -- 172.21.15.37:0/1497924529 wait complete. 2024-04-22T07:19:16.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.001+0000 7f0a2da14640 1 Processor -- start 2024-04-22T07:19:16.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.001+0000 7f0a2da14640 1 -- start start 2024-04-22T07:19:16.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.001+0000 7f0a2da14640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0a100039b0 0x7f0a281524d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:19:16.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.001+0000 7f0a2da14640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0a2815bff0 0x7f0a2814d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:19:16.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.001+0000 7f0a2da14640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a280cdf50 0x7f0a2814d880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:19:16.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.001+0000 7f0a2da14640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0a2815ae90 con 0x7f0a280cdf50 2024-04-22T07:19:16.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.001+0000 7f0a2da14640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f0a2806c210 con 0x7f0a100039b0 2024-04-22T07:19:16.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.001+0000 7f0a2da14640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f0a280cea70 con 0x7f0a2815bff0 2024-04-22T07:19:16.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.001+0000 7f0a277fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a280cdf50 0x7f0a2814d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:19:16.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.001+0000 7f0a277fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a280cdf50 0x7f0a2814d880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54252/0 (socket says 172.21.15.37:54252) 2024-04-22T07:19:16.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.001+0000 7f0a277fe640 1 -- 172.21.15.37:0/1772224755 learned_addr learned my addr 172.21.15.37:0/1772224755 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:19:16.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.001+0000 7f0a267fc640 1 --2- 172.21.15.37:0/1772224755 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0a2815bff0 0x7f0a2814d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:19:16.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.001+0000 7f0a26ffd640 1 --2- 172.21.15.37:0/1772224755 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0a100039b0 0x7f0a281524d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:19:16.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.002+0000 7f0a277fe640 1 -- 172.21.15.37:0/1772224755 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0a2815bff0 msgr2=0x7f0a2814d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:19:16.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.002+0000 7f0a277fe640 1 --2- 172.21.15.37:0/1772224755 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0a2815bff0 0x7f0a2814d340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:19:16.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.002+0000 7f0a277fe640 1 -- 172.21.15.37:0/1772224755 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0a100039b0 msgr2=0x7f0a281524d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:19:16.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.002+0000 7f0a277fe640 1 --2- 172.21.15.37:0/1772224755 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0a100039b0 0x7f0a281524d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:19:16.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.002+0000 7f0a277fe640 1 -- 172.21.15.37:0/1772224755 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a2815f160 con 0x7f0a280cdf50 2024-04-22T07:19:16.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.002+0000 7f0a26ffd640 1 --2- 172.21.15.37:0/1772224755 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0a100039b0 0x7f0a281524d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T07:19:16.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.002+0000 7f0a277fe640 1 --2- 172.21.15.37:0/1772224755 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a280cdf50 0x7f0a2814d880 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f0a280c4d40 tx=0x7f0a2000f1b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:19:16.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.002+0000 7f0a0ffff640 1 -- 172.21.15.37:0/1772224755 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a2000fce0 con 0x7f0a280cdf50 2024-04-22T07:19:16.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.002+0000 7f0a0ffff640 1 -- 172.21.15.37:0/1772224755 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a2001d070 con 0x7f0a280cdf50 2024-04-22T07:19:16.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.002+0000 7f0a0ffff640 1 -- 172.21.15.37:0/1772224755 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a20015670 con 0x7f0a280cdf50 2024-04-22T07:19:16.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.002+0000 7f0a2da14640 1 -- 172.21.15.37:0/1772224755 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a281f3b80 con 0x7f0a280cdf50 2024-04-22T07:19:16.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.002+0000 7f0a2da14640 1 -- 172.21.15.37:0/1772224755 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a281f3e20 con 0x7f0a280cdf50 2024-04-22T07:19:16.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.003+0000 7f0a2da14640 1 -- 172.21.15.37:0/1772224755 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a28069cc0 con 0x7f0a280cdf50 2024-04-22T07:19:16.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.004+0000 7f0a0ffff640 1 -- 172.21.15.37:0/1772224755 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0a20015810 con 0x7f0a280cdf50 2024-04-22T07:19:16.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.004+0000 7f0a0ffff640 1 --2- 172.21.15.37:0/1772224755 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f0a1406c920 0x7f0a1406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:19:16.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.004+0000 7f0a0ffff640 1 -- 172.21.15.37:0/1772224755 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f0a2008c3c0 con 0x7f0a280cdf50 2024-04-22T07:19:16.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.004+0000 7f0a26ffd640 1 --2- 172.21.15.37:0/1772224755 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f0a1406c920 0x7f0a1406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:19:16.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.005+0000 7f0a26ffd640 1 --2- 172.21.15.37:0/1772224755 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f0a1406c920 0x7f0a1406ede0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f0a18034000 tx=0x7f0a18007000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:19:16.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.008+0000 7f0a0ffff640 1 -- 172.21.15.37:0/1772224755 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f0a20010040 con 0x7f0a280cdf50 2024-04-22T07:19:16.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.237+0000 7f0a2da14640 1 -- 172.21.15.37:0/1772224755 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0a28070c20 con 0x7f0a280cdf50 2024-04-22T07:19:16.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.238+0000 7f0a0ffff640 1 -- 172.21.15.37:0/1772224755 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6827 (secure 0 0 0) 0x7f0a2005a760 con 0x7f0a280cdf50 2024-04-22T07:19:16.237 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-22T07:19:16.237 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4265,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6839/671847354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6835","nonce":671847354},{"type":"v1","addr":"172.21.15.196:6839","nonce":671847354}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6833/1549427395","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1549427395},{"type":"v1","addr":"172.21.15.37:6833","nonce":1549427395}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6836/3825988951","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":3825988951},{"type":"v1","addr":"172.21.15.37:6836","nonce":3825988951}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4272,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/611771502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6835","nonce":611771502},{"type":"v1","addr":"172.21.15.37:6837","nonce":611771502}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4291,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6837/3055080225","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6834","nonce":3055080225},{"type":"v1","addr":"172.21.15.196:6837","nonce":3055080225}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-22T07:18:36.111618+0000","modified":"2024-04-22T07:18:41.783857+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.196:6838/3264179771","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6836","nonce":3264179771},{"type":"v1","addr":"172.21.15.196:6838","nonce":3264179771}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4294,"qdb_cluster":[4294]},"id":1}]} 2024-04-22T07:19:16.237 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 8 2024-04-22T07:19:16.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.240+0000 7f0a2da14640 1 -- 172.21.15.37:0/1772224755 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f0a1406c920 msgr2=0x7f0a1406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:19:16.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.240+0000 7f0a2da14640 1 --2- 172.21.15.37:0/1772224755 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f0a1406c920 0x7f0a1406ede0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f0a18034000 tx=0x7f0a18007000 comp rx=0 tx=0).stop 2024-04-22T07:19:16.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.240+0000 7f0a2da14640 1 -- 172.21.15.37:0/1772224755 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a280cdf50 msgr2=0x7f0a2814d880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:19:16.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.240+0000 7f0a2da14640 1 --2- 172.21.15.37:0/1772224755 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a280cdf50 0x7f0a2814d880 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f0a280c4d40 tx=0x7f0a2000f1b0 comp rx=0 tx=0).stop 2024-04-22T07:19:16.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.240+0000 7f0a2da14640 1 -- 172.21.15.37:0/1772224755 shutdown_connections 2024-04-22T07:19:16.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.240+0000 7f0a2da14640 1 --2- 172.21.15.37:0/1772224755 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f0a1406c920 0x7f0a1406ede0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:19:16.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.240+0000 7f0a2da14640 1 --2- 172.21.15.37:0/1772224755 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a280cdf50 0x7f0a2814d880 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:19:16.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.240+0000 7f0a2da14640 1 --2- 172.21.15.37:0/1772224755 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0a2815bff0 0x7f0a2814d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:19:16.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.240+0000 7f0a2da14640 1 --2- 172.21.15.37:0/1772224755 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0a100039b0 0x7f0a281524d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:19:16.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.240+0000 7f0a2da14640 1 -- 172.21.15.37:0/1772224755 >> 172.21.15.37:0/1772224755 conn(0x7f0a2806db80 msgr2=0x7f0a280c3e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:19:16.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.240+0000 7f0a2da14640 1 -- 172.21.15.37:0/1772224755 shutdown_connections 2024-04-22T07:19:16.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.240+0000 7f0a2da14640 1 -- 172.21.15.37:0/1772224755 wait complete. 2024-04-22T07:19:16.250 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4294 quiesce db / --timeout 60 --expiration 89.9 --await' 2024-04-22T07:19:16.250 DEBUG:teuthology.orchestra.run.smithi037:> timeout 75 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4294 quiesce db / --timeout 60 --expiration 89.9 --await 2024-04-22T07:19:16.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.361+0000 7f8b0a9bb640 1 Processor -- start 2024-04-22T07:19:16.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.361+0000 7f8b0a9bb640 1 -- start start 2024-04-22T07:19:16.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.362+0000 7f8b0a9bb640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8b040c4e20 0x7f8b040c7150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:19:16.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.362+0000 7f8b0a9bb640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8b0406f1e0 0x7f8b0406f650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:19:16.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.362+0000 7f8b0a9bb640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b041531a0 con 0x7f8b04152dc0 2024-04-22T07:19:16.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.362+0000 7f8b0a9bb640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f8b040c36d0 con 0x7f8b040c4e20 2024-04-22T07:19:16.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.362+0000 7f8b0a9bb640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f8b041597e0 con 0x7f8b0406f1e0 2024-04-22T07:19:16.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.362+0000 7f8b037fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8b040c4e20 0x7f8b040c7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:19:16.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.362+0000 7f8b037fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8b040c4e20 0x7f8b040c7150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54266/0 (socket says 172.21.15.37:54266) 2024-04-22T07:19:16.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.362+0000 7f8b037fe640 1 -- 172.21.15.37:0/3361930372 learned_addr learned my addr 172.21.15.37:0/3361930372 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:19:16.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.362+0000 7f8b08f58640 1 --2- 172.21.15.37:0/3361930372 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8b0406f1e0 0x7f8b0406f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:19:16.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.362+0000 7f8b037fe640 1 -- 172.21.15.37:0/3361930372 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8b0406f1e0 msgr2=0x7f8b0406f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:19:16.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.362+0000 7f8b037fe640 1 --2- 172.21.15.37:0/3361930372 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8b0406f1e0 0x7f8b0406f650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:19:16.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.362+0000 7f8b037fe640 1 -- 172.21.15.37:0/3361930372 >> v1:172.21.15.196:6789/0 conn(0x7f8b04152dc0 legacy=0x7f8b040c4710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:19:16.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.362+0000 7f8b037fe640 1 -- 172.21.15.37:0/3361930372 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b040c3920 con 0x7f8b040c4e20 2024-04-22T07:19:16.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.363+0000 7f8b037fe640 1 --2- 172.21.15.37:0/3361930372 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b040c4e20 0x7f8b040c7150 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f8af8009870 tx=0x7f8af802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e36279b31ecc890 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:19:16.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.363+0000 7f8b02ffd640 1 -- 172.21.15.37:0/3361930372 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8af8035020 con 0x7f8b040c4e20 2024-04-22T07:19:16.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.363+0000 7f8b02ffd640 1 -- 172.21.15.37:0/3361930372 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8af8031640 con 0x7f8b040c4e20 2024-04-22T07:19:16.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.363+0000 7f8b02ffd640 1 -- 172.21.15.37:0/3361930372 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8af802d040 con 0x7f8b040c4e20 2024-04-22T07:19:16.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.364+0000 7f8b0a9bb640 1 -- 172.21.15.37:0/3361930372 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b040c4e20 msgr2=0x7f8b040c7150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:19:16.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.364+0000 7f8b0a9bb640 1 --2- 172.21.15.37:0/3361930372 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b040c4e20 0x7f8b040c7150 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f8af8009870 tx=0x7f8af802b8f0 comp rx=0 tx=0).stop 2024-04-22T07:19:16.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.364+0000 7f8b0a9bb640 1 -- 172.21.15.37:0/3361930372 shutdown_connections 2024-04-22T07:19:16.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.364+0000 7f8b0a9bb640 1 --2- 172.21.15.37:0/3361930372 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8b0406f1e0 0x7f8b0406f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:19:16.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.364+0000 7f8b0a9bb640 1 --2- 172.21.15.37:0/3361930372 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b040c4e20 0x7f8b040c7150 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:19:16.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.364+0000 7f8b0a9bb640 1 -- 172.21.15.37:0/3361930372 >> 172.21.15.37:0/3361930372 conn(0x7f8b0406b970 msgr2=0x7f8b0406bd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:19:16.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.364+0000 7f8b0a9bb640 1 -- 172.21.15.37:0/3361930372 shutdown_connections 2024-04-22T07:19:16.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.364+0000 7f8b0a9bb640 1 -- 172.21.15.37:0/3361930372 wait complete. 2024-04-22T07:19:16.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.365+0000 7f8b0a9bb640 1 Processor -- start 2024-04-22T07:19:16.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.365+0000 7f8b0a9bb640 1 -- start start 2024-04-22T07:19:16.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.366+0000 7f8b0a9bb640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8b0406f1e0 0x7f8b040ca720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:19:16.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.366+0000 7f8b0a9bb640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b040c4e20 0x7f8b040724a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:19:16.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.366+0000 7f8b0a9bb640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8b04152dc0 0x7f8b04157b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:19:16.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.366+0000 7f8b0a9bb640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8b040c3ee0 con 0x7f8b040c4e20 2024-04-22T07:19:16.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.366+0000 7f8b0a9bb640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f8b040c41f0 con 0x7f8b04152dc0 2024-04-22T07:19:16.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.366+0000 7f8b0a9bb640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f8b041594a0 con 0x7f8b0406f1e0 2024-04-22T07:19:16.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.366+0000 7f8b037fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b040c4e20 0x7f8b040724a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:19:16.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.366+0000 7f8b037fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b040c4e20 0x7f8b040724a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54278/0 (socket says 172.21.15.37:54278) 2024-04-22T07:19:16.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.366+0000 7f8b037fe640 1 -- 172.21.15.37:0/2285362142 learned_addr learned my addr 172.21.15.37:0/2285362142 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:19:16.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.366+0000 7f8b03fff640 1 --2- 172.21.15.37:0/2285362142 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8b0406f1e0 0x7f8b040ca720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:19:16.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.366+0000 7f8b08f58640 1 --2- 172.21.15.37:0/2285362142 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8b04152dc0 0x7f8b04157b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:19:16.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.366+0000 7f8b037fe640 1 -- 172.21.15.37:0/2285362142 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8b0406f1e0 msgr2=0x7f8b040ca720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:19:16.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.366+0000 7f8b037fe640 1 --2- 172.21.15.37:0/2285362142 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8b0406f1e0 0x7f8b040ca720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:19:16.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.366+0000 7f8b037fe640 1 -- 172.21.15.37:0/2285362142 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8b04152dc0 msgr2=0x7f8b04157b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:19:16.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.366+0000 7f8b037fe640 1 --2- 172.21.15.37:0/2285362142 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8b04152dc0 0x7f8b04157b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:19:16.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.366+0000 7f8b037fe640 1 -- 172.21.15.37:0/2285362142 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b041deba0 con 0x7f8b040c4e20 2024-04-22T07:19:16.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.366+0000 7f8b03fff640 1 --2- 172.21.15.37:0/2285362142 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8b0406f1e0 0x7f8b040ca720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T07:19:16.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.366+0000 7f8b08f58640 1 --2- 172.21.15.37:0/2285362142 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8b04152dc0 0x7f8b04157b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T07:19:16.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.366+0000 7f8b037fe640 1 --2- 172.21.15.37:0/2285362142 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b040c4e20 0x7f8b040724a0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f8af8000c00 tx=0x7f8af80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:19:16.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.367+0000 7f8b00ff9640 1 -- 172.21.15.37:0/2285362142 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8af8040070 con 0x7f8b040c4e20 2024-04-22T07:19:16.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.367+0000 7f8b00ff9640 1 -- 172.21.15.37:0/2285362142 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8af80399f0 con 0x7f8b040c4e20 2024-04-22T07:19:16.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.367+0000 7f8b00ff9640 1 -- 172.21.15.37:0/2285362142 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8af8035040 con 0x7f8b040c4e20 2024-04-22T07:19:16.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.367+0000 7f8b0a9bb640 1 -- 172.21.15.37:0/2285362142 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b040719c0 con 0x7f8b040c4e20 2024-04-22T07:19:16.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.367+0000 7f8b0a9bb640 1 -- 172.21.15.37:0/2285362142 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b04158f80 con 0x7f8b040c4e20 2024-04-22T07:19:16.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.368+0000 7f8b00ff9640 1 -- 172.21.15.37:0/2285362142 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8af804b060 con 0x7f8b040c4e20 2024-04-22T07:19:16.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.369+0000 7f8b00ff9640 1 --2- 172.21.15.37:0/2285362142 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f8af006c8f0 0x7f8af006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:19:16.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.369+0000 7f8b00ff9640 1 -- 172.21.15.37:0/2285362142 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f8af80ad4a0 con 0x7f8b040c4e20 2024-04-22T07:19:16.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.369+0000 7f8b03fff640 1 --2- 172.21.15.37:0/2285362142 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f8af006c8f0 0x7f8af006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:19:16.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.369+0000 7f8b03fff640 1 --2- 172.21.15.37:0/2285362142 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f8af006c8f0 0x7f8af006edb0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f8af4001700 tx=0x7f8af4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:19:16.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.370+0000 7f8b0d5a8740 1 Processor -- start 2024-04-22T07:19:16.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.370+0000 7f8b0d5a8740 1 -- start start 2024-04-22T07:19:16.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.370+0000 7f8b0d5a8740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557ec06cf200 0x557ec06cf5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:19:16.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.370+0000 7f8b0d5a8740 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x557ec0719080 0x557ec06cfb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:19:16.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.370+0000 7f8b0d5a8740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557ec06cdc60 0x557ec070eb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:19:16.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.370+0000 7f8b0d5a8740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x557ec06300b0 con 0x557ec06cdc60 2024-04-22T07:19:16.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.370+0000 7f8b0d5a8740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x557ec05e1680 con 0x557ec06cf200 2024-04-22T07:19:16.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.370+0000 7f8b0d5a8740 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x557ec05edc60 con 0x557ec0719080 2024-04-22T07:19:16.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.371+0000 7f8b08f58640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557ec06cdc60 0x557ec070eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:19:16.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.371+0000 7f8b08f58640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557ec06cdc60 0x557ec070eb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54286/0 (socket says 172.21.15.37:54286) 2024-04-22T07:19:16.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.371+0000 7f8b08f58640 1 -- 172.21.15.37:0/1472784995 learned_addr learned my addr 172.21.15.37:0/1472784995 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:19:16.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.371+0000 7f8b037fe640 1 --2- 172.21.15.37:0/1472784995 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x557ec0719080 0x557ec06cfb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:19:16.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.371+0000 7f8b03fff640 1 --2- 172.21.15.37:0/1472784995 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557ec06cf200 0x557ec06cf5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:19:16.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.371+0000 7f8b08f58640 1 -- 172.21.15.37:0/1472784995 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x557ec0719080 msgr2=0x557ec06cfb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:19:16.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.371+0000 7f8b08f58640 1 --2- 172.21.15.37:0/1472784995 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x557ec0719080 0x557ec06cfb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:19:16.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.371+0000 7f8b08f58640 1 -- 172.21.15.37:0/1472784995 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557ec06cf200 msgr2=0x557ec06cf5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:19:16.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.371+0000 7f8b08f58640 1 --2- 172.21.15.37:0/1472784995 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557ec06cf200 0x557ec06cf5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:19:16.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.371+0000 7f8b08f58640 1 -- 172.21.15.37:0/1472784995 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557ec0412c90 con 0x557ec06cdc60 2024-04-22T07:19:16.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.371+0000 7f8b03fff640 1 --2- 172.21.15.37:0/1472784995 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557ec06cf200 0x557ec06cf5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-22T07:19:16.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.371+0000 7f8b08f58640 1 --2- 172.21.15.37:0/1472784995 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557ec06cdc60 0x557ec070eb80 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f8afc0073e0 tx=0x7f8afc009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5584fe5b469bb745 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:19:16.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.371+0000 7f8aea7fc640 1 -- 172.21.15.37:0/1472784995 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8afc0147e0 con 0x557ec06cdc60 2024-04-22T07:19:16.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.371+0000 7f8aea7fc640 1 -- 172.21.15.37:0/1472784995 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8afc01a070 con 0x557ec06cdc60 2024-04-22T07:19:16.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.371+0000 7f8aea7fc640 1 -- 172.21.15.37:0/1472784995 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8afc014b80 con 0x557ec06cdc60 2024-04-22T07:19:16.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.372+0000 7f8b0d5a8740 1 -- 172.21.15.37:0/1472784995 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557ec06cdc60 msgr2=0x557ec070eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:19:16.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.372+0000 7f8b0d5a8740 1 --2- 172.21.15.37:0/1472784995 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557ec06cdc60 0x557ec070eb80 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f8afc0073e0 tx=0x7f8afc009f90 comp rx=0 tx=0).stop 2024-04-22T07:19:16.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.372+0000 7f8b0d5a8740 1 -- 172.21.15.37:0/1472784995 shutdown_connections 2024-04-22T07:19:16.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.372+0000 7f8b0d5a8740 1 --2- 172.21.15.37:0/1472784995 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557ec06cdc60 0x557ec070eb80 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:19:16.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.372+0000 7f8b0d5a8740 1 --2- 172.21.15.37:0/1472784995 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x557ec0719080 0x557ec06cfb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:19:16.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.372+0000 7f8b0d5a8740 1 --2- 172.21.15.37:0/1472784995 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557ec06cf200 0x557ec06cf5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:19:16.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.372+0000 7f8b0d5a8740 1 -- 172.21.15.37:0/1472784995 >> 172.21.15.37:0/1472784995 conn(0x557ec06cbc00 msgr2=0x557ec06ce2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:19:16.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.372+0000 7f8b0d5a8740 1 -- 172.21.15.37:0/1472784995 shutdown_connections 2024-04-22T07:19:16.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.372+0000 7f8b0d5a8740 1 -- 172.21.15.37:0/1472784995 wait complete. 2024-04-22T07:19:16.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.372+0000 7f8b0d5a8740 1 -- start start 2024-04-22T07:19:16.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.372+0000 7f8b0d5a8740 1 Processor -- start 2024-04-22T07:19:16.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.373+0000 7f8b0d5a8740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557ec06cf200 0x557ec071ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:19:16.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.373+0000 7f8b0d5a8740 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x557ec0719080 0x557ec07104e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:19:16.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.373+0000 7f8b0d5a8740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557ec06f8100 0x557ec070a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:19:16.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.373+0000 7f8b0d5a8740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x557ec0633400 con 0x557ec06f8100 2024-04-22T07:19:16.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.373+0000 7f8b0d5a8740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x557ec05ef840 con 0x557ec06cf200 2024-04-22T07:19:16.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.373+0000 7f8b0d5a8740 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x557ec0638720 con 0x557ec0719080 2024-04-22T07:19:16.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.373+0000 7f8b0d5a8740 10 client.0 _ll_register_callbacks cb 0x557ec0640ea0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-22T07:19:16.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.373+0000 7f8b08f58640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557ec06f8100 0x557ec070a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:19:16.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.373+0000 7f8b08f58640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557ec06f8100 0x557ec070a0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54302/0 (socket says 172.21.15.37:54302) 2024-04-22T07:19:16.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.373+0000 7f8b08f58640 1 -- 172.21.15.37:0/246814980 learned_addr learned my addr 172.21.15.37:0/246814980 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:19:16.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.373+0000 7f8b037fe640 1 --2- 172.21.15.37:0/246814980 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x557ec0719080 0x557ec07104e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:19:16.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.373+0000 7f8b03fff640 1 --2- 172.21.15.37:0/246814980 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557ec06cf200 0x557ec071ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:19:16.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.374+0000 7f8b08f58640 1 -- 172.21.15.37:0/246814980 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x557ec0719080 msgr2=0x557ec07104e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:19:16.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.374+0000 7f8b08f58640 1 --2- 172.21.15.37:0/246814980 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x557ec0719080 0x557ec07104e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:19:16.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.374+0000 7f8b08f58640 1 -- 172.21.15.37:0/246814980 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557ec06cf200 msgr2=0x557ec071ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:19:16.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.374+0000 7f8b08f58640 1 --2- 172.21.15.37:0/246814980 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557ec06cf200 0x557ec071ffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:19:16.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.374+0000 7f8b08f58640 1 -- 172.21.15.37:0/246814980 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557ec0473420 con 0x557ec06f8100 2024-04-22T07:19:16.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.374+0000 7f8b037fe640 1 --2- 172.21.15.37:0/246814980 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x557ec0719080 0x557ec07104e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T07:19:16.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.374+0000 7f8b08f58640 1 --2- 172.21.15.37:0/246814980 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557ec06f8100 0x557ec070a0a0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f8afc007d30 tx=0x7f8afc012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d36d0411e69bcc90 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:19:16.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.374+0000 7f8ae2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-04-22T07:19:16.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.374+0000 7f8ae2ffd640 1 -- 172.21.15.37:0/246814980 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8afc02a480 con 0x557ec06f8100 2024-04-22T07:19:16.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.374+0000 7f8ae2ffd640 1 -- 172.21.15.37:0/246814980 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f8afc02a620 con 0x557ec06f8100 2024-04-22T07:19:16.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.374+0000 7f8b0d5a8740 1 -- 172.21.15.37:0/246814980 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8afc01a070 con 0x557ec06f8100 2024-04-22T07:19:16.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.374+0000 7f8ae2ffd640 1 -- 172.21.15.37:0/246814980 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7f8afc032050 con 0x557ec06f8100 2024-04-22T07:19:16.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.374+0000 7f8b0d5a8740 10 client.4854 fetch_fsmap learned FSMap version 8 2024-04-22T07:19:16.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.374+0000 7f8b0d5a8740 1 -- 172.21.15.37:0/246814980 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x557ec0306580 con 0x557ec06f8100 2024-04-22T07:19:16.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.374+0000 7f8ae2ffd640 1 -- 172.21.15.37:0/246814980 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8afc01a070 con 0x557ec06f8100 2024-04-22T07:19:16.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.374+0000 7f8ae2ffd640 1 -- 172.21.15.37:0/246814980 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 8) ==== 4704+0+0 (secure 0 0 0) 0x7f8afc035020 con 0x557ec06f8100 2024-04-22T07:19:16.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.374+0000 7f8b0d5a8740 10 client.4854 fetch_fsmap finished waiting for FSMap version 8 2024-04-22T07:19:16.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.374+0000 7f8b0d5a8740 10 client.4854 resolve_mds: validated gid 4294 aka daemon mds.f 2024-04-22T07:19:16.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.374+0000 7f8b0d5a8740 20 client.4854 populate_metadata read hostname 'smithi037' 2024-04-22T07:19:16.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.374+0000 7f8b0d5a8740 1 --2- 172.21.15.37:0/246814980 >> [v2:172.21.15.196:6836/3264179771,v1:172.21.15.196:6838/3264179771] conn(0x557ec070a5e0 0x557ec070a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:19:16.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.375+0000 7f8b0d5a8740 4 client.4854 mds_command: new command op to 4294 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-22T07:19:16.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.375+0000 7f8b0d5a8740 1 -- 172.21.15.37:0/246814980 --> [v2:172.21.15.196:6836/3264179771,v1:172.21.15.196:6838/3264179771] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557ec0641b10 con 0x557ec070a5e0 2024-04-22T07:19:16.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.375+0000 7f8b03fff640 1 --2- 172.21.15.37:0/246814980 >> [v2:172.21.15.196:6836/3264179771,v1:172.21.15.196:6838/3264179771] conn(0x557ec070a5e0 0x557ec070a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:19:16.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.375+0000 7f8ae2ffd640 10 client.4854 ms_handle_connect on v2:172.21.15.196:6836/3264179771 2024-04-22T07:19:16.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.375+0000 7f8b03fff640 1 --2- 172.21.15.37:0/246814980 >> [v2:172.21.15.196:6836/3264179771,v1:172.21.15.196:6838/3264179771] conn(0x557ec070a5e0 0x557ec070a9f0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ca19fa55b69f7d02 server_cookie=2c7addca3b032b50 in_seq=0 out_seq=0 2024-04-22T07:19:16.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.376+0000 7f8ae2ffd640 1 -- 172.21.15.37:0/246814980 <== mds.0 v2:172.21.15.196:6836/3264179771 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x557ec0641b10 con 0x557ec070a5e0 2024-04-22T07:19:16.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.376+0000 7f8ae2ffd640 10 client.4854 handle_command_reply: tid=0 2024-04-22T07:19:16.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.376+0000 7f8b0d5a8740 1 client.4854 shutdown 2024-04-22T07:19:16.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.376+0000 7f8b0d5a8740 1 -- 172.21.15.37:0/246814980 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557ec06f8100 msgr2=0x557ec070a0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:19:16.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.376+0000 7f8b0d5a8740 1 --2- 172.21.15.37:0/246814980 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557ec06f8100 0x557ec070a0a0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f8afc007d30 tx=0x7f8afc012000 comp rx=0 tx=0).stop 2024-04-22T07:19:16.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.376+0000 7f8b0d5a8740 1 -- 172.21.15.37:0/246814980 shutdown_connections 2024-04-22T07:19:16.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.376+0000 7f8b0d5a8740 1 --2- 172.21.15.37:0/246814980 >> [v2:172.21.15.196:6836/3264179771,v1:172.21.15.196:6838/3264179771] conn(0x557ec070a5e0 0x557ec070a9f0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:19:16.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.376+0000 7f8b0d5a8740 1 --2- 172.21.15.37:0/246814980 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557ec06f8100 0x557ec070a0a0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:19:16.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.376+0000 7f8b0d5a8740 1 --2- 172.21.15.37:0/246814980 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x557ec0719080 0x557ec07104e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:19:16.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.376+0000 7f8b0d5a8740 1 --2- 172.21.15.37:0/246814980 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557ec06cf200 0x557ec071ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:19:16.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.376+0000 7f8ae2ffd640 0 client.4854 ms_handle_reset on v2:172.21.15.196:6836/3264179771 2024-04-22T07:19:16.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.376+0000 7f8b0d5a8740 1 -- 172.21.15.37:0/246814980 >> 172.21.15.37:0/246814980 conn(0x557ec06cdc60 msgr2=0x557ec06c8940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:19:16.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.376+0000 7f8b0d5a8740 1 -- 172.21.15.37:0/246814980 shutdown_connections 2024-04-22T07:19:16.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.376+0000 7f8b0d5a8740 1 -- 172.21.15.37:0/246814980 wait complete. 2024-04-22T07:19:16.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.376+0000 7f8b0d5a8740 20 client.4854 trim_cache size 0 max 16384 2024-04-22T07:19:16.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.394+0000 7f8b0d5a8740 1 Processor -- start 2024-04-22T07:19:16.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.394+0000 7f8b0d5a8740 1 -- start start 2024-04-22T07:19:16.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.394+0000 7f8b0d5a8740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557ec06cf200 0x557ec06ce2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:19:16.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.394+0000 7f8b0d5a8740 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x557ec06f8100 0x557ec06ce7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:19:16.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.394+0000 7f8b0d5a8740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557ec0719080 0x557ec0717490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:19:16.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.394+0000 7f8b0d5a8740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8b041fe0c0 con 0x557ec0719080 2024-04-22T07:19:16.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.394+0000 7f8b0d5a8740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f8b041fcfd0 con 0x557ec06cf200 2024-04-22T07:19:16.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.394+0000 7f8b0d5a8740 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f8b041f42c0 con 0x557ec06f8100 2024-04-22T07:19:16.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.395+0000 7f8b08f58640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557ec0719080 0x557ec0717490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:19:16.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.395+0000 7f8b08f58640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557ec0719080 0x557ec0717490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54304/0 (socket says 172.21.15.37:54304) 2024-04-22T07:19:16.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.395+0000 7f8b08f58640 1 -- 172.21.15.37:0/2044036676 learned_addr learned my addr 172.21.15.37:0/2044036676 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:19:16.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.395+0000 7f8b08f58640 1 -- 172.21.15.37:0/2044036676 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x557ec06f8100 msgr2=0x557ec06ce7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:19:16.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.395+0000 7f8b08f58640 1 --2- 172.21.15.37:0/2044036676 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x557ec06f8100 0x557ec06ce7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:19:16.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.395+0000 7f8b08f58640 1 -- 172.21.15.37:0/2044036676 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557ec06cf200 msgr2=0x557ec06ce2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:19:16.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.395+0000 7f8b08f58640 1 --2- 172.21.15.37:0/2044036676 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557ec06cf200 0x557ec06ce2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:19:16.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.395+0000 7f8b08f58640 1 -- 172.21.15.37:0/2044036676 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557ec070ad60 con 0x557ec0719080 2024-04-22T07:19:16.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.395+0000 7f8b08f58640 1 --2- 172.21.15.37:0/2044036676 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557ec0719080 0x557ec0717490 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f8afc009f60 tx=0x7f8afc015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d696e1c53d2b926 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:19:16.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.395+0000 7f8ae9ffb640 1 -- 172.21.15.37:0/2044036676 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8afc0145e0 con 0x557ec0719080 2024-04-22T07:19:16.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.395+0000 7f8ae9ffb640 1 -- 172.21.15.37:0/2044036676 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8afc01a040 con 0x557ec0719080 2024-04-22T07:19:16.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.395+0000 7f8ae9ffb640 1 -- 172.21.15.37:0/2044036676 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8afc02a480 con 0x557ec0719080 2024-04-22T07:19:16.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.396+0000 7f8b0d5a8740 1 -- 172.21.15.37:0/2044036676 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557ec0719080 msgr2=0x557ec0717490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:19:16.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.396+0000 7f8b0d5a8740 1 --2- 172.21.15.37:0/2044036676 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557ec0719080 0x557ec0717490 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f8afc009f60 tx=0x7f8afc015000 comp rx=0 tx=0).stop 2024-04-22T07:19:16.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.396+0000 7f8b0d5a8740 1 -- 172.21.15.37:0/2044036676 shutdown_connections 2024-04-22T07:19:16.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.396+0000 7f8b0d5a8740 1 --2- 172.21.15.37:0/2044036676 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557ec0719080 0x557ec0717490 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:19:16.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.396+0000 7f8b0d5a8740 1 --2- 172.21.15.37:0/2044036676 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x557ec06f8100 0x557ec06ce7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:19:16.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.396+0000 7f8b0d5a8740 1 --2- 172.21.15.37:0/2044036676 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557ec06cf200 0x557ec06ce2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:19:16.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.396+0000 7f8b0d5a8740 1 -- 172.21.15.37:0/2044036676 >> 172.21.15.37:0/2044036676 conn(0x557ec06cdc60 msgr2=0x557ec06cc700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:19:16.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.396+0000 7f8b0d5a8740 1 -- 172.21.15.37:0/2044036676 shutdown_connections 2024-04-22T07:19:16.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.396+0000 7f8b0d5a8740 1 -- 172.21.15.37:0/2044036676 wait complete. 2024-04-22T07:19:16.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.396+0000 7f8b0d5a8740 1 -- start start 2024-04-22T07:19:16.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.396+0000 7f8b0d5a8740 1 Processor -- start 2024-04-22T07:19:16.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.397+0000 7f8b0d5a8740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557ec06cf200 0x557ec0719e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:19:16.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.397+0000 7f8b0d5a8740 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x557ec06f8100 0x557ec070c850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:19:16.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.397+0000 7f8b0d5a8740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557ec0719080 0x557ec0709930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:19:16.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.397+0000 7f8b0d5a8740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8b041f4910 con 0x557ec0719080 2024-04-22T07:19:16.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.397+0000 7f8b0d5a8740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f8b041fc920 con 0x557ec06cf200 2024-04-22T07:19:16.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.397+0000 7f8b0d5a8740 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f8b041f4f60 con 0x557ec06f8100 2024-04-22T07:19:16.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.397+0000 7f8b0d5a8740 10 client.0 _ll_register_callbacks cb 0x7f8afc009e90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-22T07:19:16.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.397+0000 7f8b08f58640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557ec0719080 0x557ec0709930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:19:16.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.397+0000 7f8b08f58640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557ec0719080 0x557ec0709930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54312/0 (socket says 172.21.15.37:54312) 2024-04-22T07:19:16.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.397+0000 7f8b08f58640 1 -- 172.21.15.37:0/4038619552 learned_addr learned my addr 172.21.15.37:0/4038619552 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:19:16.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.397+0000 7f8b037fe640 1 --2- 172.21.15.37:0/4038619552 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x557ec06f8100 0x557ec070c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:19:16.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.397+0000 7f8b03fff640 1 --2- 172.21.15.37:0/4038619552 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557ec06cf200 0x557ec0719e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:19:16.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.397+0000 7f8b08f58640 1 -- 172.21.15.37:0/4038619552 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x557ec06f8100 msgr2=0x557ec070c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:19:16.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.397+0000 7f8b08f58640 1 --2- 172.21.15.37:0/4038619552 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x557ec06f8100 0x557ec070c850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:19:16.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.397+0000 7f8b08f58640 1 -- 172.21.15.37:0/4038619552 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557ec06cf200 msgr2=0x557ec0719e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:19:16.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.397+0000 7f8b08f58640 1 --2- 172.21.15.37:0/4038619552 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557ec06cf200 0x557ec0719e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:19:16.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.397+0000 7f8b08f58640 1 -- 172.21.15.37:0/4038619552 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557ec06f8f50 con 0x557ec0719080 2024-04-22T07:19:16.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.398+0000 7f8b08f58640 1 --2- 172.21.15.37:0/4038619552 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557ec0719080 0x557ec0709930 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f8afc00b010 tx=0x7f8afc00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a861b682acc7db2 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:19:16.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.398+0000 7f8ae2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-04-22T07:19:16.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.398+0000 7f8ae2ffd640 1 -- 172.21.15.37:0/4038619552 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8afc002030 con 0x557ec0719080 2024-04-22T07:19:16.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.398+0000 7f8ae2ffd640 1 -- 172.21.15.37:0/4038619552 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f8afc02ad10 con 0x557ec0719080 2024-04-22T07:19:16.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.398+0000 7f8b0d5a8740 1 -- 172.21.15.37:0/4038619552 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8afc01a040 con 0x557ec0719080 2024-04-22T07:19:16.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.398+0000 7f8ae2ffd640 1 -- 172.21.15.37:0/4038619552 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7f8afc045050 con 0x557ec0719080 2024-04-22T07:19:16.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.398+0000 7f8b0d5a8740 10 client.4860 fetch_fsmap learned FSMap version 8 2024-04-22T07:19:16.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.398+0000 7f8b0d5a8740 1 -- 172.21.15.37:0/4038619552 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x557ec0719460 con 0x557ec0719080 2024-04-22T07:19:16.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.398+0000 7f8ae2ffd640 1 -- 172.21.15.37:0/4038619552 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8afc01a040 con 0x557ec0719080 2024-04-22T07:19:16.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.398+0000 7f8ae2ffd640 1 -- 172.21.15.37:0/4038619552 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 8) ==== 4704+0+0 (secure 0 0 0) 0x7f8afc048020 con 0x557ec0719080 2024-04-22T07:19:16.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.398+0000 7f8b0d5a8740 10 client.4860 fetch_fsmap finished waiting for FSMap version 8 2024-04-22T07:19:16.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.398+0000 7f8b0d5a8740 10 client.4860 resolve_mds: validated gid 4294 aka daemon mds.f 2024-04-22T07:19:16.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.398+0000 7f8b0d5a8740 20 client.4860 populate_metadata read hostname 'smithi037' 2024-04-22T07:19:16.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.398+0000 7f8b0d5a8740 1 --2- 172.21.15.37:0/4038619552 >> [v2:172.21.15.196:6836/3264179771,v1:172.21.15.196:6838/3264179771] conn(0x557ec0723190 0x557ec07837d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:19:16.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.398+0000 7f8b0d5a8740 4 client.4860 mds_command: new command op to 4294 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 89.9, "await": true}] 2024-04-22T07:19:16.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.398+0000 7f8b0d5a8740 1 -- 172.21.15.37:0/4038619552 --> [v2:172.21.15.196:6836/3264179771,v1:172.21.15.196:6838/3264179771] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 89.9, "await": true}) -- 0x557ec063b980 con 0x557ec0723190 2024-04-22T07:19:16.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.398+0000 7f8b03fff640 1 --2- 172.21.15.37:0/4038619552 >> [v2:172.21.15.196:6836/3264179771,v1:172.21.15.196:6838/3264179771] conn(0x557ec0723190 0x557ec07837d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:19:16.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.399+0000 7f8b03fff640 1 --2- 172.21.15.37:0/4038619552 >> [v2:172.21.15.196:6836/3264179771,v1:172.21.15.196:6838/3264179771] conn(0x557ec0723190 0x557ec07837d0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=73dc291ca6af36d3 server_cookie=4ee35f22a7697efd in_seq=0 out_seq=0 2024-04-22T07:19:16.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.399+0000 7f8ae2ffd640 10 client.4860 ms_handle_connect on v2:172.21.15.196:6836/3264179771 2024-04-22T07:19:16.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.402+0000 7f8ae2ffd640 1 -- 172.21.15.37:0/4038619552 <== mds.0 v2:172.21.15.196:6836/3264179771 1 ==== command_reply(tid 0: 0 ) ==== 8+0+586 (crc 0 0 0) 0x557ec063b980 con 0x557ec0723190 2024-04-22T07:19:16.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.402+0000 7f8ae2ffd640 10 client.4860 handle_command_reply: tid=0 2024-04-22T07:19:16.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.402+0000 7f8b0d5a8740 1 client.4860 shutdown 2024-04-22T07:19:16.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.402+0000 7f8b0d5a8740 1 -- 172.21.15.37:0/4038619552 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557ec0719080 msgr2=0x557ec0709930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:19:16.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.402+0000 7f8b0d5a8740 1 --2- 172.21.15.37:0/4038619552 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557ec0719080 0x557ec0709930 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f8afc00b010 tx=0x7f8afc00b040 comp rx=0 tx=0).stop 2024-04-22T07:19:16.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.403+0000 7f8b0d5a8740 1 -- 172.21.15.37:0/4038619552 shutdown_connections 2024-04-22T07:19:16.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.403+0000 7f8b0d5a8740 1 --2- 172.21.15.37:0/4038619552 >> [v2:172.21.15.196:6836/3264179771,v1:172.21.15.196:6838/3264179771] conn(0x557ec0723190 0x557ec07837d0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:19:16.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.403+0000 7f8b0d5a8740 1 --2- 172.21.15.37:0/4038619552 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557ec0719080 0x557ec0709930 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:19:16.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.403+0000 7f8b0d5a8740 1 --2- 172.21.15.37:0/4038619552 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x557ec06f8100 0x557ec070c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:19:16.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.403+0000 7f8ae2ffd640 0 client.4860 ms_handle_reset on v2:172.21.15.196:6836/3264179771 2024-04-22T07:19:16.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.403+0000 7f8b0d5a8740 1 --2- 172.21.15.37:0/4038619552 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557ec06cf200 0x557ec0719e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:19:16.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.403+0000 7f8b0d5a8740 1 -- 172.21.15.37:0/4038619552 >> 172.21.15.37:0/4038619552 conn(0x557ec06cdc60 msgr2=0x557ec06cce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:19:16.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.403+0000 7f8b0d5a8740 1 -- 172.21.15.37:0/4038619552 shutdown_connections 2024-04-22T07:19:16.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.403+0000 7f8b0d5a8740 1 -- 172.21.15.37:0/4038619552 wait complete. 2024-04-22T07:19:16.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.403+0000 7f8b0d5a8740 20 client.4860 trim_cache size 0 max 16384 2024-04-22T07:19:16.407 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-04-22T07:19:16.407 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 8, 2024-04-22T07:19:16.407 INFO:teuthology.orchestra.run.smithi037.stdout: "leader": 4294, 2024-04-22T07:19:16.407 INFO:teuthology.orchestra.run.smithi037.stdout: "set_version": 2, 2024-04-22T07:19:16.407 INFO:teuthology.orchestra.run.smithi037.stdout: "sets": { 2024-04-22T07:19:16.407 INFO:teuthology.orchestra.run.smithi037.stdout: "2e500164": { 2024-04-22T07:19:16.408 INFO:teuthology.orchestra.run.smithi037.stdout: "version": 2, 2024-04-22T07:19:16.408 INFO:teuthology.orchestra.run.smithi037.stdout: "age_ref": 0.0, 2024-04-22T07:19:16.408 INFO:teuthology.orchestra.run.smithi037.stdout: "state": { 2024-04-22T07:19:16.408 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "QUIESCED", 2024-04-22T07:19:16.408 INFO:teuthology.orchestra.run.smithi037.stdout: "age": 0.0 2024-04-22T07:19:16.408 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-04-22T07:19:16.408 INFO:teuthology.orchestra.run.smithi037.stdout: "timeout": 60.0, 2024-04-22T07:19:16.408 INFO:teuthology.orchestra.run.smithi037.stdout: "expiration": 89.9, 2024-04-22T07:19:16.408 INFO:teuthology.orchestra.run.smithi037.stdout: "members": { 2024-04-22T07:19:16.408 INFO:teuthology.orchestra.run.smithi037.stdout: "file:/": { 2024-04-22T07:19:16.408 INFO:teuthology.orchestra.run.smithi037.stdout: "excluded": false, 2024-04-22T07:19:16.408 INFO:teuthology.orchestra.run.smithi037.stdout: "state": { 2024-04-22T07:19:16.408 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "QUIESCED", 2024-04-22T07:19:16.408 INFO:teuthology.orchestra.run.smithi037.stdout: "age": 0.0 2024-04-22T07:19:16.409 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-04-22T07:19:16.409 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-04-22T07:19:16.409 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-04-22T07:19:16.409 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-04-22T07:19:16.409 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-04-22T07:19:16.409 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-04-22T07:19:16.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.403+0000 7f8b0a9bb640 1 -- 172.21.15.37:0/2285362142 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f8af006c8f0 msgr2=0x7f8af006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:19:16.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.403+0000 7f8b0a9bb640 1 --2- 172.21.15.37:0/2285362142 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f8af006c8f0 0x7f8af006edb0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f8af4001700 tx=0x7f8af4009040 comp rx=0 tx=0).stop 2024-04-22T07:19:16.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.403+0000 7f8b0a9bb640 1 -- 172.21.15.37:0/2285362142 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b040c4e20 msgr2=0x7f8b040724a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:19:16.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.403+0000 7f8b0a9bb640 1 --2- 172.21.15.37:0/2285362142 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b040c4e20 0x7f8b040724a0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f8af8000c00 tx=0x7f8af80046c0 comp rx=0 tx=0).stop 2024-04-22T07:19:16.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.403+0000 7f8b0a9bb640 1 -- 172.21.15.37:0/2285362142 shutdown_connections 2024-04-22T07:19:16.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.403+0000 7f8b0a9bb640 1 --2- 172.21.15.37:0/2285362142 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f8af006c8f0 0x7f8af006edb0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:19:16.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.403+0000 7f8b0a9bb640 1 --2- 172.21.15.37:0/2285362142 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8b04152dc0 0x7f8b04157b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:19:16.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.403+0000 7f8b0a9bb640 1 --2- 172.21.15.37:0/2285362142 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b040c4e20 0x7f8b040724a0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:19:16.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.403+0000 7f8b0a9bb640 1 --2- 172.21.15.37:0/2285362142 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8b0406f1e0 0x7f8b040ca720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:19:16.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.403+0000 7f8b0a9bb640 1 -- 172.21.15.37:0/2285362142 >> 172.21.15.37:0/2285362142 conn(0x7f8b0406b970 msgr2=0x7f8b0414dc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:19:16.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.403+0000 7f8b0a9bb640 1 -- 172.21.15.37:0/2285362142 shutdown_connections 2024-04-22T07:19:16.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:16.403+0000 7f8b0a9bb640 1 -- 172.21.15.37:0/2285362142 wait complete. 2024-04-22T07:19:16.413 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced, set_id: 2e500164, quiesce took 0.5 seconds. Will release after: 29.9 2024-04-22T07:19:36.725 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-22T07:19:36.728 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-22T07:19:46.314 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-22T07:19:46.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.422+0000 7f5746e81640 1 Processor -- start 2024-04-22T07:19:46.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.422+0000 7f5746e81640 1 -- start start 2024-04-22T07:19:46.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.423+0000 7f5746e81640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f57400b38f0 0x7f574015aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:19:46.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.423+0000 7f5746e81640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f574015f280 con 0x7f57401552f0 2024-04-22T07:19:46.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.423+0000 7f5746e81640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f57400cda00 con 0x7f574015b3f0 2024-04-22T07:19:46.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.423+0000 7f5746e81640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f57400b3100 con 0x7f57400b38f0 2024-04-22T07:19:46.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.423+0000 7f5744c1d640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f57401552f0 0x7f57400cb430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:57786/0 (socket says 172.21.15.37:57786) 2024-04-22T07:19:46.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.423+0000 7f5744c1d640 1 -- 172.21.15.37:0/3278677932 learned_addr learned my addr 172.21.15.37:0/3278677932 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-04-22T07:19:46.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.423+0000 7f5737fff640 1 --2- 172.21.15.37:0/3278677932 >> v2:172.21.15.196:3300/0 conn(0x7f57400b38f0 0x7f574015aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:19:46.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.423+0000 7f57377fe640 1 -- 172.21.15.37:0/3278677932 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1746624311 0 0) 0x7f574015f280 con 0x7f57401552f0 2024-04-22T07:19:46.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.423+0000 7f57377fe640 1 -- 172.21.15.37:0/3278677932 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5728003520 con 0x7f57401552f0 2024-04-22T07:19:46.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.423+0000 7f5737fff640 1 -- 172.21.15.37:0/3278677932 >> v1:172.21.15.196:6789/0 conn(0x7f574015b3f0 legacy=0x7f57400ccd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:19:46.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.423+0000 7f5737fff640 1 -- 172.21.15.37:0/3278677932 >> v1:172.21.15.37:6789/0 conn(0x7f57401552f0 legacy=0x7f57400cb430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:19:46.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.423+0000 7f5737fff640 1 -- 172.21.15.37:0/3278677932 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57400b3350 con 0x7f57400b38f0 2024-04-22T07:19:46.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.424+0000 7f5737fff640 1 --2- 172.21.15.37:0/3278677932 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f57400b38f0 0x7f574015aeb0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f57300097a0 tx=0x7f573002b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=366f1bed176914a4 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:19:46.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.424+0000 7f57377fe640 1 -- 172.21.15.37:0/3278677932 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5730034070 con 0x7f57400b38f0 2024-04-22T07:19:46.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.425+0000 7f57377fe640 1 -- 172.21.15.37:0/3278677932 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5730030610 con 0x7f57400b38f0 2024-04-22T07:19:46.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.425+0000 7f57377fe640 1 -- 172.21.15.37:0/3278677932 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57300309e0 con 0x7f57400b38f0 2024-04-22T07:19:46.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.425+0000 7f5746e81640 1 -- 172.21.15.37:0/3278677932 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f57400b38f0 msgr2=0x7f574015aeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:19:46.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.425+0000 7f5746e81640 1 --2- 172.21.15.37:0/3278677932 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f57400b38f0 0x7f574015aeb0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f57300097a0 tx=0x7f573002b960 comp rx=0 tx=0).stop 2024-04-22T07:19:46.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.425+0000 7f5746e81640 1 -- 172.21.15.37:0/3278677932 shutdown_connections 2024-04-22T07:19:46.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.425+0000 7f5746e81640 1 --2- 172.21.15.37:0/3278677932 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f57400b38f0 0x7f574015aeb0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:19:46.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.425+0000 7f5746e81640 1 -- 172.21.15.37:0/3278677932 >> 172.21.15.37:0/3278677932 conn(0x7f5740071f90 msgr2=0x7f57400723a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:19:46.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.425+0000 7f5746e81640 1 -- 172.21.15.37:0/3278677932 shutdown_connections 2024-04-22T07:19:46.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.425+0000 7f5746e81640 1 -- 172.21.15.37:0/3278677932 wait complete. 2024-04-22T07:19:46.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.426+0000 7f5746e81640 1 Processor -- start 2024-04-22T07:19:46.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.426+0000 7f5746e81640 1 -- start start 2024-04-22T07:19:46.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.427+0000 7f5746e81640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f57400b38f0 0x7f57401e4b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:19:46.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.427+0000 7f5746e81640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f57401552f0 0x7f57401e6810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:19:46.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.427+0000 7f5746e81640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f574015b3f0 0x7f57401f0d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:19:46.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.427+0000 7f5746e81640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f574015e7a0 con 0x7f574015b3f0 2024-04-22T07:19:46.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.427+0000 7f5746e81640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f574015e4c0 con 0x7f57401552f0 2024-04-22T07:19:46.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.427+0000 7f5746e81640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f574015ea80 con 0x7f57400b38f0 2024-04-22T07:19:46.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.427+0000 7f574541e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f574015b3f0 0x7f57401f0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:19:46.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.427+0000 7f574541e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f574015b3f0 0x7f57401f0d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47448/0 (socket says 172.21.15.37:47448) 2024-04-22T07:19:46.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.427+0000 7f574541e640 1 -- 172.21.15.37:0/247693728 learned_addr learned my addr 172.21.15.37:0/247693728 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:19:46.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.427+0000 7f5737fff640 1 --2- 172.21.15.37:0/247693728 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f57401552f0 0x7f57401e6810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:19:46.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.427+0000 7f5744c1d640 1 --2- 172.21.15.37:0/247693728 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f57400b38f0 0x7f57401e4b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:19:46.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.427+0000 7f574541e640 1 -- 172.21.15.37:0/247693728 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f57400b38f0 msgr2=0x7f57401e4b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:19:46.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.427+0000 7f574541e640 1 --2- 172.21.15.37:0/247693728 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f57400b38f0 0x7f57401e4b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:19:46.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.427+0000 7f574541e640 1 -- 172.21.15.37:0/247693728 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f57401552f0 msgr2=0x7f57401e6810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:19:46.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.427+0000 7f574541e640 1 --2- 172.21.15.37:0/247693728 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f57401552f0 0x7f57401e6810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:19:46.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.427+0000 7f574541e640 1 -- 172.21.15.37:0/247693728 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57401e42d0 con 0x7f574015b3f0 2024-04-22T07:19:46.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.427+0000 7f5744c1d640 1 --2- 172.21.15.37:0/247693728 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f57400b38f0 0x7f57401e4b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T07:19:46.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.427+0000 7f5737fff640 1 --2- 172.21.15.37:0/247693728 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f57401552f0 0x7f57401e6810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T07:19:46.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.428+0000 7f574541e640 1 --2- 172.21.15.37:0/247693728 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f574015b3f0 0x7f57401f0d90 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f573800c6b0 tx=0x7f573800cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:19:46.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.428+0000 7f57357fa640 1 -- 172.21.15.37:0/247693728 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5738003b70 con 0x7f574015b3f0 2024-04-22T07:19:46.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.428+0000 7f57357fa640 1 -- 172.21.15.37:0/247693728 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5738003d30 con 0x7f574015b3f0 2024-04-22T07:19:46.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.428+0000 7f5746e81640 1 -- 172.21.15.37:0/247693728 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57401e4890 con 0x7f574015b3f0 2024-04-22T07:19:46.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.428+0000 7f57357fa640 1 -- 172.21.15.37:0/247693728 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5738005310 con 0x7f574015b3f0 2024-04-22T07:19:46.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.428+0000 7f5746e81640 1 -- 172.21.15.37:0/247693728 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5740155c30 con 0x7f574015b3f0 2024-04-22T07:19:46.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.429+0000 7f5746e81640 1 -- 172.21.15.37:0/247693728 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5740154e30 con 0x7f574015b3f0 2024-04-22T07:19:46.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.429+0000 7f57357fa640 1 -- 172.21.15.37:0/247693728 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f57380054b0 con 0x7f574015b3f0 2024-04-22T07:19:46.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.430+0000 7f57357fa640 1 --2- 172.21.15.37:0/247693728 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f572c06c8f0 0x7f572c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:19:46.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.430+0000 7f57357fa640 1 -- 172.21.15.37:0/247693728 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f573808ba90 con 0x7f574015b3f0 2024-04-22T07:19:46.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.430+0000 7f5744c1d640 1 --2- 172.21.15.37:0/247693728 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f572c06c8f0 0x7f572c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:19:46.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.430+0000 7f5744c1d640 1 --2- 172.21.15.37:0/247693728 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f572c06c8f0 0x7f572c06edb0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f573c0011e0 tx=0x7f573c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:19:46.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.434+0000 7f57357fa640 1 -- 172.21.15.37:0/247693728 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f5738059e40 con 0x7f574015b3f0 2024-04-22T07:19:46.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.658+0000 7f5746e81640 1 -- 172.21.15.37:0/247693728 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5740069cc0 con 0x7f574015b3f0 2024-04-22T07:19:46.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.658+0000 7f57357fa640 1 -- 172.21.15.37:0/247693728 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6827 (secure 0 0 0) 0x7f5738059740 con 0x7f574015b3f0 2024-04-22T07:19:46.656 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-22T07:19:46.656 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4265,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6839/671847354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6835","nonce":671847354},{"type":"v1","addr":"172.21.15.196:6839","nonce":671847354}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6833/1549427395","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1549427395},{"type":"v1","addr":"172.21.15.37:6833","nonce":1549427395}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6836/3825988951","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":3825988951},{"type":"v1","addr":"172.21.15.37:6836","nonce":3825988951}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4272,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/611771502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6835","nonce":611771502},{"type":"v1","addr":"172.21.15.37:6837","nonce":611771502}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4291,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6837/3055080225","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6834","nonce":3055080225},{"type":"v1","addr":"172.21.15.196:6837","nonce":3055080225}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-22T07:18:36.111618+0000","modified":"2024-04-22T07:18:41.783857+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.196:6838/3264179771","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6836","nonce":3264179771},{"type":"v1","addr":"172.21.15.196:6838","nonce":3264179771}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4294,"qdb_cluster":[4294]},"id":1}]} 2024-04-22T07:19:46.657 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 8 2024-04-22T07:19:46.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.660+0000 7f5746e81640 1 -- 172.21.15.37:0/247693728 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f572c06c8f0 msgr2=0x7f572c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:19:46.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.660+0000 7f5746e81640 1 --2- 172.21.15.37:0/247693728 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f572c06c8f0 0x7f572c06edb0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f573c0011e0 tx=0x7f573c009040 comp rx=0 tx=0).stop 2024-04-22T07:19:46.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.660+0000 7f5746e81640 1 -- 172.21.15.37:0/247693728 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f574015b3f0 msgr2=0x7f57401f0d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:19:46.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.660+0000 7f5746e81640 1 --2- 172.21.15.37:0/247693728 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f574015b3f0 0x7f57401f0d90 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f573800c6b0 tx=0x7f573800cb70 comp rx=0 tx=0).stop 2024-04-22T07:19:46.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.660+0000 7f5746e81640 1 -- 172.21.15.37:0/247693728 shutdown_connections 2024-04-22T07:19:46.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.660+0000 7f5746e81640 1 --2- 172.21.15.37:0/247693728 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f572c06c8f0 0x7f572c06edb0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:19:46.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.660+0000 7f5746e81640 1 --2- 172.21.15.37:0/247693728 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f574015b3f0 0x7f57401f0d90 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:19:46.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.660+0000 7f5746e81640 1 --2- 172.21.15.37:0/247693728 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f57401552f0 0x7f57401e6810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:19:46.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.660+0000 7f5746e81640 1 --2- 172.21.15.37:0/247693728 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f57400b38f0 0x7f57401e4b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:19:46.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.660+0000 7f5746e81640 1 -- 172.21.15.37:0/247693728 >> 172.21.15.37:0/247693728 conn(0x7f5740071f90 msgr2=0x7f57400b4b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:19:46.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.661+0000 7f5746e81640 1 -- 172.21.15.37:0/247693728 shutdown_connections 2024-04-22T07:19:46.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.661+0000 7f5746e81640 1 -- 172.21.15.37:0/247693728 wait complete. 2024-04-22T07:19:46.669 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4294 quiesce db --set-id 2e500164 --release --await' 2024-04-22T07:19:46.669 DEBUG:teuthology.orchestra.run.smithi037:> timeout 75 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4294 quiesce db --set-id 2e500164 --release --await 2024-04-22T07:19:46.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.780+0000 7fcf59515640 1 Processor -- start 2024-04-22T07:19:46.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.780+0000 7fcf59515640 1 -- start start 2024-04-22T07:19:46.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.781+0000 7fcf59515640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fcf5406c250 0x7fcf540c77e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:19:46.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.781+0000 7fcf59515640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcf54073670 con 0x7fcf540c81f0 2024-04-22T07:19:46.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.781+0000 7fcf59515640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcf54073950 con 0x7fcf540721e0 2024-04-22T07:19:46.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.781+0000 7fcf59515640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fcf5406c630 con 0x7fcf5406c250 2024-04-22T07:19:46.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.781+0000 7fcf52ffd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fcf5406c250 0x7fcf540c77e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:19:46.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.781+0000 7fcf537fe640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fcf540c81f0 0x7fcf54163550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:57792/0 (socket says 172.21.15.37:57792) 2024-04-22T07:19:46.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.781+0000 7fcf537fe640 1 -- 172.21.15.37:0/2981900420 learned_addr learned my addr 172.21.15.37:0/2981900420 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-04-22T07:19:46.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.782+0000 7fcf52ffd640 1 -- 172.21.15.37:0/2981900420 >> v1:172.21.15.196:6789/0 conn(0x7fcf540721e0 legacy=0x7fcf541595a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:19:46.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.782+0000 7fcf51ffb640 1 -- 172.21.15.37:0/2981900420 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 388126220 0 0) 0x7fcf54073670 con 0x7fcf540c81f0 2024-04-22T07:19:46.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.782+0000 7fcf52ffd640 1 -- 172.21.15.37:0/2981900420 >> v1:172.21.15.37:6789/0 conn(0x7fcf540c81f0 legacy=0x7fcf54163550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:19:46.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.782+0000 7fcf52ffd640 1 -- 172.21.15.37:0/2981900420 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf54073c30 con 0x7fcf5406c250 2024-04-22T07:19:46.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.782+0000 7fcf52ffd640 1 --2- 172.21.15.37:0/2981900420 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcf5406c250 0x7fcf540c77e0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fcf44009d90 tx=0x7fcf4402bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bef8598fc9a164b4 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:19:46.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.783+0000 7fcf51ffb640 1 -- 172.21.15.37:0/2981900420 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf44039070 con 0x7fcf5406c250 2024-04-22T07:19:46.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.783+0000 7fcf51ffb640 1 -- 172.21.15.37:0/2981900420 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf4402cd00 con 0x7fcf5406c250 2024-04-22T07:19:46.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.783+0000 7fcf51ffb640 1 -- 172.21.15.37:0/2981900420 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf44034660 con 0x7fcf5406c250 2024-04-22T07:19:46.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.783+0000 7fcf59515640 1 -- 172.21.15.37:0/2981900420 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcf5406c250 msgr2=0x7fcf540c77e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:19:46.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.783+0000 7fcf59515640 1 --2- 172.21.15.37:0/2981900420 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcf5406c250 0x7fcf540c77e0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fcf44009d90 tx=0x7fcf4402bf50 comp rx=0 tx=0).stop 2024-04-22T07:19:46.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.783+0000 7fcf59515640 1 -- 172.21.15.37:0/2981900420 shutdown_connections 2024-04-22T07:19:46.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.783+0000 7fcf59515640 1 --2- 172.21.15.37:0/2981900420 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcf5406c250 0x7fcf540c77e0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:19:46.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.783+0000 7fcf59515640 1 -- 172.21.15.37:0/2981900420 >> 172.21.15.37:0/2981900420 conn(0x7fcf540ccde0 msgr2=0x7fcf540cd1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:19:46.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.783+0000 7fcf59515640 1 -- 172.21.15.37:0/2981900420 shutdown_connections 2024-04-22T07:19:46.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.783+0000 7fcf59515640 1 -- 172.21.15.37:0/2981900420 wait complete. 2024-04-22T07:19:46.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.784+0000 7fcf59515640 1 Processor -- start 2024-04-22T07:19:46.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.784+0000 7fcf59515640 1 -- start start 2024-04-22T07:19:46.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.785+0000 7fcf59515640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcf5406c250 0x7fcf5415ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:19:46.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.785+0000 7fcf59515640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcf540721e0 0x7fcf541e5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:19:46.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.785+0000 7fcf59515640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcf540c81f0 0x7fcf541f10f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:19:46.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.785+0000 7fcf59515640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fcf54072b00 con 0x7fcf5406c250 2024-04-22T07:19:46.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.785+0000 7fcf59515640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fcf54073420 con 0x7fcf540721e0 2024-04-22T07:19:46.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.785+0000 7fcf59515640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fcf54158da0 con 0x7fcf540c81f0 2024-04-22T07:19:46.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.785+0000 7fcf52ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcf5406c250 0x7fcf5415ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:19:46.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.785+0000 7fcf52ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcf5406c250 0x7fcf5415ac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47452/0 (socket says 172.21.15.37:47452) 2024-04-22T07:19:46.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.785+0000 7fcf52ffd640 1 -- 172.21.15.37:0/1306486676 learned_addr learned my addr 172.21.15.37:0/1306486676 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:19:46.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.786+0000 7fcf537fe640 1 --2- 172.21.15.37:0/1306486676 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcf540c81f0 0x7fcf541f10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:19:46.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.786+0000 7fcf527fc640 1 --2- 172.21.15.37:0/1306486676 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcf540721e0 0x7fcf541e5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:19:46.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.786+0000 7fcf52ffd640 1 -- 172.21.15.37:0/1306486676 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcf540c81f0 msgr2=0x7fcf541f10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:19:46.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.786+0000 7fcf52ffd640 1 --2- 172.21.15.37:0/1306486676 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcf540c81f0 0x7fcf541f10f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:19:46.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.786+0000 7fcf52ffd640 1 -- 172.21.15.37:0/1306486676 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcf540721e0 msgr2=0x7fcf541e5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:19:46.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.786+0000 7fcf52ffd640 1 --2- 172.21.15.37:0/1306486676 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcf540721e0 0x7fcf541e5bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:19:46.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.786+0000 7fcf52ffd640 1 -- 172.21.15.37:0/1306486676 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf54150fd0 con 0x7fcf5406c250 2024-04-22T07:19:46.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.786+0000 7fcf527fc640 1 --2- 172.21.15.37:0/1306486676 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcf540721e0 0x7fcf541e5bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-22T07:19:46.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.786+0000 7fcf52ffd640 1 --2- 172.21.15.37:0/1306486676 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcf5406c250 0x7fcf5415ac90 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fcf44037040 tx=0x7fcf44004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:19:46.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.786+0000 7fcf4b7fe640 1 -- 172.21.15.37:0/1306486676 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf44039050 con 0x7fcf5406c250 2024-04-22T07:19:46.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.786+0000 7fcf4b7fe640 1 -- 172.21.15.37:0/1306486676 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf44045070 con 0x7fcf5406c250 2024-04-22T07:19:46.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.786+0000 7fcf59515640 1 -- 172.21.15.37:0/1306486676 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf541f0950 con 0x7fcf5406c250 2024-04-22T07:19:46.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.786+0000 7fcf4b7fe640 1 -- 172.21.15.37:0/1306486676 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf4403ea50 con 0x7fcf5406c250 2024-04-22T07:19:46.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.786+0000 7fcf59515640 1 -- 172.21.15.37:0/1306486676 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf540c20a0 con 0x7fcf5406c250 2024-04-22T07:19:46.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.788+0000 7fcf4b7fe640 1 -- 172.21.15.37:0/1306486676 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fcf4402cbc0 con 0x7fcf5406c250 2024-04-22T07:19:46.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.788+0000 7fcf4b7fe640 1 --2- 172.21.15.37:0/1306486676 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fcf3406c920 0x7fcf3406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:19:46.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.788+0000 7fcf4b7fe640 1 -- 172.21.15.37:0/1306486676 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7fcf440ae350 con 0x7fcf5406c250 2024-04-22T07:19:46.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.789+0000 7fcf527fc640 1 --2- 172.21.15.37:0/1306486676 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fcf3406c920 0x7fcf3406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:19:46.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.789+0000 7fcf5c1e6740 1 Processor -- start 2024-04-22T07:19:46.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.789+0000 7fcf527fc640 1 --2- 172.21.15.37:0/1306486676 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fcf3406c920 0x7fcf3406ede0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fcf5414d460 tx=0x7fcf3c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:19:46.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.789+0000 7fcf5c1e6740 1 -- start start 2024-04-22T07:19:46.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.790+0000 7fcf5c1e6740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55baa34a27d0 0x55baa34a2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:19:46.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.790+0000 7fcf5c1e6740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55baa348c2d0 0x55baa34a3900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:19:46.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.790+0000 7fcf5c1e6740 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x55baa3461810 0x55baa34a3e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:19:46.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.790+0000 7fcf5c1e6740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55baa33c8500 con 0x55baa348c2d0 2024-04-22T07:19:46.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.790+0000 7fcf5c1e6740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55baa336e6a0 con 0x55baa34a27d0 2024-04-22T07:19:46.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.790+0000 7fcf5c1e6740 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x55baa33c44c0 con 0x55baa3461810 2024-04-22T07:19:46.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.790+0000 7fcf527fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55baa348c2d0 0x55baa34a3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:19:46.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.790+0000 7fcf527fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55baa348c2d0 0x55baa34a3900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47460/0 (socket says 172.21.15.37:47460) 2024-04-22T07:19:46.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.790+0000 7fcf527fc640 1 -- 172.21.15.37:0/1964294234 learned_addr learned my addr 172.21.15.37:0/1964294234 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:19:46.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.790+0000 7fcf52ffd640 1 --2- 172.21.15.37:0/1964294234 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55baa34a27d0 0x55baa34a2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:19:46.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.790+0000 7fcf537fe640 1 --2- 172.21.15.37:0/1964294234 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x55baa3461810 0x55baa34a3e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:19:46.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.790+0000 7fcf527fc640 1 -- 172.21.15.37:0/1964294234 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x55baa3461810 msgr2=0x55baa34a3e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:19:46.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.790+0000 7fcf527fc640 1 --2- 172.21.15.37:0/1964294234 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x55baa3461810 0x55baa34a3e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:19:46.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.790+0000 7fcf527fc640 1 -- 172.21.15.37:0/1964294234 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55baa34a27d0 msgr2=0x55baa34a2bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:19:46.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.790+0000 7fcf527fc640 1 --2- 172.21.15.37:0/1964294234 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55baa34a27d0 0x55baa34a2bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:19:46.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.791+0000 7fcf527fc640 1 -- 172.21.15.37:0/1964294234 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55baa338d5e0 con 0x55baa348c2d0 2024-04-22T07:19:46.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.791+0000 7fcf527fc640 1 --2- 172.21.15.37:0/1964294234 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55baa348c2d0 0x55baa34a3900 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fcf3c0147c0 tx=0x7fcf3c010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60e0634bd3ae01f0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:19:46.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.791+0000 7fcf48ff9640 1 -- 172.21.15.37:0/1964294234 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf3c024070 con 0x55baa348c2d0 2024-04-22T07:19:46.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.791+0000 7fcf48ff9640 1 -- 172.21.15.37:0/1964294234 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf3c00dbd0 con 0x55baa348c2d0 2024-04-22T07:19:46.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.791+0000 7fcf48ff9640 1 -- 172.21.15.37:0/1964294234 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf3c01f400 con 0x55baa348c2d0 2024-04-22T07:19:46.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.791+0000 7fcf5c1e6740 1 -- 172.21.15.37:0/1964294234 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55baa348c2d0 msgr2=0x55baa34a3900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:19:46.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.791+0000 7fcf5c1e6740 1 --2- 172.21.15.37:0/1964294234 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55baa348c2d0 0x55baa34a3900 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fcf3c0147c0 tx=0x7fcf3c010000 comp rx=0 tx=0).stop 2024-04-22T07:19:46.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.792+0000 7fcf5c1e6740 1 -- 172.21.15.37:0/1964294234 shutdown_connections 2024-04-22T07:19:46.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.792+0000 7fcf5c1e6740 1 --2- 172.21.15.37:0/1964294234 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x55baa3461810 0x55baa34a3e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:19:46.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.792+0000 7fcf5c1e6740 1 --2- 172.21.15.37:0/1964294234 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55baa348c2d0 0x55baa34a3900 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:19:46.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.792+0000 7fcf5c1e6740 1 --2- 172.21.15.37:0/1964294234 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55baa34a27d0 0x55baa34a2bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:19:46.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.792+0000 7fcf5c1e6740 1 -- 172.21.15.37:0/1964294234 >> 172.21.15.37:0/1964294234 conn(0x55baa345f550 msgr2=0x55baa3461e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:19:46.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.792+0000 7fcf5c1e6740 1 -- 172.21.15.37:0/1964294234 shutdown_connections 2024-04-22T07:19:46.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.792+0000 7fcf5c1e6740 1 -- 172.21.15.37:0/1964294234 wait complete. 2024-04-22T07:19:46.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.792+0000 7fcf5c1e6740 1 -- start start 2024-04-22T07:19:46.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.792+0000 7fcf5c1e6740 1 Processor -- start 2024-04-22T07:19:46.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.793+0000 7fcf5c1e6740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55baa348c2d0 0x55baa3462d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:19:46.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.793+0000 7fcf5c1e6740 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x55baa34a27d0 0x55baa34b3c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:19:46.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.793+0000 7fcf5c1e6740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55baa3487cc0 0x55baa3484fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:19:46.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.793+0000 7fcf5c1e6740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55baa3460c30 con 0x55baa348c2d0 2024-04-22T07:19:46.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.793+0000 7fcf5c1e6740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55baa3381a60 con 0x55baa3487cc0 2024-04-22T07:19:46.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.793+0000 7fcf5c1e6740 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x55baa348c7a0 con 0x55baa34a27d0 2024-04-22T07:19:46.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.793+0000 7fcf5c1e6740 10 client.0 _ll_register_callbacks cb 0x55baa30da110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-22T07:19:46.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.793+0000 7fcf52ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55baa348c2d0 0x55baa3462d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:19:46.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.793+0000 7fcf52ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55baa348c2d0 0x55baa3462d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47468/0 (socket says 172.21.15.37:47468) 2024-04-22T07:19:46.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.793+0000 7fcf52ffd640 1 -- 172.21.15.37:0/4271219308 learned_addr learned my addr 172.21.15.37:0/4271219308 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:19:46.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.793+0000 7fcf527fc640 1 --2- 172.21.15.37:0/4271219308 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x55baa34a27d0 0x55baa34b3c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:19:46.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.793+0000 7fcf537fe640 1 --2- 172.21.15.37:0/4271219308 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55baa3487cc0 0x55baa3484fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:19:46.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.793+0000 7fcf52ffd640 1 -- 172.21.15.37:0/4271219308 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x55baa34a27d0 msgr2=0x55baa34b3c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:19:46.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.793+0000 7fcf52ffd640 1 --2- 172.21.15.37:0/4271219308 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x55baa34a27d0 0x55baa34b3c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:19:46.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.793+0000 7fcf52ffd640 1 -- 172.21.15.37:0/4271219308 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55baa3487cc0 msgr2=0x55baa3484fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:19:46.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.793+0000 7fcf52ffd640 1 --2- 172.21.15.37:0/4271219308 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55baa3487cc0 0x55baa3484fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:19:46.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.793+0000 7fcf52ffd640 1 -- 172.21.15.37:0/4271219308 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55baa30da920 con 0x55baa348c2d0 2024-04-22T07:19:46.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.793+0000 7fcf527fc640 1 --2- 172.21.15.37:0/4271219308 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x55baa34a27d0 0x55baa34b3c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T07:19:46.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.794+0000 7fcf52ffd640 1 --2- 172.21.15.37:0/4271219308 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55baa348c2d0 0x55baa3462d90 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fcf440784f0 tx=0x7fcf44080440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc55d6e87dcc7acb server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:19:46.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.794+0000 7fcf31ffb640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-04-22T07:19:46.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.794+0000 7fcf31ffb640 1 -- 172.21.15.37:0/4271219308 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf44094020 con 0x55baa348c2d0 2024-04-22T07:19:46.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.794+0000 7fcf31ffb640 1 -- 172.21.15.37:0/4271219308 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7fcf440800e0 con 0x55baa348c2d0 2024-04-22T07:19:46.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.794+0000 7fcf5c1e6740 1 -- 172.21.15.37:0/4271219308 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcf3c00dbd0 con 0x55baa348c2d0 2024-04-22T07:19:46.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.794+0000 7fcf31ffb640 1 -- 172.21.15.37:0/4271219308 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7fcf4407a450 con 0x55baa348c2d0 2024-04-22T07:19:46.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.794+0000 7fcf5c1e6740 10 client.4881 fetch_fsmap learned FSMap version 8 2024-04-22T07:19:46.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.794+0000 7fcf5c1e6740 1 -- 172.21.15.37:0/4271219308 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x55baa31a6d30 con 0x55baa348c2d0 2024-04-22T07:19:46.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.794+0000 7fcf31ffb640 1 -- 172.21.15.37:0/4271219308 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf3c00dbd0 con 0x55baa348c2d0 2024-04-22T07:19:46.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.794+0000 7fcf31ffb640 1 -- 172.21.15.37:0/4271219308 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 8) ==== 4704+0+0 (secure 0 0 0) 0x7fcf440a9020 con 0x55baa348c2d0 2024-04-22T07:19:46.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.794+0000 7fcf5c1e6740 10 client.4881 fetch_fsmap finished waiting for FSMap version 8 2024-04-22T07:19:46.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.794+0000 7fcf5c1e6740 10 client.4881 resolve_mds: validated gid 4294 aka daemon mds.f 2024-04-22T07:19:46.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.794+0000 7fcf5c1e6740 20 client.4881 populate_metadata read hostname 'smithi037' 2024-04-22T07:19:46.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.794+0000 7fcf5c1e6740 1 --2- 172.21.15.37:0/4271219308 >> [v2:172.21.15.196:6836/3264179771,v1:172.21.15.196:6838/3264179771] conn(0x55baa34a93b0 0x55baa34a9800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:19:46.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.794+0000 7fcf5c1e6740 4 client.4881 mds_command: new command op to 4294 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-22T07:19:46.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.794+0000 7fcf5c1e6740 1 -- 172.21.15.37:0/4271219308 --> [v2:172.21.15.196:6836/3264179771,v1:172.21.15.196:6838/3264179771] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55baa339ba10 con 0x55baa34a93b0 2024-04-22T07:19:46.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.794+0000 7fcf527fc640 1 --2- 172.21.15.37:0/4271219308 >> [v2:172.21.15.196:6836/3264179771,v1:172.21.15.196:6838/3264179771] conn(0x55baa34a93b0 0x55baa34a9800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:19:46.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.795+0000 7fcf31ffb640 10 client.4881 ms_handle_connect on v2:172.21.15.196:6836/3264179771 2024-04-22T07:19:46.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.795+0000 7fcf527fc640 1 --2- 172.21.15.37:0/4271219308 >> [v2:172.21.15.196:6836/3264179771,v1:172.21.15.196:6838/3264179771] conn(0x55baa34a93b0 0x55baa34a9800 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5ce1fe427e72b83 server_cookie=915b66e0ca1340af in_seq=0 out_seq=0 2024-04-22T07:19:46.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.795+0000 7fcf31ffb640 1 -- 172.21.15.37:0/4271219308 <== mds.0 v2:172.21.15.196:6836/3264179771 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55baa339ba10 con 0x55baa34a93b0 2024-04-22T07:19:46.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.796+0000 7fcf31ffb640 10 client.4881 handle_command_reply: tid=0 2024-04-22T07:19:46.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.796+0000 7fcf5c1e6740 1 client.4881 shutdown 2024-04-22T07:19:46.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.796+0000 7fcf5c1e6740 1 -- 172.21.15.37:0/4271219308 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55baa348c2d0 msgr2=0x55baa3462d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:19:46.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.796+0000 7fcf5c1e6740 1 --2- 172.21.15.37:0/4271219308 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55baa348c2d0 0x55baa3462d90 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fcf440784f0 tx=0x7fcf44080440 comp rx=0 tx=0).stop 2024-04-22T07:19:46.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.796+0000 7fcf5c1e6740 1 -- 172.21.15.37:0/4271219308 shutdown_connections 2024-04-22T07:19:46.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.796+0000 7fcf5c1e6740 1 --2- 172.21.15.37:0/4271219308 >> [v2:172.21.15.196:6836/3264179771,v1:172.21.15.196:6838/3264179771] conn(0x55baa34a93b0 0x55baa34a9800 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:19:46.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.796+0000 7fcf5c1e6740 1 --2- 172.21.15.37:0/4271219308 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55baa3487cc0 0x55baa3484fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:19:46.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.796+0000 7fcf31ffb640 0 client.4881 ms_handle_reset on v2:172.21.15.196:6836/3264179771 2024-04-22T07:19:46.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.796+0000 7fcf5c1e6740 1 --2- 172.21.15.37:0/4271219308 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x55baa34a27d0 0x55baa34b3c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:19:46.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.796+0000 7fcf5c1e6740 1 --2- 172.21.15.37:0/4271219308 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55baa348c2d0 0x55baa3462d90 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:19:46.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.796+0000 7fcf5c1e6740 1 -- 172.21.15.37:0/4271219308 >> 172.21.15.37:0/4271219308 conn(0x55baa3461810 msgr2=0x55baa34a3870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:19:46.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.796+0000 7fcf5c1e6740 1 -- 172.21.15.37:0/4271219308 shutdown_connections 2024-04-22T07:19:46.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.796+0000 7fcf5c1e6740 1 -- 172.21.15.37:0/4271219308 wait complete. 2024-04-22T07:19:46.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.796+0000 7fcf5c1e6740 20 client.4881 trim_cache size 0 max 16384 2024-04-22T07:19:46.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.813+0000 7fcf5c1e6740 1 Processor -- start 2024-04-22T07:19:46.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.813+0000 7fcf5c1e6740 1 -- start start 2024-04-22T07:19:46.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.814+0000 7fcf5c1e6740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55baa3487cc0 0x55baa34837e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:19:46.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.814+0000 7fcf5c1e6740 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x55baa348c2d0 0x55baa345e280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:19:46.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.814+0000 7fcf5c1e6740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55baa34a27d0 0x55baa345e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:19:46.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.814+0000 7fcf5c1e6740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fcf541fdf70 con 0x55baa34a27d0 2024-04-22T07:19:46.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.814+0000 7fcf5c1e6740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fcf541fce80 con 0x55baa3487cc0 2024-04-22T07:19:46.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.814+0000 7fcf5c1e6740 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fcf5414c1c0 con 0x55baa348c2d0 2024-04-22T07:19:46.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.814+0000 7fcf537fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55baa34a27d0 0x55baa345e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:19:46.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.814+0000 7fcf537fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55baa34a27d0 0x55baa345e7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47478/0 (socket says 172.21.15.37:47478) 2024-04-22T07:19:46.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.814+0000 7fcf537fe640 1 -- 172.21.15.37:0/2405548693 learned_addr learned my addr 172.21.15.37:0/2405548693 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:19:46.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.814+0000 7fcf537fe640 1 -- 172.21.15.37:0/2405548693 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x55baa348c2d0 msgr2=0x55baa345e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:19:46.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.814+0000 7fcf537fe640 1 --2- 172.21.15.37:0/2405548693 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x55baa348c2d0 0x55baa345e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:19:46.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.814+0000 7fcf537fe640 1 -- 172.21.15.37:0/2405548693 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55baa3487cc0 msgr2=0x55baa34837e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:19:46.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.814+0000 7fcf52ffd640 1 --2- 172.21.15.37:0/2405548693 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55baa3487cc0 0x55baa34837e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:19:46.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.814+0000 7fcf537fe640 1 --2- 172.21.15.37:0/2405548693 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55baa3487cc0 0x55baa34837e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:19:46.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.814+0000 7fcf537fe640 1 -- 172.21.15.37:0/2405548693 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55baa347dc10 con 0x55baa34a27d0 2024-04-22T07:19:46.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.814+0000 7fcf537fe640 1 --2- 172.21.15.37:0/2405548693 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55baa34a27d0 0x55baa345e7c0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fcf4c007460 tx=0x7fcf4c007e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9ba42a6fff68b91 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:19:46.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.815+0000 7fcf33fff640 1 -- 172.21.15.37:0/2405548693 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf4c01a020 con 0x55baa34a27d0 2024-04-22T07:19:46.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.815+0000 7fcf33fff640 1 -- 172.21.15.37:0/2405548693 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf4c001810 con 0x55baa34a27d0 2024-04-22T07:19:46.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.815+0000 7fcf33fff640 1 -- 172.21.15.37:0/2405548693 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf4c007670 con 0x55baa34a27d0 2024-04-22T07:19:46.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.815+0000 7fcf5c1e6740 1 -- 172.21.15.37:0/2405548693 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55baa34a27d0 msgr2=0x55baa345e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:19:46.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.815+0000 7fcf5c1e6740 1 --2- 172.21.15.37:0/2405548693 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55baa34a27d0 0x55baa345e7c0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fcf4c007460 tx=0x7fcf4c007e70 comp rx=0 tx=0).stop 2024-04-22T07:19:46.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.815+0000 7fcf5c1e6740 1 -- 172.21.15.37:0/2405548693 shutdown_connections 2024-04-22T07:19:46.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.815+0000 7fcf5c1e6740 1 --2- 172.21.15.37:0/2405548693 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55baa34a27d0 0x55baa345e7c0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:19:46.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.815+0000 7fcf5c1e6740 1 --2- 172.21.15.37:0/2405548693 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x55baa348c2d0 0x55baa345e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:19:46.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.815+0000 7fcf5c1e6740 1 --2- 172.21.15.37:0/2405548693 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55baa3487cc0 0x55baa34837e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:19:46.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.815+0000 7fcf5c1e6740 1 -- 172.21.15.37:0/2405548693 >> 172.21.15.37:0/2405548693 conn(0x55baa3461810 msgr2=0x55baa34586d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:19:46.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.815+0000 7fcf5c1e6740 1 -- 172.21.15.37:0/2405548693 shutdown_connections 2024-04-22T07:19:46.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.815+0000 7fcf5c1e6740 1 -- 172.21.15.37:0/2405548693 wait complete. 2024-04-22T07:19:46.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.816+0000 7fcf5c1e6740 1 -- start start 2024-04-22T07:19:46.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.816+0000 7fcf5c1e6740 1 Processor -- start 2024-04-22T07:19:46.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.816+0000 7fcf5c1e6740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55baa3487cc0 0x55baa34808c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:19:46.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.816+0000 7fcf5c1e6740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55baa348c2d0 0x55baa348a920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:19:46.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.816+0000 7fcf5c1e6740 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x55baa34a27d0 0x55baa34b0bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:19:46.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.816+0000 7fcf5c1e6740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fcf5414c810 con 0x55baa348c2d0 2024-04-22T07:19:46.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.816+0000 7fcf5c1e6740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fcf541fc7b0 con 0x55baa3487cc0 2024-04-22T07:19:46.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.816+0000 7fcf5c1e6740 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fcf5414ce60 con 0x55baa34a27d0 2024-04-22T07:19:46.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.817+0000 7fcf5c1e6740 10 client.0 _ll_register_callbacks cb 0x7fcf4407bc80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-22T07:19:46.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.817+0000 7fcf527fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55baa348c2d0 0x55baa348a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:19:46.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.817+0000 7fcf527fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55baa348c2d0 0x55baa348a920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47492/0 (socket says 172.21.15.37:47492) 2024-04-22T07:19:46.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.817+0000 7fcf527fc640 1 -- 172.21.15.37:0/1399368122 learned_addr learned my addr 172.21.15.37:0/1399368122 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:19:46.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.817+0000 7fcf52ffd640 1 --2- 172.21.15.37:0/1399368122 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55baa3487cc0 0x55baa34808c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:19:46.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.817+0000 7fcf537fe640 1 --2- 172.21.15.37:0/1399368122 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x55baa34a27d0 0x55baa34b0bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:19:46.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.817+0000 7fcf527fc640 1 -- 172.21.15.37:0/1399368122 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x55baa34a27d0 msgr2=0x55baa34b0bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:19:46.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.817+0000 7fcf527fc640 1 --2- 172.21.15.37:0/1399368122 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x55baa34a27d0 0x55baa34b0bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:19:46.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.817+0000 7fcf527fc640 1 -- 172.21.15.37:0/1399368122 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55baa3487cc0 msgr2=0x55baa34808c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:19:46.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.817+0000 7fcf527fc640 1 --2- 172.21.15.37:0/1399368122 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55baa3487cc0 0x55baa34808c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:19:46.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.817+0000 7fcf527fc640 1 -- 172.21.15.37:0/1399368122 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55baa34a7e70 con 0x55baa348c2d0 2024-04-22T07:19:46.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.817+0000 7fcf527fc640 1 --2- 172.21.15.37:0/1399368122 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55baa348c2d0 0x55baa348a920 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fcf3c014790 tx=0x7fcf3c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ed1e60f31688b60 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:19:46.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.817+0000 7fcf31ffb640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-04-22T07:19:46.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.817+0000 7fcf31ffb640 1 -- 172.21.15.37:0/1399368122 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf3c033020 con 0x55baa348c2d0 2024-04-22T07:19:46.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.817+0000 7fcf31ffb640 1 -- 172.21.15.37:0/1399368122 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7fcf3c0069d0 con 0x55baa348c2d0 2024-04-22T07:19:46.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.817+0000 7fcf5c1e6740 1 -- 172.21.15.37:0/1399368122 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcf4c001810 con 0x55baa348c2d0 2024-04-22T07:19:46.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.817+0000 7fcf31ffb640 1 -- 172.21.15.37:0/1399368122 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7fcf3c03d050 con 0x55baa348c2d0 2024-04-22T07:19:46.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.817+0000 7fcf5c1e6740 10 client.4887 fetch_fsmap learned FSMap version 8 2024-04-22T07:19:46.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.817+0000 7fcf5c1e6740 1 -- 172.21.15.37:0/1399368122 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x55baa34adc40 con 0x55baa348c2d0 2024-04-22T07:19:46.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.818+0000 7fcf31ffb640 1 -- 172.21.15.37:0/1399368122 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf4c001810 con 0x55baa348c2d0 2024-04-22T07:19:46.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.818+0000 7fcf31ffb640 1 -- 172.21.15.37:0/1399368122 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 8) ==== 4704+0+0 (secure 0 0 0) 0x7fcf3c040020 con 0x55baa348c2d0 2024-04-22T07:19:46.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.818+0000 7fcf5c1e6740 10 client.4887 fetch_fsmap finished waiting for FSMap version 8 2024-04-22T07:19:46.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.818+0000 7fcf5c1e6740 10 client.4887 resolve_mds: validated gid 4294 aka daemon mds.f 2024-04-22T07:19:46.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.818+0000 7fcf5c1e6740 20 client.4887 populate_metadata read hostname 'smithi037' 2024-04-22T07:19:46.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.818+0000 7fcf5c1e6740 1 --2- 172.21.15.37:0/1399368122 >> [v2:172.21.15.196:6836/3264179771,v1:172.21.15.196:6838/3264179771] conn(0x55baa3520f40 0x55baa3521350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:19:46.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.818+0000 7fcf5c1e6740 4 client.4887 mds_command: new command op to 4294 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "2e500164", "release": true, "await": true}] 2024-04-22T07:19:46.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.818+0000 7fcf5c1e6740 1 -- 172.21.15.37:0/1399368122 --> [v2:172.21.15.196:6836/3264179771,v1:172.21.15.196:6838/3264179771] -- command(tid 0: {"prefix": "quiesce db", "set_id": "2e500164", "release": true, "await": true}) -- 0x55baa34aa4d0 con 0x55baa3520f40 2024-04-22T07:19:46.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.818+0000 7fcf52ffd640 1 --2- 172.21.15.37:0/1399368122 >> [v2:172.21.15.196:6836/3264179771,v1:172.21.15.196:6838/3264179771] conn(0x55baa3520f40 0x55baa3521350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:19:46.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.818+0000 7fcf31ffb640 10 client.4887 ms_handle_connect on v2:172.21.15.196:6836/3264179771 2024-04-22T07:19:46.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.818+0000 7fcf52ffd640 1 --2- 172.21.15.37:0/1399368122 >> [v2:172.21.15.196:6836/3264179771,v1:172.21.15.196:6838/3264179771] conn(0x55baa3520f40 0x55baa3521350 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2c64e0d674377257 server_cookie=cac85fcca6f4b71b in_seq=0 out_seq=0 2024-04-22T07:19:46.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.819+0000 7fcf31ffb640 1 -- 172.21.15.37:0/1399368122 <== mds.0 v2:172.21.15.196:6836/3264179771 1 ==== command_reply(tid 0: 0 ) ==== 8+0+586 (crc 0 0 0) 0x55baa34aa4d0 con 0x55baa3520f40 2024-04-22T07:19:46.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.819+0000 7fcf31ffb640 10 client.4887 handle_command_reply: tid=0 2024-04-22T07:19:46.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.819+0000 7fcf5c1e6740 1 client.4887 shutdown 2024-04-22T07:19:46.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.819+0000 7fcf5c1e6740 1 -- 172.21.15.37:0/1399368122 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55baa348c2d0 msgr2=0x55baa348a920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:19:46.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.819+0000 7fcf5c1e6740 1 --2- 172.21.15.37:0/1399368122 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55baa348c2d0 0x55baa348a920 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fcf3c014790 tx=0x7fcf3c000ed0 comp rx=0 tx=0).stop 2024-04-22T07:19:46.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.819+0000 7fcf5c1e6740 1 -- 172.21.15.37:0/1399368122 shutdown_connections 2024-04-22T07:19:46.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.819+0000 7fcf5c1e6740 1 --2- 172.21.15.37:0/1399368122 >> [v2:172.21.15.196:6836/3264179771,v1:172.21.15.196:6838/3264179771] conn(0x55baa3520f40 0x55baa3521350 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:19:46.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.819+0000 7fcf5c1e6740 1 --2- 172.21.15.37:0/1399368122 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x55baa34a27d0 0x55baa34b0bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:19:46.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.819+0000 7fcf5c1e6740 1 --2- 172.21.15.37:0/1399368122 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55baa348c2d0 0x55baa348a920 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:19:46.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.819+0000 7fcf31ffb640 0 client.4887 ms_handle_reset on v2:172.21.15.196:6836/3264179771 2024-04-22T07:19:46.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.819+0000 7fcf5c1e6740 1 --2- 172.21.15.37:0/1399368122 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55baa3487cc0 0x55baa34808c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:19:46.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.819+0000 7fcf5c1e6740 1 -- 172.21.15.37:0/1399368122 >> 172.21.15.37:0/1399368122 conn(0x55baa3461810 msgr2=0x55baa345e280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:19:46.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.819+0000 7fcf5c1e6740 1 -- 172.21.15.37:0/1399368122 shutdown_connections 2024-04-22T07:19:46.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.819+0000 7fcf5c1e6740 1 -- 172.21.15.37:0/1399368122 wait complete. 2024-04-22T07:19:46.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.819+0000 7fcf5c1e6740 20 client.4887 trim_cache size 0 max 16384 2024-04-22T07:19:46.823 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-04-22T07:19:46.823 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 8, 2024-04-22T07:19:46.823 INFO:teuthology.orchestra.run.smithi037.stdout: "leader": 4294, 2024-04-22T07:19:46.823 INFO:teuthology.orchestra.run.smithi037.stdout: "set_version": 4, 2024-04-22T07:19:46.823 INFO:teuthology.orchestra.run.smithi037.stdout: "sets": { 2024-04-22T07:19:46.823 INFO:teuthology.orchestra.run.smithi037.stdout: "2e500164": { 2024-04-22T07:19:46.823 INFO:teuthology.orchestra.run.smithi037.stdout: "version": 4, 2024-04-22T07:19:46.823 INFO:teuthology.orchestra.run.smithi037.stdout: "age_ref": 0.0, 2024-04-22T07:19:46.823 INFO:teuthology.orchestra.run.smithi037.stdout: "state": { 2024-04-22T07:19:46.823 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "RELEASED", 2024-04-22T07:19:46.823 INFO:teuthology.orchestra.run.smithi037.stdout: "age": 0.0 2024-04-22T07:19:46.824 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-04-22T07:19:46.824 INFO:teuthology.orchestra.run.smithi037.stdout: "timeout": 60.0, 2024-04-22T07:19:46.824 INFO:teuthology.orchestra.run.smithi037.stdout: "expiration": 89.9, 2024-04-22T07:19:46.824 INFO:teuthology.orchestra.run.smithi037.stdout: "members": { 2024-04-22T07:19:46.824 INFO:teuthology.orchestra.run.smithi037.stdout: "file:/": { 2024-04-22T07:19:46.824 INFO:teuthology.orchestra.run.smithi037.stdout: "excluded": false, 2024-04-22T07:19:46.824 INFO:teuthology.orchestra.run.smithi037.stdout: "state": { 2024-04-22T07:19:46.824 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "RELEASED", 2024-04-22T07:19:46.824 INFO:teuthology.orchestra.run.smithi037.stdout: "age": 0.0 2024-04-22T07:19:46.824 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-04-22T07:19:46.824 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-04-22T07:19:46.824 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-04-22T07:19:46.824 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-04-22T07:19:46.825 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-04-22T07:19:46.825 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-04-22T07:19:46.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.819+0000 7fcf59515640 1 -- 172.21.15.37:0/1306486676 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fcf3406c920 msgr2=0x7fcf3406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:19:46.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.819+0000 7fcf59515640 1 --2- 172.21.15.37:0/1306486676 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fcf3406c920 0x7fcf3406ede0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fcf5414d460 tx=0x7fcf3c009040 comp rx=0 tx=0).stop 2024-04-22T07:19:46.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.819+0000 7fcf59515640 1 -- 172.21.15.37:0/1306486676 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcf5406c250 msgr2=0x7fcf5415ac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:19:46.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.819+0000 7fcf59515640 1 --2- 172.21.15.37:0/1306486676 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcf5406c250 0x7fcf5415ac90 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fcf44037040 tx=0x7fcf44004a40 comp rx=0 tx=0).stop 2024-04-22T07:19:46.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.819+0000 7fcf59515640 1 -- 172.21.15.37:0/1306486676 shutdown_connections 2024-04-22T07:19:46.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.819+0000 7fcf59515640 1 --2- 172.21.15.37:0/1306486676 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fcf3406c920 0x7fcf3406ede0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:19:46.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.819+0000 7fcf59515640 1 --2- 172.21.15.37:0/1306486676 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcf540c81f0 0x7fcf541f10f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:19:46.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.819+0000 7fcf59515640 1 --2- 172.21.15.37:0/1306486676 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcf540721e0 0x7fcf541e5bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:19:46.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.819+0000 7fcf59515640 1 --2- 172.21.15.37:0/1306486676 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcf5406c250 0x7fcf5415ac90 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:19:46.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.819+0000 7fcf59515640 1 -- 172.21.15.37:0/1306486676 >> 172.21.15.37:0/1306486676 conn(0x7fcf540ccde0 msgr2=0x7fcf540cbf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:19:46.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.820+0000 7fcf59515640 1 -- 172.21.15.37:0/1306486676 shutdown_connections 2024-04-22T07:19:46.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:19:46.820+0000 7fcf59515640 1 -- 172.21.15.37:0/1306486676 wait complete. 2024-04-22T07:19:46.828 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set_id: 2e500164, seconds elapsed: 30.9 2024-04-22T07:20:06.888 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-22T07:20:06.891 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-22T07:20:23.106 INFO:tasks.workunit.client.0.smithi037.stderr:Updating files: 94% (11543/12271) Updating files: 95% (11658/12271) Updating files: 96% (11781/12271) Updating files: 97% (11903/12271) Updating files: 98% (12026/12271) Updating files: 99% (12149/12271) Updating files: 100% (12271/12271) Updating files: 100% (12271/12271), done. 2024-04-22T07:20:23.459 INFO:tasks.workunit.client.0.smithi037.stderr:Note: switching to '86f7587a5a09af35f0895e1a2d08527638fae697'. 2024-04-22T07:20:23.459 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-04-22T07:20:23.459 INFO:tasks.workunit.client.0.smithi037.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-04-22T07:20:23.459 INFO:tasks.workunit.client.0.smithi037.stderr:changes and commit them, and you can discard any commits you make in this 2024-04-22T07:20:23.459 INFO:tasks.workunit.client.0.smithi037.stderr:state without impacting any branches by switching back to a branch. 2024-04-22T07:20:23.460 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-04-22T07:20:23.460 INFO:tasks.workunit.client.0.smithi037.stderr:If you want to create a new branch to retain commits you create, you may 2024-04-22T07:20:23.460 INFO:tasks.workunit.client.0.smithi037.stderr:do so (now or later) by using -c with the switch command. Example: 2024-04-22T07:20:23.460 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-04-22T07:20:23.460 INFO:tasks.workunit.client.0.smithi037.stderr: git switch -c 2024-04-22T07:20:23.460 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-04-22T07:20:23.461 INFO:tasks.workunit.client.0.smithi037.stderr:Or undo this operation with: 2024-04-22T07:20:23.461 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-04-22T07:20:23.461 INFO:tasks.workunit.client.0.smithi037.stderr: git switch - 2024-04-22T07:20:23.461 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-04-22T07:20:23.461 INFO:tasks.workunit.client.0.smithi037.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-04-22T07:20:23.461 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-04-22T07:20:23.462 INFO:tasks.workunit.client.0.smithi037.stderr:HEAD is now at 86f7587a5a0 qa/fsx: use the master branch to build the xfstest-dev 2024-04-22T07:20:23.464 DEBUG:teuthology.orchestra.run.smithi037:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-04-22T07:20:23.504 INFO:tasks.workunit.client.0.smithi037.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-04-22T07:20:23.506 INFO:tasks.workunit.client.0.smithi037.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-22T07:20:23.506 INFO:tasks.workunit.client.0.smithi037.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-04-22T07:20:24.191 INFO:tasks.workunit.client.0.smithi037.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-04-22T07:20:24.248 INFO:tasks.workunit.client.0.smithi037.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-04-22T07:20:24.290 INFO:tasks.workunit.client.0.smithi037.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-22T07:20:24.292 INFO:tasks.workunit.client.0.smithi037.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-22T07:20:24.292 INFO:tasks.workunit.client.0.smithi037.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-04-22T07:20:24.332 INFO:tasks.workunit.client.0.smithi037.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-22T07:20:24.335 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-04-22T07:20:24.336 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-04-22T07:20:24.391 INFO:tasks.workunit:Running workunits matching suites/iozone.sh on client.0... 2024-04-22T07:20:24.393 INFO:tasks.workunit:Running workunit suites/iozone.sh... 2024-04-22T07:20:24.393 DEBUG:teuthology.orchestra.run.smithi037:workunit test suites/iozone.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=86f7587a5a09af35f0895e1a2d08527638fae697 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/iozone.sh 2024-04-22T07:20:24.453 INFO:tasks.workunit.client.0.smithi037.stderr:+ iozone -c -e -s 1024M -r 16K -t 1 -F f1 -i 0 -i 1 2024-04-22T07:20:24.528 INFO:tasks.workunit.client.0.smithi037.stdout: Iozone: Performance Test of File I/O 2024-04-22T07:20:24.528 INFO:tasks.workunit.client.0.smithi037.stdout: Version $Revision: 3.494 $ 2024-04-22T07:20:24.528 INFO:tasks.workunit.client.0.smithi037.stdout: Compiled for 64 bit mode. 2024-04-22T07:20:24.528 INFO:tasks.workunit.client.0.smithi037.stdout: Build: linux-AMD64 2024-04-22T07:20:24.528 INFO:tasks.workunit.client.0.smithi037.stdout: 2024-04-22T07:20:24.528 INFO:tasks.workunit.client.0.smithi037.stdout: Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins 2024-04-22T07:20:24.528 INFO:tasks.workunit.client.0.smithi037.stdout: Al Slater, Scott Rhine, Mike Wisner, Ken Goss 2024-04-22T07:20:24.528 INFO:tasks.workunit.client.0.smithi037.stdout: Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR, 2024-04-22T07:20:24.528 INFO:tasks.workunit.client.0.smithi037.stdout: Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner, 2024-04-22T07:20:24.528 INFO:tasks.workunit.client.0.smithi037.stdout: Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone, 2024-04-22T07:20:24.529 INFO:tasks.workunit.client.0.smithi037.stdout: Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root, 2024-04-22T07:20:24.529 INFO:tasks.workunit.client.0.smithi037.stdout: Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer, 2024-04-22T07:20:24.529 INFO:tasks.workunit.client.0.smithi037.stdout: Vangel Bojaxhi, Ben England, Vikentsi Lapa, 2024-04-22T07:20:24.529 INFO:tasks.workunit.client.0.smithi037.stdout: Alexey Skidanov, Sudhir Kumar. 2024-04-22T07:20:24.529 INFO:tasks.workunit.client.0.smithi037.stdout: 2024-04-22T07:20:24.529 INFO:tasks.workunit.client.0.smithi037.stdout: Run began: Mon Apr 22 07:20:24 2024 2024-04-22T07:20:24.529 INFO:tasks.workunit.client.0.smithi037.stdout: 2024-04-22T07:20:24.529 INFO:tasks.workunit.client.0.smithi037.stdout: Include close in write timing 2024-04-22T07:20:24.529 INFO:tasks.workunit.client.0.smithi037.stdout: Include fsync in write timing 2024-04-22T07:20:24.529 INFO:tasks.workunit.client.0.smithi037.stdout: File size set to 1048576 kB 2024-04-22T07:20:24.529 INFO:tasks.workunit.client.0.smithi037.stdout: Record Size 16 kB 2024-04-22T07:20:24.529 INFO:tasks.workunit.client.0.smithi037.stdout: Command line used: iozone -c -e -s 1024M -r 16K -t 1 -F f1 -i 0 -i 1 2024-04-22T07:20:24.529 INFO:tasks.workunit.client.0.smithi037.stdout: Output is in kBytes/sec 2024-04-22T07:20:24.529 INFO:tasks.workunit.client.0.smithi037.stdout: Time Resolution = 0.000001 seconds. 2024-04-22T07:20:24.529 INFO:tasks.workunit.client.0.smithi037.stdout: Processor cache size set to 1024 kBytes. 2024-04-22T07:20:24.530 INFO:tasks.workunit.client.0.smithi037.stdout: Processor cache line size set to 32 bytes. 2024-04-22T07:20:24.530 INFO:tasks.workunit.client.0.smithi037.stdout: File stride size set to 17 * record size. 2024-04-22T07:20:24.530 INFO:tasks.workunit.client.0.smithi037.stdout: Throughput test with 1 process 2024-04-22T07:20:24.530 INFO:tasks.workunit.client.0.smithi037.stdout: Each process writes a 1048576 kByte file in 16 kByte records 2024-04-22T07:20:25.954 INFO:tasks.workunit.client.0.smithi037.stdout: 2024-04-22T07:20:25.954 INFO:tasks.workunit.client.0.smithi037.stdout: Children see throughput for 1 initial writers = 736084.56 kB/sec 2024-04-22T07:20:25.954 INFO:tasks.workunit.client.0.smithi037.stdout: Parent sees throughput for 1 initial writers = 735994.19 kB/sec 2024-04-22T07:20:25.954 INFO:tasks.workunit.client.0.smithi037.stdout: Min throughput per process = 736084.56 kB/sec 2024-04-22T07:20:25.955 INFO:tasks.workunit.client.0.smithi037.stdout: Max throughput per process = 736084.56 kB/sec 2024-04-22T07:20:25.955 INFO:tasks.workunit.client.0.smithi037.stdout: Avg throughput per process = 736084.56 kB/sec 2024-04-22T07:20:25.955 INFO:tasks.workunit.client.0.smithi037.stdout: Min xfer = 1048576.00 kB 2024-04-22T07:20:31.335 INFO:tasks.workunit.client.0.smithi037.stdout: 2024-04-22T07:20:31.335 INFO:tasks.workunit.client.0.smithi037.stdout: Children see throughput for 1 rewriters = 716834.88 kB/sec 2024-04-22T07:20:31.335 INFO:tasks.workunit.client.0.smithi037.stdout: Parent sees throughput for 1 rewriters = 716749.16 kB/sec 2024-04-22T07:20:31.335 INFO:tasks.workunit.client.0.smithi037.stdout: Min throughput per process = 716834.88 kB/sec 2024-04-22T07:20:31.335 INFO:tasks.workunit.client.0.smithi037.stdout: Max throughput per process = 716834.88 kB/sec 2024-04-22T07:20:31.335 INFO:tasks.workunit.client.0.smithi037.stdout: Avg throughput per process = 716834.88 kB/sec 2024-04-22T07:20:31.336 INFO:tasks.workunit.client.0.smithi037.stdout: Min xfer = 1048576.00 kB 2024-04-22T07:20:33.576 INFO:tasks.workunit.client.0.smithi037.stdout: 2024-04-22T07:20:33.576 INFO:tasks.workunit.client.0.smithi037.stdout: Children see throughput for 1 readers = 6853488.00 kB/sec 2024-04-22T07:20:33.576 INFO:tasks.workunit.client.0.smithi037.stdout: Parent sees throughput for 1 readers = 6843101.80 kB/sec 2024-04-22T07:20:33.577 INFO:tasks.workunit.client.0.smithi037.stdout: Min throughput per process = 6853488.00 kB/sec 2024-04-22T07:20:33.577 INFO:tasks.workunit.client.0.smithi037.stdout: Max throughput per process = 6853488.00 kB/sec 2024-04-22T07:20:33.577 INFO:tasks.workunit.client.0.smithi037.stdout: Avg throughput per process = 6853488.00 kB/sec 2024-04-22T07:20:33.577 INFO:tasks.workunit.client.0.smithi037.stdout: Min xfer = 1048576.00 kB 2024-04-22T07:20:35.791 INFO:tasks.workunit.client.0.smithi037.stdout: 2024-04-22T07:20:35.791 INFO:tasks.workunit.client.0.smithi037.stdout: Children see throughput for 1 re-readers = 6637601.00 kB/sec 2024-04-22T07:20:35.791 INFO:tasks.workunit.client.0.smithi037.stdout: Parent sees throughput for 1 re-readers = 6628117.80 kB/sec 2024-04-22T07:20:35.791 INFO:tasks.workunit.client.0.smithi037.stdout: Min throughput per process = 6637601.00 kB/sec 2024-04-22T07:20:35.791 INFO:tasks.workunit.client.0.smithi037.stdout: Max throughput per process = 6637601.00 kB/sec 2024-04-22T07:20:35.791 INFO:tasks.workunit.client.0.smithi037.stdout: Avg throughput per process = 6637601.00 kB/sec 2024-04-22T07:20:35.791 INFO:tasks.workunit.client.0.smithi037.stdout: Min xfer = 1048576.00 kB 2024-04-22T07:20:36.958 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-22T07:20:36.961 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-22T07:20:42.031 INFO:tasks.workunit.client.0.smithi037.stdout: 2024-04-22T07:20:42.031 INFO:tasks.workunit.client.0.smithi037.stdout: 2024-04-22T07:20:42.031 INFO:tasks.workunit.client.0.smithi037.stdout: 2024-04-22T07:20:42.031 INFO:tasks.workunit.client.0.smithi037.stdout:iozone test complete. 2024-04-22T07:20:42.032 INFO:tasks.workunit.client.0.smithi037.stderr:+ iozone -c -e -s 1024M -r 1M -t 1 -F f2 -i 0 -i 1 2024-04-22T07:20:42.099 INFO:tasks.workunit.client.0.smithi037.stdout: Iozone: Performance Test of File I/O 2024-04-22T07:20:42.099 INFO:tasks.workunit.client.0.smithi037.stdout: Version $Revision: 3.494 $ 2024-04-22T07:20:42.099 INFO:tasks.workunit.client.0.smithi037.stdout: Compiled for 64 bit mode. 2024-04-22T07:20:42.099 INFO:tasks.workunit.client.0.smithi037.stdout: Build: linux-AMD64 2024-04-22T07:20:42.099 INFO:tasks.workunit.client.0.smithi037.stdout: 2024-04-22T07:20:42.099 INFO:tasks.workunit.client.0.smithi037.stdout: Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins 2024-04-22T07:20:42.099 INFO:tasks.workunit.client.0.smithi037.stdout: Al Slater, Scott Rhine, Mike Wisner, Ken Goss 2024-04-22T07:20:42.100 INFO:tasks.workunit.client.0.smithi037.stdout: Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR, 2024-04-22T07:20:42.100 INFO:tasks.workunit.client.0.smithi037.stdout: Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner, 2024-04-22T07:20:42.100 INFO:tasks.workunit.client.0.smithi037.stdout: Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone, 2024-04-22T07:20:42.100 INFO:tasks.workunit.client.0.smithi037.stdout: Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root, 2024-04-22T07:20:42.100 INFO:tasks.workunit.client.0.smithi037.stdout: Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer, 2024-04-22T07:20:42.100 INFO:tasks.workunit.client.0.smithi037.stdout: Vangel Bojaxhi, Ben England, Vikentsi Lapa, 2024-04-22T07:20:42.100 INFO:tasks.workunit.client.0.smithi037.stdout: Alexey Skidanov, Sudhir Kumar. 2024-04-22T07:20:42.100 INFO:tasks.workunit.client.0.smithi037.stdout: 2024-04-22T07:20:42.100 INFO:tasks.workunit.client.0.smithi037.stdout: Run began: Mon Apr 22 07:20:42 2024 2024-04-22T07:20:42.100 INFO:tasks.workunit.client.0.smithi037.stdout: 2024-04-22T07:20:42.100 INFO:tasks.workunit.client.0.smithi037.stdout: Include close in write timing 2024-04-22T07:20:42.100 INFO:tasks.workunit.client.0.smithi037.stdout: Include fsync in write timing 2024-04-22T07:20:42.100 INFO:tasks.workunit.client.0.smithi037.stdout: File size set to 1048576 kB 2024-04-22T07:20:42.100 INFO:tasks.workunit.client.0.smithi037.stdout: Record Size 1024 kB 2024-04-22T07:20:42.100 INFO:tasks.workunit.client.0.smithi037.stdout: Command line used: iozone -c -e -s 1024M -r 1M -t 1 -F f2 -i 0 -i 1 2024-04-22T07:20:42.101 INFO:tasks.workunit.client.0.smithi037.stdout: Output is in kBytes/sec 2024-04-22T07:20:42.101 INFO:tasks.workunit.client.0.smithi037.stdout: Time Resolution = 0.000001 seconds. 2024-04-22T07:20:42.101 INFO:tasks.workunit.client.0.smithi037.stdout: Processor cache size set to 1024 kBytes. 2024-04-22T07:20:42.101 INFO:tasks.workunit.client.0.smithi037.stdout: Processor cache line size set to 32 bytes. 2024-04-22T07:20:42.101 INFO:tasks.workunit.client.0.smithi037.stdout: File stride size set to 17 * record size. 2024-04-22T07:20:42.101 INFO:tasks.workunit.client.0.smithi037.stdout: Throughput test with 1 process 2024-04-22T07:20:42.101 INFO:tasks.workunit.client.0.smithi037.stdout: Each process writes a 1048576 kByte file in 1024 kByte records 2024-04-22T07:20:42.357 INFO:tasks.quiescer.fs.[cephfs]:Total duration (59.7) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-04-22T07:20:42.357 INFO:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 29.85 2024-04-22T07:20:42.357 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-22T07:20:42.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:42.519+0000 7fe01f7ce640 1 Processor -- start 2024-04-22T07:20:42.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:42.523+0000 7fe01f7ce640 1 -- start start 2024-04-22T07:20:42.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:42.524+0000 7fe01f7ce640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe0100dd3b0 0x7fe010046450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:42.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:42.524+0000 7fe01f7ce640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fe01004ba50 0x7fe01004be70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:42.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:42.524+0000 7fe01f7ce640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe0100e3080 0x7fe0100e3510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:42.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:42.524+0000 7fe01f7ce640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fe010045440 con 0x7fe0100e3080 2024-04-22T07:20:42.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:42.524+0000 7fe01f7ce640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7fe010045fc0 con 0x7fe01004ba50 2024-04-22T07:20:42.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:42.524+0000 7fe01f7ce640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fe0100dd790 con 0x7fe0100dd3b0 2024-04-22T07:20:42.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:42.525+0000 7fe01dd6b640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe0100e3080 0x7fe0100e3510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:42.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:42.525+0000 7fe01dd6b640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe0100e3080 0x7fe0100e3510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:32822/0 (socket says 172.21.15.37:32822) 2024-04-22T07:20:42.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:42.525+0000 7fe01dd6b640 1 -- 172.21.15.37:0/737463276 learned_addr learned my addr 172.21.15.37:0/737463276 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:20:42.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:42.526+0000 7fe01dd6b640 1 -- 172.21.15.37:0/737463276 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe0100dd3b0 msgr2=0x7fe010046450 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T07:20:42.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:42.526+0000 7fe01dd6b640 1 --2- 172.21.15.37:0/737463276 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe0100dd3b0 0x7fe010046450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:42.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:42.526+0000 7fe01dd6b640 1 -- 172.21.15.37:0/737463276 >> v2:172.21.15.196:3300/0 conn(0x7fe01004ba50 msgr2=0x7fe01004be70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T07:20:42.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:42.526+0000 7fe01dd6b640 1 --2- 172.21.15.37:0/737463276 >> v2:172.21.15.196:3300/0 conn(0x7fe01004ba50 0x7fe01004be70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:42.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:42.526+0000 7fe01dd6b640 1 -- 172.21.15.37:0/737463276 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0100e3e80 con 0x7fe0100e3080 2024-04-22T07:20:42.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:42.527+0000 7fe01dd6b640 1 --2- 172.21.15.37:0/737463276 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0100e3080 0x7fe0100e3510 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fe018051690 tx=0x7fe0180a7e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8315cf340d57d309 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:20:42.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:42.529+0000 7fe00ffff640 1 -- 172.21.15.37:0/737463276 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0180b5070 con 0x7fe0100e3080 2024-04-22T07:20:42.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:42.529+0000 7fe00ffff640 1 -- 172.21.15.37:0/737463276 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0180a8af0 con 0x7fe0100e3080 2024-04-22T07:20:42.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:42.529+0000 7fe00ffff640 1 -- 172.21.15.37:0/737463276 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0180b0440 con 0x7fe0100e3080 2024-04-22T07:20:42.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:42.530+0000 7fe01f7ce640 1 -- 172.21.15.37:0/737463276 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0100e3080 msgr2=0x7fe0100e3510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:42.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:42.530+0000 7fe01f7ce640 1 --2- 172.21.15.37:0/737463276 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0100e3080 0x7fe0100e3510 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fe018051690 tx=0x7fe0180a7e90 comp rx=0 tx=0).stop 2024-04-22T07:20:42.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:42.531+0000 7fe01f7ce640 1 -- 172.21.15.37:0/737463276 shutdown_connections 2024-04-22T07:20:42.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:42.531+0000 7fe01f7ce640 1 --2- 172.21.15.37:0/737463276 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0100e3080 0x7fe0100e3510 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:42.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:42.531+0000 7fe01f7ce640 1 --2- 172.21.15.37:0/737463276 >> v2:172.21.15.196:3300/0 conn(0x7fe01004ba50 0x7fe01004be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:42.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:42.531+0000 7fe01f7ce640 1 --2- 172.21.15.37:0/737463276 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe0100dd3b0 0x7fe010046450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:42.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:42.531+0000 7fe01f7ce640 1 -- 172.21.15.37:0/737463276 >> 172.21.15.37:0/737463276 conn(0x7fe010050170 msgr2=0x7fe010050580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:20:42.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:42.532+0000 7fe01f7ce640 1 -- 172.21.15.37:0/737463276 shutdown_connections 2024-04-22T07:20:42.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:42.532+0000 7fe01f7ce640 1 -- 172.21.15.37:0/737463276 wait complete. 2024-04-22T07:20:42.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:42.536+0000 7fe01f7ce640 1 Processor -- start 2024-04-22T07:20:42.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:42.542+0000 7fe01f7ce640 1 -- start start 2024-04-22T07:20:42.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:42.544+0000 7fe01f7ce640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe01004ba50 0x7fe0100cf840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:42.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:42.544+0000 7fe01f7ce640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe0100dd3b0 0x7fe0100ca0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:42.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:42.544+0000 7fe01f7ce640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe0100e3080 0x7fe0100cbb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:42.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:42.544+0000 7fe01f7ce640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe010045c50 con 0x7fe01004ba50 2024-04-22T07:20:42.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:42.544+0000 7fe01f7ce640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fe010045970 con 0x7fe0100dd3b0 2024-04-22T07:20:42.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:42.544+0000 7fe01f7ce640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fe010005e80 con 0x7fe0100e3080 2024-04-22T07:20:42.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:42.546+0000 7fe01cd69640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe0100dd3b0 0x7fe0100ca0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:42.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:42.546+0000 7fe01d56a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe01004ba50 0x7fe0100cf840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:42.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:42.546+0000 7fe01d56a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe01004ba50 0x7fe0100cf840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:32830/0 (socket says 172.21.15.37:32830) 2024-04-22T07:20:42.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:42.547+0000 7fe01d56a640 1 -- 172.21.15.37:0/1006175154 learned_addr learned my addr 172.21.15.37:0/1006175154 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:20:42.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:42.547+0000 7fe01dd6b640 1 --2- 172.21.15.37:0/1006175154 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe0100e3080 0x7fe0100cbb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:42.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:42.549+0000 7fe01d56a640 1 -- 172.21.15.37:0/1006175154 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe0100e3080 msgr2=0x7fe0100cbb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:42.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:42.549+0000 7fe01d56a640 1 --2- 172.21.15.37:0/1006175154 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe0100e3080 0x7fe0100cbb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:42.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:42.549+0000 7fe01d56a640 1 -- 172.21.15.37:0/1006175154 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe0100dd3b0 msgr2=0x7fe0100ca0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:42.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:42.550+0000 7fe01d56a640 1 --2- 172.21.15.37:0/1006175154 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe0100dd3b0 0x7fe0100ca0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:42.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:42.550+0000 7fe01d56a640 1 -- 172.21.15.37:0/1006175154 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0100c8b10 con 0x7fe01004ba50 2024-04-22T07:20:42.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:42.551+0000 7fe01d56a640 1 --2- 172.21.15.37:0/1006175154 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe01004ba50 0x7fe0100cf840 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fe01400b3e0 tx=0x7fe01400b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:20:42.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:42.552+0000 7fe00dffb640 1 -- 172.21.15.37:0/1006175154 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe014015020 con 0x7fe01004ba50 2024-04-22T07:20:42.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:42.552+0000 7fe01f7ce640 1 -- 172.21.15.37:0/1006175154 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0100c8df0 con 0x7fe01004ba50 2024-04-22T07:20:42.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:42.553+0000 7fe01f7ce640 1 -- 172.21.15.37:0/1006175154 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0100c93b0 con 0x7fe01004ba50 2024-04-22T07:20:42.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:42.555+0000 7fe00dffb640 1 -- 172.21.15.37:0/1006175154 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe014011850 con 0x7fe01004ba50 2024-04-22T07:20:42.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:42.556+0000 7fe01f7ce640 1 -- 172.21.15.37:0/1006175154 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe010005380 con 0x7fe01004ba50 2024-04-22T07:20:42.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:42.557+0000 7fe00dffb640 1 -- 172.21.15.37:0/1006175154 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe014011c40 con 0x7fe01004ba50 2024-04-22T07:20:42.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:42.565+0000 7fe00dffb640 1 -- 172.21.15.37:0/1006175154 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe014018020 con 0x7fe01004ba50 2024-04-22T07:20:42.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:42.577+0000 7fe00dffb640 1 --2- 172.21.15.37:0/1006175154 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fdffc06c9f0 0x7fdffc06eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:42.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:42.578+0000 7fe01cd69640 1 --2- 172.21.15.37:0/1006175154 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fdffc06c9f0 0x7fdffc06eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:42.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:42.581+0000 7fe01cd69640 1 --2- 172.21.15.37:0/1006175154 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fdffc06c9f0 0x7fdffc06eeb0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fe0100cca10 tx=0x7fe008009060 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:20:42.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:42.581+0000 7fe00dffb640 1 -- 172.21.15.37:0/1006175154 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7fe01408c120 con 0x7fe01004ba50 2024-04-22T07:20:42.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:42.581+0000 7fe00dffb640 1 -- 172.21.15.37:0/1006175154 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fe01401f020 con 0x7fe01004ba50 2024-04-22T07:20:42.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:42.979+0000 7fe01f7ce640 1 -- 172.21.15.37:0/1006175154 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe0100070e0 con 0x7fe01004ba50 2024-04-22T07:20:42.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:42.980+0000 7fe00dffb640 1 -- 172.21.15.37:0/1006175154 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6827 (secure 0 0 0) 0x7fe01405a4b0 con 0x7fe01004ba50 2024-04-22T07:20:42.978 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-22T07:20:42.978 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4265,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6839/671847354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6835","nonce":671847354},{"type":"v1","addr":"172.21.15.196:6839","nonce":671847354}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6833/1549427395","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1549427395},{"type":"v1","addr":"172.21.15.37:6833","nonce":1549427395}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6836/3825988951","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":3825988951},{"type":"v1","addr":"172.21.15.37:6836","nonce":3825988951}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4272,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/611771502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6835","nonce":611771502},{"type":"v1","addr":"172.21.15.37:6837","nonce":611771502}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4291,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6837/3055080225","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6834","nonce":3055080225},{"type":"v1","addr":"172.21.15.196:6837","nonce":3055080225}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-22T07:18:36.111618+0000","modified":"2024-04-22T07:18:41.783857+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.196:6838/3264179771","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6836","nonce":3264179771},{"type":"v1","addr":"172.21.15.196:6838","nonce":3264179771}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4294,"qdb_cluster":[4294]},"id":1}]} 2024-04-22T07:20:42.978 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 8 2024-04-22T07:20:42.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:42.983+0000 7fe01f7ce640 1 -- 172.21.15.37:0/1006175154 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fdffc06c9f0 msgr2=0x7fdffc06eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:42.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:42.983+0000 7fe01f7ce640 1 --2- 172.21.15.37:0/1006175154 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fdffc06c9f0 0x7fdffc06eeb0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fe0100cca10 tx=0x7fe008009060 comp rx=0 tx=0).stop 2024-04-22T07:20:42.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:42.983+0000 7fe01f7ce640 1 -- 172.21.15.37:0/1006175154 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe01004ba50 msgr2=0x7fe0100cf840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:42.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:42.983+0000 7fe01f7ce640 1 --2- 172.21.15.37:0/1006175154 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe01004ba50 0x7fe0100cf840 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fe01400b3e0 tx=0x7fe01400b8a0 comp rx=0 tx=0).stop 2024-04-22T07:20:42.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:42.984+0000 7fe01f7ce640 1 -- 172.21.15.37:0/1006175154 shutdown_connections 2024-04-22T07:20:42.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:42.984+0000 7fe01f7ce640 1 --2- 172.21.15.37:0/1006175154 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fdffc06c9f0 0x7fdffc06eeb0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:42.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:42.984+0000 7fe01f7ce640 1 --2- 172.21.15.37:0/1006175154 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe0100e3080 0x7fe0100cbb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:42.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:42.984+0000 7fe01f7ce640 1 --2- 172.21.15.37:0/1006175154 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe0100dd3b0 0x7fe0100ca0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:42.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:42.984+0000 7fe01f7ce640 1 --2- 172.21.15.37:0/1006175154 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe01004ba50 0x7fe0100cf840 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:42.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:42.984+0000 7fe01f7ce640 1 -- 172.21.15.37:0/1006175154 >> 172.21.15.37:0/1006175154 conn(0x7fe010050170 msgr2=0x7fe0100067e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:20:42.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:42.984+0000 7fe01f7ce640 1 -- 172.21.15.37:0/1006175154 shutdown_connections 2024-04-22T07:20:42.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:42.984+0000 7fe01f7ce640 1 -- 172.21.15.37:0/1006175154 wait complete. 2024-04-22T07:20:42.996 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4294 quiesce db / --timeout 60 --expiration 89.85 --await' 2024-04-22T07:20:42.996 DEBUG:teuthology.orchestra.run.smithi037:> timeout 75 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4294 quiesce db / --timeout 60 --expiration 89.85 --await 2024-04-22T07:20:43.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.179+0000 7fb989a4e640 1 Processor -- start 2024-04-22T07:20:43.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.179+0000 7fb989a4e640 1 -- start start 2024-04-22T07:20:43.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.180+0000 7fb989a4e640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fb9840cc910 0x7fb98415b260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:43.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.181+0000 7fb989a4e640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb9840cdb70 con 0x7fb984151720 2024-04-22T07:20:43.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.181+0000 7fb989a4e640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb9840cb730 con 0x7fb9840cabe0 2024-04-22T07:20:43.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.181+0000 7fb989a4e640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7fb9840cb4e0 con 0x7fb9840cc910 2024-04-22T07:20:43.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.181+0000 7fb982ffd640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fb984151720 0x7fb98406e780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:57798/0 (socket says 172.21.15.37:57798) 2024-04-22T07:20:43.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.181+0000 7fb982ffd640 1 -- 172.21.15.37:0/3655288386 learned_addr learned my addr 172.21.15.37:0/3655288386 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-04-22T07:20:43.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.181+0000 7fb981ffb640 1 -- 172.21.15.37:0/3655288386 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3025471347 0 0) 0x7fb9840cdb70 con 0x7fb984151720 2024-04-22T07:20:43.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.181+0000 7fb981ffb640 1 -- 172.21.15.37:0/3655288386 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb96c003520 con 0x7fb984151720 2024-04-22T07:20:43.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.181+0000 7fb981ffb640 1 -- 172.21.15.37:0/3655288386 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3050799378 0 0) 0x7fb96c003520 con 0x7fb984151720 2024-04-22T07:20:43.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.181+0000 7fb981ffb640 1 -- 172.21.15.37:0/3655288386 >> v2:172.21.15.196:3300/0 conn(0x7fb9840cc910 msgr2=0x7fb98415b260 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-22T07:20:43.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.181+0000 7fb981ffb640 1 --2- 172.21.15.37:0/3655288386 >> v2:172.21.15.196:3300/0 conn(0x7fb9840cc910 0x7fb98415b260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:43.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.181+0000 7fb981ffb640 1 -- 172.21.15.37:0/3655288386 >> v1:172.21.15.196:6789/0 conn(0x7fb9840cabe0 legacy=0x7fb98406f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:20:43.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.181+0000 7fb981ffb640 1 -- 172.21.15.37:0/3655288386 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9840cba10 con 0x7fb984151720 2024-04-22T07:20:43.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.181+0000 7fb981ffb640 1 -- 172.21.15.37:0/3655288386 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2576656170 0 0) 0x7fb974001670 con 0x7fb984151720 2024-04-22T07:20:43.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.181+0000 7fb981ffb640 1 -- 172.21.15.37:0/3655288386 >> v1:172.21.15.37:6789/0 conn(0x7fb984151720 legacy=0x7fb98406e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:43.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.182+0000 7fb981ffb640 1 --2- 172.21.15.37:0/3655288386 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb96c0039b0 0x7fb96c003db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:43.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.182+0000 7fb981ffb640 1 --2- 172.21.15.37:0/3655288386 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb96c004800 0x7fb96c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:43.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.182+0000 7fb981ffb640 1 --2- 172.21.15.37:0/3655288386 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb96c0053c0 0x7fb96c005990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:43.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.182+0000 7fb981ffb640 1 -- 172.21.15.37:0/3655288386 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fb9840cb4e0 con 0x7fb96c004800 2024-04-22T07:20:43.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.182+0000 7fb981ffb640 1 -- 172.21.15.37:0/3655288386 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fb96c006270 con 0x7fb96c0053c0 2024-04-22T07:20:43.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.182+0000 7fb981ffb640 1 -- 172.21.15.37:0/3655288386 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fb96c006470 con 0x7fb96c0039b0 2024-04-22T07:20:43.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.182+0000 7fb9827fc640 1 --2- 172.21.15.37:0/3655288386 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb96c004800 0x7fb96c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:43.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.182+0000 7fb9827fc640 1 -- 172.21.15.37:0/3655288386 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb96c0039b0 msgr2=0x7fb96c003db0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-22T07:20:43.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.182+0000 7fb9827fc640 1 --2- 172.21.15.37:0/3655288386 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb96c0039b0 0x7fb96c003db0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:43.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.182+0000 7fb9827fc640 1 -- 172.21.15.37:0/3655288386 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb96c0053c0 msgr2=0x7fb96c005990 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-22T07:20:43.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.182+0000 7fb9827fc640 1 --2- 172.21.15.37:0/3655288386 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb96c0053c0 0x7fb96c005990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:43.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.182+0000 7fb9827fc640 1 -- 172.21.15.37:0/3655288386 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb96c003520 con 0x7fb96c004800 2024-04-22T07:20:43.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.182+0000 7fb9837fe640 1 -- 172.21.15.37:0/3655288386 reap_dead start 2024-04-22T07:20:43.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.183+0000 7fb9827fc640 1 --2- 172.21.15.37:0/3655288386 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb96c004800 0x7fb96c004c80 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fb978001650 tx=0x7fb96c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ef705311b119f4a server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:20:43.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.183+0000 7fb981ffb640 1 -- 172.21.15.37:0/3655288386 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb978001220 con 0x7fb96c004800 2024-04-22T07:20:43.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.183+0000 7fb981ffb640 1 -- 172.21.15.37:0/3655288386 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb978005290 con 0x7fb96c004800 2024-04-22T07:20:43.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.183+0000 7fb981ffb640 1 -- 172.21.15.37:0/3655288386 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb978003850 con 0x7fb96c004800 2024-04-22T07:20:43.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.184+0000 7fb989a4e640 1 -- 172.21.15.37:0/3655288386 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb96c004800 msgr2=0x7fb96c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:43.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.184+0000 7fb989a4e640 1 --2- 172.21.15.37:0/3655288386 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb96c004800 0x7fb96c004c80 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fb978001650 tx=0x7fb96c005830 comp rx=0 tx=0).stop 2024-04-22T07:20:43.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.184+0000 7fb989a4e640 1 -- 172.21.15.37:0/3655288386 shutdown_connections 2024-04-22T07:20:43.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.184+0000 7fb989a4e640 1 --2- 172.21.15.37:0/3655288386 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb96c004800 0x7fb96c004c80 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:43.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.184+0000 7fb989a4e640 1 -- 172.21.15.37:0/3655288386 >> 172.21.15.37:0/3655288386 conn(0x7fb98406bfa0 msgr2=0x7fb9840ccde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:20:43.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.184+0000 7fb989a4e640 1 -- 172.21.15.37:0/3655288386 shutdown_connections 2024-04-22T07:20:43.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.184+0000 7fb989a4e640 1 -- 172.21.15.37:0/3655288386 wait complete. 2024-04-22T07:20:43.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.186+0000 7fb989a4e640 1 Processor -- start 2024-04-22T07:20:43.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.186+0000 7fb989a4e640 1 -- start start 2024-04-22T07:20:43.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.187+0000 7fb989a4e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb96c004800 0x7fb98414fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:43.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.187+0000 7fb989a4e640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb984157a20 0x7fb9841f1430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:43.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.187+0000 7fb989a4e640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb9841f1970 0x7fb9841475c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:43.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.187+0000 7fb989a4e640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fb9840c77e0 con 0x7fb96c004800 2024-04-22T07:20:43.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.187+0000 7fb989a4e640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fb98406e2f0 con 0x7fb984157a20 2024-04-22T07:20:43.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.187+0000 7fb989a4e640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fb9840c7960 con 0x7fb9841f1970 2024-04-22T07:20:43.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.187+0000 7fb982ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb96c004800 0x7fb98414fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:43.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.187+0000 7fb982ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb96c004800 0x7fb98414fa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:32848/0 (socket says 172.21.15.37:32848) 2024-04-22T07:20:43.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.187+0000 7fb982ffd640 1 -- 172.21.15.37:0/3284807801 learned_addr learned my addr 172.21.15.37:0/3284807801 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:20:43.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.188+0000 7fb982ffd640 1 -- 172.21.15.37:0/3284807801 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb9841f1970 msgr2=0x7fb9841475c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:43.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.188+0000 7fb982ffd640 1 --2- 172.21.15.37:0/3284807801 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb9841f1970 0x7fb9841475c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:43.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.188+0000 7fb982ffd640 1 -- 172.21.15.37:0/3284807801 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb984157a20 msgr2=0x7fb9841f1430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:43.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.188+0000 7fb982ffd640 1 --2- 172.21.15.37:0/3284807801 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb984157a20 0x7fb9841f1430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:43.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.188+0000 7fb982ffd640 1 -- 172.21.15.37:0/3284807801 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9841f1df0 con 0x7fb96c004800 2024-04-22T07:20:43.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.188+0000 7fb982ffd640 1 --2- 172.21.15.37:0/3284807801 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb96c004800 0x7fb98414fa50 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fb97400c760 tx=0x7fb97400cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:20:43.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.188+0000 7fb96bfff640 1 -- 172.21.15.37:0/3284807801 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb974018070 con 0x7fb96c004800 2024-04-22T07:20:43.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.188+0000 7fb989a4e640 1 -- 172.21.15.37:0/3284807801 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9841546c0 con 0x7fb96c004800 2024-04-22T07:20:43.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.189+0000 7fb989a4e640 1 -- 172.21.15.37:0/3284807801 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb984156a30 con 0x7fb96c004800 2024-04-22T07:20:43.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.189+0000 7fb96bfff640 1 -- 172.21.15.37:0/3284807801 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9740074e0 con 0x7fb96c004800 2024-04-22T07:20:43.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.189+0000 7fb96bfff640 1 -- 172.21.15.37:0/3284807801 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9740049e0 con 0x7fb96c004800 2024-04-22T07:20:43.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.191+0000 7fb96bfff640 1 -- 172.21.15.37:0/3284807801 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb97401b070 con 0x7fb96c004800 2024-04-22T07:20:43.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.191+0000 7fb96bfff640 1 --2- 172.21.15.37:0/3284807801 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fb97006c8f0 0x7fb97006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:43.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.191+0000 7fb96bfff640 1 -- 172.21.15.37:0/3284807801 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7fb97408b380 con 0x7fb96c004800 2024-04-22T07:20:43.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.192+0000 7fb98c644740 1 Processor -- start 2024-04-22T07:20:43.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.192+0000 7fb98c644740 1 -- start start 2024-04-22T07:20:43.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.194+0000 7fb9827fc640 1 --2- 172.21.15.37:0/3284807801 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fb97006c8f0 0x7fb97006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:43.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.194+0000 7fb98c644740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55c4546a6200 0x55c4546a65e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:43.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.194+0000 7fb98c644740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c4546f0080 0x55c4546a6b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:43.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.194+0000 7fb98c644740 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x55c4546a4c60 0x55c4546e5b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:43.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.194+0000 7fb98c644740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55c4546070b0 con 0x55c4546f0080 2024-04-22T07:20:43.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.194+0000 7fb98c644740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55c4545b8680 con 0x55c4546a6200 2024-04-22T07:20:43.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.194+0000 7fb98c644740 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x55c4545c4c60 con 0x55c4546a4c60 2024-04-22T07:20:43.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.194+0000 7fb9827fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c4546f0080 0x55c4546a6b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:43.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.194+0000 7fb9827fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c4546f0080 0x55c4546a6b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:32850/0 (socket says 172.21.15.37:32850) 2024-04-22T07:20:43.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.194+0000 7fb9827fc640 1 -- 172.21.15.37:0/1770081035 learned_addr learned my addr 172.21.15.37:0/1770081035 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:20:43.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.194+0000 7fb9827fc640 1 -- 172.21.15.37:0/1770081035 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x55c4546a4c60 msgr2=0x55c4546e5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:20:43.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.194+0000 7fb9827fc640 1 --2- 172.21.15.37:0/1770081035 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x55c4546a4c60 0x55c4546e5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:43.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.195+0000 7fb9827fc640 1 -- 172.21.15.37:0/1770081035 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55c4546a6200 msgr2=0x55c4546a65e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:20:43.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.195+0000 7fb9827fc640 1 --2- 172.21.15.37:0/1770081035 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55c4546a6200 0x55c4546a65e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:43.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.195+0000 7fb9827fc640 1 -- 172.21.15.37:0/1770081035 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c4543e9c90 con 0x55c4546f0080 2024-04-22T07:20:43.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.195+0000 7fb9827fc640 1 --2- 172.21.15.37:0/1770081035 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c4546f0080 0x55c4546a6b20 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fb97802bbc0 tx=0x7fb978000fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b66f2e55a0dbed89 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:20:43.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.197+0000 7fb9827fc640 1 --2- 172.21.15.37:0/3284807801 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fb97006c8f0 0x7fb97006edb0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fb978048000 tx=0x7fb978045000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:20:43.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.205+0000 7fb9697fa640 1 -- 172.21.15.37:0/1770081035 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb978046040 con 0x55c4546f0080 2024-04-22T07:20:43.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.205+0000 7fb9697fa640 1 -- 172.21.15.37:0/1770081035 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb978047020 con 0x55c4546f0080 2024-04-22T07:20:43.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.205+0000 7fb9697fa640 1 -- 172.21.15.37:0/1770081035 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb978038040 con 0x55c4546f0080 2024-04-22T07:20:43.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.207+0000 7fb98c644740 1 -- 172.21.15.37:0/1770081035 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c4546f0080 msgr2=0x55c4546a6b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:43.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.207+0000 7fb98c644740 1 --2- 172.21.15.37:0/1770081035 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c4546f0080 0x55c4546a6b20 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fb97802bbc0 tx=0x7fb978000fb0 comp rx=0 tx=0).stop 2024-04-22T07:20:43.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.207+0000 7fb98c644740 1 -- 172.21.15.37:0/1770081035 shutdown_connections 2024-04-22T07:20:43.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.207+0000 7fb98c644740 1 --2- 172.21.15.37:0/1770081035 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x55c4546a4c60 0x55c4546e5b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:43.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.207+0000 7fb98c644740 1 --2- 172.21.15.37:0/1770081035 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c4546f0080 0x55c4546a6b20 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:43.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.207+0000 7fb98c644740 1 --2- 172.21.15.37:0/1770081035 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55c4546a6200 0x55c4546a65e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:43.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.207+0000 7fb98c644740 1 -- 172.21.15.37:0/1770081035 >> 172.21.15.37:0/1770081035 conn(0x55c4546a2c00 msgr2=0x55c4546a52b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:20:43.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.207+0000 7fb98c644740 1 -- 172.21.15.37:0/1770081035 shutdown_connections 2024-04-22T07:20:43.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.207+0000 7fb98c644740 1 -- 172.21.15.37:0/1770081035 wait complete. 2024-04-22T07:20:43.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.208+0000 7fb98c644740 1 -- start start 2024-04-22T07:20:43.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.208+0000 7fb98c644740 1 Processor -- start 2024-04-22T07:20:43.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.209+0000 7fb98c644740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c4546a6200 0x55c4546f7850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:43.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.209+0000 7fb98c644740 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x55c4546f0080 0x55c4546fabe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:43.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.209+0000 7fb98c644740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55c4546e7ae0 0x55c4546ca540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:43.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.209+0000 7fb98c644740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55c45460a400 con 0x55c4546a6200 2024-04-22T07:20:43.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.209+0000 7fb98c644740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55c4545c6840 con 0x55c4546e7ae0 2024-04-22T07:20:43.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.209+0000 7fb98c644740 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x55c45460f720 con 0x55c4546f0080 2024-04-22T07:20:43.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.209+0000 7fb98c644740 10 client.0 _ll_register_callbacks cb 0x55c454617ea0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-22T07:20:43.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.209+0000 7fb982ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c4546a6200 0x55c4546f7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:43.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.209+0000 7fb982ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c4546a6200 0x55c4546f7850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:32852/0 (socket says 172.21.15.37:32852) 2024-04-22T07:20:43.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.209+0000 7fb982ffd640 1 -- 172.21.15.37:0/4181341246 learned_addr learned my addr 172.21.15.37:0/4181341246 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:20:43.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.210+0000 7fb9827fc640 1 --2- 172.21.15.37:0/4181341246 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x55c4546f0080 0x55c4546fabe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:43.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.210+0000 7fb9837fe640 1 --2- 172.21.15.37:0/4181341246 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55c4546e7ae0 0x55c4546ca540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:43.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.210+0000 7fb982ffd640 1 -- 172.21.15.37:0/4181341246 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x55c4546f0080 msgr2=0x55c4546fabe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:20:43.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.210+0000 7fb982ffd640 1 --2- 172.21.15.37:0/4181341246 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x55c4546f0080 0x55c4546fabe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:43.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.210+0000 7fb982ffd640 1 -- 172.21.15.37:0/4181341246 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55c4546e7ae0 msgr2=0x55c4546ca540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:20:43.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.210+0000 7fb982ffd640 1 --2- 172.21.15.37:0/4181341246 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55c4546e7ae0 0x55c4546ca540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:43.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.210+0000 7fb982ffd640 1 -- 172.21.15.37:0/4181341246 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c45444a420 con 0x55c4546a6200 2024-04-22T07:20:43.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.210+0000 7fb9827fc640 1 --2- 172.21.15.37:0/4181341246 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x55c4546f0080 0x55c4546fabe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-22T07:20:43.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.210+0000 7fb9837fe640 1 --2- 172.21.15.37:0/4181341246 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55c4546e7ae0 0x55c4546ca540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-22T07:20:43.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.210+0000 7fb982ffd640 1 --2- 172.21.15.37:0/4181341246 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c4546a6200 0x55c4546f7850 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fb9740615c0 tx=0x7fb974059640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1ce3a098d52fa88 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:20:43.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.210+0000 7fb9627fc640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-04-22T07:20:43.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.211+0000 7fb9627fc640 1 -- 172.21.15.37:0/4181341246 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb974061af0 con 0x55c4546a6200 2024-04-22T07:20:43.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.211+0000 7fb98c644740 1 -- 172.21.15.37:0/4181341246 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb978047020 con 0x55c4546a6200 2024-04-22T07:20:43.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.211+0000 7fb9627fc640 1 -- 172.21.15.37:0/4181341246 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7fb974004b80 con 0x55c4546a6200 2024-04-22T07:20:43.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.211+0000 7fb9627fc640 1 -- 172.21.15.37:0/4181341246 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7fb974004d80 con 0x55c4546a6200 2024-04-22T07:20:43.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.211+0000 7fb98c644740 10 client.4905 fetch_fsmap learned FSMap version 8 2024-04-22T07:20:43.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.211+0000 7fb98c644740 1 -- 172.21.15.37:0/4181341246 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x55c4542dd580 con 0x55c4546a6200 2024-04-22T07:20:43.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.211+0000 7fb9627fc640 1 -- 172.21.15.37:0/4181341246 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb978047020 con 0x55c4546a6200 2024-04-22T07:20:43.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.211+0000 7fb9627fc640 1 -- 172.21.15.37:0/4181341246 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 8) ==== 4704+0+0 (secure 0 0 0) 0x7fb9740582d0 con 0x55c4546a6200 2024-04-22T07:20:43.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.211+0000 7fb98c644740 10 client.4905 fetch_fsmap finished waiting for FSMap version 8 2024-04-22T07:20:43.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.211+0000 7fb98c644740 10 client.4905 resolve_mds: validated gid 4294 aka daemon mds.f 2024-04-22T07:20:43.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.211+0000 7fb98c644740 20 client.4905 populate_metadata read hostname 'smithi037' 2024-04-22T07:20:43.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.211+0000 7fb98c644740 1 --2- 172.21.15.37:0/4181341246 >> [v2:172.21.15.196:6836/3264179771,v1:172.21.15.196:6838/3264179771] conn(0x55c4546f0a90 0x55c4546f0e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:43.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.211+0000 7fb98c644740 4 client.4905 mds_command: new command op to 4294 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-22T07:20:43.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.211+0000 7fb98c644740 1 -- 172.21.15.37:0/4181341246 --> [v2:172.21.15.196:6836/3264179771,v1:172.21.15.196:6838/3264179771] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c454618b10 con 0x55c4546f0a90 2024-04-22T07:20:43.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.212+0000 7fb9827fc640 1 --2- 172.21.15.37:0/4181341246 >> [v2:172.21.15.196:6836/3264179771,v1:172.21.15.196:6838/3264179771] conn(0x55c4546f0a90 0x55c4546f0e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:43.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.213+0000 7fb9627fc640 10 client.4905 ms_handle_connect on v2:172.21.15.196:6836/3264179771 2024-04-22T07:20:43.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.213+0000 7fb9827fc640 1 --2- 172.21.15.37:0/4181341246 >> [v2:172.21.15.196:6836/3264179771,v1:172.21.15.196:6838/3264179771] conn(0x55c4546f0a90 0x55c4546f0e70 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=933617ebbbe310c4 server_cookie=6c35bebec82655ce in_seq=0 out_seq=0 2024-04-22T07:20:43.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.214+0000 7fb9627fc640 1 -- 172.21.15.37:0/4181341246 <== mds.0 v2:172.21.15.196:6836/3264179771 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55c454618b10 con 0x55c4546f0a90 2024-04-22T07:20:43.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.214+0000 7fb9627fc640 10 client.4905 handle_command_reply: tid=0 2024-04-22T07:20:43.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.214+0000 7fb98c644740 1 client.4905 shutdown 2024-04-22T07:20:43.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.214+0000 7fb98c644740 1 -- 172.21.15.37:0/4181341246 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c4546a6200 msgr2=0x55c4546f7850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:43.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.214+0000 7fb98c644740 1 --2- 172.21.15.37:0/4181341246 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c4546a6200 0x55c4546f7850 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fb9740615c0 tx=0x7fb974059640 comp rx=0 tx=0).stop 2024-04-22T07:20:43.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.214+0000 7fb98c644740 1 -- 172.21.15.37:0/4181341246 shutdown_connections 2024-04-22T07:20:43.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.214+0000 7fb98c644740 1 --2- 172.21.15.37:0/4181341246 >> [v2:172.21.15.196:6836/3264179771,v1:172.21.15.196:6838/3264179771] conn(0x55c4546f0a90 0x55c4546f0e70 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:43.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.214+0000 7fb98c644740 1 --2- 172.21.15.37:0/4181341246 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55c4546e7ae0 0x55c4546ca540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:43.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.214+0000 7fb98c644740 1 --2- 172.21.15.37:0/4181341246 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x55c4546f0080 0x55c4546fabe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:43.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.214+0000 7fb98c644740 1 --2- 172.21.15.37:0/4181341246 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c4546a6200 0x55c4546f7850 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:43.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.214+0000 7fb9627fc640 0 client.4905 ms_handle_reset on v2:172.21.15.196:6836/3264179771 2024-04-22T07:20:43.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.214+0000 7fb98c644740 1 -- 172.21.15.37:0/4181341246 >> 172.21.15.37:0/4181341246 conn(0x55c4546a4c60 msgr2=0x55c45469f940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:20:43.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.214+0000 7fb98c644740 1 -- 172.21.15.37:0/4181341246 shutdown_connections 2024-04-22T07:20:43.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.214+0000 7fb98c644740 1 -- 172.21.15.37:0/4181341246 wait complete. 2024-04-22T07:20:43.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.214+0000 7fb98c644740 20 client.4905 trim_cache size 0 max 16384 2024-04-22T07:20:43.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.236+0000 7fb98c644740 1 Processor -- start 2024-04-22T07:20:43.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.236+0000 7fb98c644740 1 -- start start 2024-04-22T07:20:43.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.237+0000 7fb98c644740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55c4546a6200 0x55c4546e2a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:43.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.237+0000 7fb98c644740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c4546e7ae0 0x55c45469f940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:43.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.237+0000 7fb98c644740 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x55c4546f0080 0x55c45469fe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:43.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.237+0000 7fb98c644740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fb9841fe8c0 con 0x55c4546e7ae0 2024-04-22T07:20:43.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.237+0000 7fb98c644740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fb9841fd7a0 con 0x55c4546a6200 2024-04-22T07:20:43.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.237+0000 7fb98c644740 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fb9841f4900 con 0x55c4546f0080 2024-04-22T07:20:43.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.237+0000 7fb9827fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c4546e7ae0 0x55c45469f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:43.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.237+0000 7fb9827fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c4546e7ae0 0x55c45469f940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:32866/0 (socket says 172.21.15.37:32866) 2024-04-22T07:20:43.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.237+0000 7fb9827fc640 1 -- 172.21.15.37:0/2795006962 learned_addr learned my addr 172.21.15.37:0/2795006962 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:20:43.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.238+0000 7fb9837fe640 1 --2- 172.21.15.37:0/2795006962 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x55c4546f0080 0x55c45469fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:43.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.238+0000 7fb982ffd640 1 --2- 172.21.15.37:0/2795006962 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55c4546a6200 0x55c4546e2a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:43.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.238+0000 7fb9827fc640 1 -- 172.21.15.37:0/2795006962 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x55c4546f0080 msgr2=0x55c45469fe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:20:43.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.238+0000 7fb9827fc640 1 --2- 172.21.15.37:0/2795006962 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x55c4546f0080 0x55c45469fe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:43.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.238+0000 7fb9827fc640 1 -- 172.21.15.37:0/2795006962 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55c4546a6200 msgr2=0x55c4546e2a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:20:43.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.238+0000 7fb9827fc640 1 --2- 172.21.15.37:0/2795006962 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55c4546a6200 0x55c4546e2a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:43.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.238+0000 7fb9827fc640 1 -- 172.21.15.37:0/2795006962 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c4546c4600 con 0x55c4546e7ae0 2024-04-22T07:20:43.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.238+0000 7fb9827fc640 1 --2- 172.21.15.37:0/2795006962 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c4546e7ae0 0x55c45469f940 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fb978001620 tx=0x7fb978039000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f47d5d7853157b41 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:20:43.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.238+0000 7fb968ff9640 1 -- 172.21.15.37:0/2795006962 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb978050040 con 0x55c4546e7ae0 2024-04-22T07:20:43.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.238+0000 7fb968ff9640 1 -- 172.21.15.37:0/2795006962 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb978006c00 con 0x55c4546e7ae0 2024-04-22T07:20:43.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.238+0000 7fb968ff9640 1 -- 172.21.15.37:0/2795006962 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb978046040 con 0x55c4546e7ae0 2024-04-22T07:20:43.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.239+0000 7fb98c644740 1 -- 172.21.15.37:0/2795006962 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c4546e7ae0 msgr2=0x55c45469f940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:43.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.239+0000 7fb98c644740 1 --2- 172.21.15.37:0/2795006962 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c4546e7ae0 0x55c45469f940 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fb978001620 tx=0x7fb978039000 comp rx=0 tx=0).stop 2024-04-22T07:20:43.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.239+0000 7fb98c644740 1 -- 172.21.15.37:0/2795006962 shutdown_connections 2024-04-22T07:20:43.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.239+0000 7fb98c644740 1 --2- 172.21.15.37:0/2795006962 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x55c4546f0080 0x55c45469fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:43.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.239+0000 7fb98c644740 1 --2- 172.21.15.37:0/2795006962 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c4546e7ae0 0x55c45469f940 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:43.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.239+0000 7fb98c644740 1 --2- 172.21.15.37:0/2795006962 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55c4546a6200 0x55c4546e2a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:43.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.239+0000 7fb98c644740 1 -- 172.21.15.37:0/2795006962 >> 172.21.15.37:0/2795006962 conn(0x55c4546a4c60 msgr2=0x55c4546ca350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:20:43.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.239+0000 7fb98c644740 1 -- 172.21.15.37:0/2795006962 shutdown_connections 2024-04-22T07:20:43.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.239+0000 7fb98c644740 1 -- 172.21.15.37:0/2795006962 wait complete. 2024-04-22T07:20:43.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.239+0000 7fb98c644740 1 -- start start 2024-04-22T07:20:43.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.240+0000 7fb98c644740 1 Processor -- start 2024-04-22T07:20:43.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.240+0000 7fb98c644740 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x55c4546a6200 0x55c45469fd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:43.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.240+0000 7fb98c644740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55c4546e7ae0 0x55c45475b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:43.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.240+0000 7fb98c644740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c4546f0080 0x55c45475b930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:43.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.240+0000 7fb98c644740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fb9841f4f50 con 0x55c4546f0080 2024-04-22T07:20:43.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.240+0000 7fb98c644740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fb9841fd0f0 con 0x55c4546e7ae0 2024-04-22T07:20:43.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.240+0000 7fb98c644740 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fb9841f55a0 con 0x55c4546a6200 2024-04-22T07:20:43.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.240+0000 7fb98c644740 10 client.0 _ll_register_callbacks cb 0x7fb974055120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-22T07:20:43.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.240+0000 7fb9837fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c4546f0080 0x55c45475b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:43.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.240+0000 7fb9837fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c4546f0080 0x55c45475b930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:32882/0 (socket says 172.21.15.37:32882) 2024-04-22T07:20:43.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.240+0000 7fb9837fe640 1 -- 172.21.15.37:0/1032717335 learned_addr learned my addr 172.21.15.37:0/1032717335 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:20:43.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.241+0000 7fb982ffd640 1 --2- 172.21.15.37:0/1032717335 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x55c4546a6200 0x55c45469fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:43.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.241+0000 7fb9827fc640 1 --2- 172.21.15.37:0/1032717335 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55c4546e7ae0 0x55c45475b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:43.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.241+0000 7fb9837fe640 1 -- 172.21.15.37:0/1032717335 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x55c4546a6200 msgr2=0x55c45469fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:20:43.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.241+0000 7fb9837fe640 1 --2- 172.21.15.37:0/1032717335 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x55c4546a6200 0x55c45469fd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:43.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.241+0000 7fb9837fe640 1 -- 172.21.15.37:0/1032717335 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55c4546e7ae0 msgr2=0x55c45475b3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:20:43.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.241+0000 7fb9837fe640 1 --2- 172.21.15.37:0/1032717335 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55c4546e7ae0 0x55c45475b3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:43.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.241+0000 7fb9837fe640 1 -- 172.21.15.37:0/1032717335 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c4546fa150 con 0x55c4546f0080 2024-04-22T07:20:43.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.241+0000 7fb9837fe640 1 --2- 172.21.15.37:0/1032717335 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c4546f0080 0x55c45475b930 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fb984072020 tx=0x7fb97c00fd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a7544e32828be3e server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:20:43.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.241+0000 7fb9627fc640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-04-22T07:20:43.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.241+0000 7fb9627fc640 1 -- 172.21.15.37:0/1032717335 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb97c016020 con 0x55c4546f0080 2024-04-22T07:20:43.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.242+0000 7fb9627fc640 1 -- 172.21.15.37:0/1032717335 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7fb97c003de0 con 0x55c4546f0080 2024-04-22T07:20:43.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.242+0000 7fb98c644740 1 -- 172.21.15.37:0/1032717335 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb978006c00 con 0x55c4546f0080 2024-04-22T07:20:43.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.242+0000 7fb9627fc640 1 -- 172.21.15.37:0/1032717335 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7fb97c00fe50 con 0x55c4546f0080 2024-04-22T07:20:43.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.242+0000 7fb98c644740 10 client.4911 fetch_fsmap learned FSMap version 8 2024-04-22T07:20:43.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.242+0000 7fb98c644740 1 -- 172.21.15.37:0/1032717335 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x55c454761c30 con 0x55c4546f0080 2024-04-22T07:20:43.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.242+0000 7fb9627fc640 1 -- 172.21.15.37:0/1032717335 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb978006c00 con 0x55c4546f0080 2024-04-22T07:20:43.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.242+0000 7fb9627fc640 1 -- 172.21.15.37:0/1032717335 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 8) ==== 4704+0+0 (secure 0 0 0) 0x7fb97c010040 con 0x55c4546f0080 2024-04-22T07:20:43.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.242+0000 7fb98c644740 10 client.4911 fetch_fsmap finished waiting for FSMap version 8 2024-04-22T07:20:43.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.242+0000 7fb98c644740 10 client.4911 resolve_mds: validated gid 4294 aka daemon mds.f 2024-04-22T07:20:43.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.242+0000 7fb98c644740 20 client.4911 populate_metadata read hostname 'smithi037' 2024-04-22T07:20:43.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.242+0000 7fb98c644740 1 --2- 172.21.15.37:0/1032717335 >> [v2:172.21.15.196:6836/3264179771,v1:172.21.15.196:6838/3264179771] conn(0x55c4547623d0 0x55c454764c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:43.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.242+0000 7fb98c644740 4 client.4911 mds_command: new command op to 4294 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 89.85, "await": true}] 2024-04-22T07:20:43.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.242+0000 7fb98c644740 1 -- 172.21.15.37:0/1032717335 --> [v2:172.21.15.196:6836/3264179771,v1:172.21.15.196:6838/3264179771] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 89.85, "await": true}) -- 0x55c454612980 con 0x55c4547623d0 2024-04-22T07:20:43.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.243+0000 7fb982ffd640 1 --2- 172.21.15.37:0/1032717335 >> [v2:172.21.15.196:6836/3264179771,v1:172.21.15.196:6838/3264179771] conn(0x55c4547623d0 0x55c454764c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:43.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.243+0000 7fb9627fc640 10 client.4911 ms_handle_connect on v2:172.21.15.196:6836/3264179771 2024-04-22T07:20:43.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.243+0000 7fb982ffd640 1 --2- 172.21.15.37:0/1032717335 >> [v2:172.21.15.196:6836/3264179771,v1:172.21.15.196:6838/3264179771] conn(0x55c4547623d0 0x55c454764c10 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dc31f5f3b75066e3 server_cookie=a372f39b91e5b24c in_seq=0 out_seq=0 2024-04-22T07:20:43.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.350+0000 7fb9627fc640 1 -- 172.21.15.37:0/1032717335 <== mds.0 v2:172.21.15.196:6836/3264179771 1 ==== command_reply(tid 0: 0 ) ==== 8+0+586 (crc 0 0 0) 0x55c454612980 con 0x55c4547623d0 2024-04-22T07:20:43.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.351+0000 7fb9627fc640 10 client.4911 handle_command_reply: tid=0 2024-04-22T07:20:43.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.351+0000 7fb98c644740 1 client.4911 shutdown 2024-04-22T07:20:43.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.351+0000 7fb98c644740 1 -- 172.21.15.37:0/1032717335 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c4546f0080 msgr2=0x55c45475b930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:43.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.351+0000 7fb98c644740 1 --2- 172.21.15.37:0/1032717335 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c4546f0080 0x55c45475b930 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fb984072020 tx=0x7fb97c00fd20 comp rx=0 tx=0).stop 2024-04-22T07:20:43.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.351+0000 7fb98c644740 1 -- 172.21.15.37:0/1032717335 shutdown_connections 2024-04-22T07:20:43.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.351+0000 7fb98c644740 1 --2- 172.21.15.37:0/1032717335 >> [v2:172.21.15.196:6836/3264179771,v1:172.21.15.196:6838/3264179771] conn(0x55c4547623d0 0x55c454764c10 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:43.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.351+0000 7fb98c644740 1 --2- 172.21.15.37:0/1032717335 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c4546f0080 0x55c45475b930 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:43.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.351+0000 7fb98c644740 1 --2- 172.21.15.37:0/1032717335 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55c4546e7ae0 0x55c45475b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:43.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.351+0000 7fb98c644740 1 --2- 172.21.15.37:0/1032717335 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x55c4546a6200 0x55c45469fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:43.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.351+0000 7fb98c644740 1 -- 172.21.15.37:0/1032717335 >> 172.21.15.37:0/1032717335 conn(0x55c4546a4c60 msgr2=0x55c4546fa630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:20:43.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.351+0000 7fb9627fc640 0 client.4911 ms_handle_reset on v2:172.21.15.196:6836/3264179771 2024-04-22T07:20:43.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.351+0000 7fb98c644740 1 -- 172.21.15.37:0/1032717335 shutdown_connections 2024-04-22T07:20:43.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.351+0000 7fb98c644740 1 -- 172.21.15.37:0/1032717335 wait complete. 2024-04-22T07:20:43.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.351+0000 7fb98c644740 20 client.4911 trim_cache size 0 max 16384 2024-04-22T07:20:43.351 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-04-22T07:20:43.351 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 8, 2024-04-22T07:20:43.351 INFO:teuthology.orchestra.run.smithi037.stdout: "leader": 4294, 2024-04-22T07:20:43.351 INFO:teuthology.orchestra.run.smithi037.stdout: "set_version": 6, 2024-04-22T07:20:43.351 INFO:teuthology.orchestra.run.smithi037.stdout: "sets": { 2024-04-22T07:20:43.351 INFO:teuthology.orchestra.run.smithi037.stdout: "68852394": { 2024-04-22T07:20:43.351 INFO:teuthology.orchestra.run.smithi037.stdout: "version": 6, 2024-04-22T07:20:43.351 INFO:teuthology.orchestra.run.smithi037.stdout: "age_ref": 0.0, 2024-04-22T07:20:43.351 INFO:teuthology.orchestra.run.smithi037.stdout: "state": { 2024-04-22T07:20:43.351 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "QUIESCED", 2024-04-22T07:20:43.351 INFO:teuthology.orchestra.run.smithi037.stdout: "age": 0.0 2024-04-22T07:20:43.351 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-04-22T07:20:43.352 INFO:teuthology.orchestra.run.smithi037.stdout: "timeout": 60.0, 2024-04-22T07:20:43.352 INFO:teuthology.orchestra.run.smithi037.stdout: "expiration": 89.8, 2024-04-22T07:20:43.352 INFO:teuthology.orchestra.run.smithi037.stdout: "members": { 2024-04-22T07:20:43.352 INFO:teuthology.orchestra.run.smithi037.stdout: "file:/": { 2024-04-22T07:20:43.352 INFO:teuthology.orchestra.run.smithi037.stdout: "excluded": false, 2024-04-22T07:20:43.352 INFO:teuthology.orchestra.run.smithi037.stdout: "state": { 2024-04-22T07:20:43.352 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "QUIESCED", 2024-04-22T07:20:43.352 INFO:teuthology.orchestra.run.smithi037.stdout: "age": 0.0 2024-04-22T07:20:43.352 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-04-22T07:20:43.352 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-04-22T07:20:43.352 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-04-22T07:20:43.352 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-04-22T07:20:43.352 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-04-22T07:20:43.352 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-04-22T07:20:43.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.352+0000 7fb989a4e640 1 -- 172.21.15.37:0/3284807801 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fb97006c8f0 msgr2=0x7fb97006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:43.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.352+0000 7fb989a4e640 1 --2- 172.21.15.37:0/3284807801 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fb97006c8f0 0x7fb97006edb0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fb978048000 tx=0x7fb978045000 comp rx=0 tx=0).stop 2024-04-22T07:20:43.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.352+0000 7fb989a4e640 1 -- 172.21.15.37:0/3284807801 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb96c004800 msgr2=0x7fb98414fa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:43.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.352+0000 7fb989a4e640 1 --2- 172.21.15.37:0/3284807801 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb96c004800 0x7fb98414fa50 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fb97400c760 tx=0x7fb97400cc20 comp rx=0 tx=0).stop 2024-04-22T07:20:43.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.352+0000 7fb989a4e640 1 -- 172.21.15.37:0/3284807801 shutdown_connections 2024-04-22T07:20:43.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.352+0000 7fb989a4e640 1 --2- 172.21.15.37:0/3284807801 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fb97006c8f0 0x7fb97006edb0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:43.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.352+0000 7fb989a4e640 1 --2- 172.21.15.37:0/3284807801 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb9841f1970 0x7fb9841475c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:43.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.352+0000 7fb989a4e640 1 --2- 172.21.15.37:0/3284807801 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb984157a20 0x7fb9841f1430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:43.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.352+0000 7fb989a4e640 1 --2- 172.21.15.37:0/3284807801 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb96c004800 0x7fb98414fa50 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:43.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.352+0000 7fb989a4e640 1 -- 172.21.15.37:0/3284807801 >> 172.21.15.37:0/3284807801 conn(0x7fb98406bfa0 msgr2=0x7fb9840c24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:20:43.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.352+0000 7fb989a4e640 1 -- 172.21.15.37:0/3284807801 shutdown_connections 2024-04-22T07:20:43.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:20:43.352+0000 7fb989a4e640 1 -- 172.21.15.37:0/3284807801 wait complete. 2024-04-22T07:20:43.361 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced, set_id: 68852394, quiesce took 1.0 seconds. Will release after: 29.85 2024-04-22T07:20:43.562 INFO:tasks.workunit.client.0.smithi037.stdout: 2024-04-22T07:20:43.562 INFO:tasks.workunit.client.0.smithi037.stdout: Children see throughput for 1 initial writers = 734464.56 kB/sec 2024-04-22T07:20:43.562 INFO:tasks.workunit.client.0.smithi037.stdout: Parent sees throughput for 1 initial writers = 734346.37 kB/sec 2024-04-22T07:20:43.562 INFO:tasks.workunit.client.0.smithi037.stdout: Min throughput per process = 734464.56 kB/sec 2024-04-22T07:20:43.562 INFO:tasks.workunit.client.0.smithi037.stdout: Max throughput per process = 734464.56 kB/sec 2024-04-22T07:20:43.562 INFO:tasks.workunit.client.0.smithi037.stdout: Avg throughput per process = 734464.56 kB/sec 2024-04-22T07:20:43.562 INFO:tasks.workunit.client.0.smithi037.stdout: Min xfer = 1048576.00 kB 2024-04-22T07:21:07.028 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-22T07:21:07.031 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-22T07:21:13.212 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-22T07:21:13.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.329+0000 7f4ef9152640 1 Processor -- start 2024-04-22T07:21:13.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.329+0000 7f4ef9152640 1 -- start start 2024-04-22T07:21:13.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.329+0000 7f4ef9152640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f4ef415c3f0 0x7f4ef415c840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:13.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.329+0000 7f4ef9152640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ef415cd80 con 0x7f4ef4152dc0 2024-04-22T07:21:13.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.329+0000 7f4ef9152640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ef40c6f70 con 0x7f4ef40c84e0 2024-04-22T07:21:13.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.329+0000 7f4ef9152640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f4ef40c7530 con 0x7f4ef415c3f0 2024-04-22T07:21:13.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.330+0000 7f4ef2d9d640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f4ef4152dc0 0x7f4ef40c4aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:59630/0 (socket says 172.21.15.37:59630) 2024-04-22T07:21:13.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.330+0000 7f4ef2d9d640 1 -- 172.21.15.37:0/4219902679 learned_addr learned my addr 172.21.15.37:0/4219902679 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-04-22T07:21:13.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.330+0000 7f4ef359e640 1 --2- 172.21.15.37:0/4219902679 >> v2:172.21.15.196:3300/0 conn(0x7f4ef415c3f0 0x7f4ef415c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:13.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.330+0000 7f4ef1d9b640 1 -- 172.21.15.37:0/4219902679 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1951448613 0 0) 0x7f4ef415cd80 con 0x7f4ef4152dc0 2024-04-22T07:21:13.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.330+0000 7f4ef1d9b640 1 -- 172.21.15.37:0/4219902679 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4ee0003520 con 0x7f4ef4152dc0 2024-04-22T07:21:13.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.330+0000 7f4ef1d9b640 1 -- 172.21.15.37:0/4219902679 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2007140842 0 0) 0x7f4ee0003520 con 0x7f4ef4152dc0 2024-04-22T07:21:13.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.330+0000 7f4ef1d9b640 1 -- 172.21.15.37:0/4219902679 >> v2:172.21.15.196:3300/0 conn(0x7f4ef415c3f0 msgr2=0x7f4ef415c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:21:13.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.330+0000 7f4ef1d9b640 1 --2- 172.21.15.37:0/4219902679 >> v2:172.21.15.196:3300/0 conn(0x7f4ef415c3f0 0x7f4ef415c840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:13.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.330+0000 7f4ef1d9b640 1 -- 172.21.15.37:0/4219902679 >> v1:172.21.15.196:6789/0 conn(0x7f4ef40c84e0 legacy=0x7f4ef40c8c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:13.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.330+0000 7f4ef1d9b640 1 -- 172.21.15.37:0/4219902679 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ef40c7250 con 0x7f4ef4152dc0 2024-04-22T07:21:13.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.330+0000 7f4ef1d9b640 1 -- 172.21.15.37:0/4219902679 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2576656170 0 0) 0x7f4eec001670 con 0x7f4ef4152dc0 2024-04-22T07:21:13.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.330+0000 7f4ef359e640 1 --2- 172.21.15.37:0/4219902679 >> v2:172.21.15.196:3300/0 conn(0x7f4ef415c3f0 0x7f4ef415c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-22T07:21:13.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.330+0000 7f4ef1d9b640 1 -- 172.21.15.37:0/4219902679 >> v1:172.21.15.37:6789/0 conn(0x7f4ef4152dc0 legacy=0x7f4ef40c4aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:13.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.330+0000 7f4ef1d9b640 1 --2- 172.21.15.37:0/4219902679 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ee00039b0 0x7f4ee0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:13.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.330+0000 7f4ef1d9b640 1 --2- 172.21.15.37:0/4219902679 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4ee0004800 0x7f4ee0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:13.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.330+0000 7f4ef1d9b640 1 --2- 172.21.15.37:0/4219902679 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4ee00051c0 0x7f4ee000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:13.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.330+0000 7f4ef1d9b640 1 -- 172.21.15.37:0/4219902679 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f4ef40c7530 con 0x7f4ee00039b0 2024-04-22T07:21:13.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.330+0000 7f4ef1d9b640 1 -- 172.21.15.37:0/4219902679 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f4ee000c160 con 0x7f4ee0004800 2024-04-22T07:21:13.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.330+0000 7f4ef1d9b640 1 -- 172.21.15.37:0/4219902679 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f4ee000c360 con 0x7f4ee00051c0 2024-04-22T07:21:13.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.330+0000 7f4ef2d9d640 1 --2- 172.21.15.37:0/4219902679 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ee00039b0 0x7f4ee0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:13.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.330+0000 7f4ef259c640 1 --2- 172.21.15.37:0/4219902679 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4ee0004800 0x7f4ee0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:13.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.330+0000 7f4ef359e640 1 --2- 172.21.15.37:0/4219902679 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4ee00051c0 0x7f4ee000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:13.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.331+0000 7f4ef2d9d640 1 -- 172.21.15.37:0/4219902679 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4ee00051c0 msgr2=0x7f4ee000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:21:13.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.331+0000 7f4ef2d9d640 1 --2- 172.21.15.37:0/4219902679 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4ee00051c0 0x7f4ee000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:13.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.331+0000 7f4ef2d9d640 1 -- 172.21.15.37:0/4219902679 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4ee0004800 msgr2=0x7f4ee0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:21:13.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.331+0000 7f4ef2d9d640 1 --2- 172.21.15.37:0/4219902679 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4ee0004800 0x7f4ee0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:13.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.331+0000 7f4ef2d9d640 1 -- 172.21.15.37:0/4219902679 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ee0003520 con 0x7f4ee00039b0 2024-04-22T07:21:13.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.331+0000 7f4ef359e640 1 -- 172.21.15.37:0/4219902679 reap_dead start 2024-04-22T07:21:13.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.331+0000 7f4ef2d9d640 1 --2- 172.21.15.37:0/4219902679 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ee00039b0 0x7f4ee0003dd0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f4eec00c240 tx=0x7f4ee0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70b20f4331496e35 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:13.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.332+0000 7f4ef1d9b640 1 -- 172.21.15.37:0/4219902679 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4eec007d10 con 0x7f4ee00039b0 2024-04-22T07:21:13.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.332+0000 7f4ef1d9b640 1 -- 172.21.15.37:0/4219902679 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4eec030070 con 0x7f4ee00039b0 2024-04-22T07:21:13.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.332+0000 7f4ef1d9b640 1 -- 172.21.15.37:0/4219902679 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4eec005d70 con 0x7f4ee00039b0 2024-04-22T07:21:13.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.332+0000 7f4ef9152640 1 -- 172.21.15.37:0/4219902679 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ee00039b0 msgr2=0x7f4ee0003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:13.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.332+0000 7f4ef9152640 1 --2- 172.21.15.37:0/4219902679 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ee00039b0 0x7f4ee0003dd0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f4eec00c240 tx=0x7f4ee0005830 comp rx=0 tx=0).stop 2024-04-22T07:21:13.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.332+0000 7f4ef9152640 1 -- 172.21.15.37:0/4219902679 shutdown_connections 2024-04-22T07:21:13.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.332+0000 7f4ef9152640 1 --2- 172.21.15.37:0/4219902679 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ee00039b0 0x7f4ee0003dd0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:13.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.332+0000 7f4ef9152640 1 -- 172.21.15.37:0/4219902679 >> 172.21.15.37:0/4219902679 conn(0x7f4ef406b970 msgr2=0x7f4ef406bd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:21:13.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.332+0000 7f4ef9152640 1 -- 172.21.15.37:0/4219902679 shutdown_connections 2024-04-22T07:21:13.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.332+0000 7f4ef9152640 1 -- 172.21.15.37:0/4219902679 wait complete. 2024-04-22T07:21:13.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.334+0000 7f4ef9152640 1 Processor -- start 2024-04-22T07:21:13.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.334+0000 7f4ef9152640 1 -- start start 2024-04-22T07:21:13.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.335+0000 7f4ef9152640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4ee00039b0 0x7f4ef40725c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:13.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.335+0000 7f4ef9152640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ef41e1ca0 0x7f4ef414f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:13.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.335+0000 7f4ef9152640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4ef41f0720 0x7f4ef41f0bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:13.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.335+0000 7f4ef9152640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f4ef40c3e50 con 0x7f4ef41e1ca0 2024-04-22T07:21:13.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.335+0000 7f4ef9152640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f4ef40c3ae0 con 0x7f4ee00039b0 2024-04-22T07:21:13.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.335+0000 7f4ef9152640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f4ef40c65e0 con 0x7f4ef41f0720 2024-04-22T07:21:13.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.335+0000 7f4ef259c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ef41e1ca0 0x7f4ef414f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:13.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.335+0000 7f4ef259c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ef41e1ca0 0x7f4ef414f480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48688/0 (socket says 172.21.15.37:48688) 2024-04-22T07:21:13.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.335+0000 7f4ef259c640 1 -- 172.21.15.37:0/2379930763 learned_addr learned my addr 172.21.15.37:0/2379930763 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:21:13.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.335+0000 7f4ef2d9d640 1 --2- 172.21.15.37:0/2379930763 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4ee00039b0 0x7f4ef40725c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:13.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.335+0000 7f4ef359e640 1 --2- 172.21.15.37:0/2379930763 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4ef41f0720 0x7f4ef41f0bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:13.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.335+0000 7f4ef259c640 1 -- 172.21.15.37:0/2379930763 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4ef41f0720 msgr2=0x7f4ef41f0bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:13.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.335+0000 7f4ef259c640 1 --2- 172.21.15.37:0/2379930763 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4ef41f0720 0x7f4ef41f0bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:13.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.335+0000 7f4ef259c640 1 -- 172.21.15.37:0/2379930763 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4ee00039b0 msgr2=0x7f4ef40725c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:13.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.335+0000 7f4ef259c640 1 --2- 172.21.15.37:0/2379930763 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4ee00039b0 0x7f4ef40725c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:13.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.335+0000 7f4ef259c640 1 -- 172.21.15.37:0/2379930763 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ef4072e70 con 0x7f4ef41e1ca0 2024-04-22T07:21:13.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.335+0000 7f4ef259c640 1 --2- 172.21.15.37:0/2379930763 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ef41e1ca0 0x7f4ef414f480 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f4edc00f620 tx=0x7f4edc00fae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:13.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.335+0000 7f4eeb7fe640 1 -- 172.21.15.37:0/2379930763 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4edc0052e0 con 0x7f4ef41e1ca0 2024-04-22T07:21:13.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.335+0000 7f4eeb7fe640 1 -- 172.21.15.37:0/2379930763 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4edc018070 con 0x7f4ef41e1ca0 2024-04-22T07:21:13.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.335+0000 7f4eeb7fe640 1 -- 172.21.15.37:0/2379930763 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4edc003810 con 0x7f4ef41e1ca0 2024-04-22T07:21:13.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.335+0000 7f4ef9152640 1 -- 172.21.15.37:0/2379930763 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ef41f3e30 con 0x7f4ef41e1ca0 2024-04-22T07:21:13.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.336+0000 7f4ef9152640 1 -- 172.21.15.37:0/2379930763 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ef41f43f0 con 0x7f4ef41e1ca0 2024-04-22T07:21:13.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.337+0000 7f4ef9152640 1 -- 172.21.15.37:0/2379930763 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ef4069cc0 con 0x7f4ef41e1ca0 2024-04-22T07:21:13.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.337+0000 7f4eeb7fe640 1 -- 172.21.15.37:0/2379930763 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4edc0039b0 con 0x7f4ef41e1ca0 2024-04-22T07:21:13.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.338+0000 7f4eeb7fe640 1 --2- 172.21.15.37:0/2379930763 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f4ed406c8f0 0x7f4ed406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:13.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.338+0000 7f4eeb7fe640 1 -- 172.21.15.37:0/2379930763 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f4edc08b910 con 0x7f4ef41e1ca0 2024-04-22T07:21:13.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.338+0000 7f4ef2d9d640 1 --2- 172.21.15.37:0/2379930763 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f4ed406c8f0 0x7f4ed406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:13.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.338+0000 7f4ef2d9d640 1 --2- 172.21.15.37:0/2379930763 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f4ed406c8f0 0x7f4ed406edb0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f4eec034000 tx=0x7f4eec009030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:13.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.342+0000 7f4eeb7fe640 1 -- 172.21.15.37:0/2379930763 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f4edc0595e0 con 0x7f4ef41e1ca0 2024-04-22T07:21:13.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.565+0000 7f4ef9152640 1 -- 172.21.15.37:0/2379930763 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4ef40c7780 con 0x7f4ef41e1ca0 2024-04-22T07:21:13.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.566+0000 7f4eeb7fe640 1 -- 172.21.15.37:0/2379930763 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6827 (secure 0 0 0) 0x7f4edc05d8e0 con 0x7f4ef41e1ca0 2024-04-22T07:21:13.564 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-22T07:21:13.564 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4265,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6839/671847354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6835","nonce":671847354},{"type":"v1","addr":"172.21.15.196:6839","nonce":671847354}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6833/1549427395","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1549427395},{"type":"v1","addr":"172.21.15.37:6833","nonce":1549427395}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6836/3825988951","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":3825988951},{"type":"v1","addr":"172.21.15.37:6836","nonce":3825988951}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4272,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/611771502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6835","nonce":611771502},{"type":"v1","addr":"172.21.15.37:6837","nonce":611771502}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4291,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6837/3055080225","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6834","nonce":3055080225},{"type":"v1","addr":"172.21.15.196:6837","nonce":3055080225}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-22T07:18:36.111618+0000","modified":"2024-04-22T07:18:41.783857+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.196:6838/3264179771","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6836","nonce":3264179771},{"type":"v1","addr":"172.21.15.196:6838","nonce":3264179771}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4294,"qdb_cluster":[4294]},"id":1}]} 2024-04-22T07:21:13.564 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 8 2024-04-22T07:21:13.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.568+0000 7f4ef9152640 1 -- 172.21.15.37:0/2379930763 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f4ed406c8f0 msgr2=0x7f4ed406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:13.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.568+0000 7f4ef9152640 1 --2- 172.21.15.37:0/2379930763 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f4ed406c8f0 0x7f4ed406edb0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f4eec034000 tx=0x7f4eec009030 comp rx=0 tx=0).stop 2024-04-22T07:21:13.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.568+0000 7f4ef9152640 1 -- 172.21.15.37:0/2379930763 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ef41e1ca0 msgr2=0x7f4ef414f480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:13.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.568+0000 7f4ef9152640 1 --2- 172.21.15.37:0/2379930763 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ef41e1ca0 0x7f4ef414f480 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f4edc00f620 tx=0x7f4edc00fae0 comp rx=0 tx=0).stop 2024-04-22T07:21:13.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.568+0000 7f4ef9152640 1 -- 172.21.15.37:0/2379930763 shutdown_connections 2024-04-22T07:21:13.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.568+0000 7f4ef9152640 1 --2- 172.21.15.37:0/2379930763 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f4ed406c8f0 0x7f4ed406edb0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:13.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.568+0000 7f4ef9152640 1 --2- 172.21.15.37:0/2379930763 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4ef41f0720 0x7f4ef41f0bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:13.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.568+0000 7f4ef9152640 1 --2- 172.21.15.37:0/2379930763 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ef41e1ca0 0x7f4ef414f480 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:13.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.568+0000 7f4ef9152640 1 --2- 172.21.15.37:0/2379930763 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4ee00039b0 0x7f4ef40725c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:13.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.568+0000 7f4ef9152640 1 -- 172.21.15.37:0/2379930763 >> 172.21.15.37:0/2379930763 conn(0x7f4ef406b970 msgr2=0x7f4ef414d060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:21:13.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.568+0000 7f4ef9152640 1 -- 172.21.15.37:0/2379930763 shutdown_connections 2024-04-22T07:21:13.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.568+0000 7f4ef9152640 1 -- 172.21.15.37:0/2379930763 wait complete. 2024-04-22T07:21:13.577 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4294 quiesce db --set-id 68852394 --release --await' 2024-04-22T07:21:13.577 DEBUG:teuthology.orchestra.run.smithi037:> timeout 75 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4294 quiesce db --set-id 68852394 --release --await 2024-04-22T07:21:13.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.687+0000 7fee85293640 1 Processor -- start 2024-04-22T07:21:13.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.687+0000 7fee85293640 1 -- start start 2024-04-22T07:21:13.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.688+0000 7fee85293640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fee801551f0 0x7fee800cc460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:13.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.688+0000 7fee85293640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fee800cb0b0 0x7fee800730c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:13.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.688+0000 7fee85293640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee801555d0 con 0x7fee800cde00 2024-04-22T07:21:13.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.688+0000 7fee85293640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fee800cc9a0 con 0x7fee801551f0 2024-04-22T07:21:13.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.688+0000 7fee85293640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fee800ccbc0 con 0x7fee800cb0b0 2024-04-22T07:21:13.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.688+0000 7fee7effd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fee801551f0 0x7fee800cc460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:13.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.688+0000 7fee7effd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fee801551f0 0x7fee800cc460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48692/0 (socket says 172.21.15.37:48692) 2024-04-22T07:21:13.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.688+0000 7fee7e7fc640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fee800cde00 0x7fee8015e4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:59646/0 (socket says 172.21.15.37:59646) 2024-04-22T07:21:13.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.688+0000 7fee7effd640 1 -- 172.21.15.37:0/1263358425 learned_addr learned my addr 172.21.15.37:0/1263358425 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:21:13.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.689+0000 7fee7f7fe640 1 --2- 172.21.15.37:0/1263358425 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fee800cb0b0 0x7fee800730c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:13.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.689+0000 7fee7effd640 1 -- 172.21.15.37:0/1263358425 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fee800cb0b0 msgr2=0x7fee800730c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:21:13.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.689+0000 7fee7effd640 1 --2- 172.21.15.37:0/1263358425 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fee800cb0b0 0x7fee800730c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:13.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.689+0000 7fee7effd640 1 -- 172.21.15.37:0/1263358425 >> v1:172.21.15.37:6789/0 conn(0x7fee800cde00 legacy=0x7fee8015e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:13.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.689+0000 7fee7effd640 1 -- 172.21.15.37:0/1263358425 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee800ccea0 con 0x7fee801551f0 2024-04-22T07:21:13.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.689+0000 7fee7dffb640 1 -- 172.21.15.37:0/1263358425 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2451663033 0 0) 0x7fee801555d0 con 0x7fee800cde00 2024-04-22T07:21:13.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.689+0000 7fee7f7fe640 1 --2- 172.21.15.37:0/1263358425 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fee800cb0b0 0x7fee800730c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-22T07:21:13.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.690+0000 7fee7effd640 1 --2- 172.21.15.37:0/1263358425 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee801551f0 0x7fee800cc460 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fee78009870 tx=0x7fee7802ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85cef1d3139334ca server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:13.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.690+0000 7fee7dffb640 1 -- 172.21.15.37:0/1263358425 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee7802f830 con 0x7fee801551f0 2024-04-22T07:21:13.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.690+0000 7fee7dffb640 1 -- 172.21.15.37:0/1263358425 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee7802f9d0 con 0x7fee801551f0 2024-04-22T07:21:13.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.690+0000 7fee7dffb640 1 -- 172.21.15.37:0/1263358425 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee7802fda0 con 0x7fee801551f0 2024-04-22T07:21:13.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.690+0000 7fee85293640 1 -- 172.21.15.37:0/1263358425 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee801551f0 msgr2=0x7fee800cc460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:13.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.690+0000 7fee85293640 1 --2- 172.21.15.37:0/1263358425 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee801551f0 0x7fee800cc460 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fee78009870 tx=0x7fee7802ba10 comp rx=0 tx=0).stop 2024-04-22T07:21:13.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.690+0000 7fee85293640 1 -- 172.21.15.37:0/1263358425 shutdown_connections 2024-04-22T07:21:13.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.690+0000 7fee85293640 1 --2- 172.21.15.37:0/1263358425 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fee800cb0b0 0x7fee800730c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:13.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.690+0000 7fee85293640 1 --2- 172.21.15.37:0/1263358425 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee801551f0 0x7fee800cc460 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:13.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.690+0000 7fee85293640 1 -- 172.21.15.37:0/1263358425 >> 172.21.15.37:0/1263358425 conn(0x7fee8006c410 msgr2=0x7fee800676b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:21:13.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.690+0000 7fee85293640 1 -- 172.21.15.37:0/1263358425 shutdown_connections 2024-04-22T07:21:13.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.690+0000 7fee85293640 1 -- 172.21.15.37:0/1263358425 wait complete. 2024-04-22T07:21:13.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.692+0000 7fee85293640 1 Processor -- start 2024-04-22T07:21:13.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.692+0000 7fee85293640 1 -- start start 2024-04-22T07:21:13.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.692+0000 7fee85293640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee800cb0b0 0x7fee80157810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:13.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.692+0000 7fee85293640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fee800cde00 0x7fee80153ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:13.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.692+0000 7fee85293640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fee801551f0 0x7fee801f5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:13.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.692+0000 7fee85293640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fee8015b5c0 con 0x7fee800cb0b0 2024-04-22T07:21:13.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.692+0000 7fee85293640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fee8015b2e0 con 0x7fee800cde00 2024-04-22T07:21:13.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.692+0000 7fee85293640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fee8015b8a0 con 0x7fee801551f0 2024-04-22T07:21:13.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.692+0000 7fee7effd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee800cb0b0 0x7fee80157810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:13.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.692+0000 7fee7effd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee800cb0b0 0x7fee80157810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48698/0 (socket says 172.21.15.37:48698) 2024-04-22T07:21:13.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.692+0000 7fee7effd640 1 -- 172.21.15.37:0/2654940026 learned_addr learned my addr 172.21.15.37:0/2654940026 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:21:13.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.693+0000 7fee7f7fe640 1 --2- 172.21.15.37:0/2654940026 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fee801551f0 0x7fee801f5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:13.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.693+0000 7fee7e7fc640 1 --2- 172.21.15.37:0/2654940026 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fee800cde00 0x7fee80153ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:13.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.693+0000 7fee7effd640 1 -- 172.21.15.37:0/2654940026 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fee801551f0 msgr2=0x7fee801f5100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:13.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.693+0000 7fee7effd640 1 --2- 172.21.15.37:0/2654940026 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fee801551f0 0x7fee801f5100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:13.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.693+0000 7fee7effd640 1 -- 172.21.15.37:0/2654940026 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fee800cde00 msgr2=0x7fee80153ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:13.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.693+0000 7fee7effd640 1 --2- 172.21.15.37:0/2654940026 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fee800cde00 0x7fee80153ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:13.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.693+0000 7fee7effd640 1 -- 172.21.15.37:0/2654940026 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee80158190 con 0x7fee800cb0b0 2024-04-22T07:21:13.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.693+0000 7fee7e7fc640 1 --2- 172.21.15.37:0/2654940026 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fee800cde00 0x7fee80153ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-22T07:21:13.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.693+0000 7fee7effd640 1 --2- 172.21.15.37:0/2654940026 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee800cb0b0 0x7fee80157810 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fee78009870 tx=0x7fee78004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:13.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.693+0000 7fee677fe640 1 -- 172.21.15.37:0/2654940026 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee7802f7e0 con 0x7fee800cb0b0 2024-04-22T07:21:13.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.693+0000 7fee677fe640 1 -- 172.21.15.37:0/2654940026 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee78046070 con 0x7fee800cb0b0 2024-04-22T07:21:13.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.693+0000 7fee677fe640 1 -- 172.21.15.37:0/2654940026 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee78041640 con 0x7fee800cb0b0 2024-04-22T07:21:13.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.693+0000 7fee85293640 1 -- 172.21.15.37:0/2654940026 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee80158470 con 0x7fee800cb0b0 2024-04-22T07:21:13.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.693+0000 7fee85293640 1 -- 172.21.15.37:0/2654940026 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee801f2800 con 0x7fee800cb0b0 2024-04-22T07:21:13.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.695+0000 7fee677fe640 1 -- 172.21.15.37:0/2654940026 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fee78040070 con 0x7fee800cb0b0 2024-04-22T07:21:13.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.695+0000 7fee677fe640 1 --2- 172.21.15.37:0/2654940026 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fee6c06c920 0x7fee6c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:13.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.695+0000 7fee677fe640 1 -- 172.21.15.37:0/2654940026 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7fee780ae3d0 con 0x7fee800cb0b0 2024-04-22T07:21:13.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.695+0000 7fee7e7fc640 1 --2- 172.21.15.37:0/2654940026 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fee6c06c920 0x7fee6c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:13.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.696+0000 7fee7e7fc640 1 --2- 172.21.15.37:0/2654940026 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fee6c06c920 0x7fee6c06ede0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fee74007fd0 tx=0x7fee74009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:13.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.696+0000 7fee87f65740 1 Processor -- start 2024-04-22T07:21:13.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.696+0000 7fee87f65740 1 -- start start 2024-04-22T07:21:13.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.697+0000 7fee87f65740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55cbdc9bc7d0 0x55cbdc9bcbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:13.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.697+0000 7fee87f65740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cbdc9a62d0 0x55cbdc9bd900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:13.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.697+0000 7fee87f65740 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x55cbdc97b810 0x55cbdc9bde40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:13.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.697+0000 7fee87f65740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55cbdc8e2500 con 0x55cbdc9a62d0 2024-04-22T07:21:13.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.697+0000 7fee87f65740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55cbdc8886a0 con 0x55cbdc9bc7d0 2024-04-22T07:21:13.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.697+0000 7fee87f65740 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x55cbdc8de4c0 con 0x55cbdc97b810 2024-04-22T07:21:13.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.697+0000 7fee7e7fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cbdc9a62d0 0x55cbdc9bd900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:13.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.697+0000 7fee7e7fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cbdc9a62d0 0x55cbdc9bd900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48712/0 (socket says 172.21.15.37:48712) 2024-04-22T07:21:13.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.697+0000 7fee7e7fc640 1 -- 172.21.15.37:0/2646953240 learned_addr learned my addr 172.21.15.37:0/2646953240 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:21:13.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.697+0000 7fee7effd640 1 --2- 172.21.15.37:0/2646953240 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55cbdc9bc7d0 0x55cbdc9bcbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:13.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.697+0000 7fee7f7fe640 1 --2- 172.21.15.37:0/2646953240 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x55cbdc97b810 0x55cbdc9bde40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:13.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.697+0000 7fee7e7fc640 1 -- 172.21.15.37:0/2646953240 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x55cbdc97b810 msgr2=0x55cbdc9bde40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:21:13.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.697+0000 7fee7e7fc640 1 --2- 172.21.15.37:0/2646953240 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x55cbdc97b810 0x55cbdc9bde40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:13.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.697+0000 7fee7e7fc640 1 -- 172.21.15.37:0/2646953240 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55cbdc9bc7d0 msgr2=0x55cbdc9bcbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:21:13.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.697+0000 7fee7e7fc640 1 --2- 172.21.15.37:0/2646953240 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55cbdc9bc7d0 0x55cbdc9bcbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:13.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.697+0000 7fee7e7fc640 1 -- 172.21.15.37:0/2646953240 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cbdc8a75e0 con 0x55cbdc9a62d0 2024-04-22T07:21:13.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.698+0000 7fee7e7fc640 1 --2- 172.21.15.37:0/2646953240 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cbdc9a62d0 0x55cbdc9bd900 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fee800ce250 tx=0x7fee74010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b0fe5d87536977e server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:13.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.698+0000 7fee64ff9640 1 -- 172.21.15.37:0/2646953240 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee7400d9a0 con 0x55cbdc9a62d0 2024-04-22T07:21:13.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.698+0000 7fee64ff9640 1 -- 172.21.15.37:0/2646953240 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee7400db40 con 0x55cbdc9a62d0 2024-04-22T07:21:13.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.698+0000 7fee64ff9640 1 -- 172.21.15.37:0/2646953240 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee74020450 con 0x55cbdc9a62d0 2024-04-22T07:21:13.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.698+0000 7fee87f65740 1 -- 172.21.15.37:0/2646953240 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cbdc9a62d0 msgr2=0x55cbdc9bd900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:13.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.698+0000 7fee87f65740 1 --2- 172.21.15.37:0/2646953240 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cbdc9a62d0 0x55cbdc9bd900 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fee800ce250 tx=0x7fee74010000 comp rx=0 tx=0).stop 2024-04-22T07:21:13.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.698+0000 7fee87f65740 1 -- 172.21.15.37:0/2646953240 shutdown_connections 2024-04-22T07:21:13.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.698+0000 7fee87f65740 1 --2- 172.21.15.37:0/2646953240 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x55cbdc97b810 0x55cbdc9bde40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:13.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.698+0000 7fee87f65740 1 --2- 172.21.15.37:0/2646953240 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cbdc9a62d0 0x55cbdc9bd900 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:13.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.698+0000 7fee87f65740 1 --2- 172.21.15.37:0/2646953240 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55cbdc9bc7d0 0x55cbdc9bcbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:13.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.698+0000 7fee87f65740 1 -- 172.21.15.37:0/2646953240 >> 172.21.15.37:0/2646953240 conn(0x55cbdc979550 msgr2=0x55cbdc97be90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:21:13.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.699+0000 7fee87f65740 1 -- 172.21.15.37:0/2646953240 shutdown_connections 2024-04-22T07:21:13.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.699+0000 7fee87f65740 1 -- 172.21.15.37:0/2646953240 wait complete. 2024-04-22T07:21:13.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.699+0000 7fee87f65740 1 -- start start 2024-04-22T07:21:13.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.699+0000 7fee87f65740 1 Processor -- start 2024-04-22T07:21:13.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.700+0000 7fee87f65740 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x55cbdc9a62d0 0x55cbdc9cdb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:13.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.700+0000 7fee87f65740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cbdc9bc7d0 0x55cbdc99d220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:13.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.700+0000 7fee87f65740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55cbdc9bf110 0x55cbdc9975a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:13.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.700+0000 7fee87f65740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55cbdc97ac30 con 0x55cbdc9bc7d0 2024-04-22T07:21:13.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.700+0000 7fee87f65740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55cbdc89ba60 con 0x55cbdc9bf110 2024-04-22T07:21:13.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.700+0000 7fee87f65740 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x55cbdc9a67a0 con 0x55cbdc9a62d0 2024-04-22T07:21:13.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.700+0000 7fee87f65740 10 client.0 _ll_register_callbacks cb 0x55cbdc5f4110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-22T07:21:13.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.700+0000 7fee7e7fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cbdc9bc7d0 0x55cbdc99d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:13.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.700+0000 7fee7e7fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cbdc9bc7d0 0x55cbdc99d220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48724/0 (socket says 172.21.15.37:48724) 2024-04-22T07:21:13.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.700+0000 7fee7e7fc640 1 -- 172.21.15.37:0/2505925744 learned_addr learned my addr 172.21.15.37:0/2505925744 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:21:13.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.700+0000 7fee7effd640 1 --2- 172.21.15.37:0/2505925744 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x55cbdc9a62d0 0x55cbdc9cdb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:13.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.700+0000 7fee7f7fe640 1 --2- 172.21.15.37:0/2505925744 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55cbdc9bf110 0x55cbdc9975a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:13.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.700+0000 7fee7e7fc640 1 -- 172.21.15.37:0/2505925744 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x55cbdc9a62d0 msgr2=0x55cbdc9cdb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:21:13.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.700+0000 7fee7e7fc640 1 --2- 172.21.15.37:0/2505925744 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x55cbdc9a62d0 0x55cbdc9cdb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:13.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.700+0000 7fee7e7fc640 1 -- 172.21.15.37:0/2505925744 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55cbdc9bf110 msgr2=0x55cbdc9975a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:21:13.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.700+0000 7fee7e7fc640 1 --2- 172.21.15.37:0/2505925744 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55cbdc9bf110 0x55cbdc9975a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:13.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.700+0000 7fee7e7fc640 1 -- 172.21.15.37:0/2505925744 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cbdc5f4920 con 0x55cbdc9bc7d0 2024-04-22T07:21:13.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.700+0000 7fee7f7fe640 1 --2- 172.21.15.37:0/2505925744 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55cbdc9bf110 0x55cbdc9975a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T07:21:13.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.700+0000 7fee7e7fc640 1 --2- 172.21.15.37:0/2505925744 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cbdc9bc7d0 0x55cbdc99d220 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fee8006ce60 tx=0x7fee74012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=132948cf2a314e24 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:13.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.700+0000 7fee5dffb640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-04-22T07:21:13.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.701+0000 7fee5dffb640 1 -- 172.21.15.37:0/2505925744 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee74020660 con 0x55cbdc9bc7d0 2024-04-22T07:21:13.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.701+0000 7fee5dffb640 1 -- 172.21.15.37:0/2505925744 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7fee74020800 con 0x55cbdc9bc7d0 2024-04-22T07:21:13.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.701+0000 7fee87f65740 1 -- 172.21.15.37:0/2505925744 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fee7400db40 con 0x55cbdc9bc7d0 2024-04-22T07:21:13.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.701+0000 7fee5dffb640 1 -- 172.21.15.37:0/2505925744 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7fee74032050 con 0x55cbdc9bc7d0 2024-04-22T07:21:13.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.701+0000 7fee87f65740 10 client.4932 fetch_fsmap learned FSMap version 8 2024-04-22T07:21:13.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.701+0000 7fee87f65740 1 -- 172.21.15.37:0/2505925744 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x55cbdc6c0d30 con 0x55cbdc9bc7d0 2024-04-22T07:21:13.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.701+0000 7fee5dffb640 1 -- 172.21.15.37:0/2505925744 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee7400db40 con 0x55cbdc9bc7d0 2024-04-22T07:21:13.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.701+0000 7fee5dffb640 1 -- 172.21.15.37:0/2505925744 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 8) ==== 4704+0+0 (secure 0 0 0) 0x7fee74035020 con 0x55cbdc9bc7d0 2024-04-22T07:21:13.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.701+0000 7fee87f65740 10 client.4932 fetch_fsmap finished waiting for FSMap version 8 2024-04-22T07:21:13.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.701+0000 7fee87f65740 10 client.4932 resolve_mds: validated gid 4294 aka daemon mds.f 2024-04-22T07:21:13.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.701+0000 7fee87f65740 20 client.4932 populate_metadata read hostname 'smithi037' 2024-04-22T07:21:13.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.701+0000 7fee87f65740 1 --2- 172.21.15.37:0/2505925744 >> [v2:172.21.15.196:6836/3264179771,v1:172.21.15.196:6838/3264179771] conn(0x55cbdc997ae0 0x55cbdc9d10d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:13.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.701+0000 7fee87f65740 4 client.4932 mds_command: new command op to 4294 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-22T07:21:13.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.701+0000 7fee87f65740 1 -- 172.21.15.37:0/2505925744 --> [v2:172.21.15.196:6836/3264179771,v1:172.21.15.196:6838/3264179771] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cbdc8b5a10 con 0x55cbdc997ae0 2024-04-22T07:21:13.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.701+0000 7fee7effd640 1 --2- 172.21.15.37:0/2505925744 >> [v2:172.21.15.196:6836/3264179771,v1:172.21.15.196:6838/3264179771] conn(0x55cbdc997ae0 0x55cbdc9d10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:13.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.702+0000 7fee5dffb640 10 client.4932 ms_handle_connect on v2:172.21.15.196:6836/3264179771 2024-04-22T07:21:13.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.702+0000 7fee7effd640 1 --2- 172.21.15.37:0/2505925744 >> [v2:172.21.15.196:6836/3264179771,v1:172.21.15.196:6838/3264179771] conn(0x55cbdc997ae0 0x55cbdc9d10d0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=59458e42e5e8ca89 server_cookie=ea2109c0958e1570 in_seq=0 out_seq=0 2024-04-22T07:21:13.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.702+0000 7fee5dffb640 1 -- 172.21.15.37:0/2505925744 <== mds.0 v2:172.21.15.196:6836/3264179771 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55cbdc8b5a10 con 0x55cbdc997ae0 2024-04-22T07:21:13.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.702+0000 7fee5dffb640 10 client.4932 handle_command_reply: tid=0 2024-04-22T07:21:13.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.702+0000 7fee87f65740 1 client.4932 shutdown 2024-04-22T07:21:13.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.703+0000 7fee87f65740 1 -- 172.21.15.37:0/2505925744 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cbdc9bc7d0 msgr2=0x55cbdc99d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:13.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.703+0000 7fee87f65740 1 --2- 172.21.15.37:0/2505925744 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cbdc9bc7d0 0x55cbdc99d220 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fee8006ce60 tx=0x7fee74012000 comp rx=0 tx=0).stop 2024-04-22T07:21:13.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.703+0000 7fee87f65740 1 -- 172.21.15.37:0/2505925744 shutdown_connections 2024-04-22T07:21:13.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.703+0000 7fee87f65740 1 --2- 172.21.15.37:0/2505925744 >> [v2:172.21.15.196:6836/3264179771,v1:172.21.15.196:6838/3264179771] conn(0x55cbdc997ae0 0x55cbdc9d10d0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:13.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.703+0000 7fee87f65740 1 --2- 172.21.15.37:0/2505925744 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55cbdc9bf110 0x55cbdc9975a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:13.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.703+0000 7fee87f65740 1 --2- 172.21.15.37:0/2505925744 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cbdc9bc7d0 0x55cbdc99d220 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:13.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.703+0000 7fee5dffb640 0 client.4932 ms_handle_reset on v2:172.21.15.196:6836/3264179771 2024-04-22T07:21:13.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.703+0000 7fee87f65740 1 --2- 172.21.15.37:0/2505925744 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x55cbdc9a62d0 0x55cbdc9cdb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:13.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.703+0000 7fee87f65740 1 -- 172.21.15.37:0/2505925744 >> 172.21.15.37:0/2505925744 conn(0x55cbdc97b810 msgr2=0x55cbdc99dc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:21:13.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.703+0000 7fee87f65740 1 -- 172.21.15.37:0/2505925744 shutdown_connections 2024-04-22T07:21:13.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.703+0000 7fee87f65740 1 -- 172.21.15.37:0/2505925744 wait complete. 2024-04-22T07:21:13.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.703+0000 7fee87f65740 20 client.4932 trim_cache size 0 max 16384 2024-04-22T07:21:13.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.720+0000 7fee87f65740 1 Processor -- start 2024-04-22T07:21:13.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.720+0000 7fee87f65740 1 -- start start 2024-04-22T07:21:13.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.721+0000 7fee87f65740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cbdc9a62d0 0x55cbdc9be600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:13.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.721+0000 7fee87f65740 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x55cbdc9bc7d0 0x55cbdc9e1740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:13.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.721+0000 7fee87f65740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55cbdc9bf110 0x55cbdc9e1c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:13.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.721+0000 7fee87f65740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fee801fde70 con 0x55cbdc9a62d0 2024-04-22T07:21:13.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.721+0000 7fee87f65740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fee80140860 con 0x55cbdc9bf110 2024-04-22T07:21:13.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.721+0000 7fee87f65740 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fee80155c40 con 0x55cbdc9bc7d0 2024-04-22T07:21:13.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.721+0000 7fee7effd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cbdc9a62d0 0x55cbdc9be600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:13.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.721+0000 7fee7effd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cbdc9a62d0 0x55cbdc9be600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48734/0 (socket says 172.21.15.37:48734) 2024-04-22T07:21:13.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.721+0000 7fee7effd640 1 -- 172.21.15.37:0/3464908703 learned_addr learned my addr 172.21.15.37:0/3464908703 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:21:13.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.721+0000 7fee7effd640 1 -- 172.21.15.37:0/3464908703 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x55cbdc9bc7d0 msgr2=0x55cbdc9e1740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:21:13.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.721+0000 7fee7effd640 1 --2- 172.21.15.37:0/3464908703 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x55cbdc9bc7d0 0x55cbdc9e1740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:13.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.721+0000 7fee7effd640 1 -- 172.21.15.37:0/3464908703 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55cbdc9bf110 msgr2=0x55cbdc9e1c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:21:13.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.721+0000 7fee7effd640 1 --2- 172.21.15.37:0/3464908703 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55cbdc9bf110 0x55cbdc9e1c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:13.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.721+0000 7fee7effd640 1 -- 172.21.15.37:0/3464908703 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cbdc979ae0 con 0x55cbdc9a62d0 2024-04-22T07:21:13.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.721+0000 7fee7effd640 1 --2- 172.21.15.37:0/3464908703 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cbdc9a62d0 0x55cbdc9be600 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fee7807c010 tx=0x7fee78043040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ea7e6de67ad4af9 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:13.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.721+0000 7fee5ffff640 1 -- 172.21.15.37:0/3464908703 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee78080430 con 0x55cbdc9a62d0 2024-04-22T07:21:13.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.721+0000 7fee5ffff640 1 -- 172.21.15.37:0/3464908703 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee78084c60 con 0x55cbdc9a62d0 2024-04-22T07:21:13.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.721+0000 7fee5ffff640 1 -- 172.21.15.37:0/3464908703 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee7807a120 con 0x55cbdc9a62d0 2024-04-22T07:21:13.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.722+0000 7fee87f65740 1 -- 172.21.15.37:0/3464908703 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cbdc9a62d0 msgr2=0x55cbdc9be600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:13.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.722+0000 7fee87f65740 1 --2- 172.21.15.37:0/3464908703 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cbdc9a62d0 0x55cbdc9be600 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fee7807c010 tx=0x7fee78043040 comp rx=0 tx=0).stop 2024-04-22T07:21:13.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.722+0000 7fee87f65740 1 -- 172.21.15.37:0/3464908703 shutdown_connections 2024-04-22T07:21:13.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.722+0000 7fee87f65740 1 --2- 172.21.15.37:0/3464908703 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55cbdc9bf110 0x55cbdc9e1c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:13.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.722+0000 7fee87f65740 1 --2- 172.21.15.37:0/3464908703 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x55cbdc9bc7d0 0x55cbdc9e1740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:13.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.722+0000 7fee87f65740 1 --2- 172.21.15.37:0/3464908703 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cbdc9a62d0 0x55cbdc9be600 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:13.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.722+0000 7fee87f65740 1 -- 172.21.15.37:0/3464908703 >> 172.21.15.37:0/3464908703 conn(0x55cbdc97b810 msgr2=0x55cbdc997370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:21:13.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.722+0000 7fee87f65740 1 -- 172.21.15.37:0/3464908703 shutdown_connections 2024-04-22T07:21:13.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.722+0000 7fee87f65740 1 -- 172.21.15.37:0/3464908703 wait complete. 2024-04-22T07:21:13.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.722+0000 7fee87f65740 1 -- start start 2024-04-22T07:21:13.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.722+0000 7fee87f65740 1 Processor -- start 2024-04-22T07:21:13.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.723+0000 7fee87f65740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55cbdc9a62d0 0x55cbdc9e0b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:13.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.723+0000 7fee87f65740 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x55cbdc9bc7d0 0x55cbdc9c9030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:13.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.723+0000 7fee87f65740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cbdc9bf110 0x55cbdca30ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:13.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.723+0000 7fee87f65740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fee80156290 con 0x55cbdc9bf110 2024-04-22T07:21:13.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.723+0000 7fee87f65740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fee801401b0 con 0x55cbdc9a62d0 2024-04-22T07:21:13.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.723+0000 7fee87f65740 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fee8013fb60 con 0x55cbdc9bc7d0 2024-04-22T07:21:13.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.723+0000 7fee87f65740 10 client.0 _ll_register_callbacks cb 0x7fee74007260 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-22T07:21:13.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.723+0000 7fee7f7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cbdc9bf110 0x55cbdca30ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:13.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.723+0000 7fee7f7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cbdc9bf110 0x55cbdca30ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48744/0 (socket says 172.21.15.37:48744) 2024-04-22T07:21:13.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.723+0000 7fee7f7fe640 1 -- 172.21.15.37:0/3950136885 learned_addr learned my addr 172.21.15.37:0/3950136885 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:21:13.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.723+0000 7fee7effd640 1 --2- 172.21.15.37:0/3950136885 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55cbdc9a62d0 0x55cbdc9e0b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:13.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.723+0000 7fee7e7fc640 1 --2- 172.21.15.37:0/3950136885 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x55cbdc9bc7d0 0x55cbdc9c9030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:13.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.724+0000 7fee7f7fe640 1 -- 172.21.15.37:0/3950136885 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x55cbdc9bc7d0 msgr2=0x55cbdc9c9030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:21:13.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.724+0000 7fee7f7fe640 1 --2- 172.21.15.37:0/3950136885 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x55cbdc9bc7d0 0x55cbdc9c9030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:13.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.724+0000 7fee7f7fe640 1 -- 172.21.15.37:0/3950136885 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55cbdc9a62d0 msgr2=0x55cbdc9e0b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:21:13.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.724+0000 7fee7f7fe640 1 --2- 172.21.15.37:0/3950136885 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55cbdc9a62d0 0x55cbdc9e0b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:13.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.724+0000 7fee7f7fe640 1 -- 172.21.15.37:0/3950136885 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cbdc9bc0c0 con 0x55cbdc9bf110 2024-04-22T07:21:13.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.724+0000 7fee7f7fe640 1 --2- 172.21.15.37:0/3950136885 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cbdc9bf110 0x55cbdca30ca0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fee7000caa0 tx=0x7fee7000cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44ce1fac5dcb78e4 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:13.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.724+0000 7fee5dffb640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-04-22T07:21:13.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.724+0000 7fee5dffb640 1 -- 172.21.15.37:0/3950136885 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee7001c060 con 0x55cbdc9bf110 2024-04-22T07:21:13.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.724+0000 7fee5dffb640 1 -- 172.21.15.37:0/3950136885 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7fee700173f0 con 0x55cbdc9bf110 2024-04-22T07:21:13.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.724+0000 7fee87f65740 1 -- 172.21.15.37:0/3950136885 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fee78084c60 con 0x55cbdc9bf110 2024-04-22T07:21:13.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.724+0000 7fee5dffb640 1 -- 172.21.15.37:0/3950136885 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7fee70022050 con 0x55cbdc9bf110 2024-04-22T07:21:13.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.724+0000 7fee87f65740 10 client.4938 fetch_fsmap learned FSMap version 8 2024-04-22T07:21:13.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.724+0000 7fee87f65740 1 -- 172.21.15.37:0/3950136885 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x55cbdc9c9570 con 0x55cbdc9bf110 2024-04-22T07:21:13.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.724+0000 7fee5dffb640 1 -- 172.21.15.37:0/3950136885 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee78084c60 con 0x55cbdc9bf110 2024-04-22T07:21:13.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.724+0000 7fee5dffb640 1 -- 172.21.15.37:0/3950136885 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 8) ==== 4704+0+0 (secure 0 0 0) 0x7fee70025020 con 0x55cbdc9bf110 2024-04-22T07:21:13.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.724+0000 7fee87f65740 10 client.4938 fetch_fsmap finished waiting for FSMap version 8 2024-04-22T07:21:13.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.724+0000 7fee87f65740 10 client.4938 resolve_mds: validated gid 4294 aka daemon mds.f 2024-04-22T07:21:13.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.724+0000 7fee87f65740 20 client.4938 populate_metadata read hostname 'smithi037' 2024-04-22T07:21:13.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.724+0000 7fee87f65740 1 --2- 172.21.15.37:0/3950136885 >> [v2:172.21.15.196:6836/3264179771,v1:172.21.15.196:6838/3264179771] conn(0x55cbdca311e0 0x55cbdca3a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:13.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.724+0000 7fee87f65740 4 client.4938 mds_command: new command op to 4294 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "68852394", "release": true, "await": true}] 2024-04-22T07:21:13.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.724+0000 7fee87f65740 1 -- 172.21.15.37:0/3950136885 --> [v2:172.21.15.196:6836/3264179771,v1:172.21.15.196:6838/3264179771] -- command(tid 0: {"prefix": "quiesce db", "set_id": "68852394", "release": true, "await": true}) -- 0x55cbdc8eff20 con 0x55cbdca311e0 2024-04-22T07:21:13.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.725+0000 7fee7effd640 1 --2- 172.21.15.37:0/3950136885 >> [v2:172.21.15.196:6836/3264179771,v1:172.21.15.196:6838/3264179771] conn(0x55cbdca311e0 0x55cbdca3a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:13.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.725+0000 7fee7effd640 1 --2- 172.21.15.37:0/3950136885 >> [v2:172.21.15.196:6836/3264179771,v1:172.21.15.196:6838/3264179771] conn(0x55cbdca311e0 0x55cbdca3a580 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9f65d089ad2754f0 server_cookie=56050f8e746dc986 in_seq=0 out_seq=0 2024-04-22T07:21:13.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.725+0000 7fee5dffb640 10 client.4938 ms_handle_connect on v2:172.21.15.196:6836/3264179771 2024-04-22T07:21:13.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.725+0000 7fee5dffb640 1 -- 172.21.15.37:0/3950136885 <== mds.0 v2:172.21.15.196:6836/3264179771 1 ==== command_reply(tid 0: 0 ) ==== 8+0+586 (crc 0 0 0) 0x55cbdc8eff20 con 0x55cbdca311e0 2024-04-22T07:21:13.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.725+0000 7fee5dffb640 10 client.4938 handle_command_reply: tid=0 2024-04-22T07:21:13.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.725+0000 7fee87f65740 1 client.4938 shutdown 2024-04-22T07:21:13.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.725+0000 7fee87f65740 1 -- 172.21.15.37:0/3950136885 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cbdc9bf110 msgr2=0x55cbdca30ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:13.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.725+0000 7fee87f65740 1 --2- 172.21.15.37:0/3950136885 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cbdc9bf110 0x55cbdca30ca0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fee7000caa0 tx=0x7fee7000cf60 comp rx=0 tx=0).stop 2024-04-22T07:21:13.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.725+0000 7fee87f65740 1 -- 172.21.15.37:0/3950136885 shutdown_connections 2024-04-22T07:21:13.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.725+0000 7fee87f65740 1 --2- 172.21.15.37:0/3950136885 >> [v2:172.21.15.196:6836/3264179771,v1:172.21.15.196:6838/3264179771] conn(0x55cbdca311e0 0x55cbdca3a580 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:13.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.725+0000 7fee5dffb640 0 client.4938 ms_handle_reset on v2:172.21.15.196:6836/3264179771 2024-04-22T07:21:13.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.725+0000 7fee87f65740 1 --2- 172.21.15.37:0/3950136885 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cbdc9bf110 0x55cbdca30ca0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:13.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.725+0000 7fee87f65740 1 --2- 172.21.15.37:0/3950136885 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x55cbdc9bc7d0 0x55cbdc9c9030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:13.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.725+0000 7fee87f65740 1 --2- 172.21.15.37:0/3950136885 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55cbdc9a62d0 0x55cbdc9e0b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:13.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.725+0000 7fee87f65740 1 -- 172.21.15.37:0/3950136885 >> 172.21.15.37:0/3950136885 conn(0x55cbdc97b810 msgr2=0x55cbdc9be600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:21:13.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.725+0000 7fee87f65740 1 -- 172.21.15.37:0/3950136885 shutdown_connections 2024-04-22T07:21:13.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.725+0000 7fee87f65740 1 -- 172.21.15.37:0/3950136885 wait complete. 2024-04-22T07:21:13.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.726+0000 7fee87f65740 20 client.4938 trim_cache size 0 max 16384 2024-04-22T07:21:13.729 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-04-22T07:21:13.730 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 8, 2024-04-22T07:21:13.730 INFO:teuthology.orchestra.run.smithi037.stdout: "leader": 4294, 2024-04-22T07:21:13.730 INFO:teuthology.orchestra.run.smithi037.stdout: "set_version": 8, 2024-04-22T07:21:13.730 INFO:teuthology.orchestra.run.smithi037.stdout: "sets": { 2024-04-22T07:21:13.730 INFO:teuthology.orchestra.run.smithi037.stdout: "68852394": { 2024-04-22T07:21:13.730 INFO:teuthology.orchestra.run.smithi037.stdout: "version": 8, 2024-04-22T07:21:13.730 INFO:teuthology.orchestra.run.smithi037.stdout: "age_ref": 0.0, 2024-04-22T07:21:13.730 INFO:teuthology.orchestra.run.smithi037.stdout: "state": { 2024-04-22T07:21:13.730 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "RELEASED", 2024-04-22T07:21:13.730 INFO:teuthology.orchestra.run.smithi037.stdout: "age": 0.0 2024-04-22T07:21:13.730 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-04-22T07:21:13.731 INFO:teuthology.orchestra.run.smithi037.stdout: "timeout": 60.0, 2024-04-22T07:21:13.731 INFO:teuthology.orchestra.run.smithi037.stdout: "expiration": 89.8, 2024-04-22T07:21:13.731 INFO:teuthology.orchestra.run.smithi037.stdout: "members": { 2024-04-22T07:21:13.731 INFO:teuthology.orchestra.run.smithi037.stdout: "file:/": { 2024-04-22T07:21:13.731 INFO:teuthology.orchestra.run.smithi037.stdout: "excluded": false, 2024-04-22T07:21:13.731 INFO:teuthology.orchestra.run.smithi037.stdout: "state": { 2024-04-22T07:21:13.731 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "RELEASED", 2024-04-22T07:21:13.731 INFO:teuthology.orchestra.run.smithi037.stdout: "age": 0.0 2024-04-22T07:21:13.731 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-04-22T07:21:13.731 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-04-22T07:21:13.731 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-04-22T07:21:13.731 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-04-22T07:21:13.731 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-04-22T07:21:13.731 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-04-22T07:21:13.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.726+0000 7fee85293640 1 -- 172.21.15.37:0/2654940026 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fee6c06c920 msgr2=0x7fee6c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:13.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.726+0000 7fee85293640 1 --2- 172.21.15.37:0/2654940026 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fee6c06c920 0x7fee6c06ede0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fee74007fd0 tx=0x7fee74009040 comp rx=0 tx=0).stop 2024-04-22T07:21:13.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.726+0000 7fee85293640 1 -- 172.21.15.37:0/2654940026 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee800cb0b0 msgr2=0x7fee80157810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:13.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.726+0000 7fee85293640 1 --2- 172.21.15.37:0/2654940026 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee800cb0b0 0x7fee80157810 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fee78009870 tx=0x7fee78004730 comp rx=0 tx=0).stop 2024-04-22T07:21:13.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.726+0000 7fee85293640 1 -- 172.21.15.37:0/2654940026 shutdown_connections 2024-04-22T07:21:13.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.726+0000 7fee85293640 1 --2- 172.21.15.37:0/2654940026 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fee6c06c920 0x7fee6c06ede0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:13.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.726+0000 7fee85293640 1 --2- 172.21.15.37:0/2654940026 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fee801551f0 0x7fee801f5100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:13.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.726+0000 7fee85293640 1 --2- 172.21.15.37:0/2654940026 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fee800cde00 0x7fee80153ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:13.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.726+0000 7fee85293640 1 --2- 172.21.15.37:0/2654940026 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee800cb0b0 0x7fee80157810 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:13.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.726+0000 7fee85293640 1 -- 172.21.15.37:0/2654940026 >> 172.21.15.37:0/2654940026 conn(0x7fee8006c410 msgr2=0x7fee800624b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:21:13.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.726+0000 7fee85293640 1 -- 172.21.15.37:0/2654940026 shutdown_connections 2024-04-22T07:21:13.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.726+0000 7fee85293640 1 -- 172.21.15.37:0/2654940026 wait complete. 2024-04-22T07:21:13.736 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set_id: 68852394, seconds elapsed: 31.4 2024-04-22T07:21:13.736 INFO:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 29.85 2024-04-22T07:21:13.737 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-22T07:21:13.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.847+0000 7f9226d2b640 1 Processor -- start 2024-04-22T07:21:13.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.847+0000 7f9226d2b640 1 -- start start 2024-04-22T07:21:13.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.848+0000 7f9226d2b640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9220151ec0 0x7f92200c9590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:13.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.848+0000 7f9226d2b640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f92200c9060 0x7f922006be00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:13.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.848+0000 7f9226d2b640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9220157c70 con 0x7f92200c9ad0 2024-04-22T07:21:13.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.848+0000 7f9226d2b640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f922006b970 con 0x7f92200c9060 2024-04-22T07:21:13.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.848+0000 7f9226d2b640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f9220157f50 con 0x7f9220151ec0 2024-04-22T07:21:13.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.848+0000 7f92252c8640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f92200c9060 0x7f922006be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:13.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.848+0000 7f92252c8640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f92200c9060 0x7f922006be00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48746/0 (socket says 172.21.15.37:48746) 2024-04-22T07:21:13.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.848+0000 7f92252c8640 1 -- 172.21.15.37:0/2153726304 learned_addr learned my addr 172.21.15.37:0/2153726304 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:21:13.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.848+0000 7f9224ac7640 1 --2- 172.21.15.37:0/2153726304 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9220151ec0 0x7f92200c9590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:13.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.849+0000 7f92252c8640 1 -- 172.21.15.37:0/2153726304 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9220151ec0 msgr2=0x7f92200c9590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:21:13.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.849+0000 7f92252c8640 1 --2- 172.21.15.37:0/2153726304 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9220151ec0 0x7f92200c9590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:13.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.849+0000 7f92252c8640 1 -- 172.21.15.37:0/2153726304 >> v1:172.21.15.196:6789/0 conn(0x7f92200c9ad0 legacy=0x7f92200c48f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:13.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.849+0000 7f921f7fe640 1 -- 172.21.15.37:0/2153726304 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2680964944 0 0) 0x7f9220157c70 con 0x7f92200c9ad0 2024-04-22T07:21:13.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.849+0000 7f92252c8640 1 -- 172.21.15.37:0/2153726304 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9220158230 con 0x7f92200c9060 2024-04-22T07:21:13.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.850+0000 7f92252c8640 1 --2- 172.21.15.37:0/2153726304 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f92200c9060 0x7f922006be00 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f921800d150 tx=0x7f921802e1f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dca02fb2beb9d58a server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:13.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.850+0000 7f921f7fe640 1 -- 172.21.15.37:0/2153726304 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f921800b0d0 con 0x7f92200c9060 2024-04-22T07:21:13.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.850+0000 7f921f7fe640 1 -- 172.21.15.37:0/2153726304 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f921800b270 con 0x7f92200c9060 2024-04-22T07:21:13.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.850+0000 7f921f7fe640 1 -- 172.21.15.37:0/2153726304 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9218009600 con 0x7f92200c9060 2024-04-22T07:21:13.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.851+0000 7f9226d2b640 1 -- 172.21.15.37:0/2153726304 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f92200c9060 msgr2=0x7f922006be00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:13.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.851+0000 7f9226d2b640 1 --2- 172.21.15.37:0/2153726304 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f92200c9060 0x7f922006be00 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f921800d150 tx=0x7f921802e1f0 comp rx=0 tx=0).stop 2024-04-22T07:21:13.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.851+0000 7f9226d2b640 1 -- 172.21.15.37:0/2153726304 shutdown_connections 2024-04-22T07:21:13.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.851+0000 7f9226d2b640 1 --2- 172.21.15.37:0/2153726304 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f92200c9060 0x7f922006be00 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:13.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.851+0000 7f9226d2b640 1 --2- 172.21.15.37:0/2153726304 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9220151ec0 0x7f92200c9590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:13.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.851+0000 7f9226d2b640 1 -- 172.21.15.37:0/2153726304 >> 172.21.15.37:0/2153726304 conn(0x7f92200c9ef0 msgr2=0x7f92200ca2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:21:13.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.851+0000 7f9226d2b640 1 -- 172.21.15.37:0/2153726304 shutdown_connections 2024-04-22T07:21:13.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.851+0000 7f9226d2b640 1 -- 172.21.15.37:0/2153726304 wait complete. 2024-04-22T07:21:13.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.852+0000 7f9226d2b640 1 Processor -- start 2024-04-22T07:21:13.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.852+0000 7f9226d2b640 1 -- start start 2024-04-22T07:21:13.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.853+0000 7f9226d2b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f92200c9060 0x7f922015a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:13.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.853+0000 7f9226d2b640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f92200c9ad0 0x7f9220144c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:13.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.853+0000 7f9226d2b640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9220151ec0 0x7f92201451a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:13.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.853+0000 7f9226d2b640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f92200c5000 con 0x7f92200c9060 2024-04-22T07:21:13.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.853+0000 7f9226d2b640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f92201587f0 con 0x7f92200c9ad0 2024-04-22T07:21:13.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.853+0000 7f9226d2b640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f92200c5180 con 0x7f9220151ec0 2024-04-22T07:21:13.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.853+0000 7f9224ac7640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f92200c9060 0x7f922015a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:13.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.853+0000 7f9224ac7640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f92200c9060 0x7f922015a800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48750/0 (socket says 172.21.15.37:48750) 2024-04-22T07:21:13.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.853+0000 7f9224ac7640 1 -- 172.21.15.37:0/3359954695 learned_addr learned my addr 172.21.15.37:0/3359954695 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:21:13.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.853+0000 7f92252c8640 1 --2- 172.21.15.37:0/3359954695 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9220151ec0 0x7f92201451a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:13.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.853+0000 7f921ffff640 1 --2- 172.21.15.37:0/3359954695 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f92200c9ad0 0x7f9220144c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:13.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.854+0000 7f9224ac7640 1 -- 172.21.15.37:0/3359954695 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9220151ec0 msgr2=0x7f92201451a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:13.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.854+0000 7f9224ac7640 1 --2- 172.21.15.37:0/3359954695 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9220151ec0 0x7f92201451a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:13.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.854+0000 7f9224ac7640 1 -- 172.21.15.37:0/3359954695 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f92200c9ad0 msgr2=0x7f9220144c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:13.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.854+0000 7f9224ac7640 1 --2- 172.21.15.37:0/3359954695 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f92200c9ad0 0x7f9220144c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:13.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.854+0000 7f9224ac7640 1 -- 172.21.15.37:0/3359954695 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9220159020 con 0x7f92200c9060 2024-04-22T07:21:13.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.854+0000 7f9224ac7640 1 --2- 172.21.15.37:0/3359954695 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f92200c9060 0x7f922015a800 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f921400e9b0 tx=0x7f921400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:13.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.854+0000 7f921d7fa640 1 -- 172.21.15.37:0/3359954695 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9214017070 con 0x7f92200c9060 2024-04-22T07:21:13.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.854+0000 7f921d7fa640 1 -- 172.21.15.37:0/3359954695 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f921400c9a0 con 0x7f92200c9060 2024-04-22T07:21:13.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.854+0000 7f921d7fa640 1 -- 172.21.15.37:0/3359954695 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f921400cd90 con 0x7f92200c9060 2024-04-22T07:21:13.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.854+0000 7f9226d2b640 1 -- 172.21.15.37:0/3359954695 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f922015b710 con 0x7f92200c9060 2024-04-22T07:21:13.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.854+0000 7f9226d2b640 1 -- 172.21.15.37:0/3359954695 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9220143b80 con 0x7f92200c9060 2024-04-22T07:21:13.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.855+0000 7f9226d2b640 1 -- 172.21.15.37:0/3359954695 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9220069cc0 con 0x7f92200c9060 2024-04-22T07:21:13.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.856+0000 7f921d7fa640 1 -- 172.21.15.37:0/3359954695 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f921401a070 con 0x7f92200c9060 2024-04-22T07:21:13.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.856+0000 7f921d7fa640 1 --2- 172.21.15.37:0/3359954695 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f920406c8f0 0x7f920406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:13.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.856+0000 7f921d7fa640 1 -- 172.21.15.37:0/3359954695 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f921408bef0 con 0x7f92200c9060 2024-04-22T07:21:13.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.856+0000 7f921ffff640 1 --2- 172.21.15.37:0/3359954695 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f920406c8f0 0x7f920406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:13.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.857+0000 7f921ffff640 1 --2- 172.21.15.37:0/3359954695 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f920406c8f0 0x7f920406edb0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f922014bde0 tx=0x7f920c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:13.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:13.861+0000 7f921d7fa640 1 -- 172.21.15.37:0/3359954695 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f9220069cc0 con 0x7f92200c9060 2024-04-22T07:21:14.213 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-22T07:21:14.213 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4265,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6839/671847354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6835","nonce":671847354},{"type":"v1","addr":"172.21.15.196:6839","nonce":671847354}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6833/1549427395","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1549427395},{"type":"v1","addr":"172.21.15.37:6833","nonce":1549427395}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6836/3825988951","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":3825988951},{"type":"v1","addr":"172.21.15.37:6836","nonce":3825988951}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4272,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/611771502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6835","nonce":611771502},{"type":"v1","addr":"172.21.15.37:6837","nonce":611771502}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4291,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6837/3055080225","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6834","nonce":3055080225},{"type":"v1","addr":"172.21.15.196:6837","nonce":3055080225}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-22T07:18:36.111618+0000","modified":"2024-04-22T07:18:41.783857+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.196:6838/3264179771","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6836","nonce":3264179771},{"type":"v1","addr":"172.21.15.196:6838","nonce":3264179771}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4294,"qdb_cluster":[4294]},"id":1}]} 2024-04-22T07:21:14.214 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 8 2024-04-22T07:21:14.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.210+0000 7f9226d2b640 1 -- 172.21.15.37:0/3359954695 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9220157c70 con 0x7f92200c9060 2024-04-22T07:21:14.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.211+0000 7f921d7fa640 1 -- 172.21.15.37:0/3359954695 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6827 (secure 0 0 0) 0x7f9220157c70 con 0x7f92200c9060 2024-04-22T07:21:14.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.221+0000 7f9226d2b640 1 -- 172.21.15.37:0/3359954695 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f920406c8f0 msgr2=0x7f920406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:14.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.221+0000 7f9226d2b640 1 --2- 172.21.15.37:0/3359954695 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f920406c8f0 0x7f920406edb0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f922014bde0 tx=0x7f920c009040 comp rx=0 tx=0).stop 2024-04-22T07:21:14.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.222+0000 7f9226d2b640 1 -- 172.21.15.37:0/3359954695 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f92200c9060 msgr2=0x7f922015a800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:14.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.222+0000 7f9226d2b640 1 --2- 172.21.15.37:0/3359954695 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f92200c9060 0x7f922015a800 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f921400e9b0 tx=0x7f921400ee70 comp rx=0 tx=0).stop 2024-04-22T07:21:14.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.222+0000 7f9226d2b640 1 -- 172.21.15.37:0/3359954695 shutdown_connections 2024-04-22T07:21:14.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.222+0000 7f9226d2b640 1 --2- 172.21.15.37:0/3359954695 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f920406c8f0 0x7f920406edb0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:14.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.222+0000 7f9226d2b640 1 --2- 172.21.15.37:0/3359954695 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9220151ec0 0x7f92201451a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:14.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.222+0000 7f9226d2b640 1 --2- 172.21.15.37:0/3359954695 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f92200c9ad0 0x7f9220144c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:14.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.222+0000 7f9226d2b640 1 --2- 172.21.15.37:0/3359954695 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f92200c9060 0x7f922015a800 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:14.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.222+0000 7f9226d2b640 1 -- 172.21.15.37:0/3359954695 >> 172.21.15.37:0/3359954695 conn(0x7f92200c9ef0 msgr2=0x7f9220147a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:21:14.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.223+0000 7f9226d2b640 1 -- 172.21.15.37:0/3359954695 shutdown_connections 2024-04-22T07:21:14.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.223+0000 7f9226d2b640 1 -- 172.21.15.37:0/3359954695 wait complete. 2024-04-22T07:21:14.254 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4294 quiesce db / --timeout 60 --expiration 89.85 --await' 2024-04-22T07:21:14.254 DEBUG:teuthology.orchestra.run.smithi037:> timeout 75 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4294 quiesce db / --timeout 60 --expiration 89.85 --await 2024-04-22T07:21:14.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.456+0000 7fbb8872e640 1 Processor -- start 2024-04-22T07:21:14.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.456+0000 7fbb8872e640 1 -- start start 2024-04-22T07:21:14.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.457+0000 7fbb8872e640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fbb800b3190 0x7fbb800b35e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:14.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.457+0000 7fbb8872e640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb800b3bd0 con 0x7fbb800ccd20 2024-04-22T07:21:14.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.457+0000 7fbb8872e640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb800b3eb0 con 0x7fbb80155250 2024-04-22T07:21:14.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.457+0000 7fbb8872e640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7fbb800cb6a0 con 0x7fbb800b3190 2024-04-22T07:21:14.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.457+0000 7fbb86ccb640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fbb800ccd20 0x7fbb800cd170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:59652/0 (socket says 172.21.15.37:59652) 2024-04-22T07:21:14.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.457+0000 7fbb86ccb640 1 -- 172.21.15.37:0/1902185095 learned_addr learned my addr 172.21.15.37:0/1902185095 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-04-22T07:21:14.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.457+0000 7fbb854c8640 1 -- 172.21.15.37:0/1902185095 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2536475345 0 0) 0x7fbb800b3bd0 con 0x7fbb800ccd20 2024-04-22T07:21:14.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.457+0000 7fbb854c8640 1 -- 172.21.15.37:0/1902185095 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbb6c003520 con 0x7fbb800ccd20 2024-04-22T07:21:14.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.457+0000 7fbb854c8640 1 -- 172.21.15.37:0/1902185095 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3058873257 0 0) 0x7fbb6c003520 con 0x7fbb800ccd20 2024-04-22T07:21:14.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.457+0000 7fbb854c8640 1 -- 172.21.15.37:0/1902185095 >> v2:172.21.15.196:3300/0 conn(0x7fbb800b3190 msgr2=0x7fbb800b35e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:21:14.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.457+0000 7fbb85cc9640 1 --2- 172.21.15.37:0/1902185095 >> v2:172.21.15.196:3300/0 conn(0x7fbb800b3190 0x7fbb800b35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:14.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.458+0000 7fbb854c8640 1 --2- 172.21.15.37:0/1902185095 >> v2:172.21.15.196:3300/0 conn(0x7fbb800b3190 0x7fbb800b35e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:14.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.458+0000 7fbb854c8640 1 -- 172.21.15.37:0/1902185095 >> v1:172.21.15.196:6789/0 conn(0x7fbb80155250 legacy=0x7fbb8015af40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:21:14.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.458+0000 7fbb854c8640 1 -- 172.21.15.37:0/1902185095 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb8015e700 con 0x7fbb800ccd20 2024-04-22T07:21:14.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.458+0000 7fbb854c8640 1 -- 172.21.15.37:0/1902185095 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2576656170 0 0) 0x7fbb780019f0 con 0x7fbb800ccd20 2024-04-22T07:21:14.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.458+0000 7fbb85cc9640 1 --2- 172.21.15.37:0/1902185095 >> v2:172.21.15.196:3300/0 conn(0x7fbb800b3190 0x7fbb800b35e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-22T07:21:14.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.458+0000 7fbb854c8640 1 -- 172.21.15.37:0/1902185095 >> v1:172.21.15.37:6789/0 conn(0x7fbb800ccd20 legacy=0x7fbb800cd170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:14.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.458+0000 7fbb854c8640 1 --2- 172.21.15.37:0/1902185095 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbb6c0039b0 0x7fbb6c003db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:14.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.458+0000 7fbb854c8640 1 --2- 172.21.15.37:0/1902185095 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb6c004800 0x7fbb6c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:14.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.458+0000 7fbb854c8640 1 --2- 172.21.15.37:0/1902185095 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbb6c0052e0 0x7fbb6c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:14.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.458+0000 7fbb854c8640 1 -- 172.21.15.37:0/1902185095 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fbb6c00c1b0 con 0x7fbb6c004800 2024-04-22T07:21:14.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.458+0000 7fbb854c8640 1 -- 172.21.15.37:0/1902185095 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fbb6c00c360 con 0x7fbb6c0052e0 2024-04-22T07:21:14.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.458+0000 7fbb854c8640 1 -- 172.21.15.37:0/1902185095 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fbb6c00c560 con 0x7fbb6c0039b0 2024-04-22T07:21:14.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.458+0000 7fbb85cc9640 1 --2- 172.21.15.37:0/1902185095 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb6c004800 0x7fbb6c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:14.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.458+0000 7fbb85cc9640 1 -- 172.21.15.37:0/1902185095 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbb6c0039b0 msgr2=0x7fbb6c003db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:21:14.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.458+0000 7fbb85cc9640 1 --2- 172.21.15.37:0/1902185095 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbb6c0039b0 0x7fbb6c003db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:14.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.458+0000 7fbb85cc9640 1 -- 172.21.15.37:0/1902185095 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbb6c0052e0 msgr2=0x7fbb6c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:21:14.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.458+0000 7fbb85cc9640 1 --2- 172.21.15.37:0/1902185095 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbb6c0052e0 0x7fbb6c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:14.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.458+0000 7fbb86ccb640 1 -- 172.21.15.37:0/1902185095 reap_dead start 2024-04-22T07:21:14.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.458+0000 7fbb85cc9640 1 -- 172.21.15.37:0/1902185095 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb6c003520 con 0x7fbb6c004800 2024-04-22T07:21:14.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.459+0000 7fbb85cc9640 1 --2- 172.21.15.37:0/1902185095 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb6c004800 0x7fbb6c004c80 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fbb7400aa50 tx=0x7fbb6c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d2a7f44cd69ca93 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:14.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.459+0000 7fbb854c8640 1 -- 172.21.15.37:0/1902185095 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb7400a650 con 0x7fbb6c004800 2024-04-22T07:21:14.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.459+0000 7fbb854c8640 1 -- 172.21.15.37:0/1902185095 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb74037600 con 0x7fbb6c004800 2024-04-22T07:21:14.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.459+0000 7fbb854c8640 1 -- 172.21.15.37:0/1902185095 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb74037a10 con 0x7fbb6c004800 2024-04-22T07:21:14.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.460+0000 7fbb8872e640 1 -- 172.21.15.37:0/1902185095 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb6c004800 msgr2=0x7fbb6c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:14.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.460+0000 7fbb8872e640 1 --2- 172.21.15.37:0/1902185095 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb6c004800 0x7fbb6c004c80 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fbb7400aa50 tx=0x7fbb6c005830 comp rx=0 tx=0).stop 2024-04-22T07:21:14.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.460+0000 7fbb8872e640 1 -- 172.21.15.37:0/1902185095 shutdown_connections 2024-04-22T07:21:14.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.460+0000 7fbb8872e640 1 --2- 172.21.15.37:0/1902185095 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb6c004800 0x7fbb6c004c80 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:14.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.460+0000 7fbb8872e640 1 -- 172.21.15.37:0/1902185095 >> 172.21.15.37:0/1902185095 conn(0x7fbb80071f90 msgr2=0x7fbb800723a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:21:14.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.460+0000 7fbb8872e640 1 -- 172.21.15.37:0/1902185095 shutdown_connections 2024-04-22T07:21:14.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.460+0000 7fbb8872e640 1 -- 172.21.15.37:0/1902185095 wait complete. 2024-04-22T07:21:14.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.462+0000 7fbb8872e640 1 Processor -- start 2024-04-22T07:21:14.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.462+0000 7fbb8872e640 1 -- start start 2024-04-22T07:21:14.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.463+0000 7fbb8872e640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbb6c004800 0x7fbb801522b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:14.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.463+0000 7fbb8872e640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbb80157d40 0x7fbb8014d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:14.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.463+0000 7fbb8872e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb800c7c90 0x7fbb800c8110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:14.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.463+0000 7fbb8872e640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fbb8015ecc0 con 0x7fbb800c7c90 2024-04-22T07:21:14.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.463+0000 7fbb8872e640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fbb8015e4b0 con 0x7fbb6c004800 2024-04-22T07:21:14.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.463+0000 7fbb8872e640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fbb80155630 con 0x7fbb80157d40 2024-04-22T07:21:14.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.463+0000 7fbb86ccb640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb800c7c90 0x7fbb800c8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:14.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.463+0000 7fbb86ccb640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb800c7c90 0x7fbb800c8110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48774/0 (socket says 172.21.15.37:48774) 2024-04-22T07:21:14.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.463+0000 7fbb86ccb640 1 -- 172.21.15.37:0/94962141 learned_addr learned my addr 172.21.15.37:0/94962141 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:21:14.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.463+0000 7fbb86ccb640 1 -- 172.21.15.37:0/94962141 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbb80157d40 msgr2=0x7fbb8014d970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:14.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.463+0000 7fbb86ccb640 1 --2- 172.21.15.37:0/94962141 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbb80157d40 0x7fbb8014d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:14.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.463+0000 7fbb86ccb640 1 -- 172.21.15.37:0/94962141 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbb6c004800 msgr2=0x7fbb801522b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:14.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.463+0000 7fbb86ccb640 1 --2- 172.21.15.37:0/94962141 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbb6c004800 0x7fbb801522b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:14.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.463+0000 7fbb86ccb640 1 -- 172.21.15.37:0/94962141 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb800c8650 con 0x7fbb800c7c90 2024-04-22T07:21:14.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.463+0000 7fbb86ccb640 1 --2- 172.21.15.37:0/94962141 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb800c7c90 0x7fbb800c8110 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fbb8008dd90 tx=0x7fbb7800cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:14.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.464+0000 7fbb72ffd640 1 -- 172.21.15.37:0/94962141 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb7800ce50 con 0x7fbb800c7c90 2024-04-22T07:21:14.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.464+0000 7fbb72ffd640 1 -- 172.21.15.37:0/94962141 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb7800a5b0 con 0x7fbb800c7c90 2024-04-22T07:21:14.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.464+0000 7fbb8872e640 1 -- 172.21.15.37:0/94962141 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb8014e3f0 con 0x7fbb800c7c90 2024-04-22T07:21:14.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.464+0000 7fbb72ffd640 1 -- 172.21.15.37:0/94962141 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb7800a9a0 con 0x7fbb800c7c90 2024-04-22T07:21:14.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.464+0000 7fbb8872e640 1 -- 172.21.15.37:0/94962141 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb80158570 con 0x7fbb800c7c90 2024-04-22T07:21:14.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.465+0000 7fbb72ffd640 1 -- 172.21.15.37:0/94962141 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fbb78011070 con 0x7fbb800c7c90 2024-04-22T07:21:14.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.466+0000 7fbb72ffd640 1 --2- 172.21.15.37:0/94962141 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fbb6406c8f0 0x7fbb6406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:14.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.467+0000 7fbb72ffd640 1 -- 172.21.15.37:0/94962141 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7fbb7808b1b0 con 0x7fbb800c7c90 2024-04-22T07:21:14.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.468+0000 7fbb864ca640 1 --2- 172.21.15.37:0/94962141 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fbb6406c8f0 0x7fbb6406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:14.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.468+0000 7fbb8b3f5740 1 Processor -- start 2024-04-22T07:21:14.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.468+0000 7fbb8b3f5740 1 -- start start 2024-04-22T07:21:14.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.469+0000 7fbb8b3f5740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55cf19907a10 0x55cf19907df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:14.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.469+0000 7fbb8b3f5740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cf19951890 0x55cf19908330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:14.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.469+0000 7fbb8b3f5740 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x55cf19906470 0x55cf19947390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:14.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.469+0000 7fbb8b3f5740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55cf198600b0 con 0x55cf19951890 2024-04-22T07:21:14.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.469+0000 7fbb8b3f5740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55cf19811680 con 0x55cf19907a10 2024-04-22T07:21:14.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.469+0000 7fbb8b3f5740 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x55cf1981dc60 con 0x55cf19906470 2024-04-22T07:21:14.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.469+0000 7fbb85cc9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cf19951890 0x55cf19908330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:14.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.469+0000 7fbb85cc9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cf19951890 0x55cf19908330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48780/0 (socket says 172.21.15.37:48780) 2024-04-22T07:21:14.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.469+0000 7fbb85cc9640 1 -- 172.21.15.37:0/701432568 learned_addr learned my addr 172.21.15.37:0/701432568 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:21:14.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.470+0000 7fbb85cc9640 1 -- 172.21.15.37:0/701432568 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x55cf19906470 msgr2=0x55cf19947390 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-22T07:21:14.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.470+0000 7fbb85cc9640 1 --2- 172.21.15.37:0/701432568 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x55cf19906470 0x55cf19947390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:14.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.470+0000 7fbb85cc9640 1 -- 172.21.15.37:0/701432568 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55cf19907a10 msgr2=0x55cf19907df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:21:14.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.470+0000 7fbb85cc9640 1 --2- 172.21.15.37:0/701432568 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55cf19907a10 0x55cf19907df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:14.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.470+0000 7fbb85cc9640 1 -- 172.21.15.37:0/701432568 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cf19642c90 con 0x55cf19951890 2024-04-22T07:21:14.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.470+0000 7fbb85cc9640 1 --2- 172.21.15.37:0/701432568 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cf19951890 0x55cf19908330 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fbb7400aa50 tx=0x7fbb7402e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a71cc1b305714f59 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:14.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.470+0000 7fbb864ca640 1 --2- 172.21.15.37:0/94962141 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fbb6406c8f0 0x7fbb6406edb0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fbb7c0014e0 tx=0x7fbb7c007990 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:14.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.470+0000 7fbb63fff640 1 -- 172.21.15.37:0/701432568 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb74048070 con 0x55cf19951890 2024-04-22T07:21:14.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.470+0000 7fbb63fff640 1 -- 172.21.15.37:0/701432568 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb740385e0 con 0x55cf19951890 2024-04-22T07:21:14.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.470+0000 7fbb63fff640 1 -- 172.21.15.37:0/701432568 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb74038990 con 0x55cf19951890 2024-04-22T07:21:14.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.471+0000 7fbb8b3f5740 1 -- 172.21.15.37:0/701432568 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cf19951890 msgr2=0x55cf19908330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:14.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.471+0000 7fbb8b3f5740 1 --2- 172.21.15.37:0/701432568 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cf19951890 0x55cf19908330 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fbb7400aa50 tx=0x7fbb7402e000 comp rx=0 tx=0).stop 2024-04-22T07:21:14.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.471+0000 7fbb8b3f5740 1 -- 172.21.15.37:0/701432568 shutdown_connections 2024-04-22T07:21:14.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.471+0000 7fbb8b3f5740 1 --2- 172.21.15.37:0/701432568 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x55cf19906470 0x55cf19947390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:14.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.471+0000 7fbb8b3f5740 1 --2- 172.21.15.37:0/701432568 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cf19951890 0x55cf19908330 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:14.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.471+0000 7fbb8b3f5740 1 --2- 172.21.15.37:0/701432568 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55cf19907a10 0x55cf19907df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:14.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.471+0000 7fbb8b3f5740 1 -- 172.21.15.37:0/701432568 >> 172.21.15.37:0/701432568 conn(0x55cf19904410 msgr2=0x55cf19906ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:21:14.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.471+0000 7fbb8b3f5740 1 -- 172.21.15.37:0/701432568 shutdown_connections 2024-04-22T07:21:14.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.471+0000 7fbb8b3f5740 1 -- 172.21.15.37:0/701432568 wait complete. 2024-04-22T07:21:14.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.472+0000 7fbb8b3f5740 1 -- start start 2024-04-22T07:21:14.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.472+0000 7fbb8b3f5740 1 Processor -- start 2024-04-22T07:21:14.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.473+0000 7fbb8b3f5740 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x55cf19907a10 0x55cf19948c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:14.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.473+0000 7fbb8b3f5740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cf19951890 0x55cf199455a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:14.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.473+0000 7fbb8b3f5740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55cf19950d00 0x55cf199429b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:14.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.474+0000 7fbb8b3f5740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55cf19863400 con 0x55cf19951890 2024-04-22T07:21:14.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.474+0000 7fbb8b3f5740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55cf1981f840 con 0x55cf19950d00 2024-04-22T07:21:14.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.474+0000 7fbb8b3f5740 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x55cf19868720 con 0x55cf19907a10 2024-04-22T07:21:14.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.474+0000 7fbb8b3f5740 10 client.0 _ll_register_callbacks cb 0x55cf19870ea0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-22T07:21:14.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.474+0000 7fbb85cc9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cf19951890 0x55cf199455a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:14.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.474+0000 7fbb85cc9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cf19951890 0x55cf199455a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48782/0 (socket says 172.21.15.37:48782) 2024-04-22T07:21:14.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.474+0000 7fbb85cc9640 1 -- 172.21.15.37:0/336319912 learned_addr learned my addr 172.21.15.37:0/336319912 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:21:14.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.474+0000 7fbb86ccb640 1 --2- 172.21.15.37:0/336319912 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55cf19950d00 0x55cf199429b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:14.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.474+0000 7fbb85cc9640 1 -- 172.21.15.37:0/336319912 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x55cf19907a10 msgr2=0x55cf19948c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:21:14.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.474+0000 7fbb85cc9640 1 --2- 172.21.15.37:0/336319912 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x55cf19907a10 0x55cf19948c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:14.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.474+0000 7fbb85cc9640 1 -- 172.21.15.37:0/336319912 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55cf19950d00 msgr2=0x55cf199429b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:21:14.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.474+0000 7fbb85cc9640 1 --2- 172.21.15.37:0/336319912 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55cf19950d00 0x55cf199429b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:14.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.474+0000 7fbb85cc9640 1 -- 172.21.15.37:0/336319912 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cf196a3420 con 0x55cf19951890 2024-04-22T07:21:14.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.475+0000 7fbb85cc9640 1 --2- 172.21.15.37:0/336319912 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cf19951890 0x55cf199455a0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fbb7400aa50 tx=0x7fbb740046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=457cfb358aae4bd7 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:14.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.475+0000 7fbb617fa640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-04-22T07:21:14.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.475+0000 7fbb617fa640 1 -- 172.21.15.37:0/336319912 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb74053060 con 0x55cf19951890 2024-04-22T07:21:14.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.475+0000 7fbb617fa640 1 -- 172.21.15.37:0/336319912 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7fbb7404e670 con 0x55cf19951890 2024-04-22T07:21:14.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.475+0000 7fbb8b3f5740 1 -- 172.21.15.37:0/336319912 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbb740385e0 con 0x55cf19951890 2024-04-22T07:21:14.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.475+0000 7fbb617fa640 1 -- 172.21.15.37:0/336319912 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7fbb74048040 con 0x55cf19951890 2024-04-22T07:21:14.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.475+0000 7fbb8b3f5740 10 client.4956 fetch_fsmap learned FSMap version 8 2024-04-22T07:21:14.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.475+0000 7fbb8b3f5740 1 -- 172.21.15.37:0/336319912 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x55cf19536580 con 0x55cf19951890 2024-04-22T07:21:14.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.475+0000 7fbb617fa640 1 -- 172.21.15.37:0/336319912 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb740385e0 con 0x55cf19951890 2024-04-22T07:21:14.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.475+0000 7fbb617fa640 1 -- 172.21.15.37:0/336319912 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 8) ==== 4704+0+0 (secure 0 0 0) 0x7fbb7404e870 con 0x55cf19951890 2024-04-22T07:21:14.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.475+0000 7fbb8b3f5740 10 client.4956 fetch_fsmap finished waiting for FSMap version 8 2024-04-22T07:21:14.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.475+0000 7fbb8b3f5740 10 client.4956 resolve_mds: validated gid 4294 aka daemon mds.f 2024-04-22T07:21:14.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.475+0000 7fbb8b3f5740 20 client.4956 populate_metadata read hostname 'smithi037' 2024-04-22T07:21:14.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.475+0000 7fbb8b3f5740 1 --2- 172.21.15.37:0/336319912 >> [v2:172.21.15.196:6836/3264179771,v1:172.21.15.196:6838/3264179771] conn(0x55cf1992d5e0 0x55cf1992d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:14.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.475+0000 7fbb8b3f5740 4 client.4956 mds_command: new command op to 4294 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-22T07:21:14.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.475+0000 7fbb8b3f5740 1 -- 172.21.15.37:0/336319912 --> [v2:172.21.15.196:6836/3264179771,v1:172.21.15.196:6838/3264179771] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cf19871b10 con 0x55cf1992d5e0 2024-04-22T07:21:14.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.476+0000 7fbb864ca640 1 --2- 172.21.15.37:0/336319912 >> [v2:172.21.15.196:6836/3264179771,v1:172.21.15.196:6838/3264179771] conn(0x55cf1992d5e0 0x55cf1992d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:14.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.478+0000 7fbb864ca640 1 --2- 172.21.15.37:0/336319912 >> [v2:172.21.15.196:6836/3264179771,v1:172.21.15.196:6838/3264179771] conn(0x55cf1992d5e0 0x55cf1992d9c0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5c143beaf883f7fa server_cookie=17c5c1d7915ba8d4 in_seq=0 out_seq=0 2024-04-22T07:21:14.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.478+0000 7fbb617fa640 10 client.4956 ms_handle_connect on v2:172.21.15.196:6836/3264179771 2024-04-22T07:21:14.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.480+0000 7fbb617fa640 1 -- 172.21.15.37:0/336319912 <== mds.0 v2:172.21.15.196:6836/3264179771 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55cf19871b10 con 0x55cf1992d5e0 2024-04-22T07:21:14.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.480+0000 7fbb617fa640 10 client.4956 handle_command_reply: tid=0 2024-04-22T07:21:14.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.480+0000 7fbb8b3f5740 1 client.4956 shutdown 2024-04-22T07:21:14.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.480+0000 7fbb8b3f5740 1 -- 172.21.15.37:0/336319912 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cf19951890 msgr2=0x55cf199455a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:14.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.480+0000 7fbb8b3f5740 1 --2- 172.21.15.37:0/336319912 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cf19951890 0x55cf199455a0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fbb7400aa50 tx=0x7fbb740046c0 comp rx=0 tx=0).stop 2024-04-22T07:21:14.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.480+0000 7fbb8b3f5740 1 -- 172.21.15.37:0/336319912 shutdown_connections 2024-04-22T07:21:14.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.480+0000 7fbb8b3f5740 1 --2- 172.21.15.37:0/336319912 >> [v2:172.21.15.196:6836/3264179771,v1:172.21.15.196:6838/3264179771] conn(0x55cf1992d5e0 0x55cf1992d9c0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:14.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.480+0000 7fbb8b3f5740 1 --2- 172.21.15.37:0/336319912 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55cf19950d00 0x55cf199429b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:14.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.480+0000 7fbb8b3f5740 1 --2- 172.21.15.37:0/336319912 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cf19951890 0x55cf199455a0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:14.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.480+0000 7fbb617fa640 0 client.4956 ms_handle_reset on v2:172.21.15.196:6836/3264179771 2024-04-22T07:21:14.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.480+0000 7fbb8b3f5740 1 --2- 172.21.15.37:0/336319912 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x55cf19907a10 0x55cf19948c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:14.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.480+0000 7fbb8b3f5740 1 -- 172.21.15.37:0/336319912 >> 172.21.15.37:0/336319912 conn(0x55cf19906470 msgr2=0x55cf19905a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:21:14.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.480+0000 7fbb8b3f5740 1 -- 172.21.15.37:0/336319912 shutdown_connections 2024-04-22T07:21:14.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.480+0000 7fbb8b3f5740 1 -- 172.21.15.37:0/336319912 wait complete. 2024-04-22T07:21:14.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.480+0000 7fbb8b3f5740 20 client.4956 trim_cache size 0 max 16384 2024-04-22T07:21:14.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.499+0000 7fbb8b3f5740 1 Processor -- start 2024-04-22T07:21:14.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.499+0000 7fbb8b3f5740 1 -- start start 2024-04-22T07:21:14.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.500+0000 7fbb8b3f5740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55cf19907a10 0x55cf199050a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:14.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.500+0000 7fbb8b3f5740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cf19950d00 0x55cf19948ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:14.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.500+0000 7fbb8b3f5740 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x55cf19951890 0x55cf198f8b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:14.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.500+0000 7fbb8b3f5740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fbb80070950 con 0x55cf19950d00 2024-04-22T07:21:14.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.500+0000 7fbb8b3f5740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fbb8006f870 con 0x55cf19907a10 2024-04-22T07:21:14.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.500+0000 7fbb8b3f5740 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fbb801e4380 con 0x55cf19951890 2024-04-22T07:21:14.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.500+0000 7fbb85cc9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cf19950d00 0x55cf19948ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:14.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.500+0000 7fbb85cc9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cf19950d00 0x55cf19948ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48796/0 (socket says 172.21.15.37:48796) 2024-04-22T07:21:14.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.500+0000 7fbb85cc9640 1 -- 172.21.15.37:0/4175143165 learned_addr learned my addr 172.21.15.37:0/4175143165 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:21:14.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.500+0000 7fbb85cc9640 1 -- 172.21.15.37:0/4175143165 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x55cf19951890 msgr2=0x55cf198f8b30 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-22T07:21:14.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.500+0000 7fbb85cc9640 1 --2- 172.21.15.37:0/4175143165 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x55cf19951890 0x55cf198f8b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:14.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.500+0000 7fbb85cc9640 1 -- 172.21.15.37:0/4175143165 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55cf19907a10 msgr2=0x55cf199050a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-22T07:21:14.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.500+0000 7fbb85cc9640 1 --2- 172.21.15.37:0/4175143165 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55cf19907a10 0x55cf199050a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:14.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.500+0000 7fbb85cc9640 1 -- 172.21.15.37:0/4175143165 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cf198f45e0 con 0x55cf19950d00 2024-04-22T07:21:14.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.500+0000 7fbb85cc9640 1 --2- 172.21.15.37:0/4175143165 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cf19950d00 0x55cf19948ac0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fbb7400ab70 tx=0x7fbb74049000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3a80459c8ceca06 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:14.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.501+0000 7fbb637fe640 1 -- 172.21.15.37:0/4175143165 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb74061020 con 0x55cf19950d00 2024-04-22T07:21:14.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.501+0000 7fbb637fe640 1 -- 172.21.15.37:0/4175143165 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb74038520 con 0x55cf19950d00 2024-04-22T07:21:14.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.501+0000 7fbb637fe640 1 -- 172.21.15.37:0/4175143165 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb74053030 con 0x55cf19950d00 2024-04-22T07:21:14.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.501+0000 7fbb8b3f5740 1 -- 172.21.15.37:0/4175143165 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cf19950d00 msgr2=0x55cf19948ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:14.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.501+0000 7fbb8b3f5740 1 --2- 172.21.15.37:0/4175143165 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cf19950d00 0x55cf19948ac0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fbb7400ab70 tx=0x7fbb74049000 comp rx=0 tx=0).stop 2024-04-22T07:21:14.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.501+0000 7fbb8b3f5740 1 -- 172.21.15.37:0/4175143165 shutdown_connections 2024-04-22T07:21:14.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.501+0000 7fbb8b3f5740 1 --2- 172.21.15.37:0/4175143165 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x55cf19951890 0x55cf198f8b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:14.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.501+0000 7fbb8b3f5740 1 --2- 172.21.15.37:0/4175143165 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cf19950d00 0x55cf19948ac0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:14.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.501+0000 7fbb8b3f5740 1 --2- 172.21.15.37:0/4175143165 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55cf19907a10 0x55cf199050a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:14.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.501+0000 7fbb8b3f5740 1 -- 172.21.15.37:0/4175143165 >> 172.21.15.37:0/4175143165 conn(0x55cf19906470 msgr2=0x55cf1996ca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:21:14.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.501+0000 7fbb8b3f5740 1 -- 172.21.15.37:0/4175143165 shutdown_connections 2024-04-22T07:21:14.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.502+0000 7fbb8b3f5740 1 -- 172.21.15.37:0/4175143165 wait complete. 2024-04-22T07:21:14.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.502+0000 7fbb8b3f5740 1 -- start start 2024-04-22T07:21:14.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.502+0000 7fbb8b3f5740 1 Processor -- start 2024-04-22T07:21:14.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.503+0000 7fbb8b3f5740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55cf19907a10 0x55cf1992abe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:14.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.503+0000 7fbb8b3f5740 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x55cf19950d00 0x55cf199081b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:14.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.503+0000 7fbb8b3f5740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cf19951890 0x55cf199bf760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:14.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.503+0000 7fbb8b3f5740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fbb801e49d0 con 0x55cf19951890 2024-04-22T07:21:14.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.503+0000 7fbb8b3f5740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fbb8006f1a0 con 0x55cf19907a10 2024-04-22T07:21:14.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.503+0000 7fbb8b3f5740 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fbb801e5020 con 0x55cf19950d00 2024-04-22T07:21:14.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.503+0000 7fbb8b3f5740 10 client.0 _ll_register_callbacks cb 0x7fbb74046070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-22T07:21:14.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.503+0000 7fbb86ccb640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cf19951890 0x55cf199bf760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:14.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.503+0000 7fbb86ccb640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cf19951890 0x55cf199bf760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48802/0 (socket says 172.21.15.37:48802) 2024-04-22T07:21:14.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.503+0000 7fbb86ccb640 1 -- 172.21.15.37:0/3058325438 learned_addr learned my addr 172.21.15.37:0/3058325438 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:21:14.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.504+0000 7fbb86ccb640 1 -- 172.21.15.37:0/3058325438 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x55cf19950d00 msgr2=0x55cf199081b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:21:14.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.504+0000 7fbb86ccb640 1 --2- 172.21.15.37:0/3058325438 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x55cf19950d00 0x55cf199081b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:14.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.504+0000 7fbb86ccb640 1 -- 172.21.15.37:0/3058325438 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55cf19907a10 msgr2=0x55cf1992abe0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-22T07:21:14.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.504+0000 7fbb86ccb640 1 --2- 172.21.15.37:0/3058325438 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55cf19907a10 0x55cf1992abe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:14.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.504+0000 7fbb86ccb640 1 -- 172.21.15.37:0/3058325438 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cf199086f0 con 0x55cf19951890 2024-04-22T07:21:14.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.504+0000 7fbb86ccb640 1 --2- 172.21.15.37:0/3058325438 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cf19951890 0x55cf199bf760 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fbb78089650 tx=0x7fbb78058f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ef006a964cb5cf1 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:14.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.504+0000 7fbb617fa640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-04-22T07:21:14.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.504+0000 7fbb617fa640 1 -- 172.21.15.37:0/3058325438 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb78087060 con 0x55cf19951890 2024-04-22T07:21:14.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.504+0000 7fbb617fa640 1 -- 172.21.15.37:0/3058325438 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7fbb780584a0 con 0x55cf19951890 2024-04-22T07:21:14.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.504+0000 7fbb8b3f5740 1 -- 172.21.15.37:0/3058325438 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbb74038520 con 0x55cf19951890 2024-04-22T07:21:14.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.504+0000 7fbb617fa640 1 -- 172.21.15.37:0/3058325438 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7fbb7805f400 con 0x55cf19951890 2024-04-22T07:21:14.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.505+0000 7fbb8b3f5740 10 client.4962 fetch_fsmap learned FSMap version 8 2024-04-22T07:21:14.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.505+0000 7fbb8b3f5740 1 -- 172.21.15.37:0/3058325438 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x55cf1996c3d0 con 0x55cf19951890 2024-04-22T07:21:14.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.505+0000 7fbb617fa640 1 -- 172.21.15.37:0/3058325438 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb74038520 con 0x55cf19951890 2024-04-22T07:21:14.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.505+0000 7fbb617fa640 1 -- 172.21.15.37:0/3058325438 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 8) ==== 4704+0+0 (secure 0 0 0) 0x7fbb7805f5a0 con 0x55cf19951890 2024-04-22T07:21:14.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.505+0000 7fbb8b3f5740 10 client.4962 fetch_fsmap finished waiting for FSMap version 8 2024-04-22T07:21:14.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.505+0000 7fbb8b3f5740 10 client.4962 resolve_mds: validated gid 4294 aka daemon mds.f 2024-04-22T07:21:14.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.505+0000 7fbb8b3f5740 20 client.4962 populate_metadata read hostname 'smithi037' 2024-04-22T07:21:14.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.505+0000 7fbb8b3f5740 1 --2- 172.21.15.37:0/3058325438 >> [v2:172.21.15.196:6836/3264179771,v1:172.21.15.196:6838/3264179771] conn(0x55cf19906850 0x55cf199bfca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:14.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.506+0000 7fbb8b3f5740 4 client.4962 mds_command: new command op to 4294 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 89.85, "await": true}] 2024-04-22T07:21:14.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.506+0000 7fbb8b3f5740 1 -- 172.21.15.37:0/3058325438 --> [v2:172.21.15.196:6836/3264179771,v1:172.21.15.196:6838/3264179771] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 89.85, "await": true}) -- 0x55cf1986b980 con 0x55cf19906850 2024-04-22T07:21:14.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.507+0000 7fbb864ca640 1 --2- 172.21.15.37:0/3058325438 >> [v2:172.21.15.196:6836/3264179771,v1:172.21.15.196:6838/3264179771] conn(0x55cf19906850 0x55cf199bfca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:14.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.512+0000 7fbb864ca640 1 --2- 172.21.15.37:0/3058325438 >> [v2:172.21.15.196:6836/3264179771,v1:172.21.15.196:6838/3264179771] conn(0x55cf19906850 0x55cf199bfca0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=16885cf0cafa896e server_cookie=dab7ab9035e5fa1c in_seq=0 out_seq=0 2024-04-22T07:21:14.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.512+0000 7fbb617fa640 10 client.4962 ms_handle_connect on v2:172.21.15.196:6836/3264179771 2024-04-22T07:21:14.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.774+0000 7fbb617fa640 1 -- 172.21.15.37:0/3058325438 <== mds.0 v2:172.21.15.196:6836/3264179771 1 ==== command_reply(tid 0: 0 ) ==== 8+0+588 (crc 0 0 0) 0x55cf1986b980 con 0x55cf19906850 2024-04-22T07:21:14.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.774+0000 7fbb617fa640 10 client.4962 handle_command_reply: tid=0 2024-04-22T07:21:14.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.774+0000 7fbb8b3f5740 1 client.4962 shutdown 2024-04-22T07:21:14.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.774+0000 7fbb8b3f5740 1 -- 172.21.15.37:0/3058325438 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cf19951890 msgr2=0x55cf199bf760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:14.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.774+0000 7fbb8b3f5740 1 --2- 172.21.15.37:0/3058325438 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cf19951890 0x55cf199bf760 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fbb78089650 tx=0x7fbb78058f10 comp rx=0 tx=0).stop 2024-04-22T07:21:14.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.774+0000 7fbb8b3f5740 1 -- 172.21.15.37:0/3058325438 shutdown_connections 2024-04-22T07:21:14.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.774+0000 7fbb8b3f5740 1 --2- 172.21.15.37:0/3058325438 >> [v2:172.21.15.196:6836/3264179771,v1:172.21.15.196:6838/3264179771] conn(0x55cf19906850 0x55cf199bfca0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:14.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.774+0000 7fbb8b3f5740 1 --2- 172.21.15.37:0/3058325438 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cf19951890 0x55cf199bf760 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:14.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.774+0000 7fbb8b3f5740 1 --2- 172.21.15.37:0/3058325438 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x55cf19950d00 0x55cf199081b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:14.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.774+0000 7fbb617fa640 0 client.4962 ms_handle_reset on v2:172.21.15.196:6836/3264179771 2024-04-22T07:21:14.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.774+0000 7fbb8b3f5740 1 --2- 172.21.15.37:0/3058325438 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55cf19907a10 0x55cf1992abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:14.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.774+0000 7fbb8b3f5740 1 -- 172.21.15.37:0/3058325438 >> 172.21.15.37:0/3058325438 conn(0x55cf19906470 msgr2=0x55cf1992d9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:21:14.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.774+0000 7fbb8b3f5740 1 -- 172.21.15.37:0/3058325438 shutdown_connections 2024-04-22T07:21:14.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.774+0000 7fbb8b3f5740 1 -- 172.21.15.37:0/3058325438 wait complete. 2024-04-22T07:21:14.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.774+0000 7fbb8b3f5740 20 client.4962 trim_cache size 0 max 16384 2024-04-22T07:21:14.775 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-04-22T07:21:14.775 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 8, 2024-04-22T07:21:14.775 INFO:teuthology.orchestra.run.smithi037.stdout: "leader": 4294, 2024-04-22T07:21:14.775 INFO:teuthology.orchestra.run.smithi037.stdout: "set_version": 10, 2024-04-22T07:21:14.775 INFO:teuthology.orchestra.run.smithi037.stdout: "sets": { 2024-04-22T07:21:14.775 INFO:teuthology.orchestra.run.smithi037.stdout: "52ee65da": { 2024-04-22T07:21:14.775 INFO:teuthology.orchestra.run.smithi037.stdout: "version": 10, 2024-04-22T07:21:14.775 INFO:teuthology.orchestra.run.smithi037.stdout: "age_ref": 0.0, 2024-04-22T07:21:14.775 INFO:teuthology.orchestra.run.smithi037.stdout: "state": { 2024-04-22T07:21:14.775 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "QUIESCED", 2024-04-22T07:21:14.775 INFO:teuthology.orchestra.run.smithi037.stdout: "age": 0.0 2024-04-22T07:21:14.775 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-04-22T07:21:14.776 INFO:teuthology.orchestra.run.smithi037.stdout: "timeout": 60.0, 2024-04-22T07:21:14.776 INFO:teuthology.orchestra.run.smithi037.stdout: "expiration": 89.8, 2024-04-22T07:21:14.776 INFO:teuthology.orchestra.run.smithi037.stdout: "members": { 2024-04-22T07:21:14.776 INFO:teuthology.orchestra.run.smithi037.stdout: "file:/": { 2024-04-22T07:21:14.776 INFO:teuthology.orchestra.run.smithi037.stdout: "excluded": false, 2024-04-22T07:21:14.776 INFO:teuthology.orchestra.run.smithi037.stdout: "state": { 2024-04-22T07:21:14.776 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "QUIESCED", 2024-04-22T07:21:14.776 INFO:teuthology.orchestra.run.smithi037.stdout: "age": 0.0 2024-04-22T07:21:14.776 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-04-22T07:21:14.776 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-04-22T07:21:14.776 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-04-22T07:21:14.776 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-04-22T07:21:14.776 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-04-22T07:21:14.776 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-04-22T07:21:14.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.775+0000 7fbb8872e640 1 -- 172.21.15.37:0/94962141 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fbb6406c8f0 msgr2=0x7fbb6406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:14.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.775+0000 7fbb8872e640 1 --2- 172.21.15.37:0/94962141 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fbb6406c8f0 0x7fbb6406edb0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fbb7c0014e0 tx=0x7fbb7c007990 comp rx=0 tx=0).stop 2024-04-22T07:21:14.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.775+0000 7fbb8872e640 1 -- 172.21.15.37:0/94962141 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb800c7c90 msgr2=0x7fbb800c8110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:14.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.775+0000 7fbb8872e640 1 --2- 172.21.15.37:0/94962141 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb800c7c90 0x7fbb800c8110 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fbb8008dd90 tx=0x7fbb7800cc00 comp rx=0 tx=0).stop 2024-04-22T07:21:14.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.775+0000 7fbb8872e640 1 -- 172.21.15.37:0/94962141 shutdown_connections 2024-04-22T07:21:14.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.775+0000 7fbb8872e640 1 --2- 172.21.15.37:0/94962141 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fbb6406c8f0 0x7fbb6406edb0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:14.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.775+0000 7fbb8872e640 1 --2- 172.21.15.37:0/94962141 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb800c7c90 0x7fbb800c8110 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:14.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.775+0000 7fbb8872e640 1 --2- 172.21.15.37:0/94962141 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbb80157d40 0x7fbb8014d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:14.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.775+0000 7fbb8872e640 1 --2- 172.21.15.37:0/94962141 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbb6c004800 0x7fbb801522b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:14.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.775+0000 7fbb8872e640 1 -- 172.21.15.37:0/94962141 >> 172.21.15.37:0/94962141 conn(0x7fbb80071f90 msgr2=0x7fbb80154090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:21:14.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.775+0000 7fbb8872e640 1 -- 172.21.15.37:0/94962141 shutdown_connections 2024-04-22T07:21:14.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:14.775+0000 7fbb8872e640 1 -- 172.21.15.37:0/94962141 wait complete. 2024-04-22T07:21:14.792 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced, set_id: 52ee65da, quiesce took 1.1 seconds. Will release after: 29.85 2024-04-22T07:21:15.151 INFO:tasks.workunit.client.0.smithi037.stdout: 2024-04-22T07:21:15.151 INFO:tasks.workunit.client.0.smithi037.stdout: Children see throughput for 1 rewriters = 35565.69 kB/sec 2024-04-22T07:21:15.151 INFO:tasks.workunit.client.0.smithi037.stdout: Parent sees throughput for 1 rewriters = 35565.41 kB/sec 2024-04-22T07:21:15.151 INFO:tasks.workunit.client.0.smithi037.stdout: Min throughput per process = 35565.69 kB/sec 2024-04-22T07:21:15.151 INFO:tasks.workunit.client.0.smithi037.stdout: Max throughput per process = 35565.69 kB/sec 2024-04-22T07:21:15.151 INFO:tasks.workunit.client.0.smithi037.stdout: Avg throughput per process = 35565.69 kB/sec 2024-04-22T07:21:15.151 INFO:tasks.workunit.client.0.smithi037.stdout: Min xfer = 1048576.00 kB 2024-04-22T07:21:18.157 INFO:tasks.workunit.client.0.smithi037.stdout: 2024-04-22T07:21:18.157 INFO:tasks.workunit.client.0.smithi037.stdout: Children see throughput for 1 readers = 1188659.38 kB/sec 2024-04-22T07:21:18.158 INFO:tasks.workunit.client.0.smithi037.stdout: Parent sees throughput for 1 readers = 1188371.25 kB/sec 2024-04-22T07:21:18.158 INFO:tasks.workunit.client.0.smithi037.stdout: Min throughput per process = 1188659.38 kB/sec 2024-04-22T07:21:18.158 INFO:tasks.workunit.client.0.smithi037.stdout: Max throughput per process = 1188659.38 kB/sec 2024-04-22T07:21:18.158 INFO:tasks.workunit.client.0.smithi037.stdout: Avg throughput per process = 1188659.38 kB/sec 2024-04-22T07:21:18.158 INFO:tasks.workunit.client.0.smithi037.stdout: Min xfer = 1048576.00 kB 2024-04-22T07:21:20.360 INFO:tasks.workunit.client.0.smithi037.stdout: 2024-04-22T07:21:20.360 INFO:tasks.workunit.client.0.smithi037.stdout: Children see throughput for 1 re-readers = 7641058.00 kB/sec 2024-04-22T07:21:20.360 INFO:tasks.workunit.client.0.smithi037.stdout: Parent sees throughput for 1 re-readers = 7629552.65 kB/sec 2024-04-22T07:21:20.360 INFO:tasks.workunit.client.0.smithi037.stdout: Min throughput per process = 7641058.00 kB/sec 2024-04-22T07:21:20.360 INFO:tasks.workunit.client.0.smithi037.stdout: Max throughput per process = 7641058.00 kB/sec 2024-04-22T07:21:20.361 INFO:tasks.workunit.client.0.smithi037.stdout: Avg throughput per process = 7641058.00 kB/sec 2024-04-22T07:21:20.361 INFO:tasks.workunit.client.0.smithi037.stdout: Min xfer = 1048576.00 kB 2024-04-22T07:21:37.158 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-22T07:21:37.161 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-22T07:21:44.642 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-22T07:21:44.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:44.745+0000 7f3a65443640 1 Processor -- start 2024-04-22T07:21:44.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:44.745+0000 7f3a65443640 1 -- start start 2024-04-22T07:21:44.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:44.746+0000 7f3a65443640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f3a60152e70 0x7f3a600c3e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:44.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:44.746+0000 7f3a65443640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3a60159520 0x7f3a600c4380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:44.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:44.746+0000 7f3a65443640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a60153250 con 0x7f3a600c8e80 2024-04-22T07:21:44.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:44.746+0000 7f3a65443640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f3a601599b0 con 0x7f3a60152e70 2024-04-22T07:21:44.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:44.746+0000 7f3a65443640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f3a6015c140 con 0x7f3a60159520 2024-04-22T07:21:44.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:44.746+0000 7f3a5effd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f3a60152e70 0x7f3a600c3e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:44.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:44.746+0000 7f3a5f7fe640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f3a600c8e80 0x7f3a600ca190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:53864/0 (socket says 172.21.15.37:53864) 2024-04-22T07:21:44.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:44.746+0000 7f3a5effd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f3a60152e70 0x7f3a600c3e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49310/0 (socket says 172.21.15.37:49310) 2024-04-22T07:21:44.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:44.746+0000 7f3a5f7fe640 1 -- 172.21.15.37:0/4291963192 learned_addr learned my addr 172.21.15.37:0/4291963192 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-04-22T07:21:44.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:44.746+0000 7f3a5e7fc640 1 --2- 172.21.15.37:0/4291963192 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3a60159520 0x7f3a600c4380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:44.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:44.746+0000 7f3a5effd640 1 -- 172.21.15.37:0/4291963192 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3a60159520 msgr2=0x7f3a600c4380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:21:44.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:44.746+0000 7f3a5effd640 1 --2- 172.21.15.37:0/4291963192 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3a60159520 0x7f3a600c4380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:44.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:44.746+0000 7f3a5effd640 1 -- 172.21.15.37:0/4291963192 >> v1:172.21.15.37:6789/0 conn(0x7f3a600c8e80 legacy=0x7f3a600ca190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:44.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:44.747+0000 7f3a5effd640 1 -- 172.21.15.37:0/4291963192 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a6015c420 con 0x7f3a60152e70 2024-04-22T07:21:44.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:44.747+0000 7f3a5dffb640 1 -- 172.21.15.37:0/4291963192 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1686042681 0 0) 0x7f3a60153250 con 0x7f3a600c8e80 2024-04-22T07:21:44.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:44.747+0000 7f3a5effd640 1 --2- 172.21.15.37:0/4291963192 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3a60152e70 0x7f3a600c3e40 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f3a500097a0 tx=0x7f3a5002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edb8d858ce27dab5 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:44.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:44.747+0000 7f3a5dffb640 1 -- 172.21.15.37:0/4291963192 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a50035020 con 0x7f3a60152e70 2024-04-22T07:21:44.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:44.748+0000 7f3a5dffb640 1 -- 172.21.15.37:0/4291963192 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a50031830 con 0x7f3a60152e70 2024-04-22T07:21:44.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:44.748+0000 7f3a5dffb640 1 -- 172.21.15.37:0/4291963192 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a50031c00 con 0x7f3a60152e70 2024-04-22T07:21:44.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:44.748+0000 7f3a65443640 1 -- 172.21.15.37:0/4291963192 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3a60152e70 msgr2=0x7f3a600c3e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:44.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:44.748+0000 7f3a65443640 1 --2- 172.21.15.37:0/4291963192 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3a60152e70 0x7f3a600c3e40 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f3a500097a0 tx=0x7f3a5002b8d0 comp rx=0 tx=0).stop 2024-04-22T07:21:44.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:44.748+0000 7f3a65443640 1 -- 172.21.15.37:0/4291963192 shutdown_connections 2024-04-22T07:21:44.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:44.748+0000 7f3a65443640 1 --2- 172.21.15.37:0/4291963192 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3a60159520 0x7f3a600c4380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:44.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:44.748+0000 7f3a65443640 1 --2- 172.21.15.37:0/4291963192 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3a60152e70 0x7f3a600c3e40 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:44.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:44.748+0000 7f3a65443640 1 -- 172.21.15.37:0/4291963192 >> 172.21.15.37:0/4291963192 conn(0x7f3a6006e370 msgr2=0x7f3a60071540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:21:44.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:44.748+0000 7f3a65443640 1 -- 172.21.15.37:0/4291963192 shutdown_connections 2024-04-22T07:21:44.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:44.748+0000 7f3a65443640 1 -- 172.21.15.37:0/4291963192 wait complete. 2024-04-22T07:21:44.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:44.749+0000 7f3a65443640 1 Processor -- start 2024-04-22T07:21:44.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:44.749+0000 7f3a65443640 1 -- start start 2024-04-22T07:21:44.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:44.750+0000 7f3a65443640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3a600c8e80 0x7f3a600cda80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:44.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:44.750+0000 7f3a65443640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3a60152e70 0x7f3a600b3060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:44.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:44.750+0000 7f3a65443640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3a600b3c80 0x7f3a601ec3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:44.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:44.750+0000 7f3a65443640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3a60070ed0 con 0x7f3a60152e70 2024-04-22T07:21:44.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:44.750+0000 7f3a65443640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f3a6015c9e0 con 0x7f3a600c8e80 2024-04-22T07:21:44.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:44.750+0000 7f3a65443640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f3a60071050 con 0x7f3a600b3c80 2024-04-22T07:21:44.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:44.750+0000 7f3a5e7fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3a60152e70 0x7f3a600b3060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:44.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:44.750+0000 7f3a5e7fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3a60152e70 0x7f3a600b3060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49324/0 (socket says 172.21.15.37:49324) 2024-04-22T07:21:44.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:44.750+0000 7f3a5e7fc640 1 -- 172.21.15.37:0/2686815587 learned_addr learned my addr 172.21.15.37:0/2686815587 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:21:44.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:44.750+0000 7f3a5f7fe640 1 --2- 172.21.15.37:0/2686815587 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3a600b3c80 0x7f3a601ec3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:44.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:44.750+0000 7f3a5effd640 1 --2- 172.21.15.37:0/2686815587 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3a600c8e80 0x7f3a600cda80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:44.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:44.751+0000 7f3a5e7fc640 1 -- 172.21.15.37:0/2686815587 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3a600b3c80 msgr2=0x7f3a601ec3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:44.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:44.751+0000 7f3a5e7fc640 1 --2- 172.21.15.37:0/2686815587 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3a600b3c80 0x7f3a601ec3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:44.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:44.751+0000 7f3a5e7fc640 1 -- 172.21.15.37:0/2686815587 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3a600c8e80 msgr2=0x7f3a600cda80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:44.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:44.751+0000 7f3a5e7fc640 1 --2- 172.21.15.37:0/2686815587 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3a600c8e80 0x7f3a600cda80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:44.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:44.751+0000 7f3a5e7fc640 1 -- 172.21.15.37:0/2686815587 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a600cc420 con 0x7f3a60152e70 2024-04-22T07:21:44.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:44.751+0000 7f3a5effd640 1 --2- 172.21.15.37:0/2686815587 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3a600c8e80 0x7f3a600cda80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-22T07:21:44.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:44.751+0000 7f3a5f7fe640 1 --2- 172.21.15.37:0/2686815587 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3a600b3c80 0x7f3a601ec3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-22T07:21:44.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:44.751+0000 7f3a5e7fc640 1 --2- 172.21.15.37:0/2686815587 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3a60152e70 0x7f3a600b3060 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f3a5400d5f0 tx=0x7f3a5400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:44.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:44.751+0000 7f3a477fe640 1 -- 172.21.15.37:0/2686815587 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a540125f0 con 0x7f3a60152e70 2024-04-22T07:21:44.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:44.751+0000 7f3a477fe640 1 -- 172.21.15.37:0/2686815587 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a54019070 con 0x7f3a60152e70 2024-04-22T07:21:44.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:44.751+0000 7f3a65443640 1 -- 172.21.15.37:0/2686815587 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a600b4150 con 0x7f3a60152e70 2024-04-22T07:21:44.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:44.751+0000 7f3a477fe640 1 -- 172.21.15.37:0/2686815587 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a540129d0 con 0x7f3a60152e70 2024-04-22T07:21:44.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:44.751+0000 7f3a65443640 1 -- 172.21.15.37:0/2686815587 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a600cc9a0 con 0x7f3a60152e70 2024-04-22T07:21:44.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:44.752+0000 7f3a65443640 1 -- 172.21.15.37:0/2686815587 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a60068b20 con 0x7f3a60152e70 2024-04-22T07:21:44.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:44.752+0000 7f3a477fe640 1 -- 172.21.15.37:0/2686815587 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3a54012b70 con 0x7f3a60152e70 2024-04-22T07:21:44.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:44.753+0000 7f3a477fe640 1 --2- 172.21.15.37:0/2686815587 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f3a4c06c8f0 0x7f3a4c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:44.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:44.753+0000 7f3a477fe640 1 -- 172.21.15.37:0/2686815587 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f3a5408c050 con 0x7f3a60152e70 2024-04-22T07:21:44.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:44.753+0000 7f3a5effd640 1 --2- 172.21.15.37:0/2686815587 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f3a4c06c8f0 0x7f3a4c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:44.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:44.754+0000 7f3a5effd640 1 --2- 172.21.15.37:0/2686815587 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f3a4c06c8f0 0x7f3a4c06edb0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f3a50036000 tx=0x7f3a50008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:44.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:44.757+0000 7f3a477fe640 1 -- 172.21.15.37:0/2686815587 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f3a5405a400 con 0x7f3a60152e70 2024-04-22T07:21:44.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:44.982+0000 7f3a65443640 1 -- 172.21.15.37:0/2686815587 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3a600c96d0 con 0x7f3a60152e70 2024-04-22T07:21:44.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:44.983+0000 7f3a477fe640 1 -- 172.21.15.37:0/2686815587 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6827 (secure 0 0 0) 0x7f3a54059d00 con 0x7f3a60152e70 2024-04-22T07:21:44.981 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-22T07:21:44.982 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4265,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6839/671847354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6835","nonce":671847354},{"type":"v1","addr":"172.21.15.196:6839","nonce":671847354}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6833/1549427395","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1549427395},{"type":"v1","addr":"172.21.15.37:6833","nonce":1549427395}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6836/3825988951","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":3825988951},{"type":"v1","addr":"172.21.15.37:6836","nonce":3825988951}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4272,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/611771502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6835","nonce":611771502},{"type":"v1","addr":"172.21.15.37:6837","nonce":611771502}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4291,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6837/3055080225","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6834","nonce":3055080225},{"type":"v1","addr":"172.21.15.196:6837","nonce":3055080225}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-22T07:18:36.111618+0000","modified":"2024-04-22T07:18:41.783857+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.196:6838/3264179771","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6836","nonce":3264179771},{"type":"v1","addr":"172.21.15.196:6838","nonce":3264179771}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4294,"qdb_cluster":[4294]},"id":1}]} 2024-04-22T07:21:44.982 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 8 2024-04-22T07:21:44.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:44.985+0000 7f3a65443640 1 -- 172.21.15.37:0/2686815587 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f3a4c06c8f0 msgr2=0x7f3a4c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:44.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:44.985+0000 7f3a65443640 1 --2- 172.21.15.37:0/2686815587 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f3a4c06c8f0 0x7f3a4c06edb0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f3a50036000 tx=0x7f3a50008030 comp rx=0 tx=0).stop 2024-04-22T07:21:44.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:44.985+0000 7f3a65443640 1 -- 172.21.15.37:0/2686815587 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3a60152e70 msgr2=0x7f3a600b3060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:44.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:44.985+0000 7f3a65443640 1 --2- 172.21.15.37:0/2686815587 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3a60152e70 0x7f3a600b3060 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f3a5400d5f0 tx=0x7f3a5400dab0 comp rx=0 tx=0).stop 2024-04-22T07:21:44.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:44.985+0000 7f3a65443640 1 -- 172.21.15.37:0/2686815587 shutdown_connections 2024-04-22T07:21:44.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:44.985+0000 7f3a65443640 1 --2- 172.21.15.37:0/2686815587 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f3a4c06c8f0 0x7f3a4c06edb0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:44.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:44.985+0000 7f3a65443640 1 --2- 172.21.15.37:0/2686815587 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3a600b3c80 0x7f3a601ec3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:44.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:44.985+0000 7f3a65443640 1 --2- 172.21.15.37:0/2686815587 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3a60152e70 0x7f3a600b3060 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:44.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:44.985+0000 7f3a65443640 1 --2- 172.21.15.37:0/2686815587 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3a600c8e80 0x7f3a600cda80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:44.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:44.985+0000 7f3a65443640 1 -- 172.21.15.37:0/2686815587 >> 172.21.15.37:0/2686815587 conn(0x7f3a6006e370 msgr2=0x7f3a60152100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:21:44.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:44.985+0000 7f3a65443640 1 -- 172.21.15.37:0/2686815587 shutdown_connections 2024-04-22T07:21:44.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:44.985+0000 7f3a65443640 1 -- 172.21.15.37:0/2686815587 wait complete. 2024-04-22T07:21:44.995 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4294 quiesce db --set-id 52ee65da --release --await' 2024-04-22T07:21:44.995 DEBUG:teuthology.orchestra.run.smithi037:> timeout 75 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4294 quiesce db --set-id 52ee65da --release --await 2024-04-22T07:21:45.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.103+0000 7fabcf688640 1 Processor -- start 2024-04-22T07:21:45.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.104+0000 7fabcf688640 1 -- start start 2024-04-22T07:21:45.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.104+0000 7fabcf688640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fabc80cde00 0x7fabc80cc460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:45.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.104+0000 7fabcf688640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fabc80cb0b0 0x7fabc80730c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:45.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.104+0000 7fabcf688640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fabc81555d0 con 0x7fabc81551f0 2024-04-22T07:21:45.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.104+0000 7fabcf688640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fabc80cc9a0 con 0x7fabc80cb0b0 2024-04-22T07:21:45.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.104+0000 7fabcf688640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fabc80ccbc0 con 0x7fabc80cde00 2024-04-22T07:21:45.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.104+0000 7fabcdc25640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fabc80cb0b0 0x7fabc80730c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:45.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.104+0000 7fabcd424640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fabc81551f0 0x7fabc815e4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:53868/0 (socket says 172.21.15.37:53868) 2024-04-22T07:21:45.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.104+0000 7fabcd424640 1 -- 172.21.15.37:0/1716485057 learned_addr learned my addr 172.21.15.37:0/1716485057 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-04-22T07:21:45.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.104+0000 7fabcdc25640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fabc80cb0b0 0x7fabc80730c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49338/0 (socket says 172.21.15.37:49338) 2024-04-22T07:21:45.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.105+0000 7fabccc23640 1 --2- 172.21.15.37:0/1716485057 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fabc80cde00 0x7fabc80cc460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:45.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.105+0000 7fabcdc25640 1 -- 172.21.15.37:0/1716485057 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fabc80cde00 msgr2=0x7fabc80cc460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:21:45.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.105+0000 7fabcdc25640 1 --2- 172.21.15.37:0/1716485057 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fabc80cde00 0x7fabc80cc460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:45.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.105+0000 7fabcdc25640 1 -- 172.21.15.37:0/1716485057 >> v1:172.21.15.37:6789/0 conn(0x7fabc81551f0 legacy=0x7fabc815e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:45.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.105+0000 7fabcdc25640 1 -- 172.21.15.37:0/1716485057 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabc80ccea0 con 0x7fabc80cb0b0 2024-04-22T07:21:45.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.106+0000 7fabcdc25640 1 --2- 172.21.15.37:0/1716485057 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fabc80cb0b0 0x7fabc80730c0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fabc40097a0 tx=0x7fabc402b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e1b853ac92421c7 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:45.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.106+0000 7fabbffff640 1 -- 172.21.15.37:0/1716485057 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabc4034070 con 0x7fabc80cb0b0 2024-04-22T07:21:45.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.106+0000 7fabbffff640 1 -- 172.21.15.37:0/1716485057 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fabc4030610 con 0x7fabc80cb0b0 2024-04-22T07:21:45.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.106+0000 7fabbffff640 1 -- 172.21.15.37:0/1716485057 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabc40309e0 con 0x7fabc80cb0b0 2024-04-22T07:21:45.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.106+0000 7fabcf688640 1 -- 172.21.15.37:0/1716485057 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fabc80cb0b0 msgr2=0x7fabc80730c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:45.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.106+0000 7fabcf688640 1 --2- 172.21.15.37:0/1716485057 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fabc80cb0b0 0x7fabc80730c0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fabc40097a0 tx=0x7fabc402b960 comp rx=0 tx=0).stop 2024-04-22T07:21:45.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.106+0000 7fabcf688640 1 -- 172.21.15.37:0/1716485057 shutdown_connections 2024-04-22T07:21:45.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.106+0000 7fabcf688640 1 --2- 172.21.15.37:0/1716485057 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fabc80cb0b0 0x7fabc80730c0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:45.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.106+0000 7fabcf688640 1 --2- 172.21.15.37:0/1716485057 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fabc80cde00 0x7fabc80cc460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:45.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.106+0000 7fabcf688640 1 -- 172.21.15.37:0/1716485057 >> 172.21.15.37:0/1716485057 conn(0x7fabc806c410 msgr2=0x7fabc80676b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:21:45.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.106+0000 7fabcf688640 1 -- 172.21.15.37:0/1716485057 shutdown_connections 2024-04-22T07:21:45.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.106+0000 7fabcf688640 1 -- 172.21.15.37:0/1716485057 wait complete. 2024-04-22T07:21:45.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.107+0000 7fabcf688640 1 Processor -- start 2024-04-22T07:21:45.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.108+0000 7fabcf688640 1 -- start start 2024-04-22T07:21:45.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.108+0000 7fabcf688640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fabc80cb0b0 0x7fabc81546e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:45.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.108+0000 7fabcf688640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fabc80cde00 0x7fabc80b5000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:45.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.108+0000 7fabcf688640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fabc81551f0 0x7fabc81f10d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:45.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.108+0000 7fabcf688640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fabc815b5c0 con 0x7fabc80cde00 2024-04-22T07:21:45.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.108+0000 7fabcf688640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fabc815b2e0 con 0x7fabc81551f0 2024-04-22T07:21:45.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.108+0000 7fabcf688640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fabc815b8a0 con 0x7fabc80cb0b0 2024-04-22T07:21:45.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.108+0000 7fabccc23640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fabc80cde00 0x7fabc80b5000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:45.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.108+0000 7fabccc23640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fabc80cde00 0x7fabc80b5000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49350/0 (socket says 172.21.15.37:49350) 2024-04-22T07:21:45.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.108+0000 7fabccc23640 1 -- 172.21.15.37:0/3608967381 learned_addr learned my addr 172.21.15.37:0/3608967381 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:21:45.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.109+0000 7fabcd424640 1 --2- 172.21.15.37:0/3608967381 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fabc80cb0b0 0x7fabc81546e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:45.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.109+0000 7fabcdc25640 1 --2- 172.21.15.37:0/3608967381 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fabc81551f0 0x7fabc81f10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:45.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.109+0000 7fabccc23640 1 -- 172.21.15.37:0/3608967381 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fabc80cb0b0 msgr2=0x7fabc81546e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:45.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.109+0000 7fabccc23640 1 --2- 172.21.15.37:0/3608967381 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fabc80cb0b0 0x7fabc81546e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:45.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.109+0000 7fabccc23640 1 -- 172.21.15.37:0/3608967381 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fabc81551f0 msgr2=0x7fabc81f10d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:45.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.109+0000 7fabccc23640 1 --2- 172.21.15.37:0/3608967381 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fabc81551f0 0x7fabc81f10d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:45.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.109+0000 7fabccc23640 1 -- 172.21.15.37:0/3608967381 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabc80b3080 con 0x7fabc80cde00 2024-04-22T07:21:45.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.109+0000 7fabccc23640 1 --2- 172.21.15.37:0/3608967381 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fabc80cde00 0x7fabc80b5000 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fabb800d800 tx=0x7fabb800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:45.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.109+0000 7fabbdffb640 1 -- 172.21.15.37:0/3608967381 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabb800b6c0 con 0x7fabc80cde00 2024-04-22T07:21:45.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.109+0000 7fabbdffb640 1 -- 172.21.15.37:0/3608967381 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fabb8019070 con 0x7fabc80cde00 2024-04-22T07:21:45.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.109+0000 7fabcf688640 1 -- 172.21.15.37:0/3608967381 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fabc80b32f0 con 0x7fabc80cde00 2024-04-22T07:21:45.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.109+0000 7fabbdffb640 1 -- 172.21.15.37:0/3608967381 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabb800ba80 con 0x7fabc80cde00 2024-04-22T07:21:45.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.109+0000 7fabcf688640 1 -- 172.21.15.37:0/3608967381 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fabc815f180 con 0x7fabc80cde00 2024-04-22T07:21:45.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.111+0000 7fabbdffb640 1 -- 172.21.15.37:0/3608967381 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fabb800bc20 con 0x7fabc80cde00 2024-04-22T07:21:45.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.111+0000 7fabbdffb640 1 --2- 172.21.15.37:0/3608967381 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fabac06c8f0 0x7fabac06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:45.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.111+0000 7fabbdffb640 1 -- 172.21.15.37:0/3608967381 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7fabb808c050 con 0x7fabc80cde00 2024-04-22T07:21:45.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.111+0000 7fabcd424640 1 --2- 172.21.15.37:0/3608967381 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fabac06c8f0 0x7fabac06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:45.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.112+0000 7fabcd424640 1 --2- 172.21.15.37:0/3608967381 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fabac06c8f0 0x7fabac06edb0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fabc00012e0 tx=0x7fabc0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:45.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.112+0000 7fabd227e740 1 Processor -- start 2024-04-22T07:21:45.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.112+0000 7fabd227e740 1 -- start start 2024-04-22T07:21:45.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.113+0000 7fabd227e740 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x55edb78627d0 0x55edb7862bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:45.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.113+0000 7fabd227e740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55edb784c2d0 0x55edb7863900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:45.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.113+0000 7fabd227e740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55edb7821810 0x55edb7863e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:45.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.113+0000 7fabd227e740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55edb7788500 con 0x55edb7821810 2024-04-22T07:21:45.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.113+0000 7fabd227e740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55edb772e6a0 con 0x55edb784c2d0 2024-04-22T07:21:45.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.113+0000 7fabd227e740 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x55edb77844c0 con 0x55edb78627d0 2024-04-22T07:21:45.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.113+0000 7fabcdc25640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55edb7821810 0x55edb7863e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:45.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.113+0000 7fabcdc25640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55edb7821810 0x55edb7863e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49362/0 (socket says 172.21.15.37:49362) 2024-04-22T07:21:45.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.113+0000 7fabcdc25640 1 -- 172.21.15.37:0/1427359352 learned_addr learned my addr 172.21.15.37:0/1427359352 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:21:45.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.113+0000 7fabccc23640 1 --2- 172.21.15.37:0/1427359352 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55edb784c2d0 0x55edb7863900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:45.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.113+0000 7fabcd424640 1 --2- 172.21.15.37:0/1427359352 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x55edb78627d0 0x55edb7862bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:45.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.113+0000 7fabcdc25640 1 -- 172.21.15.37:0/1427359352 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x55edb78627d0 msgr2=0x55edb7862bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:21:45.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.113+0000 7fabcdc25640 1 --2- 172.21.15.37:0/1427359352 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x55edb78627d0 0x55edb7862bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:45.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.113+0000 7fabcdc25640 1 -- 172.21.15.37:0/1427359352 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55edb784c2d0 msgr2=0x55edb7863900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:21:45.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.113+0000 7fabcdc25640 1 --2- 172.21.15.37:0/1427359352 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55edb784c2d0 0x55edb7863900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:45.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.113+0000 7fabcdc25640 1 -- 172.21.15.37:0/1427359352 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55edb774d5e0 con 0x55edb7821810 2024-04-22T07:21:45.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.113+0000 7fabcd424640 1 --2- 172.21.15.37:0/1427359352 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x55edb78627d0 0x55edb7862bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T07:21:45.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.113+0000 7fabcdc25640 1 --2- 172.21.15.37:0/1427359352 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55edb7821810 0x55edb7863e40 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fabc402bf70 tx=0x7fabc4008030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d0cce7d53604501 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:45.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.114+0000 7fabb2ffd640 1 -- 172.21.15.37:0/1427359352 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabc4034040 con 0x55edb7821810 2024-04-22T07:21:45.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.114+0000 7fabb2ffd640 1 -- 172.21.15.37:0/1427359352 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fabc4049070 con 0x55edb7821810 2024-04-22T07:21:45.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.114+0000 7fabb2ffd640 1 -- 172.21.15.37:0/1427359352 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabc4039b40 con 0x55edb7821810 2024-04-22T07:21:45.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.114+0000 7fabd227e740 1 -- 172.21.15.37:0/1427359352 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55edb7821810 msgr2=0x55edb7863e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:45.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.114+0000 7fabd227e740 1 --2- 172.21.15.37:0/1427359352 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55edb7821810 0x55edb7863e40 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fabc402bf70 tx=0x7fabc4008030 comp rx=0 tx=0).stop 2024-04-22T07:21:45.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.114+0000 7fabd227e740 1 -- 172.21.15.37:0/1427359352 shutdown_connections 2024-04-22T07:21:45.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.114+0000 7fabd227e740 1 --2- 172.21.15.37:0/1427359352 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55edb7821810 0x55edb7863e40 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:45.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.114+0000 7fabd227e740 1 --2- 172.21.15.37:0/1427359352 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55edb784c2d0 0x55edb7863900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:45.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.114+0000 7fabd227e740 1 --2- 172.21.15.37:0/1427359352 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x55edb78627d0 0x55edb7862bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:45.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.114+0000 7fabd227e740 1 -- 172.21.15.37:0/1427359352 >> 172.21.15.37:0/1427359352 conn(0x55edb781f550 msgr2=0x55edb7821e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:21:45.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.114+0000 7fabd227e740 1 -- 172.21.15.37:0/1427359352 shutdown_connections 2024-04-22T07:21:45.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.114+0000 7fabd227e740 1 -- 172.21.15.37:0/1427359352 wait complete. 2024-04-22T07:21:45.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.115+0000 7fabd227e740 1 -- start start 2024-04-22T07:21:45.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.115+0000 7fabd227e740 1 Processor -- start 2024-04-22T07:21:45.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.116+0000 7fabd227e740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55edb784c2d0 0x55edb7863c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:45.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.116+0000 7fabd227e740 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x55edb78627d0 0x55edb786a300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:45.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.116+0000 7fabd227e740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55edb7867e90 0x55edb7847a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:45.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.116+0000 7fabd227e740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55edb7820c30 con 0x55edb7867e90 2024-04-22T07:21:45.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.116+0000 7fabd227e740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55edb7741a60 con 0x55edb784c2d0 2024-04-22T07:21:45.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.116+0000 7fabd227e740 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x55edb784c7a0 con 0x55edb78627d0 2024-04-22T07:21:45.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.116+0000 7fabd227e740 10 client.0 _ll_register_callbacks cb 0x55edb749a110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-22T07:21:45.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.116+0000 7fabcdc25640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55edb7867e90 0x55edb7847a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:45.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.116+0000 7fabcdc25640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55edb7867e90 0x55edb7847a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49376/0 (socket says 172.21.15.37:49376) 2024-04-22T07:21:45.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.116+0000 7fabcdc25640 1 -- 172.21.15.37:0/2744542596 learned_addr learned my addr 172.21.15.37:0/2744542596 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:21:45.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.116+0000 7fabccc23640 1 --2- 172.21.15.37:0/2744542596 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x55edb78627d0 0x55edb786a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:45.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.116+0000 7fabcd424640 1 --2- 172.21.15.37:0/2744542596 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55edb784c2d0 0x55edb7863c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:45.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.116+0000 7fabcdc25640 1 -- 172.21.15.37:0/2744542596 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x55edb78627d0 msgr2=0x55edb786a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:21:45.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.116+0000 7fabcdc25640 1 --2- 172.21.15.37:0/2744542596 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x55edb78627d0 0x55edb786a300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:45.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.116+0000 7fabcdc25640 1 -- 172.21.15.37:0/2744542596 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55edb784c2d0 msgr2=0x55edb7863c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:21:45.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.116+0000 7fabcdc25640 1 --2- 172.21.15.37:0/2744542596 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55edb784c2d0 0x55edb7863c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:45.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.116+0000 7fabcdc25640 1 -- 172.21.15.37:0/2744542596 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55edb749a920 con 0x55edb7867e90 2024-04-22T07:21:45.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.116+0000 7fabcdc25640 1 --2- 172.21.15.37:0/2744542596 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55edb7867e90 0x55edb7847a70 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fabc4009890 tx=0x7fabc4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abc3899f35f4e256 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:45.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.116+0000 7faba7fff640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-04-22T07:21:45.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.117+0000 7faba7fff640 1 -- 172.21.15.37:0/2744542596 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabc4034050 con 0x55edb7867e90 2024-04-22T07:21:45.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.117+0000 7faba7fff640 1 -- 172.21.15.37:0/2744542596 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7fabc4039d10 con 0x55edb7867e90 2024-04-22T07:21:45.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.117+0000 7fabd227e740 1 -- 172.21.15.37:0/2744542596 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fabc4049070 con 0x55edb7867e90 2024-04-22T07:21:45.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.117+0000 7faba7fff640 1 -- 172.21.15.37:0/2744542596 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7fabc405c050 con 0x55edb7867e90 2024-04-22T07:21:45.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.117+0000 7fabd227e740 10 client.4986 fetch_fsmap learned FSMap version 8 2024-04-22T07:21:45.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.117+0000 7fabd227e740 1 -- 172.21.15.37:0/2744542596 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x55edb7566d30 con 0x55edb7867e90 2024-04-22T07:21:45.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.117+0000 7faba7fff640 1 -- 172.21.15.37:0/2744542596 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fabc4049070 con 0x55edb7867e90 2024-04-22T07:21:45.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.117+0000 7faba7fff640 1 -- 172.21.15.37:0/2744542596 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 8) ==== 4704+0+0 (secure 0 0 0) 0x7fabc405f020 con 0x55edb7867e90 2024-04-22T07:21:45.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.117+0000 7fabd227e740 10 client.4986 fetch_fsmap finished waiting for FSMap version 8 2024-04-22T07:21:45.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.117+0000 7fabd227e740 10 client.4986 resolve_mds: validated gid 4294 aka daemon mds.f 2024-04-22T07:21:45.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.117+0000 7fabd227e740 20 client.4986 populate_metadata read hostname 'smithi037' 2024-04-22T07:21:45.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.117+0000 7fabd227e740 1 --2- 172.21.15.37:0/2744542596 >> [v2:172.21.15.196:6836/3264179771,v1:172.21.15.196:6838/3264179771] conn(0x55edb786a840 0x55edb78688d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:45.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.117+0000 7fabd227e740 4 client.4986 mds_command: new command op to 4294 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-22T07:21:45.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.117+0000 7fabd227e740 1 -- 172.21.15.37:0/2744542596 --> [v2:172.21.15.196:6836/3264179771,v1:172.21.15.196:6838/3264179771] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55edb775ba10 con 0x55edb786a840 2024-04-22T07:21:45.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.117+0000 7fabcd424640 1 --2- 172.21.15.37:0/2744542596 >> [v2:172.21.15.196:6836/3264179771,v1:172.21.15.196:6838/3264179771] conn(0x55edb786a840 0x55edb78688d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:45.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.118+0000 7faba7fff640 10 client.4986 ms_handle_connect on v2:172.21.15.196:6836/3264179771 2024-04-22T07:21:45.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.118+0000 7fabcd424640 1 --2- 172.21.15.37:0/2744542596 >> [v2:172.21.15.196:6836/3264179771,v1:172.21.15.196:6838/3264179771] conn(0x55edb786a840 0x55edb78688d0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=30b10f942e27f206 server_cookie=ea1afe547bf68432 in_seq=0 out_seq=0 2024-04-22T07:21:45.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.118+0000 7faba7fff640 1 -- 172.21.15.37:0/2744542596 <== mds.0 v2:172.21.15.196:6836/3264179771 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55edb775ba10 con 0x55edb786a840 2024-04-22T07:21:45.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.118+0000 7faba7fff640 10 client.4986 handle_command_reply: tid=0 2024-04-22T07:21:45.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.118+0000 7fabd227e740 1 client.4986 shutdown 2024-04-22T07:21:45.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.119+0000 7fabd227e740 1 -- 172.21.15.37:0/2744542596 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55edb7867e90 msgr2=0x55edb7847a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:45.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.119+0000 7fabd227e740 1 --2- 172.21.15.37:0/2744542596 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55edb7867e90 0x55edb7847a70 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fabc4009890 tx=0x7fabc4004730 comp rx=0 tx=0).stop 2024-04-22T07:21:45.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.119+0000 7fabd227e740 1 -- 172.21.15.37:0/2744542596 shutdown_connections 2024-04-22T07:21:45.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.119+0000 7fabd227e740 1 --2- 172.21.15.37:0/2744542596 >> [v2:172.21.15.196:6836/3264179771,v1:172.21.15.196:6838/3264179771] conn(0x55edb786a840 0x55edb78688d0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:45.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.119+0000 7fabd227e740 1 --2- 172.21.15.37:0/2744542596 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55edb7867e90 0x55edb7847a70 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:45.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.119+0000 7fabd227e740 1 --2- 172.21.15.37:0/2744542596 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x55edb78627d0 0x55edb786a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:45.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.119+0000 7faba7fff640 0 client.4986 ms_handle_reset on v2:172.21.15.196:6836/3264179771 2024-04-22T07:21:45.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.119+0000 7fabd227e740 1 --2- 172.21.15.37:0/2744542596 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55edb784c2d0 0x55edb7863c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:45.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.119+0000 7fabd227e740 1 -- 172.21.15.37:0/2744542596 >> 172.21.15.37:0/2744542596 conn(0x55edb7821810 msgr2=0x55edb78229c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:21:45.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.119+0000 7fabd227e740 1 -- 172.21.15.37:0/2744542596 shutdown_connections 2024-04-22T07:21:45.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.119+0000 7fabd227e740 1 -- 172.21.15.37:0/2744542596 wait complete. 2024-04-22T07:21:45.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.119+0000 7fabd227e740 20 client.4986 trim_cache size 0 max 16384 2024-04-22T07:21:45.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.136+0000 7fabd227e740 1 Processor -- start 2024-04-22T07:21:45.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.136+0000 7fabd227e740 1 -- start start 2024-04-22T07:21:45.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.137+0000 7fabd227e740 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x55edb784c2d0 0x55edb7887560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:45.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.137+0000 7fabd227e740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55edb78627d0 0x55edb784a720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:45.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.137+0000 7fabd227e740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55edb7867e90 0x55edb784ac60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:45.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.137+0000 7fabd227e740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fabc81fe0e0 con 0x55edb78627d0 2024-04-22T07:21:45.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.137+0000 7fabd227e740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fabc81fcff0 con 0x55edb7867e90 2024-04-22T07:21:45.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.137+0000 7fabd227e740 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fabc81f40e0 con 0x55edb784c2d0 2024-04-22T07:21:45.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.137+0000 7fabccc23640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55edb78627d0 0x55edb784a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:45.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.137+0000 7fabccc23640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55edb78627d0 0x55edb784a720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49392/0 (socket says 172.21.15.37:49392) 2024-04-22T07:21:45.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.137+0000 7fabccc23640 1 -- 172.21.15.37:0/4231624311 learned_addr learned my addr 172.21.15.37:0/4231624311 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:21:45.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.137+0000 7fabcdc25640 1 --2- 172.21.15.37:0/4231624311 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55edb7867e90 0x55edb784ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:45.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.137+0000 7fabcd424640 1 --2- 172.21.15.37:0/4231624311 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x55edb784c2d0 0x55edb7887560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:45.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.137+0000 7fabccc23640 1 -- 172.21.15.37:0/4231624311 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x55edb784c2d0 msgr2=0x55edb7887560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:21:45.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.137+0000 7fabccc23640 1 --2- 172.21.15.37:0/4231624311 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x55edb784c2d0 0x55edb7887560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:45.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.137+0000 7fabccc23640 1 -- 172.21.15.37:0/4231624311 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55edb7867e90 msgr2=0x55edb784ac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:21:45.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.137+0000 7fabccc23640 1 --2- 172.21.15.37:0/4231624311 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55edb7867e90 0x55edb784ac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:45.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.137+0000 7fabccc23640 1 -- 172.21.15.37:0/4231624311 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55edb7824a90 con 0x55edb78627d0 2024-04-22T07:21:45.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.137+0000 7fabcdc25640 1 --2- 172.21.15.37:0/4231624311 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55edb7867e90 0x55edb784ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-22T07:21:45.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.137+0000 7fabccc23640 1 --2- 172.21.15.37:0/4231624311 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55edb78627d0 0x55edb784a720 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fabb8059a00 tx=0x7fabb805a4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2a380876e0b9429 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:45.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.137+0000 7fabb27fc640 1 -- 172.21.15.37:0/4231624311 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabb8083e60 con 0x55edb78627d0 2024-04-22T07:21:45.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.137+0000 7fabb27fc640 1 -- 172.21.15.37:0/4231624311 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fabb80628e0 con 0x55edb78627d0 2024-04-22T07:21:45.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.138+0000 7fabb27fc640 1 -- 172.21.15.37:0/4231624311 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabb80721e0 con 0x55edb78627d0 2024-04-22T07:21:45.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.138+0000 7fabd227e740 1 -- 172.21.15.37:0/4231624311 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55edb78627d0 msgr2=0x55edb784a720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:45.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.138+0000 7fabd227e740 1 --2- 172.21.15.37:0/4231624311 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55edb78627d0 0x55edb784a720 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fabb8059a00 tx=0x7fabb805a4c0 comp rx=0 tx=0).stop 2024-04-22T07:21:45.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.138+0000 7fabd227e740 1 -- 172.21.15.37:0/4231624311 shutdown_connections 2024-04-22T07:21:45.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.138+0000 7fabd227e740 1 --2- 172.21.15.37:0/4231624311 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55edb7867e90 0x55edb784ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:45.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.138+0000 7fabd227e740 1 --2- 172.21.15.37:0/4231624311 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55edb78627d0 0x55edb784a720 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:45.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.138+0000 7fabd227e740 1 --2- 172.21.15.37:0/4231624311 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x55edb784c2d0 0x55edb7887560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:45.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.138+0000 7fabd227e740 1 -- 172.21.15.37:0/4231624311 >> 172.21.15.37:0/4231624311 conn(0x55edb7821810 msgr2=0x55edb784ba80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:21:45.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.138+0000 7fabd227e740 1 -- 172.21.15.37:0/4231624311 shutdown_connections 2024-04-22T07:21:45.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.138+0000 7fabd227e740 1 -- 172.21.15.37:0/4231624311 wait complete. 2024-04-22T07:21:45.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.139+0000 7fabd227e740 1 -- start start 2024-04-22T07:21:45.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.139+0000 7fabd227e740 1 Processor -- start 2024-04-22T07:21:45.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.139+0000 7fabd227e740 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x55edb784c2d0 0x55edb78d8080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:45.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.139+0000 7fabd227e740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55edb78627d0 0x55edb78de6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:45.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.139+0000 7fabd227e740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55edb7867e90 0x55edb7849b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:45.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.139+0000 7fabd227e740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fabc81f4730 con 0x55edb7867e90 2024-04-22T07:21:45.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.139+0000 7fabd227e740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fabc81fc920 con 0x55edb78627d0 2024-04-22T07:21:45.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.139+0000 7fabd227e740 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fabc81f4d80 con 0x55edb784c2d0 2024-04-22T07:21:45.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.140+0000 7fabd227e740 10 client.0 _ll_register_callbacks cb 0x7fabb8055fa0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-22T07:21:45.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.140+0000 7fabcdc25640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55edb7867e90 0x55edb7849b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:45.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.140+0000 7fabcdc25640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55edb7867e90 0x55edb7849b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49394/0 (socket says 172.21.15.37:49394) 2024-04-22T07:21:45.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.140+0000 7fabcdc25640 1 -- 172.21.15.37:0/4078220053 learned_addr learned my addr 172.21.15.37:0/4078220053 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:21:45.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.140+0000 7fabcd424640 1 --2- 172.21.15.37:0/4078220053 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x55edb784c2d0 0x55edb78d8080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:45.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.140+0000 7fabccc23640 1 --2- 172.21.15.37:0/4078220053 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55edb78627d0 0x55edb78de6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:45.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.140+0000 7fabcdc25640 1 -- 172.21.15.37:0/4078220053 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x55edb784c2d0 msgr2=0x55edb78d8080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:21:45.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.140+0000 7fabcdc25640 1 --2- 172.21.15.37:0/4078220053 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x55edb784c2d0 0x55edb78d8080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:45.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.140+0000 7fabcdc25640 1 -- 172.21.15.37:0/4078220053 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55edb78627d0 msgr2=0x55edb78de6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:21:45.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.140+0000 7fabcdc25640 1 --2- 172.21.15.37:0/4078220053 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55edb78627d0 0x55edb78de6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:45.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.140+0000 7fabcdc25640 1 -- 172.21.15.37:0/4078220053 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55edb7845b50 con 0x55edb7867e90 2024-04-22T07:21:45.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.140+0000 7fabcdc25640 1 --2- 172.21.15.37:0/4078220053 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55edb7867e90 0x55edb7849b90 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fabc4000c00 tx=0x7fabc403b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27664e32bd971dcf server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:45.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.140+0000 7faba7fff640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-04-22T07:21:45.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.140+0000 7faba7fff640 1 -- 172.21.15.37:0/4078220053 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabc4034070 con 0x55edb7867e90 2024-04-22T07:21:45.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.140+0000 7faba7fff640 1 -- 172.21.15.37:0/4078220053 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7fabc4061b20 con 0x55edb7867e90 2024-04-22T07:21:45.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.140+0000 7fabd227e740 1 -- 172.21.15.37:0/4078220053 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fabb80628e0 con 0x55edb7867e90 2024-04-22T07:21:45.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.140+0000 7faba7fff640 1 -- 172.21.15.37:0/4078220053 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7fabc4068050 con 0x55edb7867e90 2024-04-22T07:21:45.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.140+0000 7fabd227e740 10 client.4992 fetch_fsmap learned FSMap version 8 2024-04-22T07:21:45.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.140+0000 7fabd227e740 1 -- 172.21.15.37:0/4078220053 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x55edb78202e0 con 0x55edb7867e90 2024-04-22T07:21:45.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.141+0000 7faba7fff640 1 -- 172.21.15.37:0/4078220053 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fabb80628e0 con 0x55edb7867e90 2024-04-22T07:21:45.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.141+0000 7faba7fff640 1 -- 172.21.15.37:0/4078220053 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 8) ==== 4704+0+0 (secure 0 0 0) 0x7fabc406b020 con 0x55edb7867e90 2024-04-22T07:21:45.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.141+0000 7fabd227e740 10 client.4992 fetch_fsmap finished waiting for FSMap version 8 2024-04-22T07:21:45.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.141+0000 7fabd227e740 10 client.4992 resolve_mds: validated gid 4294 aka daemon mds.f 2024-04-22T07:21:45.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.141+0000 7fabd227e740 20 client.4992 populate_metadata read hostname 'smithi037' 2024-04-22T07:21:45.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.141+0000 7fabd227e740 1 --2- 172.21.15.37:0/4078220053 >> [v2:172.21.15.196:6836/3264179771,v1:172.21.15.196:6838/3264179771] conn(0x55edb784a0d0 0x55edb78e1200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:45.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.141+0000 7fabd227e740 4 client.4992 mds_command: new command op to 4294 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "52ee65da", "release": true, "await": true}] 2024-04-22T07:21:45.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.141+0000 7fabd227e740 1 -- 172.21.15.37:0/4078220053 --> [v2:172.21.15.196:6836/3264179771,v1:172.21.15.196:6838/3264179771] -- command(tid 0: {"prefix": "quiesce db", "set_id": "52ee65da", "release": true, "await": true}) -- 0x55edb7795f20 con 0x55edb784a0d0 2024-04-22T07:21:45.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.141+0000 7fabcd424640 1 --2- 172.21.15.37:0/4078220053 >> [v2:172.21.15.196:6836/3264179771,v1:172.21.15.196:6838/3264179771] conn(0x55edb784a0d0 0x55edb78e1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:45.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.141+0000 7fabcd424640 1 --2- 172.21.15.37:0/4078220053 >> [v2:172.21.15.196:6836/3264179771,v1:172.21.15.196:6838/3264179771] conn(0x55edb784a0d0 0x55edb78e1200 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a890c9dc5128a7b0 server_cookie=97003fc2c6b59dcd in_seq=0 out_seq=0 2024-04-22T07:21:45.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.141+0000 7faba7fff640 10 client.4992 ms_handle_connect on v2:172.21.15.196:6836/3264179771 2024-04-22T07:21:45.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.142+0000 7faba7fff640 1 -- 172.21.15.37:0/4078220053 <== mds.0 v2:172.21.15.196:6836/3264179771 1 ==== command_reply(tid 0: 0 ) ==== 8+0+588 (crc 0 0 0) 0x55edb7795f20 con 0x55edb784a0d0 2024-04-22T07:21:45.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.142+0000 7faba7fff640 10 client.4992 handle_command_reply: tid=0 2024-04-22T07:21:45.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.142+0000 7fabd227e740 1 client.4992 shutdown 2024-04-22T07:21:45.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.142+0000 7fabd227e740 1 -- 172.21.15.37:0/4078220053 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55edb7867e90 msgr2=0x55edb7849b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:45.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.142+0000 7fabd227e740 1 --2- 172.21.15.37:0/4078220053 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55edb7867e90 0x55edb7849b90 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fabc4000c00 tx=0x7fabc403b040 comp rx=0 tx=0).stop 2024-04-22T07:21:45.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.142+0000 7fabd227e740 1 -- 172.21.15.37:0/4078220053 shutdown_connections 2024-04-22T07:21:45.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.142+0000 7fabd227e740 1 --2- 172.21.15.37:0/4078220053 >> [v2:172.21.15.196:6836/3264179771,v1:172.21.15.196:6838/3264179771] conn(0x55edb784a0d0 0x55edb78e1200 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:45.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.142+0000 7fabd227e740 1 --2- 172.21.15.37:0/4078220053 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55edb7867e90 0x55edb7849b90 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:45.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.142+0000 7fabd227e740 1 --2- 172.21.15.37:0/4078220053 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55edb78627d0 0x55edb78de6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:45.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.142+0000 7fabd227e740 1 --2- 172.21.15.37:0/4078220053 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x55edb784c2d0 0x55edb78d8080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:45.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.142+0000 7faba7fff640 0 client.4992 ms_handle_reset on v2:172.21.15.196:6836/3264179771 2024-04-22T07:21:45.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.142+0000 7fabd227e740 1 -- 172.21.15.37:0/4078220053 >> 172.21.15.37:0/4078220053 conn(0x55edb7821810 msgr2=0x55edb7844780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:21:45.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.142+0000 7fabd227e740 1 -- 172.21.15.37:0/4078220053 shutdown_connections 2024-04-22T07:21:45.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.142+0000 7fabd227e740 1 -- 172.21.15.37:0/4078220053 wait complete. 2024-04-22T07:21:45.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.142+0000 7fabd227e740 20 client.4992 trim_cache size 0 max 16384 2024-04-22T07:21:45.147 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-04-22T07:21:45.147 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 8, 2024-04-22T07:21:45.147 INFO:teuthology.orchestra.run.smithi037.stdout: "leader": 4294, 2024-04-22T07:21:45.147 INFO:teuthology.orchestra.run.smithi037.stdout: "set_version": 12, 2024-04-22T07:21:45.147 INFO:teuthology.orchestra.run.smithi037.stdout: "sets": { 2024-04-22T07:21:45.147 INFO:teuthology.orchestra.run.smithi037.stdout: "52ee65da": { 2024-04-22T07:21:45.147 INFO:teuthology.orchestra.run.smithi037.stdout: "version": 12, 2024-04-22T07:21:45.147 INFO:teuthology.orchestra.run.smithi037.stdout: "age_ref": 0.0, 2024-04-22T07:21:45.147 INFO:teuthology.orchestra.run.smithi037.stdout: "state": { 2024-04-22T07:21:45.148 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "RELEASED", 2024-04-22T07:21:45.148 INFO:teuthology.orchestra.run.smithi037.stdout: "age": 0.0 2024-04-22T07:21:45.148 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-04-22T07:21:45.148 INFO:teuthology.orchestra.run.smithi037.stdout: "timeout": 60.0, 2024-04-22T07:21:45.148 INFO:teuthology.orchestra.run.smithi037.stdout: "expiration": 89.8, 2024-04-22T07:21:45.148 INFO:teuthology.orchestra.run.smithi037.stdout: "members": { 2024-04-22T07:21:45.148 INFO:teuthology.orchestra.run.smithi037.stdout: "file:/": { 2024-04-22T07:21:45.148 INFO:teuthology.orchestra.run.smithi037.stdout: "excluded": false, 2024-04-22T07:21:45.148 INFO:teuthology.orchestra.run.smithi037.stdout: "state": { 2024-04-22T07:21:45.148 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "RELEASED", 2024-04-22T07:21:45.148 INFO:teuthology.orchestra.run.smithi037.stdout: "age": 0.0 2024-04-22T07:21:45.148 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-04-22T07:21:45.148 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-04-22T07:21:45.148 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-04-22T07:21:45.148 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-04-22T07:21:45.149 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-04-22T07:21:45.149 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-04-22T07:21:45.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.142+0000 7fabcf688640 1 -- 172.21.15.37:0/3608967381 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fabac06c8f0 msgr2=0x7fabac06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:45.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.142+0000 7fabcf688640 1 --2- 172.21.15.37:0/3608967381 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fabac06c8f0 0x7fabac06edb0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fabc00012e0 tx=0x7fabc0009040 comp rx=0 tx=0).stop 2024-04-22T07:21:45.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.142+0000 7fabcf688640 1 -- 172.21.15.37:0/3608967381 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fabc80cde00 msgr2=0x7fabc80b5000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:45.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.142+0000 7fabcf688640 1 --2- 172.21.15.37:0/3608967381 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fabc80cde00 0x7fabc80b5000 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fabb800d800 tx=0x7fabb800dcc0 comp rx=0 tx=0).stop 2024-04-22T07:21:45.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.142+0000 7fabcf688640 1 -- 172.21.15.37:0/3608967381 shutdown_connections 2024-04-22T07:21:45.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.142+0000 7fabcf688640 1 --2- 172.21.15.37:0/3608967381 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fabac06c8f0 0x7fabac06edb0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:45.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.143+0000 7fabcf688640 1 --2- 172.21.15.37:0/3608967381 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fabc81551f0 0x7fabc81f10d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:45.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.143+0000 7fabcf688640 1 --2- 172.21.15.37:0/3608967381 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fabc80cde00 0x7fabc80b5000 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:45.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.143+0000 7fabcf688640 1 --2- 172.21.15.37:0/3608967381 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fabc80cb0b0 0x7fabc81546e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:45.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.143+0000 7fabcf688640 1 -- 172.21.15.37:0/3608967381 >> 172.21.15.37:0/3608967381 conn(0x7fabc806c410 msgr2=0x7fabc80730c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:21:45.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.143+0000 7fabcf688640 1 -- 172.21.15.37:0/3608967381 shutdown_connections 2024-04-22T07:21:45.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:21:45.143+0000 7fabcf688640 1 -- 172.21.15.37:0/3608967381 wait complete. 2024-04-22T07:21:45.152 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set_id: 52ee65da, seconds elapsed: 31.4 2024-04-22T07:21:47.530 INFO:tasks.workunit.client.0.smithi037.stdout: 2024-04-22T07:21:47.530 INFO:tasks.workunit.client.0.smithi037.stdout: 2024-04-22T07:21:47.530 INFO:tasks.workunit.client.0.smithi037.stdout: 2024-04-22T07:21:47.530 INFO:tasks.workunit.client.0.smithi037.stdout:iozone test complete. 2024-04-22T07:21:47.530 INFO:tasks.workunit.client.0.smithi037.stderr:+ iozone -c -e -s 10240M -r 1M -t 1 -F f3 -i 0 -i 1 2024-04-22T07:21:47.597 INFO:tasks.workunit.client.0.smithi037.stdout: Iozone: Performance Test of File I/O 2024-04-22T07:21:47.597 INFO:tasks.workunit.client.0.smithi037.stdout: Version $Revision: 3.494 $ 2024-04-22T07:21:47.597 INFO:tasks.workunit.client.0.smithi037.stdout: Compiled for 64 bit mode. 2024-04-22T07:21:47.597 INFO:tasks.workunit.client.0.smithi037.stdout: Build: linux-AMD64 2024-04-22T07:21:47.598 INFO:tasks.workunit.client.0.smithi037.stdout: 2024-04-22T07:21:47.598 INFO:tasks.workunit.client.0.smithi037.stdout: Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins 2024-04-22T07:21:47.598 INFO:tasks.workunit.client.0.smithi037.stdout: Al Slater, Scott Rhine, Mike Wisner, Ken Goss 2024-04-22T07:21:47.598 INFO:tasks.workunit.client.0.smithi037.stdout: Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR, 2024-04-22T07:21:47.598 INFO:tasks.workunit.client.0.smithi037.stdout: Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner, 2024-04-22T07:21:47.598 INFO:tasks.workunit.client.0.smithi037.stdout: Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone, 2024-04-22T07:21:47.598 INFO:tasks.workunit.client.0.smithi037.stdout: Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root, 2024-04-22T07:21:47.598 INFO:tasks.workunit.client.0.smithi037.stdout: Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer, 2024-04-22T07:21:47.598 INFO:tasks.workunit.client.0.smithi037.stdout: Vangel Bojaxhi, Ben England, Vikentsi Lapa, 2024-04-22T07:21:47.598 INFO:tasks.workunit.client.0.smithi037.stdout: Alexey Skidanov, Sudhir Kumar. 2024-04-22T07:21:47.598 INFO:tasks.workunit.client.0.smithi037.stdout: 2024-04-22T07:21:47.598 INFO:tasks.workunit.client.0.smithi037.stdout: Run began: Mon Apr 22 07:21:47 2024 2024-04-22T07:21:47.599 INFO:tasks.workunit.client.0.smithi037.stdout: 2024-04-22T07:21:47.599 INFO:tasks.workunit.client.0.smithi037.stdout: Include close in write timing 2024-04-22T07:21:47.599 INFO:tasks.workunit.client.0.smithi037.stdout: Include fsync in write timing 2024-04-22T07:21:47.599 INFO:tasks.workunit.client.0.smithi037.stdout: File size set to 10485760 kB 2024-04-22T07:21:47.599 INFO:tasks.workunit.client.0.smithi037.stdout: Record Size 1024 kB 2024-04-22T07:21:47.599 INFO:tasks.workunit.client.0.smithi037.stdout: Command line used: iozone -c -e -s 10240M -r 1M -t 1 -F f3 -i 0 -i 1 2024-04-22T07:21:47.599 INFO:tasks.workunit.client.0.smithi037.stdout: Output is in kBytes/sec 2024-04-22T07:21:47.599 INFO:tasks.workunit.client.0.smithi037.stdout: Time Resolution = 0.000001 seconds. 2024-04-22T07:21:47.599 INFO:tasks.workunit.client.0.smithi037.stdout: Processor cache size set to 1024 kBytes. 2024-04-22T07:21:47.599 INFO:tasks.workunit.client.0.smithi037.stdout: Processor cache line size set to 32 bytes. 2024-04-22T07:21:47.599 INFO:tasks.workunit.client.0.smithi037.stdout: File stride size set to 17 * record size. 2024-04-22T07:21:47.599 INFO:tasks.workunit.client.0.smithi037.stdout: Throughput test with 1 process 2024-04-22T07:21:47.599 INFO:tasks.workunit.client.0.smithi037.stdout: Each process writes a 10485760 kByte file in 1024 kByte records 2024-04-22T07:21:59.695 INFO:tasks.workunit.client.0.smithi037.stdout: 2024-04-22T07:21:59.695 INFO:tasks.workunit.client.0.smithi037.stdout: Children see throughput for 1 initial writers = 869322.88 kB/sec 2024-04-22T07:21:59.696 INFO:tasks.workunit.client.0.smithi037.stdout: Parent sees throughput for 1 initial writers = 869305.05 kB/sec 2024-04-22T07:21:59.696 INFO:tasks.workunit.client.0.smithi037.stdout: Min throughput per process = 869322.88 kB/sec 2024-04-22T07:21:59.696 INFO:tasks.workunit.client.0.smithi037.stdout: Max throughput per process = 869322.88 kB/sec 2024-04-22T07:21:59.696 INFO:tasks.workunit.client.0.smithi037.stdout: Avg throughput per process = 869322.88 kB/sec 2024-04-22T07:21:59.696 INFO:tasks.workunit.client.0.smithi037.stdout: Min xfer = 10485760.00 kB 2024-04-22T07:22:07.212 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-22T07:22:07.216 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-22T07:22:13.490 INFO:tasks.workunit.client.0.smithi037.stdout: 2024-04-22T07:22:13.490 INFO:tasks.workunit.client.0.smithi037.stdout: Children see throughput for 1 rewriters = 903143.06 kB/sec 2024-04-22T07:22:13.490 INFO:tasks.workunit.client.0.smithi037.stdout: Parent sees throughput for 1 rewriters = 903128.28 kB/sec 2024-04-22T07:22:13.490 INFO:tasks.workunit.client.0.smithi037.stdout: Min throughput per process = 903143.06 kB/sec 2024-04-22T07:22:13.490 INFO:tasks.workunit.client.0.smithi037.stdout: Max throughput per process = 903143.06 kB/sec 2024-04-22T07:22:13.490 INFO:tasks.workunit.client.0.smithi037.stdout: Avg throughput per process = 903143.06 kB/sec 2024-04-22T07:22:13.490 INFO:tasks.workunit.client.0.smithi037.stdout: Min xfer = 10485760.00 kB 2024-04-22T07:22:16.937 INFO:tasks.workunit.client.0.smithi037.stdout: 2024-04-22T07:22:16.938 INFO:tasks.workunit.client.0.smithi037.stdout: Children see throughput for 1 readers = 8987252.00 kB/sec 2024-04-22T07:22:16.938 INFO:tasks.workunit.client.0.smithi037.stdout: Parent sees throughput for 1 readers = 8985518.89 kB/sec 2024-04-22T07:22:16.938 INFO:tasks.workunit.client.0.smithi037.stdout: Min throughput per process = 8987252.00 kB/sec 2024-04-22T07:22:16.938 INFO:tasks.workunit.client.0.smithi037.stdout: Max throughput per process = 8987252.00 kB/sec 2024-04-22T07:22:16.938 INFO:tasks.workunit.client.0.smithi037.stdout: Avg throughput per process = 8987252.00 kB/sec 2024-04-22T07:22:16.938 INFO:tasks.workunit.client.0.smithi037.stdout: Min xfer = 10485760.00 kB 2024-04-22T07:22:20.155 INFO:tasks.workunit.client.0.smithi037.stdout: 2024-04-22T07:22:20.155 INFO:tasks.workunit.client.0.smithi037.stdout: Children see throughput for 1 re-readers = 8974876.00 kB/sec 2024-04-22T07:22:20.155 INFO:tasks.workunit.client.0.smithi037.stdout: Parent sees throughput for 1 re-readers = 8972979.51 kB/sec 2024-04-22T07:22:20.155 INFO:tasks.workunit.client.0.smithi037.stdout: Min throughput per process = 8974876.00 kB/sec 2024-04-22T07:22:20.155 INFO:tasks.workunit.client.0.smithi037.stdout: Max throughput per process = 8974876.00 kB/sec 2024-04-22T07:22:20.156 INFO:tasks.workunit.client.0.smithi037.stdout: Avg throughput per process = 8974876.00 kB/sec 2024-04-22T07:22:20.156 INFO:tasks.workunit.client.0.smithi037.stdout: Min xfer = 10485760.00 kB 2024-04-22T07:22:26.919 INFO:tasks.workunit.client.0.smithi037.stdout: 2024-04-22T07:22:26.920 INFO:tasks.workunit.client.0.smithi037.stdout: 2024-04-22T07:22:26.920 INFO:tasks.workunit.client.0.smithi037.stdout: 2024-04-22T07:22:26.920 INFO:tasks.workunit.client.0.smithi037.stdout:iozone test complete. 2024-04-22T07:22:26.922 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-22T07:22:26.922 DEBUG:teuthology.orchestra.run.smithi037:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-04-22T07:22:26.957 INFO:tasks.workunit:Stopping ['suites/iozone.sh'] on client.0... 2024-04-22T07:22:26.957 DEBUG:teuthology.orchestra.run.smithi037:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-04-22T07:22:27.291 DEBUG:teuthology.parallel:result is None 2024-04-22T07:22:27.291 DEBUG:teuthology.orchestra.run.smithi037:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-04-22T07:22:27.322 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-04-22T07:22:27.322 DEBUG:teuthology.run_tasks:Unwinding manager quiescer 2024-04-22T07:22:27.332 INFO:tasks.quiescer:joining Quiescers 2024-04-22T07:22:27.333 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-22T07:22:27.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.465+0000 7f3404b15640 1 Processor -- start 2024-04-22T07:22:27.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.465+0000 7f3404b15640 1 -- start start 2024-04-22T07:22:27.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.466+0000 7f3404b15640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f34000c5360 0x7f340015b420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:27.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.466+0000 7f3404b15640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f34000c9ea0 0x7f340015b960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:27.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.466+0000 7f3404b15640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34000c9040 con 0x7f34001550c0 2024-04-22T07:22:27.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.466+0000 7f3404b15640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f34000c8e10 con 0x7f34000c9ea0 2024-04-22T07:22:27.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.466+0000 7f3404b15640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f340006b970 con 0x7f34000c5360 2024-04-22T07:22:27.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.466+0000 7f33fed9d640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f34000c9ea0 0x7f340015b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:27.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.466+0000 7f33fed9d640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f34000c9ea0 0x7f340015b960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42314/0 (socket says 172.21.15.37:42314) 2024-04-22T07:22:27.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.466+0000 7f33fed9d640 1 -- 172.21.15.37:0/83486363 learned_addr learned my addr 172.21.15.37:0/83486363 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:22:27.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.466+0000 7f33fed9d640 1 -- 172.21.15.37:0/83486363 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f34000c5360 msgr2=0x7f340015b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:22:27.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.466+0000 7f33fdd9b640 1 --2- 172.21.15.37:0/83486363 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f34000c5360 0x7f340015b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:27.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.466+0000 7f33fed9d640 1 --2- 172.21.15.37:0/83486363 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f34000c5360 0x7f340015b420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:27.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.466+0000 7f33fed9d640 1 -- 172.21.15.37:0/83486363 >> v1:172.21.15.196:6789/0 conn(0x7f34001550c0 legacy=0x7f34000ce360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:22:27.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.466+0000 7f33fed9d640 1 -- 172.21.15.37:0/83486363 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f340006bc50 con 0x7f34000c9ea0 2024-04-22T07:22:27.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.467+0000 7f33fed9d640 1 --2- 172.21.15.37:0/83486363 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34000c9ea0 0x7f340015b960 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f33f8009e50 tx=0x7f33f802bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adcfb09e856ce8cb server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:22:27.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.467+0000 7f33fd59a640 1 -- 172.21.15.37:0/83486363 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33f802cb00 con 0x7f34000c9ea0 2024-04-22T07:22:27.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.467+0000 7f33fd59a640 1 -- 172.21.15.37:0/83486363 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33f802cca0 con 0x7f34000c9ea0 2024-04-22T07:22:27.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.467+0000 7f33fd59a640 1 -- 172.21.15.37:0/83486363 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33f8034610 con 0x7f34000c9ea0 2024-04-22T07:22:27.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.468+0000 7f3404b15640 1 -- 172.21.15.37:0/83486363 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34000c9ea0 msgr2=0x7f340015b960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:27.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.468+0000 7f3404b15640 1 --2- 172.21.15.37:0/83486363 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34000c9ea0 0x7f340015b960 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f33f8009e50 tx=0x7f33f802bf60 comp rx=0 tx=0).stop 2024-04-22T07:22:27.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.468+0000 7f3404b15640 1 -- 172.21.15.37:0/83486363 shutdown_connections 2024-04-22T07:22:27.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.468+0000 7f3404b15640 1 --2- 172.21.15.37:0/83486363 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34000c9ea0 0x7f340015b960 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:27.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.468+0000 7f3404b15640 1 --2- 172.21.15.37:0/83486363 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f34000c5360 0x7f340015b420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:27.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.468+0000 7f3404b15640 1 -- 172.21.15.37:0/83486363 >> 172.21.15.37:0/83486363 conn(0x7f340006db80 msgr2=0x7f340006df60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:22:27.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.468+0000 7f3404b15640 1 -- 172.21.15.37:0/83486363 shutdown_connections 2024-04-22T07:22:27.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.468+0000 7f3404b15640 1 -- 172.21.15.37:0/83486363 wait complete. 2024-04-22T07:22:27.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.469+0000 7f3404b15640 1 Processor -- start 2024-04-22T07:22:27.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.469+0000 7f3404b15640 1 -- start start 2024-04-22T07:22:27.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.470+0000 7f3404b15640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f34000c5360 0x7f340015ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:27.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.470+0000 7f3404b15640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f34000c9ea0 0x7f34001f4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:27.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.470+0000 7f3404b15640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34001550c0 0x7f34000cd4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:27.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.470+0000 7f3404b15640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f340015ae90 con 0x7f34001550c0 2024-04-22T07:22:27.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.470+0000 7f3404b15640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f340006c210 con 0x7f34000c5360 2024-04-22T07:22:27.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.470+0000 7f3404b15640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f34000cea70 con 0x7f34000c9ea0 2024-04-22T07:22:27.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.470+0000 7f33fed9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34001550c0 0x7f34000cd4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:27.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.470+0000 7f33fed9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34001550c0 0x7f34000cd4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42326/0 (socket says 172.21.15.37:42326) 2024-04-22T07:22:27.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.470+0000 7f33fed9d640 1 -- 172.21.15.37:0/3607503165 learned_addr learned my addr 172.21.15.37:0/3607503165 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:22:27.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.470+0000 7f33fdd9b640 1 --2- 172.21.15.37:0/3607503165 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f34000c9ea0 0x7f34001f4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:27.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.470+0000 7f33fe59c640 1 --2- 172.21.15.37:0/3607503165 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f34000c5360 0x7f340015ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:27.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.470+0000 7f33fed9d640 1 -- 172.21.15.37:0/3607503165 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f34000c9ea0 msgr2=0x7f34001f4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:27.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.470+0000 7f33fed9d640 1 --2- 172.21.15.37:0/3607503165 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f34000c9ea0 0x7f34001f4cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:27.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.471+0000 7f33fed9d640 1 -- 172.21.15.37:0/3607503165 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f34000c5360 msgr2=0x7f340015ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:27.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.471+0000 7f33fed9d640 1 --2- 172.21.15.37:0/3607503165 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f34000c5360 0x7f340015ed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:27.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.471+0000 7f33fed9d640 1 -- 172.21.15.37:0/3607503165 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34001f2400 con 0x7f34001550c0 2024-04-22T07:22:27.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.471+0000 7f33fed9d640 1 --2- 172.21.15.37:0/3607503165 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34001550c0 0x7f34000cd4d0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f33f8009e50 tx=0x7f33f8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:22:27.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.471+0000 7f33eeffd640 1 -- 172.21.15.37:0/3607503165 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33f8043020 con 0x7f34001550c0 2024-04-22T07:22:27.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.471+0000 7f3404b15640 1 -- 172.21.15.37:0/3607503165 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34001f26e0 con 0x7f34001550c0 2024-04-22T07:22:27.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.471+0000 7f33eeffd640 1 -- 172.21.15.37:0/3607503165 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33f802ce50 con 0x7f34001550c0 2024-04-22T07:22:27.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.471+0000 7f33eeffd640 1 -- 172.21.15.37:0/3607503165 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33f803e6b0 con 0x7f34001550c0 2024-04-22T07:22:27.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.471+0000 7f3404b15640 1 -- 172.21.15.37:0/3607503165 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34001f2ca0 con 0x7f34001550c0 2024-04-22T07:22:27.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.472+0000 7f3404b15640 1 -- 172.21.15.37:0/3607503165 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3400069cc0 con 0x7f34001550c0 2024-04-22T07:22:27.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.472+0000 7f33eeffd640 1 -- 172.21.15.37:0/3607503165 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f33f8046020 con 0x7f34001550c0 2024-04-22T07:22:27.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.473+0000 7f33eeffd640 1 --2- 172.21.15.37:0/3607503165 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f33e006c920 0x7f33e006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:27.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.473+0000 7f33eeffd640 1 -- 172.21.15.37:0/3607503165 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f33f80ae1c0 con 0x7f34001550c0 2024-04-22T07:22:27.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.473+0000 7f33fe59c640 1 --2- 172.21.15.37:0/3607503165 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f33e006c920 0x7f33e006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:27.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.474+0000 7f33fe59c640 1 --2- 172.21.15.37:0/3607503165 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f33e006c920 0x7f33e006ede0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f33f0006fd0 tx=0x7f33f0009060 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:22:27.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.477+0000 7f33eeffd640 1 -- 172.21.15.37:0/3607503165 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f33f804d070 con 0x7f34001550c0 2024-04-22T07:22:27.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.702+0000 7f3404b15640 1 -- 172.21.15.37:0/3607503165 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3400070c20 con 0x7f34001550c0 2024-04-22T07:22:27.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.703+0000 7f33eeffd640 1 -- 172.21.15.37:0/3607503165 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6827 (secure 0 0 0) 0x7f33f807be00 con 0x7f34001550c0 2024-04-22T07:22:27.701 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-22T07:22:27.701 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4265,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6839/671847354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6835","nonce":671847354},{"type":"v1","addr":"172.21.15.196:6839","nonce":671847354}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6833/1549427395","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1549427395},{"type":"v1","addr":"172.21.15.37:6833","nonce":1549427395}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6836/3825988951","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":3825988951},{"type":"v1","addr":"172.21.15.37:6836","nonce":3825988951}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4272,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/611771502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6835","nonce":611771502},{"type":"v1","addr":"172.21.15.37:6837","nonce":611771502}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4291,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6837/3055080225","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6834","nonce":3055080225},{"type":"v1","addr":"172.21.15.196:6837","nonce":3055080225}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-22T07:18:36.111618+0000","modified":"2024-04-22T07:18:41.783857+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.196:6838/3264179771","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6836","nonce":3264179771},{"type":"v1","addr":"172.21.15.196:6838","nonce":3264179771}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4294,"qdb_cluster":[4294]},"id":1}]} 2024-04-22T07:22:27.701 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 8 2024-04-22T07:22:27.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.704+0000 7f3404b15640 1 -- 172.21.15.37:0/3607503165 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f33e006c920 msgr2=0x7f33e006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:27.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.704+0000 7f3404b15640 1 --2- 172.21.15.37:0/3607503165 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f33e006c920 0x7f33e006ede0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f33f0006fd0 tx=0x7f33f0009060 comp rx=0 tx=0).stop 2024-04-22T07:22:27.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.704+0000 7f3404b15640 1 -- 172.21.15.37:0/3607503165 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34001550c0 msgr2=0x7f34000cd4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:27.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.704+0000 7f3404b15640 1 --2- 172.21.15.37:0/3607503165 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34001550c0 0x7f34000cd4d0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f33f8009e50 tx=0x7f33f8004a40 comp rx=0 tx=0).stop 2024-04-22T07:22:27.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.704+0000 7f3404b15640 1 -- 172.21.15.37:0/3607503165 shutdown_connections 2024-04-22T07:22:27.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.704+0000 7f3404b15640 1 --2- 172.21.15.37:0/3607503165 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f33e006c920 0x7f33e006ede0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:27.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.704+0000 7f3404b15640 1 --2- 172.21.15.37:0/3607503165 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34001550c0 0x7f34000cd4d0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:27.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.704+0000 7f3404b15640 1 --2- 172.21.15.37:0/3607503165 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f34000c9ea0 0x7f34001f4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:27.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.704+0000 7f3404b15640 1 --2- 172.21.15.37:0/3607503165 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f34000c5360 0x7f340015ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:27.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.704+0000 7f3404b15640 1 -- 172.21.15.37:0/3607503165 >> 172.21.15.37:0/3607503165 conn(0x7f340006db80 msgr2=0x7f3400153060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:22:27.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.705+0000 7f3404b15640 1 -- 172.21.15.37:0/3607503165 shutdown_connections 2024-04-22T07:22:27.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.705+0000 7f3404b15640 1 -- 172.21.15.37:0/3607503165 wait complete. 2024-04-22T07:22:27.714 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4294 quiesce db --cancel --all' 2024-04-22T07:22:27.715 DEBUG:teuthology.orchestra.run.smithi037:> timeout 75 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4294 quiesce db --cancel --all 2024-04-22T07:22:27.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.824+0000 7f93a84ba640 1 Processor -- start 2024-04-22T07:22:27.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.824+0000 7f93a84ba640 1 -- start start 2024-04-22T07:22:27.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.825+0000 7f93a84ba640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f93a00c5860 0x7f93a00cbc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:27.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.825+0000 7f93a84ba640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f93a00cc150 0x7f93a015e300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:27.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.825+0000 7f93a84ba640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f93a0155420 con 0x7f93a0155040 2024-04-22T07:22:27.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.825+0000 7f93a84ba640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f93a00b3a20 con 0x7f93a00cc150 2024-04-22T07:22:27.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.825+0000 7f93a84ba640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f93a00cb570 con 0x7f93a00c5860 2024-04-22T07:22:27.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.825+0000 7f93a6256640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f93a0155040 0x7f93a00cc750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:58778/0 (socket says 172.21.15.37:58778) 2024-04-22T07:22:27.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.825+0000 7f93a6256640 1 -- 172.21.15.37:0/1152856307 learned_addr learned my addr 172.21.15.37:0/1152856307 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-04-22T07:22:27.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.825+0000 7f93a5a55640 1 --2- 172.21.15.37:0/1152856307 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f93a00c5860 0x7f93a00cbc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:27.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.825+0000 7f93a6a57640 1 --2- 172.21.15.37:0/1152856307 >> v2:172.21.15.196:3300/0 conn(0x7f93a00cc150 0x7f93a015e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:27.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.825+0000 7f93a5254640 1 -- 172.21.15.37:0/1152856307 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1926265015 0 0) 0x7f9394001110 con 0x7f93a0155040 2024-04-22T07:22:27.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.825+0000 7f93a5254640 1 -- 172.21.15.37:0/1152856307 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f938c003520 con 0x7f93a0155040 2024-04-22T07:22:27.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.826+0000 7f93a5a55640 1 -- 172.21.15.37:0/1152856307 >> v2:172.21.15.196:3300/0 conn(0x7f93a00cc150 msgr2=0x7f93a015e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:22:27.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.826+0000 7f93a5a55640 1 --2- 172.21.15.37:0/1152856307 >> v2:172.21.15.196:3300/0 conn(0x7f93a00cc150 0x7f93a015e300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:27.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.826+0000 7f93a5a55640 1 -- 172.21.15.37:0/1152856307 >> v1:172.21.15.37:6789/0 conn(0x7f93a0155040 legacy=0x7f93a00cc750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:27.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.826+0000 7f93a5a55640 1 -- 172.21.15.37:0/1152856307 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93a00cb290 con 0x7f93a00c5860 2024-04-22T07:22:27.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.826+0000 7f93a6a57640 1 --2- 172.21.15.37:0/1152856307 >> v2:172.21.15.196:3300/0 conn(0x7f93a00cc150 0x7f93a015e300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-22T07:22:27.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.826+0000 7f93a5a55640 1 --2- 172.21.15.37:0/1152856307 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f93a00c5860 0x7f93a00cbc10 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f939c009790 tx=0x7f939c02b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=44f400da4af91a57 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:22:27.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.827+0000 7f93a5254640 1 -- 172.21.15.37:0/1152856307 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f939c035020 con 0x7f93a00c5860 2024-04-22T07:22:27.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.827+0000 7f93a5254640 1 -- 172.21.15.37:0/1152856307 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f939c031800 con 0x7f93a00c5860 2024-04-22T07:22:27.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.827+0000 7f93a5254640 1 -- 172.21.15.37:0/1152856307 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f939c031bb0 con 0x7f93a00c5860 2024-04-22T07:22:27.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.827+0000 7f93a84ba640 1 -- 172.21.15.37:0/1152856307 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f93a00c5860 msgr2=0x7f93a00cbc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:27.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.827+0000 7f93a84ba640 1 --2- 172.21.15.37:0/1152856307 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f93a00c5860 0x7f93a00cbc10 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f939c009790 tx=0x7f939c02b8a0 comp rx=0 tx=0).stop 2024-04-22T07:22:27.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.827+0000 7f93a84ba640 1 -- 172.21.15.37:0/1152856307 shutdown_connections 2024-04-22T07:22:27.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.827+0000 7f93a84ba640 1 --2- 172.21.15.37:0/1152856307 >> v2:172.21.15.196:3300/0 conn(0x7f93a00cc150 0x7f93a015e300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:27.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.827+0000 7f93a84ba640 1 --2- 172.21.15.37:0/1152856307 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f93a00c5860 0x7f93a00cbc10 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:27.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.827+0000 7f93a84ba640 1 -- 172.21.15.37:0/1152856307 >> 172.21.15.37:0/1152856307 conn(0x7f93a0067ce0 msgr2=0x7f93a00d0610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:22:27.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.827+0000 7f93a84ba640 1 -- 172.21.15.37:0/1152856307 shutdown_connections 2024-04-22T07:22:27.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.827+0000 7f93a84ba640 1 -- 172.21.15.37:0/1152856307 wait complete. 2024-04-22T07:22:27.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.828+0000 7f93a84ba640 1 Processor -- start 2024-04-22T07:22:27.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.828+0000 7f93a84ba640 1 -- start start 2024-04-22T07:22:27.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.829+0000 7f93a84ba640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f93a00c5860 0x7f93a00b5980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:27.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.829+0000 7f93a84ba640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f93a00cc150 0x7f93a0156e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:27.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.829+0000 7f93a84ba640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f93a0155040 0x7f93a0157380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:27.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.829+0000 7f93a84ba640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f93a00c6370 con 0x7f93a00cc150 2024-04-22T07:22:27.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.829+0000 7f93a84ba640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f93a00c69c0 con 0x7f93a0155040 2024-04-22T07:22:27.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.829+0000 7f93a84ba640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f93a00c6650 con 0x7f93a00c5860 2024-04-22T07:22:27.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.829+0000 7f93a5a55640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f93a00cc150 0x7f93a0156e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:27.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.829+0000 7f93a5a55640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f93a00cc150 0x7f93a0156e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42336/0 (socket says 172.21.15.37:42336) 2024-04-22T07:22:27.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.829+0000 7f93a5a55640 1 -- 172.21.15.37:0/3735027948 learned_addr learned my addr 172.21.15.37:0/3735027948 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:22:27.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.829+0000 7f93a6256640 1 --2- 172.21.15.37:0/3735027948 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f93a00c5860 0x7f93a00b5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:27.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.829+0000 7f93a6a57640 1 --2- 172.21.15.37:0/3735027948 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f93a0155040 0x7f93a0157380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:27.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.830+0000 7f93a5a55640 1 -- 172.21.15.37:0/3735027948 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f93a00c5860 msgr2=0x7f93a00b5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:27.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.830+0000 7f93a5a55640 1 --2- 172.21.15.37:0/3735027948 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f93a00c5860 0x7f93a00b5980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:27.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.830+0000 7f93a5a55640 1 -- 172.21.15.37:0/3735027948 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f93a0155040 msgr2=0x7f93a0157380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:27.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.830+0000 7f93a5a55640 1 --2- 172.21.15.37:0/3735027948 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f93a0155040 0x7f93a0157380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:27.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.830+0000 7f93a5a55640 1 -- 172.21.15.37:0/3735027948 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93a0146dc0 con 0x7f93a00cc150 2024-04-22T07:22:27.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.830+0000 7f93a6a57640 1 --2- 172.21.15.37:0/3735027948 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f93a0155040 0x7f93a0157380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T07:22:27.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.830+0000 7f93a5a55640 1 --2- 172.21.15.37:0/3735027948 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f93a00cc150 0x7f93a0156e40 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f939c02beb0 tx=0x7f939c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:22:27.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.830+0000 7f9392ffd640 1 -- 172.21.15.37:0/3735027948 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f939c035040 con 0x7f93a00cc150 2024-04-22T07:22:27.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.830+0000 7f9392ffd640 1 -- 172.21.15.37:0/3735027948 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f939c03ad00 con 0x7f93a00cc150 2024-04-22T07:22:27.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.830+0000 7f93a84ba640 1 -- 172.21.15.37:0/3735027948 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93a0147060 con 0x7f93a00cc150 2024-04-22T07:22:27.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.830+0000 7f9392ffd640 1 -- 172.21.15.37:0/3735027948 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f939c0466c0 con 0x7f93a00cc150 2024-04-22T07:22:27.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.830+0000 7f93a84ba640 1 -- 172.21.15.37:0/3735027948 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93a0148200 con 0x7f93a00cc150 2024-04-22T07:22:27.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.832+0000 7f9392ffd640 1 -- 172.21.15.37:0/3735027948 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f939c038020 con 0x7f93a00cc150 2024-04-22T07:22:27.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.832+0000 7f9392ffd640 1 --2- 172.21.15.37:0/3735027948 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f938406c8f0 0x7f938406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:27.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.832+0000 7f9392ffd640 1 -- 172.21.15.37:0/3735027948 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f939c0adc80 con 0x7f93a00cc150 2024-04-22T07:22:27.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.832+0000 7f93a6256640 1 --2- 172.21.15.37:0/3735027948 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f938406c8f0 0x7f938406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:27.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.833+0000 7f93a6256640 1 --2- 172.21.15.37:0/3735027948 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f938406c8f0 0x7f938406edb0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f9394005880 tx=0x7f9394009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:22:27.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.833+0000 7f93ab189740 1 Processor -- start 2024-04-22T07:22:27.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.833+0000 7f93ab189740 1 -- start start 2024-04-22T07:22:27.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.834+0000 7f93ab189740 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x56337937a310 0x56337933ae60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:27.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.834+0000 7f93ab189740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56337937a6f0 0x56337937adc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:27.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.834+0000 7f93ab189740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x563379337240 0x563379383420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:27.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.834+0000 7f93ab189740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x56337929f000 con 0x56337937a6f0 2024-04-22T07:22:27.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.834+0000 7f93ab189740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x56337923bb20 con 0x563379337240 2024-04-22T07:22:27.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.834+0000 7f93ab189740 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x56337929afc0 con 0x56337937a310 2024-04-22T07:22:27.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.834+0000 7f93a5a55640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56337937a6f0 0x56337937adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:27.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.834+0000 7f93a5a55640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56337937a6f0 0x56337937adc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42340/0 (socket says 172.21.15.37:42340) 2024-04-22T07:22:27.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.834+0000 7f93a5a55640 1 -- 172.21.15.37:0/2674323655 learned_addr learned my addr 172.21.15.37:0/2674323655 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:22:27.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.834+0000 7f93a6256640 1 --2- 172.21.15.37:0/2674323655 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x56337937a310 0x56337933ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:27.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.834+0000 7f93a6a57640 1 --2- 172.21.15.37:0/2674323655 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x563379337240 0x563379383420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:27.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.834+0000 7f93a5a55640 1 -- 172.21.15.37:0/2674323655 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x56337937a310 msgr2=0x56337933ae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:22:27.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.834+0000 7f93a5a55640 1 --2- 172.21.15.37:0/2674323655 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x56337937a310 0x56337933ae60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:27.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.834+0000 7f93a5a55640 1 -- 172.21.15.37:0/2674323655 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x563379337240 msgr2=0x563379383420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:22:27.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.834+0000 7f93a5a55640 1 --2- 172.21.15.37:0/2674323655 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x563379337240 0x563379383420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:27.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.834+0000 7f93a5a55640 1 -- 172.21.15.37:0/2674323655 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563379255ea0 con 0x56337937a6f0 2024-04-22T07:22:27.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.834+0000 7f93a5a55640 1 --2- 172.21.15.37:0/2674323655 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56337937a6f0 0x56337937adc0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f939c07b7e0 tx=0x7f939c07b540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfaf8ed1bed79084 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:22:27.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.834+0000 7f9383fff640 1 -- 172.21.15.37:0/2674323655 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f939c04b050 con 0x56337937a6f0 2024-04-22T07:22:27.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.835+0000 7f9383fff640 1 -- 172.21.15.37:0/2674323655 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f939c07c040 con 0x56337937a6f0 2024-04-22T07:22:27.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.835+0000 7f9383fff640 1 -- 172.21.15.37:0/2674323655 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f939c07b940 con 0x56337937a6f0 2024-04-22T07:22:27.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.835+0000 7f93ab189740 1 -- 172.21.15.37:0/2674323655 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56337937a6f0 msgr2=0x56337937adc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:27.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.835+0000 7f93ab189740 1 --2- 172.21.15.37:0/2674323655 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56337937a6f0 0x56337937adc0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f939c07b7e0 tx=0x7f939c07b540 comp rx=0 tx=0).stop 2024-04-22T07:22:27.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.835+0000 7f93ab189740 1 -- 172.21.15.37:0/2674323655 shutdown_connections 2024-04-22T07:22:27.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.835+0000 7f93ab189740 1 --2- 172.21.15.37:0/2674323655 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x563379337240 0x563379383420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:27.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.835+0000 7f93ab189740 1 --2- 172.21.15.37:0/2674323655 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56337937a6f0 0x56337937adc0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:27.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.835+0000 7f93ab189740 1 --2- 172.21.15.37:0/2674323655 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x56337937a310 0x56337933ae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:27.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.835+0000 7f93ab189740 1 -- 172.21.15.37:0/2674323655 >> 172.21.15.37:0/2674323655 conn(0x563379335ef0 msgr2=0x5633793387f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:22:27.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.835+0000 7f93ab189740 1 -- 172.21.15.37:0/2674323655 shutdown_connections 2024-04-22T07:22:27.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.835+0000 7f93ab189740 1 -- 172.21.15.37:0/2674323655 wait complete. 2024-04-22T07:22:27.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.836+0000 7f93ab189740 1 -- start start 2024-04-22T07:22:27.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.836+0000 7f93ab189740 1 Processor -- start 2024-04-22T07:22:27.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.837+0000 7f93ab189740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56337937a310 0x5633793576c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:27.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.837+0000 7f93ab189740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56337937a6f0 0x56337937dff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:27.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.837+0000 7f93ab189740 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x563379358960 0x56337935a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:27.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.837+0000 7f93ab189740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x56337929f000 con 0x56337937a6f0 2024-04-22T07:22:27.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.837+0000 7f93ab189740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x563379239510 con 0x56337937a310 2024-04-22T07:22:27.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.837+0000 7f93ab189740 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x563379382f90 con 0x563379358960 2024-04-22T07:22:27.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.837+0000 7f93ab189740 10 client.0 _ll_register_callbacks cb 0x563379238f00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-22T07:22:27.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.837+0000 7f93a5a55640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56337937a6f0 0x56337937dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:27.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.837+0000 7f93a5a55640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56337937a6f0 0x56337937dff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42348/0 (socket says 172.21.15.37:42348) 2024-04-22T07:22:27.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.837+0000 7f93a5a55640 1 -- 172.21.15.37:0/3079535934 learned_addr learned my addr 172.21.15.37:0/3079535934 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:22:27.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.837+0000 7f93a6256640 1 --2- 172.21.15.37:0/3079535934 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56337937a310 0x5633793576c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:27.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.837+0000 7f93a6a57640 1 --2- 172.21.15.37:0/3079535934 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x563379358960 0x56337935a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:27.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.837+0000 7f93a5a55640 1 -- 172.21.15.37:0/3079535934 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x563379358960 msgr2=0x56337935a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:22:27.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.837+0000 7f93a5a55640 1 --2- 172.21.15.37:0/3079535934 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x563379358960 0x56337935a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:27.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.837+0000 7f93a5a55640 1 -- 172.21.15.37:0/3079535934 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56337937a310 msgr2=0x5633793576c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:22:27.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.837+0000 7f93a5a55640 1 --2- 172.21.15.37:0/3079535934 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56337937a310 0x5633793576c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:27.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.837+0000 7f93a5a55640 1 -- 172.21.15.37:0/3079535934 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56337907da20 con 0x56337937a6f0 2024-04-22T07:22:27.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.837+0000 7f93a5a55640 1 --2- 172.21.15.37:0/3079535934 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56337937a6f0 0x56337937dff0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f939c09b190 tx=0x7f939c03d070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebc67e453a0192ed server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:22:27.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.837+0000 7f93817fa640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-04-22T07:22:27.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.838+0000 7f93817fa640 1 -- 172.21.15.37:0/3079535934 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f939c084520 con 0x56337937a6f0 2024-04-22T07:22:27.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.838+0000 7f93817fa640 1 -- 172.21.15.37:0/3079535934 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f939c084090 con 0x56337937a6f0 2024-04-22T07:22:27.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.838+0000 7f93ab189740 1 -- 172.21.15.37:0/3079535934 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f939c07c040 con 0x56337937a6f0 2024-04-22T07:22:27.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.838+0000 7f93817fa640 1 -- 172.21.15.37:0/3079535934 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7f939c04b070 con 0x56337937a6f0 2024-04-22T07:22:27.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.838+0000 7f93ab189740 10 client.5010 fetch_fsmap learned FSMap version 8 2024-04-22T07:22:27.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.838+0000 7f93ab189740 1 -- 172.21.15.37:0/3079535934 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x5633790de1b0 con 0x56337937a6f0 2024-04-22T07:22:27.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.838+0000 7f93817fa640 1 -- 172.21.15.37:0/3079535934 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f939c07c040 con 0x56337937a6f0 2024-04-22T07:22:27.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.838+0000 7f93817fa640 1 -- 172.21.15.37:0/3079535934 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 8) ==== 4704+0+0 (secure 0 0 0) 0x7f939c099b60 con 0x56337937a6f0 2024-04-22T07:22:27.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.838+0000 7f93ab189740 10 client.5010 fetch_fsmap finished waiting for FSMap version 8 2024-04-22T07:22:27.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.838+0000 7f93ab189740 10 client.5010 resolve_mds: validated gid 4294 aka daemon mds.f 2024-04-22T07:22:27.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.838+0000 7f93ab189740 20 client.5010 populate_metadata read hostname 'smithi037' 2024-04-22T07:22:27.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.838+0000 7f93ab189740 1 --2- 172.21.15.37:0/3079535934 >> [v2:172.21.15.196:6836/3264179771,v1:172.21.15.196:6838/3264179771] conn(0x56337938ec20 0x56337938f040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:27.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.838+0000 7f93ab189740 4 client.5010 mds_command: new command op to 4294 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-22T07:22:27.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.838+0000 7f93ab189740 1 -- 172.21.15.37:0/3079535934 --> [v2:172.21.15.196:6836/3264179771,v1:172.21.15.196:6838/3264179771] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5633792aca20 con 0x56337938ec20 2024-04-22T07:22:27.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.838+0000 7f93a6256640 1 --2- 172.21.15.37:0/3079535934 >> [v2:172.21.15.196:6836/3264179771,v1:172.21.15.196:6838/3264179771] conn(0x56337938ec20 0x56337938f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:27.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.839+0000 7f93a6256640 1 --2- 172.21.15.37:0/3079535934 >> [v2:172.21.15.196:6836/3264179771,v1:172.21.15.196:6838/3264179771] conn(0x56337938ec20 0x56337938f040 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a7017c2808f9140f server_cookie=230dcb5ab10cbeea in_seq=0 out_seq=0 2024-04-22T07:22:27.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.839+0000 7f93817fa640 10 client.5010 ms_handle_connect on v2:172.21.15.196:6836/3264179771 2024-04-22T07:22:27.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.839+0000 7f93817fa640 1 -- 172.21.15.37:0/3079535934 <== mds.0 v2:172.21.15.196:6836/3264179771 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5633792aca20 con 0x56337938ec20 2024-04-22T07:22:27.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.839+0000 7f93817fa640 10 client.5010 handle_command_reply: tid=0 2024-04-22T07:22:27.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.839+0000 7f93ab189740 1 client.5010 shutdown 2024-04-22T07:22:27.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.840+0000 7f93ab189740 1 -- 172.21.15.37:0/3079535934 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56337937a6f0 msgr2=0x56337937dff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:27.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.840+0000 7f93ab189740 1 --2- 172.21.15.37:0/3079535934 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56337937a6f0 0x56337937dff0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f939c09b190 tx=0x7f939c03d070 comp rx=0 tx=0).stop 2024-04-22T07:22:27.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.840+0000 7f93ab189740 1 -- 172.21.15.37:0/3079535934 shutdown_connections 2024-04-22T07:22:27.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.840+0000 7f93ab189740 1 --2- 172.21.15.37:0/3079535934 >> [v2:172.21.15.196:6836/3264179771,v1:172.21.15.196:6838/3264179771] conn(0x56337938ec20 0x56337938f040 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:27.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.840+0000 7f93ab189740 1 --2- 172.21.15.37:0/3079535934 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x563379358960 0x56337935a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:27.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.840+0000 7f93ab189740 1 --2- 172.21.15.37:0/3079535934 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56337937a6f0 0x56337937dff0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:27.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.840+0000 7f93ab189740 1 --2- 172.21.15.37:0/3079535934 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56337937a310 0x5633793576c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:27.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.840+0000 7f93ab189740 1 -- 172.21.15.37:0/3079535934 >> 172.21.15.37:0/3079535934 conn(0x563379337240 msgr2=0x56337935f2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:22:27.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.840+0000 7f93817fa640 0 client.5010 ms_handle_reset on v2:172.21.15.196:6836/3264179771 2024-04-22T07:22:27.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.840+0000 7f93ab189740 1 -- 172.21.15.37:0/3079535934 shutdown_connections 2024-04-22T07:22:27.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.840+0000 7f93ab189740 1 -- 172.21.15.37:0/3079535934 wait complete. 2024-04-22T07:22:27.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.840+0000 7f93ab189740 20 client.5010 trim_cache size 0 max 16384 2024-04-22T07:22:27.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.858+0000 7f93ab189740 1 Processor -- start 2024-04-22T07:22:27.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.858+0000 7f93ab189740 1 -- start start 2024-04-22T07:22:27.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.858+0000 7f93ab189740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x563379358960 0x563379353fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:27.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.858+0000 7f93ab189740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56337937a310 0x563379379130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:27.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.858+0000 7f93ab189740 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x56337937a6f0 0x563379379670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:27.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.858+0000 7f93ab189740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f93a01fe010 con 0x56337937a310 2024-04-22T07:22:27.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.858+0000 7f93ab189740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f93a01fcf20 con 0x563379358960 2024-04-22T07:22:27.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.858+0000 7f93ab189740 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f93a01569e0 con 0x56337937a6f0 2024-04-22T07:22:27.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.858+0000 7f93a5a55640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56337937a310 0x563379379130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:27.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.858+0000 7f93a5a55640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56337937a310 0x563379379130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42362/0 (socket says 172.21.15.37:42362) 2024-04-22T07:22:27.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.858+0000 7f93a5a55640 1 -- 172.21.15.37:0/2313217255 learned_addr learned my addr 172.21.15.37:0/2313217255 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:22:27.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.859+0000 7f93a6a57640 1 --2- 172.21.15.37:0/2313217255 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x56337937a6f0 0x563379379670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:27.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.859+0000 7f93a6256640 1 --2- 172.21.15.37:0/2313217255 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x563379358960 0x563379353fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:27.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.859+0000 7f93a5a55640 1 -- 172.21.15.37:0/2313217255 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x56337937a6f0 msgr2=0x563379379670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:22:27.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.859+0000 7f93a5a55640 1 --2- 172.21.15.37:0/2313217255 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x56337937a6f0 0x563379379670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:27.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.859+0000 7f93a5a55640 1 -- 172.21.15.37:0/2313217255 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x563379358960 msgr2=0x563379353fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:22:27.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.859+0000 7f93a5a55640 1 --2- 172.21.15.37:0/2313217255 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x563379358960 0x563379353fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:27.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.859+0000 7f93a5a55640 1 -- 172.21.15.37:0/2313217255 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563378f71310 con 0x56337937a310 2024-04-22T07:22:27.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.859+0000 7f93a5a55640 1 --2- 172.21.15.37:0/2313217255 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56337937a310 0x563379379130 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f939c07b7e0 tx=0x7f939c048000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49fd271e6e333ccf server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:22:27.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.859+0000 7f93837fe640 1 -- 172.21.15.37:0/2313217255 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f939c07c040 con 0x56337937a310 2024-04-22T07:22:27.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.859+0000 7f93837fe640 1 -- 172.21.15.37:0/2313217255 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f939c07b940 con 0x56337937a310 2024-04-22T07:22:27.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.859+0000 7f93837fe640 1 -- 172.21.15.37:0/2313217255 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f939c07fcf0 con 0x56337937a310 2024-04-22T07:22:27.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.859+0000 7f93ab189740 1 -- 172.21.15.37:0/2313217255 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56337937a310 msgr2=0x563379379130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:27.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.859+0000 7f93ab189740 1 --2- 172.21.15.37:0/2313217255 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56337937a310 0x563379379130 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f939c07b7e0 tx=0x7f939c048000 comp rx=0 tx=0).stop 2024-04-22T07:22:27.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.860+0000 7f93ab189740 1 -- 172.21.15.37:0/2313217255 shutdown_connections 2024-04-22T07:22:27.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.860+0000 7f93ab189740 1 --2- 172.21.15.37:0/2313217255 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x56337937a6f0 0x563379379670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:27.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.860+0000 7f93ab189740 1 --2- 172.21.15.37:0/2313217255 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56337937a310 0x563379379130 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:27.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.860+0000 7f93ab189740 1 --2- 172.21.15.37:0/2313217255 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x563379358960 0x563379353fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:27.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.860+0000 7f93ab189740 1 -- 172.21.15.37:0/2313217255 >> 172.21.15.37:0/2313217255 conn(0x563379337240 msgr2=0x56337935a270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:22:27.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.860+0000 7f93ab189740 1 -- 172.21.15.37:0/2313217255 shutdown_connections 2024-04-22T07:22:27.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.860+0000 7f93ab189740 1 -- 172.21.15.37:0/2313217255 wait complete. 2024-04-22T07:22:27.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.860+0000 7f93ab189740 1 -- start start 2024-04-22T07:22:27.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.860+0000 7f93ab189740 1 Processor -- start 2024-04-22T07:22:27.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.861+0000 7f93ab189740 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x563379358960 0x5633793793c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:27.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.861+0000 7f93ab189740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56337937a310 0x563379339df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:27.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.861+0000 7f93ab189740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56337937a6f0 0x5633793f8d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:27.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.861+0000 7f93ab189740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f93a01f46e0 con 0x56337937a310 2024-04-22T07:22:27.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.861+0000 7f93ab189740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f93a01fc960 con 0x56337937a6f0 2024-04-22T07:22:27.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.861+0000 7f93ab189740 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f93a01f4d30 con 0x563379358960 2024-04-22T07:22:27.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.861+0000 7f93ab189740 10 client.0 _ll_register_callbacks cb 0x7f939c077cd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-22T07:22:27.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.861+0000 7f93a5a55640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56337937a310 0x563379339df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:27.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.861+0000 7f93a5a55640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56337937a310 0x563379339df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42368/0 (socket says 172.21.15.37:42368) 2024-04-22T07:22:27.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.861+0000 7f93a6a57640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56337937a6f0 0x5633793f8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:27.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.861+0000 7f93a5a55640 1 -- 172.21.15.37:0/3731797032 learned_addr learned my addr 172.21.15.37:0/3731797032 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:22:27.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.861+0000 7f93a6256640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x563379358960 0x5633793793c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:27.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.861+0000 7f93a5a55640 1 -- 172.21.15.37:0/3731797032 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x563379358960 msgr2=0x5633793793c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:22:27.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.861+0000 7f93a5a55640 1 --2- 172.21.15.37:0/3731797032 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x563379358960 0x5633793793c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:27.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.861+0000 7f93a5a55640 1 -- 172.21.15.37:0/3731797032 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56337937a6f0 msgr2=0x5633793f8d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:22:27.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.861+0000 7f93a5a55640 1 --2- 172.21.15.37:0/3731797032 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56337937a6f0 0x5633793f8d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:27.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.861+0000 7f93a5a55640 1 -- 172.21.15.37:0/3731797032 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5633793effc0 con 0x56337937a310 2024-04-22T07:22:27.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.862+0000 7f93a5a55640 1 --2- 172.21.15.37:0/3731797032 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56337937a310 0x563379339df0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f939c077da0 tx=0x7f939c09b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a0e95449e9ae855 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:22:27.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.862+0000 7f93817fa640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-04-22T07:22:27.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.862+0000 7f93817fa640 1 -- 172.21.15.37:0/3731797032 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f939c07c040 con 0x56337937a310 2024-04-22T07:22:27.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.862+0000 7f93817fa640 1 -- 172.21.15.37:0/3731797032 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f939c084090 con 0x56337937a310 2024-04-22T07:22:27.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.862+0000 7f93ab189740 1 -- 172.21.15.37:0/3731797032 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f939c07b940 con 0x56337937a310 2024-04-22T07:22:27.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.862+0000 7f93817fa640 1 -- 172.21.15.37:0/3731797032 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7f939c07fcf0 con 0x56337937a310 2024-04-22T07:22:27.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.862+0000 7f93ab189740 10 client.5016 fetch_fsmap learned FSMap version 8 2024-04-22T07:22:27.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.862+0000 7f93ab189740 1 -- 172.21.15.37:0/3731797032 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x5633793effc0 con 0x56337937a310 2024-04-22T07:22:27.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.862+0000 7f93817fa640 1 -- 172.21.15.37:0/3731797032 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f939c07b940 con 0x56337937a310 2024-04-22T07:22:27.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.862+0000 7f93817fa640 1 -- 172.21.15.37:0/3731797032 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 8) ==== 4704+0+0 (secure 0 0 0) 0x7f939c07ad90 con 0x56337937a310 2024-04-22T07:22:27.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.862+0000 7f93ab189740 10 client.5016 fetch_fsmap finished waiting for FSMap version 8 2024-04-22T07:22:27.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.862+0000 7f93ab189740 10 client.5016 resolve_mds: validated gid 4294 aka daemon mds.f 2024-04-22T07:22:27.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.862+0000 7f93ab189740 20 client.5016 populate_metadata read hostname 'smithi037' 2024-04-22T07:22:27.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.862+0000 7f93ab189740 1 --2- 172.21.15.37:0/3731797032 >> [v2:172.21.15.196:6836/3264179771,v1:172.21.15.196:6838/3264179771] conn(0x5633793f92d0 0x5633793f96e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:27.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.862+0000 7f93ab189740 4 client.5016 mds_command: new command op to 4294 tid=0 multi_id=0 [{"prefix": "quiesce db", "cancel": true, "all": true}] 2024-04-22T07:22:27.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.862+0000 7f93ab189740 1 -- 172.21.15.37:0/3731797032 --> [v2:172.21.15.196:6836/3264179771,v1:172.21.15.196:6838/3264179771] -- command(tid 0: {"prefix": "quiesce db", "cancel": true, "all": true}) -- 0x5633792a6890 con 0x5633793f92d0 2024-04-22T07:22:27.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.862+0000 7f93a6256640 1 --2- 172.21.15.37:0/3731797032 >> [v2:172.21.15.196:6836/3264179771,v1:172.21.15.196:6838/3264179771] conn(0x5633793f92d0 0x5633793f96e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:27.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.863+0000 7f93a6256640 1 --2- 172.21.15.37:0/3731797032 >> [v2:172.21.15.196:6836/3264179771,v1:172.21.15.196:6838/3264179771] conn(0x5633793f92d0 0x5633793f96e0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=da7fbf0887b20292 server_cookie=8438001ee041f77b in_seq=0 out_seq=0 2024-04-22T07:22:27.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.863+0000 7f93817fa640 10 client.5016 ms_handle_connect on v2:172.21.15.196:6836/3264179771 2024-04-22T07:22:27.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.863+0000 7f93817fa640 1 -- 172.21.15.37:0/3731797032 <== mds.0 v2:172.21.15.196:6836/3264179771 1 ==== command_reply(tid 0: 0 ) ==== 8+0+78 (crc 0 0 0) 0x5633792a6890 con 0x5633793f92d0 2024-04-22T07:22:27.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.863+0000 7f93817fa640 10 client.5016 handle_command_reply: tid=0 2024-04-22T07:22:27.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.863+0000 7f93ab189740 1 client.5016 shutdown 2024-04-22T07:22:27.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.863+0000 7f93ab189740 1 -- 172.21.15.37:0/3731797032 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56337937a310 msgr2=0x563379339df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:27.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.863+0000 7f93ab189740 1 --2- 172.21.15.37:0/3731797032 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56337937a310 0x563379339df0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f939c077da0 tx=0x7f939c09b040 comp rx=0 tx=0).stop 2024-04-22T07:22:27.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.863+0000 7f93ab189740 1 -- 172.21.15.37:0/3731797032 shutdown_connections 2024-04-22T07:22:27.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.863+0000 7f93ab189740 1 --2- 172.21.15.37:0/3731797032 >> [v2:172.21.15.196:6836/3264179771,v1:172.21.15.196:6838/3264179771] conn(0x5633793f92d0 0x5633793f96e0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:27.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.863+0000 7f93ab189740 1 --2- 172.21.15.37:0/3731797032 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56337937a6f0 0x5633793f8d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:27.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.863+0000 7f93ab189740 1 --2- 172.21.15.37:0/3731797032 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56337937a310 0x563379339df0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:27.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.863+0000 7f93817fa640 0 client.5016 ms_handle_reset on v2:172.21.15.196:6836/3264179771 2024-04-22T07:22:27.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.863+0000 7f93ab189740 1 --2- 172.21.15.37:0/3731797032 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x563379358960 0x5633793793c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:27.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.863+0000 7f93ab189740 1 -- 172.21.15.37:0/3731797032 >> 172.21.15.37:0/3731797032 conn(0x563379337240 msgr2=0x5633793570b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:22:27.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.863+0000 7f93ab189740 1 -- 172.21.15.37:0/3731797032 shutdown_connections 2024-04-22T07:22:27.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.863+0000 7f93ab189740 1 -- 172.21.15.37:0/3731797032 wait complete. 2024-04-22T07:22:27.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.864+0000 7f93ab189740 20 client.5016 trim_cache size 0 max 16384 2024-04-22T07:22:27.877 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-04-22T07:22:27.877 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 8, 2024-04-22T07:22:27.877 INFO:teuthology.orchestra.run.smithi037.stdout: "leader": 4294, 2024-04-22T07:22:27.877 INFO:teuthology.orchestra.run.smithi037.stdout: "set_version": 12, 2024-04-22T07:22:27.878 INFO:teuthology.orchestra.run.smithi037.stdout: "sets": {} 2024-04-22T07:22:27.878 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-04-22T07:22:27.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.864+0000 7f93a84ba640 1 -- 172.21.15.37:0/3735027948 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f938406c8f0 msgr2=0x7f938406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:27.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.864+0000 7f93a84ba640 1 --2- 172.21.15.37:0/3735027948 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f938406c8f0 0x7f938406edb0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f9394005880 tx=0x7f9394009040 comp rx=0 tx=0).stop 2024-04-22T07:22:27.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.864+0000 7f93a84ba640 1 -- 172.21.15.37:0/3735027948 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f93a00cc150 msgr2=0x7f93a0156e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:27.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.864+0000 7f93a84ba640 1 --2- 172.21.15.37:0/3735027948 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f93a00cc150 0x7f93a0156e40 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f939c02beb0 tx=0x7f939c0046c0 comp rx=0 tx=0).stop 2024-04-22T07:22:27.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.864+0000 7f93a84ba640 1 -- 172.21.15.37:0/3735027948 shutdown_connections 2024-04-22T07:22:27.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.864+0000 7f93a84ba640 1 --2- 172.21.15.37:0/3735027948 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f938406c8f0 0x7f938406edb0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:27.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.864+0000 7f93a84ba640 1 --2- 172.21.15.37:0/3735027948 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f93a0155040 0x7f93a0157380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:27.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.864+0000 7f93a84ba640 1 --2- 172.21.15.37:0/3735027948 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f93a00cc150 0x7f93a0156e40 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:27.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.864+0000 7f93a84ba640 1 --2- 172.21.15.37:0/3735027948 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f93a00c5860 0x7f93a00b5980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:27.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.864+0000 7f93a84ba640 1 -- 172.21.15.37:0/3735027948 >> 172.21.15.37:0/3735027948 conn(0x7f93a0067ce0 msgr2=0x7f93a0144060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:22:27.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.864+0000 7f93a84ba640 1 -- 172.21.15.37:0/3735027948 shutdown_connections 2024-04-22T07:22:27.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:27.864+0000 7f93a84ba640 1 -- 172.21.15.37:0/3735027948 wait complete. 2024-04-22T07:22:27.881 INFO:tasks.quiescer:done joining Quiescers 2024-04-22T07:22:27.881 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-04-22T07:22:27.891 INFO:tasks.kclient:Unmounting kernel clients... 2024-04-22T07:22:27.892 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-04-22T07:22:27.892 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-22T07:22:27.907 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-04-22T07:22:27.907 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-22T07:22:27.963 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-22T07:22:28.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.105+0000 7faed0fef640 1 Processor -- start 2024-04-22T07:22:28.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.106+0000 7faed0fef640 1 -- start start 2024-04-22T07:22:28.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.106+0000 7faed0fef640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7faecc0c84e0 0x7faecc0c8c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:28.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.106+0000 7faed0fef640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7faecc0c91a0 0x7faecc15c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:28.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.106+0000 7faed0fef640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faecc0c6f70 con 0x7faecc152dc0 2024-04-22T07:22:28.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.106+0000 7faed0fef640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7faecc0c7530 con 0x7faecc0c91a0 2024-04-22T07:22:28.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.106+0000 7faed0fef640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7faecc0c7250 con 0x7faecc0c84e0 2024-04-22T07:22:28.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.106+0000 7faeca59c640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7faecc152dc0 0x7faecc0c4aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:58794/0 (socket says 172.21.15.37:58794) 2024-04-22T07:22:28.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.106+0000 7faeca59c640 1 -- 172.21.15.37:0/3120444965 learned_addr learned my addr 172.21.15.37:0/3120444965 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-04-22T07:22:28.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.107+0000 7faec3fff640 1 --2- 172.21.15.37:0/3120444965 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7faecc0c84e0 0x7faecc0c8c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:28.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.107+0000 7faecad9d640 1 --2- 172.21.15.37:0/3120444965 >> v2:172.21.15.196:3300/0 conn(0x7faecc0c91a0 0x7faecc15c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:28.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.107+0000 7faec9d9b640 1 -- 172.21.15.37:0/3120444965 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1637116866 0 0) 0x7faecc0c6f70 con 0x7faecc152dc0 2024-04-22T07:22:28.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.107+0000 7faec9d9b640 1 -- 172.21.15.37:0/3120444965 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faeb8003520 con 0x7faecc152dc0 2024-04-22T07:22:28.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.107+0000 7faec3fff640 1 -- 172.21.15.37:0/3120444965 >> v2:172.21.15.196:3300/0 conn(0x7faecc0c91a0 msgr2=0x7faecc15c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:22:28.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.107+0000 7faec3fff640 1 --2- 172.21.15.37:0/3120444965 >> v2:172.21.15.196:3300/0 conn(0x7faecc0c91a0 0x7faecc15c3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:28.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.107+0000 7faec9d9b640 1 -- 172.21.15.37:0/3120444965 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2474669912 0 0) 0x7faeb8003520 con 0x7faecc152dc0 2024-04-22T07:22:28.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.107+0000 7faec3fff640 1 -- 172.21.15.37:0/3120444965 >> v1:172.21.15.37:6789/0 conn(0x7faecc152dc0 legacy=0x7faecc0c4aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:28.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.107+0000 7faec3fff640 1 -- 172.21.15.37:0/3120444965 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faecc0c3800 con 0x7faecc0c84e0 2024-04-22T07:22:28.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.108+0000 7faec3fff640 1 --2- 172.21.15.37:0/3120444965 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7faecc0c84e0 0x7faecc0c8c60 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7faeb40097a0 tx=0x7faeb402b710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3c3ac2f77ac1c31f server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:22:28.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.108+0000 7faec9d9b640 1 -- 172.21.15.37:0/3120444965 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faeb4037070 con 0x7faecc0c84e0 2024-04-22T07:22:28.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.108+0000 7faec9d9b640 1 -- 172.21.15.37:0/3120444965 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faeb4030510 con 0x7faecc0c84e0 2024-04-22T07:22:28.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.108+0000 7faec9d9b640 1 -- 172.21.15.37:0/3120444965 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faebc001670 con 0x7faecc0c84e0 2024-04-22T07:22:28.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.108+0000 7faed0fef640 1 -- 172.21.15.37:0/3120444965 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7faecc0c84e0 msgr2=0x7faecc0c8c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:28.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.108+0000 7faed0fef640 1 --2- 172.21.15.37:0/3120444965 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7faecc0c84e0 0x7faecc0c8c60 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7faeb40097a0 tx=0x7faeb402b710 comp rx=0 tx=0).stop 2024-04-22T07:22:28.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.109+0000 7faed0fef640 1 -- 172.21.15.37:0/3120444965 shutdown_connections 2024-04-22T07:22:28.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.109+0000 7faed0fef640 1 --2- 172.21.15.37:0/3120444965 >> v2:172.21.15.196:3300/0 conn(0x7faecc0c91a0 0x7faecc15c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:28.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.109+0000 7faed0fef640 1 --2- 172.21.15.37:0/3120444965 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7faecc0c84e0 0x7faecc0c8c60 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:28.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.109+0000 7faed0fef640 1 -- 172.21.15.37:0/3120444965 >> 172.21.15.37:0/3120444965 conn(0x7faecc06b970 msgr2=0x7faecc06bd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:22:28.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.109+0000 7faed0fef640 1 -- 172.21.15.37:0/3120444965 shutdown_connections 2024-04-22T07:22:28.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.109+0000 7faed0fef640 1 -- 172.21.15.37:0/3120444965 wait complete. 2024-04-22T07:22:28.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.110+0000 7faed0fef640 1 Processor -- start 2024-04-22T07:22:28.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.110+0000 7faed0fef640 1 -- start start 2024-04-22T07:22:28.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.111+0000 7faed0fef640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7faecc0c84e0 0x7faecc14c490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:28.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.111+0000 7faed0fef640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faecc0c91a0 0x7faecc0c44e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:28.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.111+0000 7faed0fef640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7faecc152dc0 0x7faecc1f1d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:28.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.111+0000 7faed0fef640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7faecc0c65e0 con 0x7faecc0c91a0 2024-04-22T07:22:28.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.111+0000 7faed0fef640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7faecc0c3e50 con 0x7faecc152dc0 2024-04-22T07:22:28.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.111+0000 7faed0fef640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7faecc1531a0 con 0x7faecc0c84e0 2024-04-22T07:22:28.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.111+0000 7faec3fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faecc0c91a0 0x7faecc0c44e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:28.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.111+0000 7faec3fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faecc0c91a0 0x7faecc0c44e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42372/0 (socket says 172.21.15.37:42372) 2024-04-22T07:22:28.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.111+0000 7faec3fff640 1 -- 172.21.15.37:0/1844764994 learned_addr learned my addr 172.21.15.37:0/1844764994 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:22:28.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.111+0000 7faeca59c640 1 --2- 172.21.15.37:0/1844764994 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7faecc0c84e0 0x7faecc14c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:28.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.111+0000 7faecad9d640 1 --2- 172.21.15.37:0/1844764994 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7faecc152dc0 0x7faecc1f1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:28.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.111+0000 7faec3fff640 1 -- 172.21.15.37:0/1844764994 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7faecc0c84e0 msgr2=0x7faecc14c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:28.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.111+0000 7faec3fff640 1 --2- 172.21.15.37:0/1844764994 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7faecc0c84e0 0x7faecc14c490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:28.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.111+0000 7faec3fff640 1 -- 172.21.15.37:0/1844764994 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7faecc152dc0 msgr2=0x7faecc1f1d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:28.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.111+0000 7faec3fff640 1 --2- 172.21.15.37:0/1844764994 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7faecc152dc0 0x7faecc1f1d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:28.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.111+0000 7faec3fff640 1 -- 172.21.15.37:0/1844764994 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faecc154110 con 0x7faecc0c91a0 2024-04-22T07:22:28.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.111+0000 7faec3fff640 1 --2- 172.21.15.37:0/1844764994 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faecc0c91a0 0x7faecc0c44e0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7faeb4000c00 tx=0x7faeb40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:22:28.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.111+0000 7faec2ffd640 1 -- 172.21.15.37:0/1844764994 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faeb4041020 con 0x7faecc0c91a0 2024-04-22T07:22:28.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.111+0000 7faec2ffd640 1 -- 172.21.15.37:0/1844764994 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faeb403c870 con 0x7faecc0c91a0 2024-04-22T07:22:28.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.111+0000 7faed0fef640 1 -- 172.21.15.37:0/1844764994 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faecc1543f0 con 0x7faecc0c91a0 2024-04-22T07:22:28.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.111+0000 7faec2ffd640 1 -- 172.21.15.37:0/1844764994 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faeb4037040 con 0x7faecc0c91a0 2024-04-22T07:22:28.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.111+0000 7faed0fef640 1 -- 172.21.15.37:0/1844764994 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faecc1549b0 con 0x7faecc0c91a0 2024-04-22T07:22:28.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.112+0000 7faed0fef640 1 -- 172.21.15.37:0/1844764994 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faecc0c6f70 con 0x7faecc0c91a0 2024-04-22T07:22:28.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.113+0000 7faec2ffd640 1 -- 172.21.15.37:0/1844764994 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7faeb4044020 con 0x7faecc0c91a0 2024-04-22T07:22:28.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.113+0000 7faec2ffd640 1 --2- 172.21.15.37:0/1844764994 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7faeac06c8f0 0x7faeac06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:28.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.113+0000 7faec2ffd640 1 -- 172.21.15.37:0/1844764994 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7faeb40ad4d0 con 0x7faecc0c91a0 2024-04-22T07:22:28.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.114+0000 7faeca59c640 1 --2- 172.21.15.37:0/1844764994 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7faeac06c8f0 0x7faeac06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:28.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.114+0000 7faeca59c640 1 --2- 172.21.15.37:0/1844764994 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7faeac06c8f0 0x7faeac06edb0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7faebc0013c0 tx=0x7faebc001350 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:22:28.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.118+0000 7faec2ffd640 1 -- 172.21.15.37:0/1844764994 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7faecc0c6f70 con 0x7faecc0c91a0 2024-04-22T07:22:28.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.302+0000 7faed0fef640 1 -- 172.21.15.37:0/1844764994 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7faecc069cc0 con 0x7faecc0c91a0 2024-04-22T07:22:28.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.303+0000 7faec2ffd640 1 -- 172.21.15.37:0/1844764994 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16775 (secure 0 0 0) 0x7faeb404b030 con 0x7faecc0c91a0 2024-04-22T07:22:28.301 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-22T07:22:28.302 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":22,"fsid":"10d90a41-52d3-4e09-8022-c8ac67897ad1","created":"2024-04-22T07:18:12.420756+0000","modified":"2024-04-22T07:19:17.871666+0000","last_up_change":"2024-04-22T07:18:23.649808+0000","last_in_change":"2024-04-22T07:18:14.506974+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-22T07:18:24.602243+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-22T07:18:34.673639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-22T07:18:35.055184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e248f6e1-13ad-48e0-a8f8-ec3059995654","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":1488290385},{"type":"v1","addr":"172.21.15.37:6801","nonce":1488290385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1488290385},{"type":"v1","addr":"172.21.15.37:6803","nonce":1488290385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1488290385},{"type":"v1","addr":"172.21.15.37:6807","nonce":1488290385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1488290385},{"type":"v1","addr":"172.21.15.37:6805","nonce":1488290385}]},"public_addr":"172.21.15.37:6801/1488290385","cluster_addr":"172.21.15.37:6803/1488290385","heartbeat_back_addr":"172.21.15.37:6807/1488290385","heartbeat_front_addr":"172.21.15.37:6805/1488290385","state":["exists","up"]},{"osd":1,"uuid":"01c71ab7-1326-432b-b73a-e5847abe5132","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3918584183},{"type":"v1","addr":"172.21.15.37:6811","nonce":3918584183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6813","nonce":3918584183},{"type":"v1","addr":"172.21.15.37:6816","nonce":3918584183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":3918584183},{"type":"v1","addr":"172.21.15.37:6823","nonce":3918584183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":3918584183},{"type":"v1","addr":"172.21.15.37:6821","nonce":3918584183}]},"public_addr":"172.21.15.37:6811/3918584183","cluster_addr":"172.21.15.37:6816/3918584183","heartbeat_back_addr":"172.21.15.37:6823/3918584183","heartbeat_front_addr":"172.21.15.37:6821/3918584183","state":["exists","up"]},{"osd":2,"uuid":"33a780fd-013a-41c8-9970-136c9e080897","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1895439419},{"type":"v1","addr":"172.21.15.37:6825","nonce":1895439419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1895439419},{"type":"v1","addr":"172.21.15.37:6827","nonce":1895439419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1895439419},{"type":"v1","addr":"172.21.15.37:6831","nonce":1895439419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1895439419},{"type":"v1","addr":"172.21.15.37:6829","nonce":1895439419}]},"public_addr":"172.21.15.37:6825/1895439419","cluster_addr":"172.21.15.37:6827/1895439419","heartbeat_back_addr":"172.21.15.37:6831/1895439419","heartbeat_front_addr":"172.21.15.37:6829/1895439419","state":["exists","up"]},{"osd":3,"uuid":"b46e53c4-e5b9-4098-b243-ab5a0f1f3885","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6809","nonce":1160021017},{"type":"v1","addr":"172.21.15.37:6810","nonce":1160021017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1160021017},{"type":"v1","addr":"172.21.15.37:6814","nonce":1160021017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":1160021017},{"type":"v1","addr":"172.21.15.37:6820","nonce":1160021017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6815","nonce":1160021017},{"type":"v1","addr":"172.21.15.37:6817","nonce":1160021017}]},"public_addr":"172.21.15.37:6810/1160021017","cluster_addr":"172.21.15.37:6814/1160021017","heartbeat_back_addr":"172.21.15.37:6820/1160021017","heartbeat_front_addr":"172.21.15.37:6817/1160021017","state":["exists","up"]},{"osd":4,"uuid":"cd1032c6-6a83-4e33-b7b1-baddf92a83af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":374829049},{"type":"v1","addr":"172.21.15.196:6809","nonce":374829049}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":374829049},{"type":"v1","addr":"172.21.15.196:6811","nonce":374829049}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":374829049},{"type":"v1","addr":"172.21.15.196:6815","nonce":374829049}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":374829049},{"type":"v1","addr":"172.21.15.196:6813","nonce":374829049}]},"public_addr":"172.21.15.196:6809/374829049","cluster_addr":"172.21.15.196:6811/374829049","heartbeat_back_addr":"172.21.15.196:6815/374829049","heartbeat_front_addr":"172.21.15.196:6813/374829049","state":["exists","up"]},{"osd":5,"uuid":"f561d48a-5f2d-4deb-8681-4329aed36bae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":479311302},{"type":"v1","addr":"172.21.15.196:6801","nonce":479311302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":479311302},{"type":"v1","addr":"172.21.15.196:6803","nonce":479311302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":479311302},{"type":"v1","addr":"172.21.15.196:6807","nonce":479311302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":479311302},{"type":"v1","addr":"172.21.15.196:6805","nonce":479311302}]},"public_addr":"172.21.15.196:6801/479311302","cluster_addr":"172.21.15.196:6803/479311302","heartbeat_back_addr":"172.21.15.196:6807/479311302","heartbeat_front_addr":"172.21.15.196:6805/479311302","state":["exists","up"]},{"osd":6,"uuid":"1b239c7e-2504-42e0-b308-70f4e62519c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6817","nonce":691777224},{"type":"v1","addr":"172.21.15.196:6819","nonce":691777224}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6821","nonce":691777224},{"type":"v1","addr":"172.21.15.196:6823","nonce":691777224}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6829","nonce":691777224},{"type":"v1","addr":"172.21.15.196:6831","nonce":691777224}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6825","nonce":691777224},{"type":"v1","addr":"172.21.15.196:6827","nonce":691777224}]},"public_addr":"172.21.15.196:6819/691777224","cluster_addr":"172.21.15.196:6823/691777224","heartbeat_back_addr":"172.21.15.196:6831/691777224","heartbeat_front_addr":"172.21.15.196:6827/691777224","state":["exists","up"]},{"osd":7,"uuid":"084318d4-d1fd-4b58-8c33-b1d7856fe323","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":3106266066},{"type":"v1","addr":"172.21.15.196:6818","nonce":3106266066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":3106266066},{"type":"v1","addr":"172.21.15.196:6822","nonce":3106266066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":3106266066},{"type":"v1","addr":"172.21.15.196:6830","nonce":3106266066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":3106266066},{"type":"v1","addr":"172.21.15.196:6826","nonce":3106266066}]},"public_addr":"172.21.15.196:6818/3106266066","cluster_addr":"172.21.15.196:6822/3106266066","heartbeat_back_addr":"172.21.15.196:6830/3106266066","heartbeat_front_addr":"172.21.15.196:6826/3106266066","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:18:19.587791+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:18:19.706541+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:18:19.690674+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:18:19.648354+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:18:19.666671+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:18:19.560709+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:18:19.661412+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:18:19.770650+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.13","mappings":[{"from":7,"to":2}]},{"pgid":"3.1e","mappings":[{"from":3,"to":1}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.3c","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-22T07:22:28.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.305+0000 7faed0fef640 1 -- 172.21.15.37:0/1844764994 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7faeac06c8f0 msgr2=0x7faeac06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:28.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.305+0000 7faed0fef640 1 --2- 172.21.15.37:0/1844764994 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7faeac06c8f0 0x7faeac06edb0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7faebc0013c0 tx=0x7faebc001350 comp rx=0 tx=0).stop 2024-04-22T07:22:28.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.305+0000 7faed0fef640 1 -- 172.21.15.37:0/1844764994 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faecc0c91a0 msgr2=0x7faecc0c44e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:28.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.305+0000 7faed0fef640 1 --2- 172.21.15.37:0/1844764994 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faecc0c91a0 0x7faecc0c44e0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7faeb4000c00 tx=0x7faeb40046c0 comp rx=0 tx=0).stop 2024-04-22T07:22:28.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.305+0000 7faed0fef640 1 -- 172.21.15.37:0/1844764994 shutdown_connections 2024-04-22T07:22:28.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.305+0000 7faed0fef640 1 --2- 172.21.15.37:0/1844764994 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7faeac06c8f0 0x7faeac06edb0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:28.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.305+0000 7faed0fef640 1 --2- 172.21.15.37:0/1844764994 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7faecc152dc0 0x7faecc1f1d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:28.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.305+0000 7faed0fef640 1 --2- 172.21.15.37:0/1844764994 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faecc0c91a0 0x7faecc0c44e0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:28.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.305+0000 7faed0fef640 1 --2- 172.21.15.37:0/1844764994 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7faecc0c84e0 0x7faecc14c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:28.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.305+0000 7faed0fef640 1 -- 172.21.15.37:0/1844764994 >> 172.21.15.37:0/1844764994 conn(0x7faecc06b970 msgr2=0x7faecc151b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:22:28.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.305+0000 7faed0fef640 1 -- 172.21.15.37:0/1844764994 shutdown_connections 2024-04-22T07:22:28.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.305+0000 7faed0fef640 1 -- 172.21.15.37:0/1844764994 wait complete. 2024-04-22T07:22:28.315 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-22T07:18:24.602243+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-22T07:18:34.673639+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-22T07:18:35.055184+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-22T07:22:28.315 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-22T07:22:28.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.421+0000 7f3bfd83a640 1 Processor -- start 2024-04-22T07:22:28.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.421+0000 7f3bfd83a640 1 -- start start 2024-04-22T07:22:28.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.422+0000 7f3bfd83a640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f3bf80ce6a0 0x7f3bf80cdaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:28.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.422+0000 7f3bfd83a640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f3bf80cea80 0x7f3bf81528f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:28.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.422+0000 7f3bfd83a640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3bf80cd460 con 0x7f3bf80ce030 2024-04-22T07:22:28.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.422+0000 7f3bfd83a640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f3bf8070dd0 con 0x7f3bf80ce6a0 2024-04-22T07:22:28.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.422+0000 7f3bfd83a640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f3bf80704a0 con 0x7f3bf80cea80 2024-04-22T07:22:28.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.422+0000 7f3bf6ffd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f3bf80ce6a0 0x7f3bf80cdaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:28.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.422+0000 7f3bf6ffd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f3bf80ce6a0 0x7f3bf80cdaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42376/0 (socket says 172.21.15.37:42376) 2024-04-22T07:22:28.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.422+0000 7f3bf6ffd640 1 -- 172.21.15.37:0/3811039646 learned_addr learned my addr 172.21.15.37:0/3811039646 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:22:28.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.422+0000 7f3bf6ffd640 1 -- 172.21.15.37:0/3811039646 >> v2:172.21.15.196:3300/0 conn(0x7f3bf80cea80 msgr2=0x7f3bf81528f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:22:28.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.422+0000 7f3bf77fe640 1 --2- 172.21.15.37:0/3811039646 >> v2:172.21.15.196:3300/0 conn(0x7f3bf80cea80 0x7f3bf81528f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:28.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.422+0000 7f3bf6ffd640 1 --2- 172.21.15.37:0/3811039646 >> v2:172.21.15.196:3300/0 conn(0x7f3bf80cea80 0x7f3bf81528f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:28.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.422+0000 7f3bf6ffd640 1 -- 172.21.15.37:0/3811039646 >> v1:172.21.15.196:6789/0 conn(0x7f3bf80ce030 legacy=0x7f3bf8158da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:22:28.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.422+0000 7f3bf6ffd640 1 -- 172.21.15.37:0/3811039646 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bf8070780 con 0x7f3bf80ce6a0 2024-04-22T07:22:28.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.422+0000 7f3bf77fe640 1 --2- 172.21.15.37:0/3811039646 >> v2:172.21.15.196:3300/0 conn(0x7f3bf80cea80 0x7f3bf81528f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-22T07:22:28.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.423+0000 7f3bf6ffd640 1 --2- 172.21.15.37:0/3811039646 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3bf80ce6a0 0x7f3bf80cdaf0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f3bf80c4a70 tx=0x7f3bf002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31b0481691d91045 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:22:28.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.423+0000 7f3bf5ffb640 1 -- 172.21.15.37:0/3811039646 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bf0034070 con 0x7f3bf80ce6a0 2024-04-22T07:22:28.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.423+0000 7f3bf5ffb640 1 -- 172.21.15.37:0/3811039646 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3bf0030860 con 0x7f3bf80ce6a0 2024-04-22T07:22:28.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.423+0000 7f3bf5ffb640 1 -- 172.21.15.37:0/3811039646 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bf0030c30 con 0x7f3bf80ce6a0 2024-04-22T07:22:28.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.424+0000 7f3bfd83a640 1 -- 172.21.15.37:0/3811039646 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3bf80ce6a0 msgr2=0x7f3bf80cdaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:28.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.424+0000 7f3bfd83a640 1 --2- 172.21.15.37:0/3811039646 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3bf80ce6a0 0x7f3bf80cdaf0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f3bf80c4a70 tx=0x7f3bf002b9a0 comp rx=0 tx=0).stop 2024-04-22T07:22:28.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.424+0000 7f3bfd83a640 1 -- 172.21.15.37:0/3811039646 shutdown_connections 2024-04-22T07:22:28.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.424+0000 7f3bfd83a640 1 --2- 172.21.15.37:0/3811039646 >> v2:172.21.15.196:3300/0 conn(0x7f3bf80cea80 0x7f3bf81528f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:28.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.424+0000 7f3bfd83a640 1 --2- 172.21.15.37:0/3811039646 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3bf80ce6a0 0x7f3bf80cdaf0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:28.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.424+0000 7f3bfd83a640 1 -- 172.21.15.37:0/3811039646 >> 172.21.15.37:0/3811039646 conn(0x7f3bf8071670 msgr2=0x7f3bf8071a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:22:28.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.424+0000 7f3bfd83a640 1 -- 172.21.15.37:0/3811039646 shutdown_connections 2024-04-22T07:22:28.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.424+0000 7f3bfd83a640 1 -- 172.21.15.37:0/3811039646 wait complete. 2024-04-22T07:22:28.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.425+0000 7f3bfd83a640 1 Processor -- start 2024-04-22T07:22:28.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.425+0000 7f3bfd83a640 1 -- start start 2024-04-22T07:22:28.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.426+0000 7f3bfd83a640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3bf80ce030 0x7f3bf80c6c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:28.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.426+0000 7f3bfd83a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3bf80ce6a0 0x7f3bf814de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:28.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.426+0000 7f3bfd83a640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3bf80cea80 0x7f3bf814e390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:28.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.426+0000 7f3bfd83a640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3bf80c4060 con 0x7f3bf80ce6a0 2024-04-22T07:22:28.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.426+0000 7f3bfd83a640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f3bf80c3ee0 con 0x7f3bf80ce030 2024-04-22T07:22:28.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.426+0000 7f3bfd83a640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f3bf80ccf70 con 0x7f3bf80cea80 2024-04-22T07:22:28.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.426+0000 7f3bf67fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3bf80ce6a0 0x7f3bf814de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:28.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.426+0000 7f3bf67fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3bf80ce6a0 0x7f3bf814de50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42390/0 (socket says 172.21.15.37:42390) 2024-04-22T07:22:28.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.426+0000 7f3bf67fc640 1 -- 172.21.15.37:0/1300373178 learned_addr learned my addr 172.21.15.37:0/1300373178 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:22:28.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.426+0000 7f3bf77fe640 1 --2- 172.21.15.37:0/1300373178 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3bf80cea80 0x7f3bf814e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:28.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.426+0000 7f3bf6ffd640 1 --2- 172.21.15.37:0/1300373178 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3bf80ce030 0x7f3bf80c6c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:28.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.426+0000 7f3bf67fc640 1 -- 172.21.15.37:0/1300373178 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3bf80cea80 msgr2=0x7f3bf814e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:28.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.426+0000 7f3bf67fc640 1 --2- 172.21.15.37:0/1300373178 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3bf80cea80 0x7f3bf814e390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:28.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.426+0000 7f3bf67fc640 1 -- 172.21.15.37:0/1300373178 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3bf80ce030 msgr2=0x7f3bf80c6c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:28.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.426+0000 7f3bf67fc640 1 --2- 172.21.15.37:0/1300373178 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3bf80ce030 0x7f3bf80c6c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:28.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.426+0000 7f3bf67fc640 1 -- 172.21.15.37:0/1300373178 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bf80c7410 con 0x7f3bf80ce6a0 2024-04-22T07:22:28.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.426+0000 7f3bf77fe640 1 --2- 172.21.15.37:0/1300373178 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3bf80cea80 0x7f3bf814e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T07:22:28.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.426+0000 7f3bf6ffd640 1 --2- 172.21.15.37:0/1300373178 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3bf80ce030 0x7f3bf80c6c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T07:22:28.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.427+0000 7f3bf67fc640 1 --2- 172.21.15.37:0/1300373178 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3bf80ce6a0 0x7f3bf814de50 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f3be000c430 tx=0x7f3be000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:22:28.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.427+0000 7f3beffff640 1 -- 172.21.15.37:0/1300373178 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3be0011790 con 0x7f3bf80ce6a0 2024-04-22T07:22:28.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.427+0000 7f3beffff640 1 -- 172.21.15.37:0/1300373178 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3be0017070 con 0x7f3bf80ce6a0 2024-04-22T07:22:28.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.427+0000 7f3bfd83a640 1 -- 172.21.15.37:0/1300373178 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3bf81eeb30 con 0x7f3bf80ce6a0 2024-04-22T07:22:28.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.427+0000 7f3beffff640 1 -- 172.21.15.37:0/1300373178 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3be0011bb0 con 0x7f3bf80ce6a0 2024-04-22T07:22:28.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.427+0000 7f3bfd83a640 1 -- 172.21.15.37:0/1300373178 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3bf81ef0b0 con 0x7f3bf80ce6a0 2024-04-22T07:22:28.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.428+0000 7f3bfd83a640 1 -- 172.21.15.37:0/1300373178 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3bf81ef880 con 0x7f3bf80ce6a0 2024-04-22T07:22:28.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.428+0000 7f3beffff640 1 -- 172.21.15.37:0/1300373178 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3be001c460 con 0x7f3bf80ce6a0 2024-04-22T07:22:28.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.428+0000 7f3beffff640 1 --2- 172.21.15.37:0/1300373178 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f3bd806c8f0 0x7f3bd806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:28.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.429+0000 7f3beffff640 1 -- 172.21.15.37:0/1300373178 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f3be008bb10 con 0x7f3bf80ce6a0 2024-04-22T07:22:28.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.429+0000 7f3bf6ffd640 1 --2- 172.21.15.37:0/1300373178 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f3bd806c8f0 0x7f3bd806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:28.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.429+0000 7f3bf6ffd640 1 --2- 172.21.15.37:0/1300373178 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f3bd806c8f0 0x7f3bd806edb0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f3bf0036000 tx=0x7f3bf003b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:22:28.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.433+0000 7f3beffff640 1 -- 172.21.15.37:0/1300373178 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f3be0059e30 con 0x7f3bf80ce6a0 2024-04-22T07:22:28.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.618+0000 7f3bfd83a640 1 -- 172.21.15.37:0/1300373178 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f3bf80c9390 con 0x7f3bf80ce6a0 2024-04-22T07:22:28.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.618+0000 7f3beffff640 1 -- 172.21.15.37:0/1300373178 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) ==== 93+0+10 (secure 0 0 0) 0x7f3be0059730 con 0x7f3bf80ce6a0 2024-04-22T07:22:28.616 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2024-04-22T07:22:28.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.620+0000 7f3bfd83a640 1 -- 172.21.15.37:0/1300373178 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f3bd806c8f0 msgr2=0x7f3bd806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:28.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.620+0000 7f3bfd83a640 1 --2- 172.21.15.37:0/1300373178 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f3bd806c8f0 0x7f3bd806edb0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f3bf0036000 tx=0x7f3bf003b040 comp rx=0 tx=0).stop 2024-04-22T07:22:28.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.620+0000 7f3bfd83a640 1 -- 172.21.15.37:0/1300373178 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3bf80ce6a0 msgr2=0x7f3bf814de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:28.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.620+0000 7f3bfd83a640 1 --2- 172.21.15.37:0/1300373178 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3bf80ce6a0 0x7f3bf814de50 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f3be000c430 tx=0x7f3be000c8f0 comp rx=0 tx=0).stop 2024-04-22T07:22:28.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.620+0000 7f3bfd83a640 1 -- 172.21.15.37:0/1300373178 shutdown_connections 2024-04-22T07:22:28.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.620+0000 7f3bfd83a640 1 --2- 172.21.15.37:0/1300373178 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f3bd806c8f0 0x7f3bd806edb0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:28.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.620+0000 7f3bfd83a640 1 --2- 172.21.15.37:0/1300373178 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3bf80cea80 0x7f3bf814e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:28.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.620+0000 7f3bfd83a640 1 --2- 172.21.15.37:0/1300373178 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3bf80ce6a0 0x7f3bf814de50 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:28.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.620+0000 7f3bfd83a640 1 --2- 172.21.15.37:0/1300373178 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3bf80ce030 0x7f3bf80c6c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:28.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.620+0000 7f3bfd83a640 1 -- 172.21.15.37:0/1300373178 >> 172.21.15.37:0/1300373178 conn(0x7f3bf8071670 msgr2=0x7f3bf81574e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:22:28.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.620+0000 7f3bfd83a640 1 -- 172.21.15.37:0/1300373178 shutdown_connections 2024-04-22T07:22:28.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.620+0000 7f3bfd83a640 1 -- 172.21.15.37:0/1300373178 wait complete. 2024-04-22T07:22:28.629 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-22T07:22:28.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.735+0000 7f7673996640 1 Processor -- start 2024-04-22T07:22:28.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.735+0000 7f7673996640 1 -- start start 2024-04-22T07:22:28.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.736+0000 7f7673996640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f766c1552c0 0x7f766c0c5fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:28.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.736+0000 7f7673996640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f766c0cb010 0x7f766c0676b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:28.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.736+0000 7f7673996640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f766c0c6990 con 0x7f766c0cdd60 2024-04-22T07:22:28.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.736+0000 7f7673996640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f766c1556a0 con 0x7f766c0cb010 2024-04-22T07:22:28.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.736+0000 7f7673996640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f766c0c66b0 con 0x7f766c1552c0 2024-04-22T07:22:28.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.736+0000 7f7670f31640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f766c0cb010 0x7f766c0676b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:28.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.736+0000 7f7671f33640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f766c0cdd60 0x7f766c15b160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:58806/0 (socket says 172.21.15.37:58806) 2024-04-22T07:22:28.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.736+0000 7f7670f31640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f766c0cb010 0x7f766c0676b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42392/0 (socket says 172.21.15.37:42392) 2024-04-22T07:22:28.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.736+0000 7f7671f33640 1 -- 172.21.15.37:0/3584403836 learned_addr learned my addr 172.21.15.37:0/3584403836 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-04-22T07:22:28.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.736+0000 7f7671732640 1 --2- 172.21.15.37:0/3584403836 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f766c1552c0 0x7f766c0c5fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:28.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.736+0000 7f7670f31640 1 -- 172.21.15.37:0/3584403836 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f766c1552c0 msgr2=0x7f766c0c5fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:22:28.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.736+0000 7f7670f31640 1 --2- 172.21.15.37:0/3584403836 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f766c1552c0 0x7f766c0c5fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:28.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.736+0000 7f7670f31640 1 -- 172.21.15.37:0/3584403836 >> v1:172.21.15.37:6789/0 conn(0x7f766c0cdd60 legacy=0x7f766c15b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:28.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.736+0000 7f766bfff640 1 -- 172.21.15.37:0/3584403836 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2137063727 0 0) 0x7f766c0c6990 con 0x7f766c0cdd60 2024-04-22T07:22:28.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.736+0000 7f7670f31640 1 -- 172.21.15.37:0/3584403836 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f766c0cc560 con 0x7f766c0cb010 2024-04-22T07:22:28.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.737+0000 7f7671732640 1 --2- 172.21.15.37:0/3584403836 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f766c1552c0 0x7f766c0c5fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-22T07:22:28.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.737+0000 7f7670f31640 1 --2- 172.21.15.37:0/3584403836 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f766c0cb010 0x7f766c0676b0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f76600097a0 tx=0x7f766002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=457171b71ffcd1ba server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:22:28.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.737+0000 7f766bfff640 1 -- 172.21.15.37:0/3584403836 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7660035020 con 0x7f766c0cb010 2024-04-22T07:22:28.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.737+0000 7f766bfff640 1 -- 172.21.15.37:0/3584403836 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7660031830 con 0x7f766c0cb010 2024-04-22T07:22:28.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.737+0000 7f766bfff640 1 -- 172.21.15.37:0/3584403836 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7660031c00 con 0x7f766c0cb010 2024-04-22T07:22:28.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.738+0000 7f7673996640 1 -- 172.21.15.37:0/3584403836 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f766c0cb010 msgr2=0x7f766c0676b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:28.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.738+0000 7f7673996640 1 --2- 172.21.15.37:0/3584403836 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f766c0cb010 0x7f766c0676b0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f76600097a0 tx=0x7f766002b8d0 comp rx=0 tx=0).stop 2024-04-22T07:22:28.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.738+0000 7f7673996640 1 -- 172.21.15.37:0/3584403836 shutdown_connections 2024-04-22T07:22:28.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.738+0000 7f7673996640 1 --2- 172.21.15.37:0/3584403836 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f766c0cb010 0x7f766c0676b0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:28.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.738+0000 7f7673996640 1 --2- 172.21.15.37:0/3584403836 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f766c1552c0 0x7f766c0c5fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:28.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.738+0000 7f7673996640 1 -- 172.21.15.37:0/3584403836 >> 172.21.15.37:0/3584403836 conn(0x7f766c06d330 msgr2=0x7f766c06c290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:22:28.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.738+0000 7f7673996640 1 -- 172.21.15.37:0/3584403836 shutdown_connections 2024-04-22T07:22:28.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.738+0000 7f7673996640 1 -- 172.21.15.37:0/3584403836 wait complete. 2024-04-22T07:22:28.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.739+0000 7f7673996640 1 Processor -- start 2024-04-22T07:22:28.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.739+0000 7f7673996640 1 -- start start 2024-04-22T07:22:28.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.740+0000 7f7673996640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f766c0cb010 0x7f766c1566a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:28.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.740+0000 7f7673996640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f766c0cdd60 0x7f766c153ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:28.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.740+0000 7f7673996640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f766c1552c0 0x7f766c1f0c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:28.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.740+0000 7f7673996640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f766c0cce00 con 0x7f766c0cb010 2024-04-22T07:22:28.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.740+0000 7f7673996640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f766c0ccb20 con 0x7f766c1552c0 2024-04-22T07:22:28.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.740+0000 7f7673996640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f766c15b870 con 0x7f766c0cdd60 2024-04-22T07:22:28.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.740+0000 7f7671732640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f766c0cb010 0x7f766c1566a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:28.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.740+0000 7f7671732640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f766c0cb010 0x7f766c1566a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42396/0 (socket says 172.21.15.37:42396) 2024-04-22T07:22:28.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.740+0000 7f7671732640 1 -- 172.21.15.37:0/2386019852 learned_addr learned my addr 172.21.15.37:0/2386019852 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:22:28.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.740+0000 7f7671f33640 1 --2- 172.21.15.37:0/2386019852 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f766c1552c0 0x7f766c1f0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:28.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.740+0000 7f7670f31640 1 --2- 172.21.15.37:0/2386019852 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f766c0cdd60 0x7f766c153ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:28.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.740+0000 7f7671732640 1 -- 172.21.15.37:0/2386019852 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f766c0cdd60 msgr2=0x7f766c153ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:28.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.740+0000 7f7671732640 1 --2- 172.21.15.37:0/2386019852 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f766c0cdd60 0x7f766c153ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:28.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.740+0000 7f7671732640 1 -- 172.21.15.37:0/2386019852 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f766c1552c0 msgr2=0x7f766c1f0c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:28.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.740+0000 7f7671732640 1 --2- 172.21.15.37:0/2386019852 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f766c1552c0 0x7f766c1f0c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:28.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.740+0000 7f7671732640 1 -- 172.21.15.37:0/2386019852 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f766c155950 con 0x7f766c0cb010 2024-04-22T07:22:28.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.741+0000 7f7671732640 1 --2- 172.21.15.37:0/2386019852 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f766c0cb010 0x7f766c1566a0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f766400c820 tx=0x7f766400cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:22:28.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.741+0000 7f7669ffb640 1 -- 172.21.15.37:0/2386019852 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7664015070 con 0x7f766c0cb010 2024-04-22T07:22:28.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.741+0000 7f7669ffb640 1 -- 172.21.15.37:0/2386019852 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7664007a30 con 0x7f766c0cb010 2024-04-22T07:22:28.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.741+0000 7f7673996640 1 -- 172.21.15.37:0/2386019852 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f766c155c30 con 0x7f766c0cb010 2024-04-22T07:22:28.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.741+0000 7f7669ffb640 1 -- 172.21.15.37:0/2386019852 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7664007de0 con 0x7f766c0cb010 2024-04-22T07:22:28.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.741+0000 7f7673996640 1 -- 172.21.15.37:0/2386019852 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f766c1561f0 con 0x7f766c0cb010 2024-04-22T07:22:28.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.742+0000 7f7673996640 1 -- 172.21.15.37:0/2386019852 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f766c069cc0 con 0x7f766c0cb010 2024-04-22T07:22:28.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.742+0000 7f7669ffb640 1 -- 172.21.15.37:0/2386019852 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7664018070 con 0x7f766c0cb010 2024-04-22T07:22:28.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.743+0000 7f7669ffb640 1 --2- 172.21.15.37:0/2386019852 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f765806c920 0x7f765806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:28.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.743+0000 7f7669ffb640 1 -- 172.21.15.37:0/2386019852 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f766408b9e0 con 0x7f766c0cb010 2024-04-22T07:22:28.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.743+0000 7f7670f31640 1 --2- 172.21.15.37:0/2386019852 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f765806c920 0x7f765806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:28.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.744+0000 7f7670f31640 1 --2- 172.21.15.37:0/2386019852 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f765806c920 0x7f765806ede0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f7660036000 tx=0x7f7660008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:22:28.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.747+0000 7f7669ffb640 1 -- 172.21.15.37:0/2386019852 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f7664059e20 con 0x7f766c0cb010 2024-04-22T07:22:28.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.955+0000 7f7673996640 1 -- 172.21.15.37:0/2386019852 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f766c1f0840 con 0x7f766c0cb010 2024-04-22T07:22:28.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.955+0000 7f7669ffb640 1 -- 172.21.15.37:0/2386019852 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) ==== 104+0+11 (secure 0 0 0) 0x7f7664059720 con 0x7f766c0cb010 2024-04-22T07:22:28.953 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2024-04-22T07:22:28.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.959+0000 7f7673996640 1 -- 172.21.15.37:0/2386019852 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f765806c920 msgr2=0x7f765806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:28.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.959+0000 7f7673996640 1 --2- 172.21.15.37:0/2386019852 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f765806c920 0x7f765806ede0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f7660036000 tx=0x7f7660008030 comp rx=0 tx=0).stop 2024-04-22T07:22:28.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.959+0000 7f7673996640 1 -- 172.21.15.37:0/2386019852 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f766c0cb010 msgr2=0x7f766c1566a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:28.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.959+0000 7f7673996640 1 --2- 172.21.15.37:0/2386019852 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f766c0cb010 0x7f766c1566a0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f766400c820 tx=0x7f766400cce0 comp rx=0 tx=0).stop 2024-04-22T07:22:28.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.959+0000 7f7673996640 1 -- 172.21.15.37:0/2386019852 shutdown_connections 2024-04-22T07:22:28.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.959+0000 7f7673996640 1 --2- 172.21.15.37:0/2386019852 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f765806c920 0x7f765806ede0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:28.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.959+0000 7f7673996640 1 --2- 172.21.15.37:0/2386019852 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f766c1552c0 0x7f766c1f0c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:28.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.959+0000 7f7673996640 1 --2- 172.21.15.37:0/2386019852 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f766c0cdd60 0x7f766c153ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:28.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.959+0000 7f7673996640 1 --2- 172.21.15.37:0/2386019852 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f766c0cb010 0x7f766c1566a0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:28.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.959+0000 7f7673996640 1 -- 172.21.15.37:0/2386019852 >> 172.21.15.37:0/2386019852 conn(0x7f766c06d330 msgr2=0x7f766c0b3d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:22:28.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.960+0000 7f7673996640 1 -- 172.21.15.37:0/2386019852 shutdown_connections 2024-04-22T07:22:28.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:28.960+0000 7f7673996640 1 -- 172.21.15.37:0/2386019852 wait complete. 2024-04-22T07:22:28.972 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-22T07:22:29.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:29.129+0000 7fb06a152640 1 Processor -- start 2024-04-22T07:22:29.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:29.129+0000 7fb06a152640 1 -- start start 2024-04-22T07:22:29.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:29.131+0000 7fb06a152640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fb064073d80 0x7fb0640c7380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:29.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:29.131+0000 7fb06a152640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb0640c8380 0x7fb0640c6030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:29.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:29.131+0000 7fb06a152640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb064072820 con 0x7fb064152ce0 2024-04-22T07:22:29.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:29.131+0000 7fb06a152640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fb0640c87f0 con 0x7fb0640c8380 2024-04-22T07:22:29.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:29.131+0000 7fb06a152640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7fb064071fa0 con 0x7fb064073d80 2024-04-22T07:22:29.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:29.131+0000 7fb05bfff640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fb064073d80 0x7fb0640c7380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:29.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:29.131+0000 7fb05bfff640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fb064073d80 0x7fb0640c7380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.37:48852/0 (socket says 172.21.15.37:48852) 2024-04-22T07:22:29.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:29.131+0000 7fb05bfff640 1 -- 172.21.15.37:0/101674668 learned_addr learned my addr 172.21.15.37:0/101674668 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:22:29.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:29.131+0000 7fb05bfff640 1 -- 172.21.15.37:0/101674668 >> v2:172.21.15.37:3300/0 conn(0x7fb0640c8380 msgr2=0x7fb0640c6030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:22:29.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:29.131+0000 7fb05bfff640 1 --2- 172.21.15.37:0/101674668 >> v2:172.21.15.37:3300/0 conn(0x7fb0640c8380 0x7fb0640c6030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:29.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:29.131+0000 7fb05bfff640 1 -- 172.21.15.37:0/101674668 >> v1:172.21.15.37:6789/0 conn(0x7fb064152ce0 legacy=0x7fb0641594b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:22:29.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:29.131+0000 7fb05bfff640 1 -- 172.21.15.37:0/101674668 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb064072260 con 0x7fb064073d80 2024-04-22T07:22:29.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:29.133+0000 7fb05bfff640 1 --2- 172.21.15.37:0/101674668 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb064073d80 0x7fb0640c7380 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fb0640cdaa0 tx=0x7fb05402b930 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f303d2d6b402c28f server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:22:29.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:29.133+0000 7fb062ffd640 1 -- 172.21.15.37:0/101674668 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb054035020 con 0x7fb064073d80 2024-04-22T07:22:29.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:29.133+0000 7fb062ffd640 1 -- 172.21.15.37:0/101674668 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb054031890 con 0x7fb064073d80 2024-04-22T07:22:29.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:29.133+0000 7fb062ffd640 1 -- 172.21.15.37:0/101674668 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb054031ca0 con 0x7fb064073d80 2024-04-22T07:22:29.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:29.134+0000 7fb06a152640 1 -- 172.21.15.37:0/101674668 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb064073d80 msgr2=0x7fb0640c7380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:29.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:29.134+0000 7fb06a152640 1 --2- 172.21.15.37:0/101674668 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb064073d80 0x7fb0640c7380 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fb0640cdaa0 tx=0x7fb05402b930 comp rx=0 tx=0).stop 2024-04-22T07:22:29.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:29.134+0000 7fb06a152640 1 -- 172.21.15.37:0/101674668 shutdown_connections 2024-04-22T07:22:29.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:29.134+0000 7fb06a152640 1 --2- 172.21.15.37:0/101674668 >> v2:172.21.15.37:3300/0 conn(0x7fb0640c8380 0x7fb0640c6030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:29.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:29.134+0000 7fb06a152640 1 --2- 172.21.15.37:0/101674668 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb064073d80 0x7fb0640c7380 secure :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fb0640cdaa0 tx=0x7fb05402b930 comp rx=0 tx=0).stop 2024-04-22T07:22:29.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:29.134+0000 7fb06a152640 1 -- 172.21.15.37:0/101674668 >> 172.21.15.37:0/101674668 conn(0x7fb06406fb40 msgr2=0x7fb06406ff50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:22:29.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:29.134+0000 7fb06a152640 1 -- 172.21.15.37:0/101674668 shutdown_connections 2024-04-22T07:22:29.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:29.134+0000 7fb06a152640 1 -- 172.21.15.37:0/101674668 wait complete. 2024-04-22T07:22:29.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:29.136+0000 7fb06a152640 1 Processor -- start 2024-04-22T07:22:29.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:29.137+0000 7fb06a152640 1 -- start start 2024-04-22T07:22:29.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:29.138+0000 7fb06a152640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb0640c8380 0x7fb06414e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:29.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:29.138+0000 7fb06a152640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb064152ce0 0x7fb064151120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:29.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:29.138+0000 7fb06a152640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb06415a0a0 0x7fb064151660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:29.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:29.138+0000 7fb06a152640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fb064158f90 con 0x7fb06415a0a0 2024-04-22T07:22:29.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:29.138+0000 7fb05bfff640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb064152ce0 0x7fb064151120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:29.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:29.138+0000 7fb05bfff640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb064152ce0 0x7fb064151120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.37:48868/0 (socket says 172.21.15.37:48868) 2024-04-22T07:22:29.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:29.138+0000 7fb05bfff640 1 -- 172.21.15.37:0/3639423282 learned_addr learned my addr 172.21.15.37:0/3639423282 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:22:29.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:29.138+0000 7fb0637fe640 1 --2- 172.21.15.37:0/3639423282 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb0640c8380 0x7fb06414e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:29.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:29.138+0000 7fb06a152640 1 -- 172.21.15.37:0/3639423282 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fb064158cb0 con 0x7fb064152ce0 2024-04-22T07:22:29.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:29.138+0000 7fb06a152640 1 -- 172.21.15.37:0/3639423282 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fb0641530c0 con 0x7fb0640c8380 2024-04-22T07:22:29.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:29.138+0000 7fb063fff640 1 --2- 172.21.15.37:0/3639423282 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb06415a0a0 0x7fb064151660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:29.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:29.138+0000 7fb05bfff640 1 -- 172.21.15.37:0/3639423282 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb0640c8380 msgr2=0x7fb06414e6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:29.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:29.138+0000 7fb05bfff640 1 --2- 172.21.15.37:0/3639423282 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb0640c8380 0x7fb06414e6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:29.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:29.139+0000 7fb05bfff640 1 -- 172.21.15.37:0/3639423282 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb06415a0a0 msgr2=0x7fb064151660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:29.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:29.139+0000 7fb05bfff640 1 --2- 172.21.15.37:0/3639423282 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb06415a0a0 0x7fb064151660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:29.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:29.139+0000 7fb05bfff640 1 -- 172.21.15.37:0/3639423282 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0640c5ae0 con 0x7fb064152ce0 2024-04-22T07:22:29.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:29.139+0000 7fb05bfff640 1 --2- 172.21.15.37:0/3639423282 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb064152ce0 0x7fb064151120 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fb0540090b0 tx=0x7fb0540046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:22:29.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:29.139+0000 7fb060ff9640 1 -- 172.21.15.37:0/3639423282 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb054049070 con 0x7fb064152ce0 2024-04-22T07:22:29.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:29.140+0000 7fb060ff9640 1 -- 172.21.15.37:0/3639423282 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb05403ad50 con 0x7fb064152ce0 2024-04-22T07:22:29.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:29.140+0000 7fb060ff9640 1 -- 172.21.15.37:0/3639423282 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb054044660 con 0x7fb064152ce0 2024-04-22T07:22:29.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:29.140+0000 7fb06a152640 1 -- 172.21.15.37:0/3639423282 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0640c5da0 con 0x7fb064152ce0 2024-04-22T07:22:29.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:29.140+0000 7fb06a152640 1 -- 172.21.15.37:0/3639423282 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb064200e70 con 0x7fb064152ce0 2024-04-22T07:22:29.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:29.141+0000 7fb06a152640 1 -- 172.21.15.37:0/3639423282 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb064068b20 con 0x7fb064152ce0 2024-04-22T07:22:29.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:29.142+0000 7fb060ff9640 1 -- 172.21.15.37:0/3639423282 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb054038020 con 0x7fb064152ce0 2024-04-22T07:22:29.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:29.143+0000 7fb060ff9640 1 --2- 172.21.15.37:0/3639423282 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fb04406c8f0 0x7fb04406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:29.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:29.143+0000 7fb060ff9640 1 -- 172.21.15.37:0/3639423282 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7fb0540ad8d0 con 0x7fb064152ce0 2024-04-22T07:22:29.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:29.143+0000 7fb0637fe640 1 --2- 172.21.15.37:0/3639423282 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fb04406c8f0 0x7fb04406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:29.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:29.144+0000 7fb0637fe640 1 --2- 172.21.15.37:0/3639423282 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fb04406c8f0 0x7fb04406edb0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fb04c006fd0 tx=0x7fb04c009060 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:22:29.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:29.150+0000 7fb060ff9640 1 -- 172.21.15.37:0/3639423282 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fb05403f070 con 0x7fb064152ce0 2024-04-22T07:22:29.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:29.470+0000 7fb06a152640 1 -- 172.21.15.37:0/3639423282 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fb06415a680 con 0x7fb064152ce0 2024-04-22T07:22:29.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:29.470+0000 7fb060ff9640 1 -- 172.21.15.37:0/3639423282 <== mon.1 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) ==== 100+0+11 (secure 0 0 0) 0x7fb05402d040 con 0x7fb064152ce0 2024-04-22T07:22:29.468 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 64 2024-04-22T07:22:29.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:29.473+0000 7fb06a152640 1 -- 172.21.15.37:0/3639423282 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fb04406c8f0 msgr2=0x7fb04406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:29.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:29.473+0000 7fb06a152640 1 --2- 172.21.15.37:0/3639423282 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fb04406c8f0 0x7fb04406edb0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fb04c006fd0 tx=0x7fb04c009060 comp rx=0 tx=0).stop 2024-04-22T07:22:29.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:29.473+0000 7fb06a152640 1 -- 172.21.15.37:0/3639423282 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb064152ce0 msgr2=0x7fb064151120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:29.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:29.473+0000 7fb06a152640 1 --2- 172.21.15.37:0/3639423282 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb064152ce0 0x7fb064151120 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fb0540090b0 tx=0x7fb0540046c0 comp rx=0 tx=0).stop 2024-04-22T07:22:29.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:29.473+0000 7fb06a152640 1 -- 172.21.15.37:0/3639423282 shutdown_connections 2024-04-22T07:22:29.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:29.473+0000 7fb06a152640 1 --2- 172.21.15.37:0/3639423282 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fb04406c8f0 0x7fb04406edb0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:29.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:29.473+0000 7fb06a152640 1 --2- 172.21.15.37:0/3639423282 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb06415a0a0 0x7fb064151660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:29.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:29.473+0000 7fb06a152640 1 --2- 172.21.15.37:0/3639423282 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb064152ce0 0x7fb064151120 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:29.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:29.473+0000 7fb06a152640 1 --2- 172.21.15.37:0/3639423282 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb0640c8380 0x7fb06414e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:29.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:29.473+0000 7fb06a152640 1 -- 172.21.15.37:0/3639423282 >> 172.21.15.37:0/3639423282 conn(0x7fb06406fb40 msgr2=0x7fb06414f9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:22:29.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:29.474+0000 7fb06a152640 1 -- 172.21.15.37:0/3639423282 shutdown_connections 2024-04-22T07:22:29.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:29.474+0000 7fb06a152640 1 -- 172.21.15.37:0/3639423282 wait complete. 2024-04-22T07:22:29.486 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-22T07:22:29.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:29.642+0000 7f33683e6640 1 Processor -- start 2024-04-22T07:22:29.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:29.642+0000 7f33683e6640 1 -- start start 2024-04-22T07:22:29.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:29.644+0000 7f33683e6640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f33601564f0 0x7f33600c3540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:29.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:29.644+0000 7f33683e6640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f33600c4860 0x7f33600ca110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:29.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:29.644+0000 7f3366182640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f33601564f0 0x7f33600c3540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:29.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:29.644+0000 7f3366182640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f33601564f0 0x7f33600c3540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.37:48790/0 (socket says 172.21.15.37:48790) 2024-04-22T07:22:29.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:29.644+0000 7f3366182640 1 -- 172.21.15.37:0/1079471017 learned_addr learned my addr 172.21.15.37:0/1079471017 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:22:29.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:29.644+0000 7f3365981640 1 --2- 172.21.15.37:0/1079471017 >> v2:172.21.15.37:3300/0 conn(0x7f33600c4860 0x7f33600ca110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:29.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:29.644+0000 7f33683e6640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33600c3a80 con 0x7f33600ca650 2024-04-22T07:22:29.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:29.644+0000 7f33683e6640 1 -- 172.21.15.37:0/1079471017 --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f3360159d60 con 0x7f33600c4860 2024-04-22T07:22:29.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:29.644+0000 7f33683e6640 1 -- 172.21.15.37:0/1079471017 --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f33601598d0 con 0x7f33601564f0 2024-04-22T07:22:29.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:29.644+0000 7f3365180640 1 -- 172.21.15.37:0/1079471017 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1966689699 0 0) 0x7f33600c3a80 con 0x7f33600ca650 2024-04-22T07:22:29.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:29.644+0000 7f3365180640 1 -- 172.21.15.37:0/1079471017 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f334c003520 con 0x7f33600ca650 2024-04-22T07:22:29.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:29.645+0000 7f3366182640 1 -- 172.21.15.37:0/1079471017 >> v2:172.21.15.37:3300/0 conn(0x7f33600c4860 msgr2=0x7f33600ca110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:22:29.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:29.645+0000 7f3366182640 1 --2- 172.21.15.37:0/1079471017 >> v2:172.21.15.37:3300/0 conn(0x7f33600c4860 0x7f33600ca110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:29.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:29.645+0000 7f3366182640 1 -- 172.21.15.37:0/1079471017 >> v1:172.21.15.196:6789/0 conn(0x7f33600ca650 legacy=0x7f336006df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:29.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:29.645+0000 7f3366182640 1 -- 172.21.15.37:0/1079471017 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33600c9360 con 0x7f33601564f0 2024-04-22T07:22:29.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:29.646+0000 7f3366182640 1 --2- 172.21.15.37:0/1079471017 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f33601564f0 0x7f33600c3540 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f33600cedc0 tx=0x7f335002b790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=18d4acf001f9287f server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:22:29.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:29.647+0000 7f3365180640 1 -- 172.21.15.37:0/1079471017 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3350037070 con 0x7f33601564f0 2024-04-22T07:22:29.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:29.647+0000 7f3365180640 1 -- 172.21.15.37:0/1079471017 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3350030510 con 0x7f33601564f0 2024-04-22T07:22:29.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:29.647+0000 7f3365180640 1 -- 172.21.15.37:0/1079471017 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33580019f0 con 0x7f33601564f0 2024-04-22T07:22:29.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:29.648+0000 7f33683e6640 1 -- 172.21.15.37:0/1079471017 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f33601564f0 msgr2=0x7f33600c3540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:29.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:29.648+0000 7f33683e6640 1 --2- 172.21.15.37:0/1079471017 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f33601564f0 0x7f33600c3540 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f33600cedc0 tx=0x7f335002b790 comp rx=0 tx=0).stop 2024-04-22T07:22:29.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:29.648+0000 7f33683e6640 1 -- 172.21.15.37:0/1079471017 shutdown_connections 2024-04-22T07:22:29.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:29.648+0000 7f33683e6640 1 --2- 172.21.15.37:0/1079471017 >> v2:172.21.15.37:3300/0 conn(0x7f33600c4860 0x7f33600ca110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:29.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:29.648+0000 7f33683e6640 1 --2- 172.21.15.37:0/1079471017 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f33601564f0 0x7f33600c3540 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:29.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:29.648+0000 7f33683e6640 1 -- 172.21.15.37:0/1079471017 >> 172.21.15.37:0/1079471017 conn(0x7f33600676b0 msgr2=0x7f3360067ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:22:29.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:29.649+0000 7f33683e6640 1 -- 172.21.15.37:0/1079471017 shutdown_connections 2024-04-22T07:22:29.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:29.649+0000 7f33683e6640 1 -- 172.21.15.37:0/1079471017 wait complete. 2024-04-22T07:22:29.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:29.651+0000 7f33683e6640 1 Processor -- start 2024-04-22T07:22:29.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:29.651+0000 7f33683e6640 1 -- start start 2024-04-22T07:22:29.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:29.652+0000 7f33683e6640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f33600c4860 0x7f33600c8560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:29.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:29.652+0000 7f33683e6640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f33600ca650 0x7f33600b36d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:29.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:29.652+0000 7f33683e6640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f33601564f0 0x7f3360150110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:29.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:29.653+0000 7f33683e6640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3360159560 con 0x7f33601564f0 2024-04-22T07:22:29.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:29.653+0000 7f33683e6640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f3360159280 con 0x7f33600c4860 2024-04-22T07:22:29.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:29.653+0000 7f33683e6640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f336006e660 con 0x7f33600ca650 2024-04-22T07:22:29.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:29.653+0000 7f3366182640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f33600c4860 0x7f33600c8560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:29.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:29.653+0000 7f3365981640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f33600ca650 0x7f33600b36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:29.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:29.653+0000 7f3366182640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f33600c4860 0x7f33600c8560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.37:48792/0 (socket says 172.21.15.37:48792) 2024-04-22T07:22:29.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:29.653+0000 7f3366182640 1 -- 172.21.15.37:0/3865550652 learned_addr learned my addr 172.21.15.37:0/3865550652 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:22:29.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:29.653+0000 7f3366983640 1 --2- 172.21.15.37:0/3865550652 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f33601564f0 0x7f3360150110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:29.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:29.653+0000 7f3365981640 1 -- 172.21.15.37:0/3865550652 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f33600c4860 msgr2=0x7f33600c8560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:29.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:29.653+0000 7f3365981640 1 --2- 172.21.15.37:0/3865550652 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f33600c4860 0x7f33600c8560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:29.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:29.653+0000 7f3365981640 1 -- 172.21.15.37:0/3865550652 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f33601564f0 msgr2=0x7f3360150110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:29.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:29.653+0000 7f3365981640 1 --2- 172.21.15.37:0/3865550652 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f33601564f0 0x7f3360150110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:29.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:29.653+0000 7f3365981640 1 -- 172.21.15.37:0/3865550652 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33600b3c10 con 0x7f33600ca650 2024-04-22T07:22:29.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:29.654+0000 7f3365981640 1 --2- 172.21.15.37:0/3865550652 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f33600ca650 0x7f33600b36d0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f335c00e880 tx=0x7f335c00ed40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:22:29.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:29.655+0000 7f3356ffd640 1 -- 172.21.15.37:0/3865550652 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f335c017070 con 0x7f33600ca650 2024-04-22T07:22:29.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:29.655+0000 7f3356ffd640 1 -- 172.21.15.37:0/3865550652 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f335c00c940 con 0x7f33600ca650 2024-04-22T07:22:29.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:29.655+0000 7f3356ffd640 1 -- 172.21.15.37:0/3865550652 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f335c00cd30 con 0x7f33600ca650 2024-04-22T07:22:29.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:29.655+0000 7f33683e6640 1 -- 172.21.15.37:0/3865550652 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33600b24e0 con 0x7f33600ca650 2024-04-22T07:22:29.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:29.656+0000 7f33683e6640 1 -- 172.21.15.37:0/3865550652 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f33601f80a0 con 0x7f33600ca650 2024-04-22T07:22:29.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:29.657+0000 7f33683e6640 1 -- 172.21.15.37:0/3865550652 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33600c55a0 con 0x7f33600ca650 2024-04-22T07:22:29.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:29.658+0000 7f3356ffd640 1 -- 172.21.15.37:0/3865550652 <== mon.2 v2:172.21.15.196:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f335c01a070 con 0x7f33600ca650 2024-04-22T07:22:29.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:29.658+0000 7f3356ffd640 1 --2- 172.21.15.37:0/3865550652 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f334406c970 0x7f334406ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:29.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:29.658+0000 7f3356ffd640 1 -- 172.21.15.37:0/3865550652 <== mon.2 v2:172.21.15.196:3301/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f335c08b9e0 con 0x7f33600ca650 2024-04-22T07:22:29.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:29.658+0000 7f3366182640 1 --2- 172.21.15.37:0/3865550652 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f334406c970 0x7f334406ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:29.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:29.659+0000 7f3366182640 1 --2- 172.21.15.37:0/3865550652 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f334406c970 0x7f334406ee30 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f3350009630 tx=0x7f335002f000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:22:29.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:29.666+0000 7f3356ffd640 1 -- 172.21.15.37:0/3865550652 <== mon.2 v2:172.21.15.196:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f33600c55a0 con 0x7f33600ca650 2024-04-22T07:22:30.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:30.021+0000 7f33683e6640 1 -- 172.21.15.37:0/3865550652 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f3360069cc0 con 0x7f33600ca650 2024-04-22T07:22:30.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:30.022+0000 7f3356ffd640 1 -- 172.21.15.37:0/3865550652 <== mon.2 v2:172.21.15.196:3301/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) ==== 80+0+0 (secure 0 0 0) 0x7f335c059790 con 0x7f33600ca650 2024-04-22T07:22:30.020 INFO:teuthology.orchestra.run.smithi037.stderr:listed 0 entries 2024-04-22T07:22:30.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:30.024+0000 7f33683e6640 1 -- 172.21.15.37:0/3865550652 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f334406c970 msgr2=0x7f334406ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:30.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:30.024+0000 7f33683e6640 1 --2- 172.21.15.37:0/3865550652 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f334406c970 0x7f334406ee30 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f3350009630 tx=0x7f335002f000 comp rx=0 tx=0).stop 2024-04-22T07:22:30.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:30.024+0000 7f33683e6640 1 -- 172.21.15.37:0/3865550652 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f33600ca650 msgr2=0x7f33600b36d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:30.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:30.024+0000 7f33683e6640 1 --2- 172.21.15.37:0/3865550652 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f33600ca650 0x7f33600b36d0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f335c00e880 tx=0x7f335c00ed40 comp rx=0 tx=0).stop 2024-04-22T07:22:30.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:30.024+0000 7f33683e6640 1 -- 172.21.15.37:0/3865550652 shutdown_connections 2024-04-22T07:22:30.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:30.024+0000 7f33683e6640 1 --2- 172.21.15.37:0/3865550652 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f334406c970 0x7f334406ee30 secure :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f3350009630 tx=0x7f335002f000 comp rx=0 tx=0).stop 2024-04-22T07:22:30.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:30.024+0000 7f33683e6640 1 --2- 172.21.15.37:0/3865550652 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f33601564f0 0x7f3360150110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:30.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:30.024+0000 7f33683e6640 1 --2- 172.21.15.37:0/3865550652 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f33600ca650 0x7f33600b36d0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:30.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:30.024+0000 7f33683e6640 1 --2- 172.21.15.37:0/3865550652 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f33600c4860 0x7f33600c8560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:30.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:30.024+0000 7f33683e6640 1 -- 172.21.15.37:0/3865550652 >> 172.21.15.37:0/3865550652 conn(0x7f33600676b0 msgr2=0x7f3360153c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:22:30.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:30.025+0000 7f33683e6640 1 -- 172.21.15.37:0/3865550652 shutdown_connections 2024-04-22T07:22:30.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:30.025+0000 7f33683e6640 1 -- 172.21.15.37:0/3865550652 wait complete. 2024-04-22T07:22:30.037 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-22T07:22:30.037 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-22T07:22:30.038 DEBUG:teuthology.orchestra.run.smithi037:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-22T07:22:30.103 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi037.front.sepia.ceph.com 2024-04-22T07:22:30.103 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-22T07:22:30.103 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-22T07:22:30.143 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-22T07:22:30.143 DEBUG:teuthology.orchestra.run.smithi037:> ip netns list 2024-04-22T07:22:30.201 INFO:teuthology.orchestra.run.smithi037.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-22T07:22:30.202 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-22T07:22:30.202 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-22T07:22:30.272 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-22T07:22:30.272 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link delete ceph-brx 2024-04-22T07:22:30.368 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-04-22T07:22:30.378 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-22T07:22:30.378 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-22T07:22:30.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:30.512+0000 7f9e8a014640 1 Processor -- start 2024-04-22T07:22:30.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:30.512+0000 7f9e8a014640 1 -- start start 2024-04-22T07:22:30.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:30.513+0000 7f9e8a014640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f9e840c36d0 0x7f9e840c8a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:30.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:30.513+0000 7f9e8a014640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f9e840c8fd0 0x7f9e8415ae90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:30.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:30.513+0000 7f9e8a014640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e840c9600 con 0x7f9e84151a90 2024-04-22T07:22:30.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:30.513+0000 7f9e8a014640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f9e840c93e0 con 0x7f9e840c36d0 2024-04-22T07:22:30.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:30.513+0000 7f9e8a014640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f9e841578a0 con 0x7f9e840c8fd0 2024-04-22T07:22:30.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:30.513+0000 7f9e82ffd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f9e840c36d0 0x7f9e840c8a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:30.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:30.513+0000 7f9e83fff640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f9e840c8fd0 0x7f9e8415ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:30.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:30.513+0000 7f9e82ffd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f9e840c36d0 0x7f9e840c8a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36912/0 (socket says 172.21.15.37:36912) 2024-04-22T07:22:30.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:30.513+0000 7f9e82ffd640 1 -- 172.21.15.37:0/618884974 learned_addr learned my addr 172.21.15.37:0/618884974 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:22:30.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:30.513+0000 7f9e82ffd640 1 -- 172.21.15.37:0/618884974 >> v2:172.21.15.196:3300/0 conn(0x7f9e840c8fd0 msgr2=0x7f9e8415ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:22:30.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:30.513+0000 7f9e82ffd640 1 --2- 172.21.15.37:0/618884974 >> v2:172.21.15.196:3300/0 conn(0x7f9e840c8fd0 0x7f9e8415ae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:30.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:30.513+0000 7f9e82ffd640 1 -- 172.21.15.37:0/618884974 >> v1:172.21.15.196:6789/0 conn(0x7f9e84151a90 legacy=0x7f9e84073340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:30.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:30.513+0000 7f9e82ffd640 1 -- 172.21.15.37:0/618884974 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e84157b60 con 0x7f9e840c36d0 2024-04-22T07:22:30.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:30.514+0000 7f9e82ffd640 1 --2- 172.21.15.37:0/618884974 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e840c36d0 0x7f9e840c8a90 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f9e841553e0 tx=0x7f9e7802ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b61ad9cd6139e5e3 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:22:30.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:30.514+0000 7f9e827fc640 1 -- 172.21.15.37:0/618884974 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e7802f850 con 0x7f9e840c36d0 2024-04-22T07:22:30.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:30.514+0000 7f9e827fc640 1 -- 172.21.15.37:0/618884974 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e7802f9f0 con 0x7f9e840c36d0 2024-04-22T07:22:30.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:30.514+0000 7f9e827fc640 1 -- 172.21.15.37:0/618884974 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e7802fdc0 con 0x7f9e840c36d0 2024-04-22T07:22:30.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:30.515+0000 7f9e8a014640 1 -- 172.21.15.37:0/618884974 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e840c36d0 msgr2=0x7f9e840c8a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:30.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:30.515+0000 7f9e8a014640 1 --2- 172.21.15.37:0/618884974 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e840c36d0 0x7f9e840c8a90 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f9e841553e0 tx=0x7f9e7802ba30 comp rx=0 tx=0).stop 2024-04-22T07:22:30.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:30.515+0000 7f9e8a014640 1 -- 172.21.15.37:0/618884974 shutdown_connections 2024-04-22T07:22:30.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:30.515+0000 7f9e8a014640 1 --2- 172.21.15.37:0/618884974 >> v2:172.21.15.196:3300/0 conn(0x7f9e840c8fd0 0x7f9e8415ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:30.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:30.515+0000 7f9e8a014640 1 --2- 172.21.15.37:0/618884974 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e840c36d0 0x7f9e840c8a90 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:30.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:30.515+0000 7f9e8a014640 1 -- 172.21.15.37:0/618884974 >> 172.21.15.37:0/618884974 conn(0x7f9e8406b970 msgr2=0x7f9e8406bd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:22:30.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:30.515+0000 7f9e8a014640 1 -- 172.21.15.37:0/618884974 shutdown_connections 2024-04-22T07:22:30.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:30.515+0000 7f9e8a014640 1 -- 172.21.15.37:0/618884974 wait complete. 2024-04-22T07:22:30.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:30.517+0000 7f9e8a014640 1 Processor -- start 2024-04-22T07:22:30.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:30.517+0000 7f9e8a014640 1 -- start start 2024-04-22T07:22:30.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:30.518+0000 7f9e8a014640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9e840c36d0 0x7f9e84159ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:30.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:30.518+0000 7f9e8a014640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9e840c8fd0 0x7f9e8414ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:30.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:30.518+0000 7f9e8a014640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e84151a90 0x7f9e841533a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:30.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:30.518+0000 7f9e8a014640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f9e84158400 con 0x7f9e84151a90 2024-04-22T07:22:30.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:30.518+0000 7f9e8a014640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f9e84158120 con 0x7f9e840c8fd0 2024-04-22T07:22:30.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:30.518+0000 7f9e8a014640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f9e84151e70 con 0x7f9e840c36d0 2024-04-22T07:22:30.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:30.518+0000 7f9e83fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e84151a90 0x7f9e841533a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:30.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:30.518+0000 7f9e83fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e84151a90 0x7f9e841533a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36918/0 (socket says 172.21.15.37:36918) 2024-04-22T07:22:30.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:30.518+0000 7f9e83fff640 1 -- 172.21.15.37:0/1914905827 learned_addr learned my addr 172.21.15.37:0/1914905827 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:22:30.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:30.518+0000 7f9e837fe640 1 --2- 172.21.15.37:0/1914905827 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9e840c36d0 0x7f9e84159ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:30.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:30.518+0000 7f9e82ffd640 1 --2- 172.21.15.37:0/1914905827 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9e840c8fd0 0x7f9e8414ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:30.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:30.518+0000 7f9e83fff640 1 -- 172.21.15.37:0/1914905827 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9e840c36d0 msgr2=0x7f9e84159ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:30.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:30.518+0000 7f9e83fff640 1 --2- 172.21.15.37:0/1914905827 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9e840c36d0 0x7f9e84159ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:30.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:30.518+0000 7f9e83fff640 1 -- 172.21.15.37:0/1914905827 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9e840c8fd0 msgr2=0x7f9e8414ceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:30.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:30.518+0000 7f9e83fff640 1 --2- 172.21.15.37:0/1914905827 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9e840c8fd0 0x7f9e8414ceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:30.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:30.518+0000 7f9e83fff640 1 -- 172.21.15.37:0/1914905827 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e841542b0 con 0x7f9e84151a90 2024-04-22T07:22:30.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:30.519+0000 7f9e83fff640 1 --2- 172.21.15.37:0/1914905827 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e84151a90 0x7f9e841533a0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f9e7c009dd0 tx=0x7f9e7c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:22:30.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:30.519+0000 7f9e6bfff640 1 -- 172.21.15.37:0/1914905827 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e7c018020 con 0x7f9e84151a90 2024-04-22T07:22:30.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:30.519+0000 7f9e6bfff640 1 -- 172.21.15.37:0/1914905827 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e7c014480 con 0x7f9e84151a90 2024-04-22T07:22:30.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:30.519+0000 7f9e6bfff640 1 -- 172.21.15.37:0/1914905827 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e7c014870 con 0x7f9e84151a90 2024-04-22T07:22:30.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:30.519+0000 7f9e8a014640 1 -- 172.21.15.37:0/1914905827 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e84153d50 con 0x7f9e84151a90 2024-04-22T07:22:30.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:30.519+0000 7f9e8a014640 1 -- 172.21.15.37:0/1914905827 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e841597f0 con 0x7f9e84151a90 2024-04-22T07:22:30.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:30.520+0000 7f9e8a014640 1 -- 172.21.15.37:0/1914905827 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e84069cc0 con 0x7f9e84151a90 2024-04-22T07:22:30.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:30.521+0000 7f9e6bfff640 1 -- 172.21.15.37:0/1914905827 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9e7c005d10 con 0x7f9e84151a90 2024-04-22T07:22:30.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:30.521+0000 7f9e6bfff640 1 --2- 172.21.15.37:0/1914905827 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f9e7006c8f0 0x7f9e7006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:30.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:30.521+0000 7f9e6bfff640 1 -- 172.21.15.37:0/1914905827 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f9e7c08c640 con 0x7f9e84151a90 2024-04-22T07:22:30.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:30.521+0000 7f9e837fe640 1 --2- 172.21.15.37:0/1914905827 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f9e7006c8f0 0x7f9e7006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:30.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:30.522+0000 7f9e837fe640 1 --2- 172.21.15.37:0/1914905827 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f9e7006c8f0 0x7f9e7006edb0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f9e74007fd0 tx=0x7f9e74009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:22:30.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:30.526+0000 7f9e6bfff640 1 -- 172.21.15.37:0/1914905827 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f9e7c022070 con 0x7f9e84151a90 2024-04-22T07:22:30.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:30.723+0000 7f9e8a014640 1 -- 172.21.15.37:0/1914905827 --> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f9e84165220 con 0x7f9e7006c8f0 2024-04-22T07:22:30.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:30.730+0000 7f9e6bfff640 1 -- 172.21.15.37:0/1914905827 <== mgr.4103 v2:172.21.15.196:6832/321987173 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+254062 (secure 0 0 0) 0x7f9e84165220 con 0x7f9e7006c8f0 2024-04-22T07:22:30.731 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-22T07:22:30.733 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-04-22T07:22:30.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:30.733+0000 7f9e8a014640 1 -- 172.21.15.37:0/1914905827 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f9e7006c8f0 msgr2=0x7f9e7006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:30.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:30.733+0000 7f9e8a014640 1 --2- 172.21.15.37:0/1914905827 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f9e7006c8f0 0x7f9e7006edb0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f9e74007fd0 tx=0x7f9e74009040 comp rx=0 tx=0).stop 2024-04-22T07:22:30.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:30.733+0000 7f9e8a014640 1 -- 172.21.15.37:0/1914905827 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e84151a90 msgr2=0x7f9e841533a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:30.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:30.733+0000 7f9e8a014640 1 --2- 172.21.15.37:0/1914905827 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e84151a90 0x7f9e841533a0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f9e7c009dd0 tx=0x7f9e7c00c490 comp rx=0 tx=0).stop 2024-04-22T07:22:30.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:30.734+0000 7f9e8a014640 1 -- 172.21.15.37:0/1914905827 shutdown_connections 2024-04-22T07:22:30.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:30.734+0000 7f9e8a014640 1 --2- 172.21.15.37:0/1914905827 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f9e7006c8f0 0x7f9e7006edb0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:30.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:30.734+0000 7f9e8a014640 1 --2- 172.21.15.37:0/1914905827 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e84151a90 0x7f9e841533a0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:30.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:30.734+0000 7f9e8a014640 1 --2- 172.21.15.37:0/1914905827 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9e840c8fd0 0x7f9e8414ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:30.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:30.734+0000 7f9e8a014640 1 --2- 172.21.15.37:0/1914905827 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9e840c36d0 0x7f9e84159ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:30.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:30.734+0000 7f9e8a014640 1 -- 172.21.15.37:0/1914905827 >> 172.21.15.37:0/1914905827 conn(0x7f9e8406b970 msgr2=0x7f9e84072100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:22:30.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:30.734+0000 7f9e8a014640 1 -- 172.21.15.37:0/1914905827 shutdown_connections 2024-04-22T07:22:30.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:30.734+0000 7f9e8a014640 1 -- 172.21.15.37:0/1914905827 wait complete. 2024-04-22T07:22:30.742 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":138,"stamp":"2024-04-22T07:22:30.644112+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":5996193988,"num_objects":1454,"num_object_clones":0,"num_object_copies":2908,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1454,"num_whiteouts":0,"num_read":374,"num_read_kb":1048678,"num_write":10964,"num_write_kb":25177088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11342,"ondisk_log_size":11342,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":17362084,"kb_used_data":17037988,"kb_used_omap":12,"kb_used_meta":307635,"kb_avail":737612636,"statfs":{"total":773094113280,"available":755315339264,"internally_reserved":0,"allocated":17446899712,"data_stored":17445652572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":315018800},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,1,2,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-4747946717,"num_objects":-1132,"num_object_clones":0,"num_object_copies":-2264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1132,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1143,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002731"},"pg_stats":[{"pgid":"3.3f","version":"22'125","reported_seq":147,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:29.576470+0000","last_change":"2024-04-22T07:18:36.765825+0000","last_active":"2024-04-22T07:22:29.576470+0000","last_peered":"2024-04-22T07:22:29.576470+0000","last_clean":"2024-04-22T07:22:29.576470+0000","last_became_active":"2024-04-22T07:18:36.765306+0000","last_became_peered":"2024-04-22T07:18:36.765306+0000","last_unstale":"2024-04-22T07:22:29.576470+0000","last_undegraded":"2024-04-22T07:22:29.576470+0000","last_fullsized":"2024-04-22T07:22:29.576470+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":125,"log_dups_size":0,"ondisk_log_size":125,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:00:45.046782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67108864,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":5,"num_read_kb":20480,"num_write":122,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"22'150","reported_seq":170,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:30.536645+0000","last_change":"2024-04-22T07:18:36.772829+0000","last_active":"2024-04-22T07:22:30.536645+0000","last_peered":"2024-04-22T07:22:30.536645+0000","last_clean":"2024-04-22T07:22:30.536645+0000","last_became_active":"2024-04-22T07:18:36.772464+0000","last_became_peered":"2024-04-22T07:18:36.772464+0000","last_unstale":"2024-04-22T07:22:30.536645+0000","last_undegraded":"2024-04-22T07:22:30.536645+0000","last_fullsized":"2024-04-22T07:22:30.536645+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":150,"log_dups_size":0,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:09:08.040513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"22'107","reported_seq":128,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:11.499314+0000","last_change":"2024-04-22T07:18:36.760613+0000","last_active":"2024-04-22T07:22:11.499314+0000","last_peered":"2024-04-22T07:22:11.499314+0000","last_clean":"2024-04-22T07:22:11.499314+0000","last_became_active":"2024-04-22T07:18:36.760313+0000","last_became_peered":"2024-04-22T07:18:36.760313+0000","last_unstale":"2024-04-22T07:22:11.499314+0000","last_undegraded":"2024-04-22T07:22:11.499314+0000","last_fullsized":"2024-04-22T07:22:11.499314+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:51:10.038201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":171966464,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":4,"num_read_kb":16384,"num_write":103,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"22'120","reported_seq":133,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:12.480325+0000","last_change":"2024-04-22T07:19:18.282481+0000","last_active":"2024-04-22T07:22:12.480325+0000","last_peered":"2024-04-22T07:22:12.480325+0000","last_clean":"2024-04-22T07:22:12.480325+0000","last_became_active":"2024-04-22T07:19:18.282077+0000","last_became_peered":"2024-04-22T07:19:18.282077+0000","last_unstale":"2024-04-22T07:22:12.480325+0000","last_undegraded":"2024-04-22T07:22:12.480325+0000","last_fullsized":"2024-04-22T07:22:12.480325+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:45:42.674989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":209715200,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":115,"num_write_kb":450560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"22'129","reported_seq":150,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:29.605299+0000","last_change":"2024-04-22T07:18:36.764361+0000","last_active":"2024-04-22T07:22:29.605299+0000","last_peered":"2024-04-22T07:22:29.605299+0000","last_clean":"2024-04-22T07:22:29.605299+0000","last_became_active":"2024-04-22T07:18:36.763812+0000","last_became_peered":"2024-04-22T07:18:36.763812+0000","last_unstale":"2024-04-22T07:22:29.605299+0000","last_undegraded":"2024-04-22T07:22:29.605299+0000","last_fullsized":"2024-04-22T07:22:29.605299+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:18:59.298766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":4,"num_read_kb":16384,"num_write":124,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"22'129","reported_seq":151,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:30.049001+0000","last_change":"2024-04-22T07:18:36.762804+0000","last_active":"2024-04-22T07:22:30.049001+0000","last_peered":"2024-04-22T07:22:30.049001+0000","last_clean":"2024-04-22T07:22:30.049001+0000","last_became_active":"2024-04-22T07:18:36.762508+0000","last_became_peered":"2024-04-22T07:18:36.762508+0000","last_unstale":"2024-04-22T07:22:30.049001+0000","last_undegraded":"2024-04-22T07:22:30.049001+0000","last_fullsized":"2024-04-22T07:22:30.049001+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:09:08.040513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5,"num_read_kb":20480,"num_write":126,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"22'154","reported_seq":172,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:29.558783+0000","last_change":"2024-04-22T07:18:36.771774+0000","last_active":"2024-04-22T07:22:29.558783+0000","last_peered":"2024-04-22T07:22:29.558783+0000","last_clean":"2024-04-22T07:22:29.558783+0000","last_became_active":"2024-04-22T07:18:36.771425+0000","last_became_peered":"2024-04-22T07:18:36.771425+0000","last_unstale":"2024-04-22T07:22:29.558783+0000","last_undegraded":"2024-04-22T07:22:29.558783+0000","last_fullsized":"2024-04-22T07:22:29.558783+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":154,"log_dups_size":0,"ondisk_log_size":154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:45:27.464772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54525952,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":146,"num_write_kb":434176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"22'129","reported_seq":153,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:13.162133+0000","last_change":"2024-04-22T07:18:36.773631+0000","last_active":"2024-04-22T07:22:13.162133+0000","last_peered":"2024-04-22T07:22:13.162133+0000","last_clean":"2024-04-22T07:22:13.162133+0000","last_became_active":"2024-04-22T07:18:36.773347+0000","last_became_peered":"2024-04-22T07:18:36.773347+0000","last_unstale":"2024-04-22T07:22:13.162133+0000","last_undegraded":"2024-04-22T07:22:13.162133+0000","last_fullsized":"2024-04-22T07:22:13.162133+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:23:03.787574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":213909504,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":7,"num_read_kb":28672,"num_write":126,"num_write_kb":483328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"22'128","reported_seq":150,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:29.512031+0000","last_change":"2024-04-22T07:18:36.773325+0000","last_active":"2024-04-22T07:22:29.512031+0000","last_peered":"2024-04-22T07:22:29.512031+0000","last_clean":"2024-04-22T07:22:29.512031+0000","last_became_active":"2024-04-22T07:18:36.773023+0000","last_became_peered":"2024-04-22T07:18:36.773023+0000","last_unstale":"2024-04-22T07:22:29.512031+0000","last_undegraded":"2024-04-22T07:22:29.512031+0000","last_fullsized":"2024-04-22T07:22:29.512031+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:11:55.496104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":5,"num_read_kb":20480,"num_write":123,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"22'136","reported_seq":157,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:29.703843+0000","last_change":"2024-04-22T07:18:36.769834+0000","last_active":"2024-04-22T07:22:29.703843+0000","last_peered":"2024-04-22T07:22:29.703843+0000","last_clean":"2024-04-22T07:22:29.703843+0000","last_became_active":"2024-04-22T07:18:36.769544+0000","last_became_peered":"2024-04-22T07:18:36.769544+0000","last_unstale":"2024-04-22T07:22:29.703843+0000","last_undegraded":"2024-04-22T07:22:29.703843+0000","last_fullsized":"2024-04-22T07:22:29.703843+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:30:36.755201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50331648,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":4,"num_read_kb":16384,"num_write":129,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"22'175","reported_seq":197,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:29.787310+0000","last_change":"2024-04-22T07:18:36.762325+0000","last_active":"2024-04-22T07:22:29.787310+0000","last_peered":"2024-04-22T07:22:29.787310+0000","last_clean":"2024-04-22T07:22:29.787310+0000","last_became_active":"2024-04-22T07:18:36.762059+0000","last_became_peered":"2024-04-22T07:18:36.762059+0000","last_unstale":"2024-04-22T07:22:29.787310+0000","last_undegraded":"2024-04-22T07:22:29.787310+0000","last_fullsized":"2024-04-22T07:22:29.787310+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:51:10.038201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54525952,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":5,"num_read_kb":20480,"num_write":170,"num_write_kb":499712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"22'104","reported_seq":125,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:13.258058+0000","last_change":"2024-04-22T07:18:36.761961+0000","last_active":"2024-04-22T07:22:13.258058+0000","last_peered":"2024-04-22T07:22:13.258058+0000","last_clean":"2024-04-22T07:22:13.258058+0000","last_became_active":"2024-04-22T07:18:36.761389+0000","last_became_peered":"2024-04-22T07:18:36.761389+0000","last_unstale":"2024-04-22T07:22:13.258058+0000","last_undegraded":"2024-04-22T07:22:13.258058+0000","last_fullsized":"2024-04-22T07:22:13.258058+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T19:09:21.533739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":142606336,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":4,"num_read_kb":16384,"num_write":101,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"22'110","reported_seq":132,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:11.880117+0000","last_change":"2024-04-22T07:18:36.767665+0000","last_active":"2024-04-22T07:22:11.880117+0000","last_peered":"2024-04-22T07:22:11.880117+0000","last_clean":"2024-04-22T07:22:11.880117+0000","last_became_active":"2024-04-22T07:18:36.767386+0000","last_became_peered":"2024-04-22T07:18:36.767386+0000","last_unstale":"2024-04-22T07:22:11.880117+0000","last_undegraded":"2024-04-22T07:22:11.880117+0000","last_fullsized":"2024-04-22T07:22:11.880117+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:09:08.040513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":167772160,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":5,"num_read_kb":20480,"num_write":101,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"22'104","reported_seq":122,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:11.887349+0000","last_change":"2024-04-22T07:18:36.770591+0000","last_active":"2024-04-22T07:22:11.887349+0000","last_peered":"2024-04-22T07:22:11.887349+0000","last_clean":"2024-04-22T07:22:11.887349+0000","last_became_active":"2024-04-22T07:18:36.768507+0000","last_became_peered":"2024-04-22T07:18:36.768507+0000","last_unstale":"2024-04-22T07:22:11.887349+0000","last_undegraded":"2024-04-22T07:22:11.887349+0000","last_fullsized":"2024-04-22T07:22:11.887349+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:00:52.151755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":167772160,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":101,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"22'175","reported_seq":195,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:30.562456+0000","last_change":"2024-04-22T07:18:36.769407+0000","last_active":"2024-04-22T07:22:30.562456+0000","last_peered":"2024-04-22T07:22:30.562456+0000","last_clean":"2024-04-22T07:22:30.562456+0000","last_became_active":"2024-04-22T07:18:36.769114+0000","last_became_peered":"2024-04-22T07:18:36.769114+0000","last_unstale":"2024-04-22T07:22:30.562456+0000","last_undegraded":"2024-04-22T07:22:30.562456+0000","last_fullsized":"2024-04-22T07:22:30.562456+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:30:36.755201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"22'142","reported_seq":163,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:30.076101+0000","last_change":"2024-04-22T07:18:36.766539+0000","last_active":"2024-04-22T07:22:30.076101+0000","last_peered":"2024-04-22T07:22:30.076101+0000","last_clean":"2024-04-22T07:22:30.076101+0000","last_became_active":"2024-04-22T07:18:36.764865+0000","last_became_peered":"2024-04-22T07:18:36.764865+0000","last_unstale":"2024-04-22T07:22:30.076101+0000","last_undegraded":"2024-04-22T07:22:30.076101+0000","last_fullsized":"2024-04-22T07:22:30.076101+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:45:27.464772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":16384,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"22'101","reported_seq":112,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:11.660117+0000","last_change":"2024-04-22T07:19:17.897134+0000","last_active":"2024-04-22T07:22:11.660117+0000","last_peered":"2024-04-22T07:22:11.660117+0000","last_clean":"2024-04-22T07:22:11.660117+0000","last_became_active":"2024-04-22T07:19:17.896886+0000","last_became_peered":"2024-04-22T07:19:17.896886+0000","last_unstale":"2024-04-22T07:22:11.660117+0000","last_undegraded":"2024-04-22T07:22:11.660117+0000","last_fullsized":"2024-04-22T07:22:11.660117+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:59:57.688417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":176160768,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":96,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"22'106","reported_seq":126,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:11.829003+0000","last_change":"2024-04-22T07:18:36.764432+0000","last_active":"2024-04-22T07:22:11.829003+0000","last_peered":"2024-04-22T07:22:11.829003+0000","last_clean":"2024-04-22T07:22:11.829003+0000","last_became_active":"2024-04-22T07:18:36.764113+0000","last_became_peered":"2024-04-22T07:18:36.764113+0000","last_unstale":"2024-04-22T07:22:11.829003+0000","last_undegraded":"2024-04-22T07:22:11.829003+0000","last_fullsized":"2024-04-22T07:22:11.829003+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:32:48.474033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":184549376,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":103,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"22'155","reported_seq":176,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:29.529144+0000","last_change":"2024-04-22T07:18:36.772138+0000","last_active":"2024-04-22T07:22:29.529144+0000","last_peered":"2024-04-22T07:22:29.529144+0000","last_clean":"2024-04-22T07:22:29.529144+0000","last_became_active":"2024-04-22T07:18:36.771878+0000","last_became_peered":"2024-04-22T07:18:36.771878+0000","last_unstale":"2024-04-22T07:22:29.529144+0000","last_undegraded":"2024-04-22T07:22:29.529144+0000","last_fullsized":"2024-04-22T07:22:29.529144+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:36:27.097452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54525952,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":4,"num_read_kb":16384,"num_write":152,"num_write_kb":450560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"22'145","reported_seq":166,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:29.778033+0000","last_change":"2024-04-22T07:18:36.769528+0000","last_active":"2024-04-22T07:22:29.778033+0000","last_peered":"2024-04-22T07:22:29.778033+0000","last_clean":"2024-04-22T07:22:29.778033+0000","last_became_active":"2024-04-22T07:18:36.769240+0000","last_became_peered":"2024-04-22T07:18:36.769240+0000","last_unstale":"2024-04-22T07:22:29.778033+0000","last_undegraded":"2024-04-22T07:22:29.778033+0000","last_fullsized":"2024-04-22T07:22:29.778033+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:09:08.040513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50331648,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":4,"num_read_kb":16384,"num_write":141,"num_write_kb":417792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"22'92","reported_seq":110,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:13.222540+0000","last_change":"2024-04-22T07:18:36.766049+0000","last_active":"2024-04-22T07:22:13.222540+0000","last_peered":"2024-04-22T07:22:13.222540+0000","last_clean":"2024-04-22T07:22:13.222540+0000","last_became_active":"2024-04-22T07:18:36.765724+0000","last_became_peered":"2024-04-22T07:18:36.765724+0000","last_unstale":"2024-04-22T07:22:13.222540+0000","last_undegraded":"2024-04-22T07:22:13.222540+0000","last_fullsized":"2024-04-22T07:22:13.222540+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:32:20.374856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146800640,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":91,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"22'159","reported_seq":180,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:30.046853+0000","last_change":"2024-04-22T07:18:36.765850+0000","last_active":"2024-04-22T07:22:30.046853+0000","last_peered":"2024-04-22T07:22:30.046853+0000","last_clean":"2024-04-22T07:22:30.046853+0000","last_became_active":"2024-04-22T07:18:36.765560+0000","last_became_peered":"2024-04-22T07:18:36.765560+0000","last_unstale":"2024-04-22T07:22:30.046853+0000","last_undegraded":"2024-04-22T07:22:30.046853+0000","last_fullsized":"2024-04-22T07:22:30.046853+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:30:36.755201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":16384,"num_write":153,"num_write_kb":425984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"22'90","reported_seq":111,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:11.264602+0000","last_change":"2024-04-22T07:18:36.769465+0000","last_active":"2024-04-22T07:22:11.264602+0000","last_peered":"2024-04-22T07:22:11.264602+0000","last_clean":"2024-04-22T07:22:11.264602+0000","last_became_active":"2024-04-22T07:18:36.769181+0000","last_became_peered":"2024-04-22T07:18:36.769181+0000","last_unstale":"2024-04-22T07:22:11.264602+0000","last_undegraded":"2024-04-22T07:22:11.264602+0000","last_fullsized":"2024-04-22T07:22:11.264602+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:51:10.038201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":150994944,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":4,"num_read_kb":16384,"num_write":90,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"22'179","reported_seq":201,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:30.048452+0000","last_change":"2024-04-22T07:18:36.763439+0000","last_active":"2024-04-22T07:22:30.048452+0000","last_peered":"2024-04-22T07:22:30.048452+0000","last_clean":"2024-04-22T07:22:30.048452+0000","last_became_active":"2024-04-22T07:18:36.763146+0000","last_became_peered":"2024-04-22T07:18:36.763146+0000","last_unstale":"2024-04-22T07:22:30.048452+0000","last_undegraded":"2024-04-22T07:22:30.048452+0000","last_fullsized":"2024-04-22T07:22:30.048452+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":179,"log_dups_size":0,"ondisk_log_size":179,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:18:59.298766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":20480,"num_write":174,"num_write_kb":475136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"22'99","reported_seq":120,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:12.503842+0000","last_change":"2024-04-22T07:18:36.769533+0000","last_active":"2024-04-22T07:22:12.503842+0000","last_peered":"2024-04-22T07:22:12.503842+0000","last_clean":"2024-04-22T07:22:12.503842+0000","last_became_active":"2024-04-22T07:18:36.769274+0000","last_became_peered":"2024-04-22T07:18:36.769274+0000","last_unstale":"2024-04-22T07:22:12.503842+0000","last_undegraded":"2024-04-22T07:22:12.503842+0000","last_fullsized":"2024-04-22T07:22:12.503842+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:03:50.228822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":159383552,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":4,"num_read_kb":16384,"num_write":94,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"22'173","reported_seq":194,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:29.774823+0000","last_change":"2024-04-22T07:18:36.763931+0000","last_active":"2024-04-22T07:22:29.774823+0000","last_peered":"2024-04-22T07:22:29.774823+0000","last_clean":"2024-04-22T07:22:29.774823+0000","last_became_active":"2024-04-22T07:18:36.763656+0000","last_became_peered":"2024-04-22T07:18:36.763656+0000","last_unstale":"2024-04-22T07:22:29.774823+0000","last_undegraded":"2024-04-22T07:22:29.774823+0000","last_fullsized":"2024-04-22T07:22:29.774823+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:22:58.884168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54525952,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":4,"num_read_kb":16384,"num_write":170,"num_write_kb":499712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"22'159","reported_seq":179,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:30.545019+0000","last_change":"2024-04-22T07:18:36.767158+0000","last_active":"2024-04-22T07:22:30.545019+0000","last_peered":"2024-04-22T07:22:30.545019+0000","last_clean":"2024-04-22T07:22:30.545019+0000","last_became_active":"2024-04-22T07:18:36.766614+0000","last_became_peered":"2024-04-22T07:18:36.766614+0000","last_unstale":"2024-04-22T07:22:30.545019+0000","last_undegraded":"2024-04-22T07:22:30.545019+0000","last_fullsized":"2024-04-22T07:22:30.545019+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:44:30.785178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"22'97","reported_seq":118,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:12.412037+0000","last_change":"2024-04-22T07:18:36.773129+0000","last_active":"2024-04-22T07:22:12.412037+0000","last_peered":"2024-04-22T07:22:12.412037+0000","last_clean":"2024-04-22T07:22:12.412037+0000","last_became_active":"2024-04-22T07:18:36.772827+0000","last_became_peered":"2024-04-22T07:18:36.772827+0000","last_unstale":"2024-04-22T07:22:12.412037+0000","last_undegraded":"2024-04-22T07:22:12.412037+0000","last_fullsized":"2024-04-22T07:22:12.412037+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:45:27.464772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146800640,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":4,"num_read_kb":16384,"num_write":94,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"22'84","reported_seq":107,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:12.457029+0000","last_change":"2024-04-22T07:18:36.763716+0000","last_active":"2024-04-22T07:22:12.457029+0000","last_peered":"2024-04-22T07:22:12.457029+0000","last_clean":"2024-04-22T07:22:12.457029+0000","last_became_active":"2024-04-22T07:18:36.762270+0000","last_became_peered":"2024-04-22T07:18:36.762270+0000","last_unstale":"2024-04-22T07:22:12.457029+0000","last_undegraded":"2024-04-22T07:22:12.457029+0000","last_fullsized":"2024-04-22T07:22:12.457029+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:23:03.787574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117440512,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":6,"num_read_kb":24576,"num_write":83,"num_write_kb":303104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"22'128","reported_seq":151,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:30.054996+0000","last_change":"2024-04-22T07:18:36.764152+0000","last_active":"2024-04-22T07:22:30.054996+0000","last_peered":"2024-04-22T07:22:30.054996+0000","last_clean":"2024-04-22T07:22:30.054996+0000","last_became_active":"2024-04-22T07:18:36.763770+0000","last_became_peered":"2024-04-22T07:18:36.763770+0000","last_unstale":"2024-04-22T07:22:30.054996+0000","last_undegraded":"2024-04-22T07:22:30.054996+0000","last_fullsized":"2024-04-22T07:22:30.054996+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:22:58.884168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":24576,"num_write":122,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"22'92","reported_seq":112,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:10.640334+0000","last_change":"2024-04-22T07:18:36.771121+0000","last_active":"2024-04-22T07:22:10.640334+0000","last_peered":"2024-04-22T07:22:10.640334+0000","last_clean":"2024-04-22T07:22:10.640334+0000","last_became_active":"2024-04-22T07:18:36.770786+0000","last_became_peered":"2024-04-22T07:18:36.770786+0000","last_unstale":"2024-04-22T07:22:10.640334+0000","last_undegraded":"2024-04-22T07:22:10.640334+0000","last_fullsized":"2024-04-22T07:22:10.640334+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:45:15.213668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":138412032,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":90,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"22'135","reported_seq":157,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:29.785572+0000","last_change":"2024-04-22T07:18:36.765462+0000","last_active":"2024-04-22T07:22:29.785572+0000","last_peered":"2024-04-22T07:22:29.785572+0000","last_clean":"2024-04-22T07:22:29.785572+0000","last_became_active":"2024-04-22T07:18:36.765142+0000","last_became_peered":"2024-04-22T07:18:36.765142+0000","last_unstale":"2024-04-22T07:22:29.785572+0000","last_undegraded":"2024-04-22T07:22:29.785572+0000","last_fullsized":"2024-04-22T07:22:29.785572+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:32:20.374856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":5,"num_read_kb":20480,"num_write":133,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"22'93","reported_seq":112,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:11.112135+0000","last_change":"2024-04-22T07:18:36.768234+0000","last_active":"2024-04-22T07:22:11.112135+0000","last_peered":"2024-04-22T07:22:11.112135+0000","last_clean":"2024-04-22T07:22:11.112135+0000","last_became_active":"2024-04-22T07:18:36.767951+0000","last_became_peered":"2024-04-22T07:18:36.767951+0000","last_unstale":"2024-04-22T07:22:11.112135+0000","last_undegraded":"2024-04-22T07:22:11.112135+0000","last_fullsized":"2024-04-22T07:22:11.112135+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:08:05.611868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146800640,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":88,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"22'928","reported_seq":947,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:13.495922+0000","last_change":"2024-04-22T07:18:35.751538+0000","last_active":"2024-04-22T07:22:13.495922+0000","last_peered":"2024-04-22T07:22:13.495922+0000","last_clean":"2024-04-22T07:22:13.495922+0000","last_became_active":"2024-04-22T07:18:35.751219+0000","last_became_peered":"2024-04-22T07:18:35.751219+0000","last_unstale":"2024-04-22T07:22:13.495922+0000","last_undegraded":"2024-04-22T07:22:13.495922+0000","last_fullsized":"2024-04-22T07:22:13.495922+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":928,"log_dups_size":0,"ondisk_log_size":928,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:00:10.289974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1941532,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":927,"num_write_kb":2790,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"22'97","reported_seq":119,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:12.951383+0000","last_change":"2024-04-22T07:18:36.757337+0000","last_active":"2024-04-22T07:22:12.951383+0000","last_peered":"2024-04-22T07:22:12.951383+0000","last_clean":"2024-04-22T07:22:12.951383+0000","last_became_active":"2024-04-22T07:18:36.757039+0000","last_became_peered":"2024-04-22T07:18:36.757039+0000","last_unstale":"2024-04-22T07:22:12.951383+0000","last_undegraded":"2024-04-22T07:22:12.951383+0000","last_fullsized":"2024-04-22T07:22:12.951383+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:09:08.040513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146800640,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":5,"num_read_kb":20480,"num_write":94,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:19:18.280153+0000","last_change":"2024-04-22T07:18:35.746515+0000","last_active":"2024-04-22T07:19:18.280153+0000","last_peered":"2024-04-22T07:19:18.280153+0000","last_clean":"2024-04-22T07:19:18.280153+0000","last_became_active":"2024-04-22T07:18:35.746198+0000","last_became_peered":"2024-04-22T07:18:35.746198+0000","last_unstale":"2024-04-22T07:19:18.280153+0000","last_undegraded":"2024-04-22T07:19:18.280153+0000","last_fullsized":"2024-04-22T07:19:18.280153+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:43:54.682673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:19:18.280622+0000","last_change":"2024-04-22T07:18:35.752307+0000","last_active":"2024-04-22T07:19:18.280622+0000","last_peered":"2024-04-22T07:19:18.280622+0000","last_clean":"2024-04-22T07:19:18.280622+0000","last_became_active":"2024-04-22T07:18:35.751545+0000","last_became_peered":"2024-04-22T07:18:35.751545+0000","last_unstale":"2024-04-22T07:19:18.280622+0000","last_undegraded":"2024-04-22T07:19:18.280622+0000","last_fullsized":"2024-04-22T07:19:18.280622+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:21:55.316649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"22'121","reported_seq":142,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:12.400098+0000","last_change":"2024-04-22T07:18:36.772372+0000","last_active":"2024-04-22T07:22:12.400098+0000","last_peered":"2024-04-22T07:22:12.400098+0000","last_clean":"2024-04-22T07:22:12.400098+0000","last_became_active":"2024-04-22T07:18:36.772067+0000","last_became_peered":"2024-04-22T07:18:36.772067+0000","last_unstale":"2024-04-22T07:22:12.400098+0000","last_undegraded":"2024-04-22T07:22:12.400098+0000","last_fullsized":"2024-04-22T07:22:12.400098+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":121,"log_dups_size":0,"ondisk_log_size":121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:44:30.785178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":197132288,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":4,"num_read_kb":16384,"num_write":115,"num_write_kb":442368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:19:17.876687+0000","last_change":"2024-04-22T07:18:35.740989+0000","last_active":"2024-04-22T07:19:17.876687+0000","last_peered":"2024-04-22T07:19:17.876687+0000","last_clean":"2024-04-22T07:19:17.876687+0000","last_became_active":"2024-04-22T07:18:35.740665+0000","last_became_peered":"2024-04-22T07:18:35.740665+0000","last_unstale":"2024-04-22T07:19:17.876687+0000","last_undegraded":"2024-04-22T07:19:17.876687+0000","last_fullsized":"2024-04-22T07:19:17.876687+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:00:10.289974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"22'181","reported_seq":201,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:30.564910+0000","last_change":"2024-04-22T07:18:36.767022+0000","last_active":"2024-04-22T07:22:30.564910+0000","last_peered":"2024-04-22T07:22:30.564910+0000","last_clean":"2024-04-22T07:22:30.564910+0000","last_became_active":"2024-04-22T07:18:36.766609+0000","last_became_peered":"2024-04-22T07:18:36.766609+0000","last_unstale":"2024-04-22T07:22:30.564910+0000","last_undegraded":"2024-04-22T07:22:30.564910+0000","last_fullsized":"2024-04-22T07:22:30.564910+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":181,"log_dups_size":0,"ondisk_log_size":181,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:32:20.374856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"22'1","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:20:43.848866+0000","last_change":"2024-04-22T07:18:35.752081+0000","last_active":"2024-04-22T07:20:43.848866+0000","last_peered":"2024-04-22T07:20:43.848866+0000","last_clean":"2024-04-22T07:20:43.848866+0000","last_became_active":"2024-04-22T07:18:35.751757+0000","last_became_peered":"2024-04-22T07:18:35.751757+0000","last_unstale":"2024-04-22T07:20:43.848866+0000","last_undegraded":"2024-04-22T07:20:43.848866+0000","last_fullsized":"2024-04-22T07:20:43.848866+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:21:55.316649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"22'217","reported_seq":242,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:30.042586+0000","last_change":"2024-04-22T07:18:36.765937+0000","last_active":"2024-04-22T07:22:30.042586+0000","last_peered":"2024-04-22T07:22:30.042586+0000","last_clean":"2024-04-22T07:22:30.042586+0000","last_became_active":"2024-04-22T07:18:36.765647+0000","last_became_peered":"2024-04-22T07:18:36.765647+0000","last_unstale":"2024-04-22T07:22:30.042586+0000","last_undegraded":"2024-04-22T07:22:30.042586+0000","last_fullsized":"2024-04-22T07:22:30.042586+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:59:57.688417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":8,"num_read_kb":32768,"num_write":214,"num_write_kb":598016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:19:17.877284+0000","last_change":"2024-04-22T07:18:35.747309+0000","last_active":"2024-04-22T07:19:17.877284+0000","last_peered":"2024-04-22T07:19:17.877284+0000","last_clean":"2024-04-22T07:19:17.877284+0000","last_became_active":"2024-04-22T07:18:35.747019+0000","last_became_peered":"2024-04-22T07:18:35.747019+0000","last_unstale":"2024-04-22T07:19:17.877284+0000","last_undegraded":"2024-04-22T07:19:17.877284+0000","last_fullsized":"2024-04-22T07:19:17.877284+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:21:55.316649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"22'97","reported_seq":118,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:12.706549+0000","last_change":"2024-04-22T07:18:36.763436+0000","last_active":"2024-04-22T07:22:12.706549+0000","last_peered":"2024-04-22T07:22:12.706549+0000","last_clean":"2024-04-22T07:22:12.706549+0000","last_became_active":"2024-04-22T07:18:36.763068+0000","last_became_peered":"2024-04-22T07:18:36.763068+0000","last_unstale":"2024-04-22T07:22:12.706549+0000","last_undegraded":"2024-04-22T07:22:12.706549+0000","last_fullsized":"2024-04-22T07:22:12.706549+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:22:58.884168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146800640,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":4,"num_read_kb":16384,"num_write":97,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"22'8","reported_seq":27,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:30.596987+0000","last_change":"2024-04-22T07:18:35.750769+0000","last_active":"2024-04-22T07:22:30.596987+0000","last_peered":"2024-04-22T07:22:30.596987+0000","last_clean":"2024-04-22T07:22:30.596987+0000","last_became_active":"2024-04-22T07:18:35.750406+0000","last_became_peered":"2024-04-22T07:18:35.750406+0000","last_unstale":"2024-04-22T07:22:30.596987+0000","last_undegraded":"2024-04-22T07:22:30.596987+0000","last_fullsized":"2024-04-22T07:22:30.596987+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T19:09:20.529889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"22'104","reported_seq":123,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:13.257565+0000","last_change":"2024-04-22T07:18:36.767426+0000","last_active":"2024-04-22T07:22:13.257565+0000","last_peered":"2024-04-22T07:22:13.257565+0000","last_clean":"2024-04-22T07:22:13.257565+0000","last_became_active":"2024-04-22T07:18:36.767159+0000","last_became_peered":"2024-04-22T07:18:36.767159+0000","last_unstale":"2024-04-22T07:22:13.257565+0000","last_undegraded":"2024-04-22T07:22:13.257565+0000","last_fullsized":"2024-04-22T07:22:13.257565+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:19:49.652644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":163577856,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":99,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"22'2012","reported_seq":2031,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:03.268031+0000","last_change":"2024-04-22T07:18:35.752996+0000","last_active":"2024-04-22T07:22:03.268031+0000","last_peered":"2024-04-22T07:22:03.268031+0000","last_clean":"2024-04-22T07:22:03.268031+0000","last_became_active":"2024-04-22T07:18:35.752686+0000","last_became_peered":"2024-04-22T07:18:35.752686+0000","last_unstale":"2024-04-22T07:22:03.268031+0000","last_undegraded":"2024-04-22T07:22:03.268031+0000","last_fullsized":"2024-04-22T07:22:03.268031+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":2012,"log_dups_size":0,"ondisk_log_size":2012,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:36:55.684427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2011,"num_write_kb":6027,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"22'126","reported_seq":150,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:29.502078+0000","last_change":"2024-04-22T07:18:36.767539+0000","last_active":"2024-04-22T07:22:29.502078+0000","last_peered":"2024-04-22T07:22:29.502078+0000","last_clean":"2024-04-22T07:22:29.502078+0000","last_became_active":"2024-04-22T07:18:36.767273+0000","last_became_peered":"2024-04-22T07:18:36.767273+0000","last_unstale":"2024-04-22T07:22:29.502078+0000","last_undegraded":"2024-04-22T07:22:29.502078+0000","last_fullsized":"2024-04-22T07:22:29.502078+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:03:50.228822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":7,"num_read_kb":28672,"num_write":122,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":21,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:19:18.281247+0000","last_change":"2024-04-22T07:18:35.752382+0000","last_active":"2024-04-22T07:19:18.281247+0000","last_peered":"2024-04-22T07:19:18.281247+0000","last_clean":"2024-04-22T07:19:18.281247+0000","last_became_active":"2024-04-22T07:18:35.752060+0000","last_became_peered":"2024-04-22T07:18:35.752060+0000","last_unstale":"2024-04-22T07:19:18.281247+0000","last_undegraded":"2024-04-22T07:19:18.281247+0000","last_fullsized":"2024-04-22T07:19:18.281247+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:31:33.559251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"22'113","reported_seq":133,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:11.988938+0000","last_change":"2024-04-22T07:18:36.764670+0000","last_active":"2024-04-22T07:22:11.988938+0000","last_peered":"2024-04-22T07:22:11.988938+0000","last_clean":"2024-04-22T07:22:11.988938+0000","last_became_active":"2024-04-22T07:18:36.763834+0000","last_became_peered":"2024-04-22T07:18:36.763834+0000","last_unstale":"2024-04-22T07:22:11.988938+0000","last_undegraded":"2024-04-22T07:22:11.988938+0000","last_fullsized":"2024-04-22T07:22:11.988938+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:41:20.703226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":167772160,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":107,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:19:17.877449+0000","last_change":"2024-04-22T07:18:35.752856+0000","last_active":"2024-04-22T07:19:17.877449+0000","last_peered":"2024-04-22T07:19:17.877449+0000","last_clean":"2024-04-22T07:19:17.877449+0000","last_became_active":"2024-04-22T07:18:35.752527+0000","last_became_peered":"2024-04-22T07:18:35.752527+0000","last_unstale":"2024-04-22T07:19:17.877449+0000","last_undegraded":"2024-04-22T07:19:17.877449+0000","last_fullsized":"2024-04-22T07:19:17.877449+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:40:59.305769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"22'116","reported_seq":128,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:12.199280+0000","last_change":"2024-04-22T07:19:17.878772+0000","last_active":"2024-04-22T07:22:12.199280+0000","last_peered":"2024-04-22T07:22:12.199280+0000","last_clean":"2024-04-22T07:22:12.199280+0000","last_became_active":"2024-04-22T07:19:17.878334+0000","last_became_peered":"2024-04-22T07:19:17.878334+0000","last_unstale":"2024-04-22T07:22:12.199280+0000","last_undegraded":"2024-04-22T07:22:12.199280+0000","last_fullsized":"2024-04-22T07:22:12.199280+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":116,"log_dups_size":0,"ondisk_log_size":116,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:03:50.228822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":197132288,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":109,"num_write_kb":425984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:19:18.280016+0000","last_change":"2024-04-22T07:18:35.749740+0000","last_active":"2024-04-22T07:19:18.280016+0000","last_peered":"2024-04-22T07:19:18.280016+0000","last_clean":"2024-04-22T07:19:18.280016+0000","last_became_active":"2024-04-22T07:18:35.749453+0000","last_became_peered":"2024-04-22T07:18:35.749453+0000","last_unstale":"2024-04-22T07:19:18.280016+0000","last_undegraded":"2024-04-22T07:19:18.280016+0000","last_fullsized":"2024-04-22T07:19:18.280016+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:08:04.608018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"22'156","reported_seq":182,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:29.819186+0000","last_change":"2024-04-22T07:18:36.771940+0000","last_active":"2024-04-22T07:22:29.819186+0000","last_peered":"2024-04-22T07:22:29.819186+0000","last_clean":"2024-04-22T07:22:29.819186+0000","last_became_active":"2024-04-22T07:18:36.771548+0000","last_became_peered":"2024-04-22T07:18:36.771548+0000","last_unstale":"2024-04-22T07:22:29.819186+0000","last_undegraded":"2024-04-22T07:22:29.819186+0000","last_fullsized":"2024-04-22T07:22:29.819186+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:23:03.787574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":9,"num_read_kb":36864,"num_write":151,"num_write_kb":434176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":27,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:19:17.875275+0000","last_change":"2024-04-22T07:18:35.749047+0000","last_active":"2024-04-22T07:19:17.875275+0000","last_peered":"2024-04-22T07:19:17.875275+0000","last_clean":"2024-04-22T07:19:17.875275+0000","last_became_active":"2024-04-22T07:18:35.748757+0000","last_became_peered":"2024-04-22T07:18:35.748757+0000","last_unstale":"2024-04-22T07:19:17.875275+0000","last_undegraded":"2024-04-22T07:19:17.875275+0000","last_fullsized":"2024-04-22T07:19:17.875275+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:40:59.305769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"22'169","reported_seq":193,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:29.604592+0000","last_change":"2024-04-22T07:18:36.769894+0000","last_active":"2024-04-22T07:22:29.604592+0000","last_peered":"2024-04-22T07:22:29.604592+0000","last_clean":"2024-04-22T07:22:29.604592+0000","last_became_active":"2024-04-22T07:18:36.768702+0000","last_became_peered":"2024-04-22T07:18:36.768702+0000","last_unstale":"2024-04-22T07:22:29.604592+0000","last_undegraded":"2024-04-22T07:22:29.604592+0000","last_fullsized":"2024-04-22T07:22:29.604592+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:36:53.716397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":7,"num_read_kb":28672,"num_write":164,"num_write_kb":499712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:19:17.877321+0000","last_change":"2024-04-22T07:18:35.747536+0000","last_active":"2024-04-22T07:19:17.877321+0000","last_peered":"2024-04-22T07:19:17.877321+0000","last_clean":"2024-04-22T07:19:17.877321+0000","last_became_active":"2024-04-22T07:18:35.747271+0000","last_became_peered":"2024-04-22T07:18:35.747271+0000","last_unstale":"2024-04-22T07:19:17.877321+0000","last_undegraded":"2024-04-22T07:19:17.877321+0000","last_fullsized":"2024-04-22T07:19:17.877321+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:51:11.593642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"22'123","reported_seq":144,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:29.498215+0000","last_change":"2024-04-22T07:18:36.773033+0000","last_active":"2024-04-22T07:22:29.498215+0000","last_peered":"2024-04-22T07:22:29.498215+0000","last_clean":"2024-04-22T07:22:29.498215+0000","last_became_active":"2024-04-22T07:18:36.772537+0000","last_became_peered":"2024-04-22T07:18:36.772537+0000","last_unstale":"2024-04-22T07:22:29.498215+0000","last_undegraded":"2024-04-22T07:22:29.498215+0000","last_fullsized":"2024-04-22T07:22:29.498215+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:58:41.509248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":4,"num_read_kb":16384,"num_write":122,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":21,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:19:17.875556+0000","last_change":"2024-04-22T07:18:35.747533+0000","last_active":"2024-04-22T07:19:17.875556+0000","last_peered":"2024-04-22T07:19:17.875556+0000","last_clean":"2024-04-22T07:19:17.875556+0000","last_became_active":"2024-04-22T07:18:35.746881+0000","last_became_peered":"2024-04-22T07:18:35.746881+0000","last_unstale":"2024-04-22T07:19:17.875556+0000","last_undegraded":"2024-04-22T07:19:17.875556+0000","last_fullsized":"2024-04-22T07:19:17.875556+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:43:54.682673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"22'119","reported_seq":138,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:29.579066+0000","last_change":"2024-04-22T07:18:36.773723+0000","last_active":"2024-04-22T07:22:29.579066+0000","last_peered":"2024-04-22T07:22:29.579066+0000","last_clean":"2024-04-22T07:22:29.579066+0000","last_became_active":"2024-04-22T07:18:36.773466+0000","last_became_peered":"2024-04-22T07:18:36.773466+0000","last_unstale":"2024-04-22T07:22:29.579066+0000","last_undegraded":"2024-04-22T07:22:29.579066+0000","last_fullsized":"2024-04-22T07:22:29.579066+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:42:20.611744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":111,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:19:17.878170+0000","last_change":"2024-04-22T07:18:35.750360+0000","last_active":"2024-04-22T07:19:17.878170+0000","last_peered":"2024-04-22T07:19:17.878170+0000","last_clean":"2024-04-22T07:19:17.878170+0000","last_became_active":"2024-04-22T07:18:35.749984+0000","last_became_peered":"2024-04-22T07:18:35.749984+0000","last_unstale":"2024-04-22T07:19:17.878170+0000","last_undegraded":"2024-04-22T07:19:17.878170+0000","last_fullsized":"2024-04-22T07:19:17.878170+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:19:48.648793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"22'137","reported_seq":157,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:30.051930+0000","last_change":"2024-04-22T07:18:36.765767+0000","last_active":"2024-04-22T07:22:30.051930+0000","last_peered":"2024-04-22T07:22:30.051930+0000","last_clean":"2024-04-22T07:22:30.051930+0000","last_became_active":"2024-04-22T07:18:36.764218+0000","last_became_peered":"2024-04-22T07:18:36.764218+0000","last_unstale":"2024-04-22T07:22:30.051930+0000","last_undegraded":"2024-04-22T07:22:30.051930+0000","last_fullsized":"2024-04-22T07:22:30.051930+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:45:42.674989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":137,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:19:17.875606+0000","last_change":"2024-04-22T07:18:35.743323+0000","last_active":"2024-04-22T07:19:17.875606+0000","last_peered":"2024-04-22T07:19:17.875606+0000","last_clean":"2024-04-22T07:19:17.875606+0000","last_became_active":"2024-04-22T07:18:35.743023+0000","last_became_peered":"2024-04-22T07:18:35.743023+0000","last_unstale":"2024-04-22T07:19:17.875606+0000","last_undegraded":"2024-04-22T07:19:17.875606+0000","last_fullsized":"2024-04-22T07:19:17.875606+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:08:04.608018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"22'136","reported_seq":158,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:29.534168+0000","last_change":"2024-04-22T07:18:36.771073+0000","last_active":"2024-04-22T07:22:29.534168+0000","last_peered":"2024-04-22T07:22:29.534168+0000","last_clean":"2024-04-22T07:22:29.534168+0000","last_became_active":"2024-04-22T07:18:36.770678+0000","last_became_peered":"2024-04-22T07:18:36.770678+0000","last_unstale":"2024-04-22T07:22:29.534168+0000","last_undegraded":"2024-04-22T07:22:29.534168+0000","last_fullsized":"2024-04-22T07:22:29.534168+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:59:57.688417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62914560,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":5,"num_read_kb":20480,"num_write":129,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":176,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:20:29.610374+0000","last_change":"2024-04-22T07:18:26.518190+0000","last_active":"2024-04-22T07:20:29.610374+0000","last_peered":"2024-04-22T07:20:29.610374+0000","last_clean":"2024-04-22T07:20:29.610374+0000","last_became_active":"2024-04-22T07:18:26.515489+0000","last_became_peered":"2024-04-22T07:18:26.515489+0000","last_unstale":"2024-04-22T07:20:29.610374+0000","last_undegraded":"2024-04-22T07:20:29.610374+0000","last_fullsized":"2024-04-22T07:20:29.610374+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:24.652061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:24.652061+0000","last_clean_scrub_stamp":"2024-04-22T07:18:24.652061+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:32:54.875706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:19:17.876989+0000","last_change":"2024-04-22T07:18:35.748477+0000","last_active":"2024-04-22T07:19:17.876989+0000","last_peered":"2024-04-22T07:19:17.876989+0000","last_clean":"2024-04-22T07:19:17.876989+0000","last_became_active":"2024-04-22T07:18:35.748176+0000","last_became_peered":"2024-04-22T07:18:35.748176+0000","last_unstale":"2024-04-22T07:19:17.876989+0000","last_undegraded":"2024-04-22T07:19:17.876989+0000","last_fullsized":"2024-04-22T07:19:17.876989+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:36:55.684427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"22'107","reported_seq":125,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:12.286332+0000","last_change":"2024-04-22T07:18:36.771870+0000","last_active":"2024-04-22T07:22:12.286332+0000","last_peered":"2024-04-22T07:22:12.286332+0000","last_clean":"2024-04-22T07:22:12.286332+0000","last_became_active":"2024-04-22T07:18:36.771583+0000","last_became_peered":"2024-04-22T07:18:36.771583+0000","last_unstale":"2024-04-22T07:22:12.286332+0000","last_undegraded":"2024-04-22T07:22:12.286332+0000","last_fullsized":"2024-04-22T07:22:12.286332+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:22:58.884168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":184549376,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":106,"num_write_kb":409600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:19:17.895780+0000","last_change":"2024-04-22T07:18:35.755668+0000","last_active":"2024-04-22T07:19:17.895780+0000","last_peered":"2024-04-22T07:19:17.895780+0000","last_clean":"2024-04-22T07:19:17.895780+0000","last_became_active":"2024-04-22T07:18:35.755471+0000","last_became_peered":"2024-04-22T07:18:35.755471+0000","last_unstale":"2024-04-22T07:19:17.895780+0000","last_undegraded":"2024-04-22T07:19:17.895780+0000","last_fullsized":"2024-04-22T07:19:17.895780+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:36:55.684427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"22'107","reported_seq":130,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:12.366346+0000","last_change":"2024-04-22T07:18:36.758204+0000","last_active":"2024-04-22T07:22:12.366346+0000","last_peered":"2024-04-22T07:22:12.366346+0000","last_clean":"2024-04-22T07:22:12.366346+0000","last_became_active":"2024-04-22T07:18:36.757841+0000","last_became_peered":"2024-04-22T07:18:36.757841+0000","last_unstale":"2024-04-22T07:22:12.366346+0000","last_undegraded":"2024-04-22T07:22:12.366346+0000","last_fullsized":"2024-04-22T07:22:12.366346+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:43:09.058016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130023424,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":6,"num_read_kb":24576,"num_write":95,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"22'3","reported_seq":24,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:21:49.949664+0000","last_change":"2024-04-22T07:18:35.746686+0000","last_active":"2024-04-22T07:21:49.949664+0000","last_peered":"2024-04-22T07:21:49.949664+0000","last_clean":"2024-04-22T07:21:49.949664+0000","last_became_active":"2024-04-22T07:18:35.746371+0000","last_became_peered":"2024-04-22T07:18:35.746371+0000","last_unstale":"2024-04-22T07:21:49.949664+0000","last_undegraded":"2024-04-22T07:21:49.949664+0000","last_fullsized":"2024-04-22T07:21:49.949664+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:36:55.684427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":202,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"22'163","reported_seq":183,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:30.560499+0000","last_change":"2024-04-22T07:18:36.765985+0000","last_active":"2024-04-22T07:22:30.560499+0000","last_peered":"2024-04-22T07:22:30.560499+0000","last_clean":"2024-04-22T07:22:30.560499+0000","last_became_active":"2024-04-22T07:18:36.765661+0000","last_became_peered":"2024-04-22T07:18:36.765661+0000","last_unstale":"2024-04-22T07:22:30.560499+0000","last_undegraded":"2024-04-22T07:22:30.560499+0000","last_fullsized":"2024-04-22T07:22:30.560499+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:23:03.787574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:19:17.876920+0000","last_change":"2024-04-22T07:18:35.754160+0000","last_active":"2024-04-22T07:19:17.876920+0000","last_peered":"2024-04-22T07:19:17.876920+0000","last_clean":"2024-04-22T07:19:17.876920+0000","last_became_active":"2024-04-22T07:18:35.753860+0000","last_became_peered":"2024-04-22T07:18:35.753860+0000","last_unstale":"2024-04-22T07:19:17.876920+0000","last_undegraded":"2024-04-22T07:19:17.876920+0000","last_fullsized":"2024-04-22T07:19:17.876920+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:08:04.608018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"22'103","reported_seq":123,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:13.095777+0000","last_change":"2024-04-22T07:18:36.762349+0000","last_active":"2024-04-22T07:22:13.095777+0000","last_peered":"2024-04-22T07:22:13.095777+0000","last_clean":"2024-04-22T07:22:13.095777+0000","last_became_active":"2024-04-22T07:18:36.762097+0000","last_became_peered":"2024-04-22T07:18:36.762097+0000","last_unstale":"2024-04-22T07:22:13.095777+0000","last_undegraded":"2024-04-22T07:22:13.095777+0000","last_fullsized":"2024-04-22T07:22:13.095777+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:43:55.686523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":167772160,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":98,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:19:17.877984+0000","last_change":"2024-04-22T07:18:35.758810+0000","last_active":"2024-04-22T07:19:17.877984+0000","last_peered":"2024-04-22T07:19:17.877984+0000","last_clean":"2024-04-22T07:19:17.877984+0000","last_became_active":"2024-04-22T07:18:35.758521+0000","last_became_peered":"2024-04-22T07:18:35.758521+0000","last_unstale":"2024-04-22T07:19:17.877984+0000","last_undegraded":"2024-04-22T07:19:17.877984+0000","last_fullsized":"2024-04-22T07:19:17.877984+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:40:59.305769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"22'138","reported_seq":160,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:30.007404+0000","last_change":"2024-04-22T07:18:36.764448+0000","last_active":"2024-04-22T07:22:30.007404+0000","last_peered":"2024-04-22T07:22:30.007404+0000","last_clean":"2024-04-22T07:22:30.007404+0000","last_became_active":"2024-04-22T07:18:36.763728+0000","last_became_peered":"2024-04-22T07:18:36.763728+0000","last_unstale":"2024-04-22T07:22:30.007404+0000","last_undegraded":"2024-04-22T07:22:30.007404+0000","last_fullsized":"2024-04-22T07:22:30.007404+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:58:41.509248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":20480,"num_write":136,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:19:17.896310+0000","last_change":"2024-04-22T07:18:35.758980+0000","last_active":"2024-04-22T07:19:17.896310+0000","last_peered":"2024-04-22T07:19:17.896310+0000","last_clean":"2024-04-22T07:19:17.896310+0000","last_became_active":"2024-04-22T07:18:35.758674+0000","last_became_peered":"2024-04-22T07:18:35.758674+0000","last_unstale":"2024-04-22T07:19:17.896310+0000","last_undegraded":"2024-04-22T07:19:17.896310+0000","last_fullsized":"2024-04-22T07:19:17.896310+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:45:14.209818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"22'160","reported_seq":181,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:30.588721+0000","last_change":"2024-04-22T07:18:36.772908+0000","last_active":"2024-04-22T07:22:30.588721+0000","last_peered":"2024-04-22T07:22:30.588721+0000","last_clean":"2024-04-22T07:22:30.588721+0000","last_became_active":"2024-04-22T07:18:36.772636+0000","last_became_peered":"2024-04-22T07:18:36.772636+0000","last_unstale":"2024-04-22T07:22:30.588721+0000","last_undegraded":"2024-04-22T07:22:30.588721+0000","last_fullsized":"2024-04-22T07:22:30.588721+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:51:10.038201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":16384,"num_write":135,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"22'18","reported_seq":37,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:27.820343+0000","last_change":"2024-04-22T07:18:35.753595+0000","last_active":"2024-04-22T07:22:27.820343+0000","last_peered":"2024-04-22T07:22:27.820343+0000","last_clean":"2024-04-22T07:22:27.820343+0000","last_became_active":"2024-04-22T07:18:35.753295+0000","last_became_peered":"2024-04-22T07:18:35.753295+0000","last_unstale":"2024-04-22T07:22:27.820343+0000","last_undegraded":"2024-04-22T07:22:27.820343+0000","last_fullsized":"2024-04-22T07:22:27.820343+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:08:04.608018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"22'108","reported_seq":131,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:12.510716+0000","last_change":"2024-04-22T07:18:36.768580+0000","last_active":"2024-04-22T07:22:12.510716+0000","last_peered":"2024-04-22T07:22:12.510716+0000","last_clean":"2024-04-22T07:22:12.510716+0000","last_became_active":"2024-04-22T07:18:36.767702+0000","last_became_peered":"2024-04-22T07:18:36.767702+0000","last_unstale":"2024-04-22T07:22:12.510716+0000","last_undegraded":"2024-04-22T07:22:12.510716+0000","last_fullsized":"2024-04-22T07:22:12.510716+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:59:57.688417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":138412032,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":6,"num_read_kb":24576,"num_write":105,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":21,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:19:18.280400+0000","last_change":"2024-04-22T07:18:35.751692+0000","last_active":"2024-04-22T07:19:18.280400+0000","last_peered":"2024-04-22T07:19:18.280400+0000","last_clean":"2024-04-22T07:19:18.280400+0000","last_became_active":"2024-04-22T07:18:35.751393+0000","last_became_peered":"2024-04-22T07:18:35.751393+0000","last_unstale":"2024-04-22T07:19:18.280400+0000","last_undegraded":"2024-04-22T07:19:18.280400+0000","last_fullsized":"2024-04-22T07:19:18.280400+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:40:59.305769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"22'114","reported_seq":136,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:11.519295+0000","last_change":"2024-04-22T07:18:36.768532+0000","last_active":"2024-04-22T07:22:11.519295+0000","last_peered":"2024-04-22T07:22:11.519295+0000","last_clean":"2024-04-22T07:22:11.519295+0000","last_became_active":"2024-04-22T07:18:36.768253+0000","last_became_peered":"2024-04-22T07:18:36.768253+0000","last_unstale":"2024-04-22T07:22:11.519295+0000","last_undegraded":"2024-04-22T07:22:11.519295+0000","last_fullsized":"2024-04-22T07:22:11.519295+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:30:36.755201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":188743680,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":5,"num_read_kb":20480,"num_write":111,"num_write_kb":425984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:19:17.895786+0000","last_change":"2024-04-22T07:18:35.758702+0000","last_active":"2024-04-22T07:19:17.895786+0000","last_peered":"2024-04-22T07:19:17.895786+0000","last_clean":"2024-04-22T07:19:17.895786+0000","last_became_active":"2024-04-22T07:18:35.758415+0000","last_became_peered":"2024-04-22T07:18:35.758415+0000","last_unstale":"2024-04-22T07:19:17.895786+0000","last_undegraded":"2024-04-22T07:19:17.895786+0000","last_fullsized":"2024-04-22T07:19:17.895786+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:08:04.608018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"22'106","reported_seq":130,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:13.261095+0000","last_change":"2024-04-22T07:18:36.763053+0000","last_active":"2024-04-22T07:22:13.261095+0000","last_peered":"2024-04-22T07:22:13.261095+0000","last_clean":"2024-04-22T07:22:13.261095+0000","last_became_active":"2024-04-22T07:18:36.762546+0000","last_became_peered":"2024-04-22T07:18:36.762546+0000","last_unstale":"2024-04-22T07:22:13.261095+0000","last_undegraded":"2024-04-22T07:22:13.261095+0000","last_fullsized":"2024-04-22T07:22:13.261095+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:36:56.688277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130023424,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":7,"num_read_kb":28672,"num_write":101,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:19:17.877836+0000","last_change":"2024-04-22T07:18:35.748837+0000","last_active":"2024-04-22T07:19:17.877836+0000","last_peered":"2024-04-22T07:19:17.877836+0000","last_clean":"2024-04-22T07:19:17.877836+0000","last_became_active":"2024-04-22T07:18:35.748080+0000","last_became_peered":"2024-04-22T07:18:35.748080+0000","last_unstale":"2024-04-22T07:19:17.877836+0000","last_undegraded":"2024-04-22T07:19:17.877836+0000","last_fullsized":"2024-04-22T07:19:17.877836+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:36:55.684427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"22'113","reported_seq":135,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:12.487210+0000","last_change":"2024-04-22T07:18:36.769911+0000","last_active":"2024-04-22T07:22:12.487210+0000","last_peered":"2024-04-22T07:22:12.487210+0000","last_clean":"2024-04-22T07:22:12.487210+0000","last_became_active":"2024-04-22T07:18:36.768682+0000","last_became_peered":"2024-04-22T07:18:36.768682+0000","last_unstale":"2024-04-22T07:22:12.487210+0000","last_undegraded":"2024-04-22T07:22:12.487210+0000","last_fullsized":"2024-04-22T07:22:12.487210+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:30:36.755201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":150994944,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":5,"num_read_kb":20480,"num_write":108,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:19:17.878036+0000","last_change":"2024-04-22T07:18:35.753066+0000","last_active":"2024-04-22T07:19:17.878036+0000","last_peered":"2024-04-22T07:19:17.878036+0000","last_clean":"2024-04-22T07:19:17.878036+0000","last_became_active":"2024-04-22T07:18:35.752804+0000","last_became_peered":"2024-04-22T07:18:35.752804+0000","last_unstale":"2024-04-22T07:19:17.878036+0000","last_undegraded":"2024-04-22T07:19:17.878036+0000","last_fullsized":"2024-04-22T07:19:17.878036+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:43:54.682673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"22'103","reported_seq":125,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:11.993395+0000","last_change":"2024-04-22T07:18:36.774790+0000","last_active":"2024-04-22T07:22:11.993395+0000","last_peered":"2024-04-22T07:22:11.993395+0000","last_clean":"2024-04-22T07:22:11.993395+0000","last_became_active":"2024-04-22T07:18:36.774479+0000","last_became_peered":"2024-04-22T07:18:36.774479+0000","last_unstale":"2024-04-22T07:22:11.993395+0000","last_undegraded":"2024-04-22T07:22:11.993395+0000","last_fullsized":"2024-04-22T07:22:11.993395+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:36:53.716397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":150994944,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":5,"num_read_kb":20480,"num_write":99,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"22'3","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:20:43.848781+0000","last_change":"2024-04-22T07:18:35.754440+0000","last_active":"2024-04-22T07:20:43.848781+0000","last_peered":"2024-04-22T07:20:43.848781+0000","last_clean":"2024-04-22T07:20:43.848781+0000","last_became_active":"2024-04-22T07:18:35.754137+0000","last_became_peered":"2024-04-22T07:18:35.754137+0000","last_unstale":"2024-04-22T07:20:43.848781+0000","last_undegraded":"2024-04-22T07:20:43.848781+0000","last_fullsized":"2024-04-22T07:20:43.848781+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T19:09:20.529889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"22'116","reported_seq":136,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:29.700144+0000","last_change":"2024-04-22T07:18:36.759585+0000","last_active":"2024-04-22T07:22:29.700144+0000","last_peered":"2024-04-22T07:22:29.700144+0000","last_clean":"2024-04-22T07:22:29.700144+0000","last_became_active":"2024-04-22T07:18:36.759342+0000","last_became_peered":"2024-04-22T07:18:36.759342+0000","last_unstale":"2024-04-22T07:22:29.700144+0000","last_undegraded":"2024-04-22T07:22:29.700144+0000","last_fullsized":"2024-04-22T07:22:29.700144+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":116,"log_dups_size":0,"ondisk_log_size":116,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:44:30.785178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":112,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"22'170","reported_seq":191,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:30.042379+0000","last_change":"2024-04-22T07:18:36.762665+0000","last_active":"2024-04-22T07:22:30.042379+0000","last_peered":"2024-04-22T07:22:30.042379+0000","last_clean":"2024-04-22T07:22:30.042379+0000","last_became_active":"2024-04-22T07:18:36.762392+0000","last_became_peered":"2024-04-22T07:18:36.762392+0000","last_unstale":"2024-04-22T07:22:30.042379+0000","last_undegraded":"2024-04-22T07:22:30.042379+0000","last_fullsized":"2024-04-22T07:22:30.042379+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:36:27.097452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":16384,"num_write":165,"num_write_kb":458752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":21,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:19:17.896085+0000","last_change":"2024-04-22T07:18:35.755160+0000","last_active":"2024-04-22T07:19:17.896085+0000","last_peered":"2024-04-22T07:19:17.896085+0000","last_clean":"2024-04-22T07:19:17.896085+0000","last_became_active":"2024-04-22T07:18:35.754877+0000","last_became_peered":"2024-04-22T07:18:35.754877+0000","last_unstale":"2024-04-22T07:19:17.896085+0000","last_undegraded":"2024-04-22T07:19:17.896085+0000","last_fullsized":"2024-04-22T07:19:17.896085+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:43:54.682673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"22'134","reported_seq":154,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:30.071130+0000","last_change":"2024-04-22T07:18:36.761534+0000","last_active":"2024-04-22T07:22:30.071130+0000","last_peered":"2024-04-22T07:22:30.071130+0000","last_clean":"2024-04-22T07:22:30.071130+0000","last_became_active":"2024-04-22T07:18:36.761181+0000","last_became_peered":"2024-04-22T07:18:36.761181+0000","last_unstale":"2024-04-22T07:22:30.071130+0000","last_undegraded":"2024-04-22T07:22:30.071130+0000","last_fullsized":"2024-04-22T07:22:30.071130+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:03:50.228822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":131,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"22'4","reported_seq":23,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:21:09.614846+0000","last_change":"2024-04-22T07:18:35.752282+0000","last_active":"2024-04-22T07:21:09.614846+0000","last_peered":"2024-04-22T07:21:09.614846+0000","last_clean":"2024-04-22T07:21:09.614846+0000","last_became_active":"2024-04-22T07:18:35.751866+0000","last_became_peered":"2024-04-22T07:18:35.751866+0000","last_unstale":"2024-04-22T07:21:09.614846+0000","last_undegraded":"2024-04-22T07:21:09.614846+0000","last_fullsized":"2024-04-22T07:21:09.614846+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:19:48.648793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"22'93","reported_seq":112,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:12.974110+0000","last_change":"2024-04-22T07:18:36.763229+0000","last_active":"2024-04-22T07:22:12.974110+0000","last_peered":"2024-04-22T07:22:12.974110+0000","last_clean":"2024-04-22T07:22:12.974110+0000","last_became_active":"2024-04-22T07:18:36.762882+0000","last_became_peered":"2024-04-22T07:18:36.762882+0000","last_unstale":"2024-04-22T07:22:12.974110+0000","last_undegraded":"2024-04-22T07:22:12.974110+0000","last_fullsized":"2024-04-22T07:22:12.974110+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:44:30.785178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":159383552,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":91,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:19:18.281451+0000","last_change":"2024-04-22T07:18:35.758820+0000","last_active":"2024-04-22T07:19:18.281451+0000","last_peered":"2024-04-22T07:19:18.281451+0000","last_clean":"2024-04-22T07:19:18.281451+0000","last_became_active":"2024-04-22T07:18:35.758514+0000","last_became_peered":"2024-04-22T07:18:35.758514+0000","last_unstale":"2024-04-22T07:19:18.281451+0000","last_undegraded":"2024-04-22T07:19:18.281451+0000","last_fullsized":"2024-04-22T07:19:18.281451+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:40:59.305769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"22'173","reported_seq":187,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:30.562489+0000","last_change":"2024-04-22T07:19:18.281671+0000","last_active":"2024-04-22T07:22:30.562489+0000","last_peered":"2024-04-22T07:22:30.562489+0000","last_clean":"2024-04-22T07:22:30.562489+0000","last_became_active":"2024-04-22T07:19:18.281158+0000","last_became_peered":"2024-04-22T07:19:18.281158+0000","last_unstale":"2024-04-22T07:22:30.562489+0000","last_undegraded":"2024-04-22T07:22:30.562489+0000","last_fullsized":"2024-04-22T07:22:30.562489+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:42:20.611744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":23,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:19:18.281631+0000","last_change":"2024-04-22T07:18:35.754117+0000","last_active":"2024-04-22T07:19:18.281631+0000","last_peered":"2024-04-22T07:19:18.281631+0000","last_clean":"2024-04-22T07:19:18.281631+0000","last_became_active":"2024-04-22T07:18:35.753833+0000","last_became_peered":"2024-04-22T07:18:35.753833+0000","last_unstale":"2024-04-22T07:19:18.281631+0000","last_undegraded":"2024-04-22T07:19:18.281631+0000","last_fullsized":"2024-04-22T07:19:18.281631+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:54:03.123665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":5989466112,"num_objects":1428,"num_object_clones":0,"num_object_copies":2856,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1428,"num_whiteouts":0,"num_read":256,"num_read_kb":1048576,"num_write":7788,"num_write_kb":25165824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":13241417728,"data_stored":13241417728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8224,"ondisk_log_size":8224,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":6137508,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3017,"num_write_kb":8848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12349440,"data_stored":12279484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3001,"ondisk_log_size":3001,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574902,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2382560,"kb_used_data":2333336,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":91989280,"statfs":{"total":96636764160,"available":94197022720,"internally_reserved":0,"allocated":2389336064,"data_stored":2389179042,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574901,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":692528,"kb_used_data":635112,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":93679312,"statfs":{"total":96636764160,"available":95927615488,"internally_reserved":0,"allocated":650354688,"data_stored":650200908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574901,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2472620,"kb_used_data":2433252,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":91899220,"statfs":{"total":96636764160,"available":94104801280,"internally_reserved":0,"allocated":2491650048,"data_stored":2491499782,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1],"upper_bound":4},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574900,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3013300,"kb_used_data":2982124,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":91358540,"statfs":{"total":96636764160,"available":93551144960,"internally_reserved":0,"allocated":3053694976,"data_stored":3053536554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574901,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3152096,"kb_used_data":3098712,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":91219744,"statfs":{"total":96636764160,"available":93409017856,"internally_reserved":0,"allocated":3173081088,"data_stored":3172919346,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":54655431},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574900,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1870508,"kb_used_data":1839332,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":92501332,"statfs":{"total":96636764160,"available":94721363968,"internally_reserved":0,"allocated":1883475968,"data_stored":1883325814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574902,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":801456,"kb_used_data":770280,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93570384,"statfs":{"total":96636764160,"available":95816073216,"internally_reserved":0,"allocated":788766720,"data_stored":788612428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,0,2,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574900,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2977016,"kb_used_data":2945840,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":91394824,"statfs":{"total":96636764160,"available":93588299776,"internally_reserved":0,"allocated":3016540160,"data_stored":3016378698,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":202,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":6152192,"data_stored":6136710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4202496,"data_stored":4194976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1953792,"data_stored":1946582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":3015704576,"data_stored":3015704576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1883242496,"data_stored":1883242496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":3166699520,"data_stored":3166699520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":3053453312,"data_stored":3053453312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":188743680,"data_stored":188743680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":570425344,"data_stored":570425344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1363148800,"data_stored":1363148800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-22T07:22:30.746 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-22T07:22:30.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:30.886+0000 7ff2b2462640 1 Processor -- start 2024-04-22T07:22:30.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:30.886+0000 7ff2b2462640 1 -- start start 2024-04-22T07:22:30.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:30.887+0000 7ff2b2462640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7ff2ac151a90 0x7ff2ac073340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:30.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:30.887+0000 7ff2b2462640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff2ac073880 0x7ff2ac15ae90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:30.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:30.887+0000 7ff2b2462640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2ac0c9600 con 0x7ff2ac0c36d0 2024-04-22T07:22:30.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:30.887+0000 7ff2b2462640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7ff2ac1578a0 con 0x7ff2ac151a90 2024-04-22T07:22:30.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:30.887+0000 7ff2b2462640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7ff2ac157b60 con 0x7ff2ac073880 2024-04-22T07:22:30.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:30.887+0000 7ff2b09ff640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff2ac073880 0x7ff2ac15ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:30.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:30.887+0000 7ff2abfff640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7ff2ac151a90 0x7ff2ac073340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:30.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:30.887+0000 7ff2ab7fe640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7ff2ac0c36d0 0x7ff2ac0c8a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.37:38020/0 (socket says 172.21.15.37:38020) 2024-04-22T07:22:30.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:30.887+0000 7ff2ab7fe640 1 -- 172.21.15.37:0/2157206731 learned_addr learned my addr 172.21.15.37:0/2157206731 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-04-22T07:22:30.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:30.887+0000 7ff2b09ff640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff2ac073880 0x7ff2ac15ae90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.37:51830/0 (socket says 172.21.15.37:51830) 2024-04-22T07:22:30.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:30.888+0000 7ff2b09ff640 1 -- 172.21.15.37:0/2157206731 >> v2:172.21.15.196:3300/0 conn(0x7ff2ac151a90 msgr2=0x7ff2ac073340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:22:30.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:30.888+0000 7ff2b09ff640 1 --2- 172.21.15.37:0/2157206731 >> v2:172.21.15.196:3300/0 conn(0x7ff2ac151a90 0x7ff2ac073340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:30.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:30.888+0000 7ff2b09ff640 1 -- 172.21.15.37:0/2157206731 >> v1:172.21.15.196:6789/0 conn(0x7ff2ac0c36d0 legacy=0x7ff2ac0c8a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:30.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:30.888+0000 7ff2aaffd640 1 -- 172.21.15.37:0/2157206731 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3505172110 0 0) 0x7ff2ac0c9600 con 0x7ff2ac0c36d0 2024-04-22T07:22:30.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:30.888+0000 7ff2b09ff640 1 -- 172.21.15.37:0/2157206731 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2ac157e40 con 0x7ff2ac073880 2024-04-22T07:22:30.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:30.888+0000 7ff2b09ff640 1 --2- 172.21.15.37:0/2157206731 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff2ac073880 0x7ff2ac15ae90 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ff2a400bfa0 tx=0x7ff2a402e140 comp rx=0 tx=0).ready entity=mon.2 client_cookie=642423ce70c6b428 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:22:30.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:30.889+0000 7ff2aaffd640 1 -- 172.21.15.37:0/2157206731 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2a402eae0 con 0x7ff2ac073880 2024-04-22T07:22:30.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:30.889+0000 7ff2aaffd640 1 -- 172.21.15.37:0/2157206731 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2a402ec80 con 0x7ff2ac073880 2024-04-22T07:22:30.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:30.889+0000 7ff2aaffd640 1 -- 172.21.15.37:0/2157206731 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2a4009760 con 0x7ff2ac073880 2024-04-22T07:22:30.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:30.889+0000 7ff2b2462640 1 -- 172.21.15.37:0/2157206731 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff2ac073880 msgr2=0x7ff2ac15ae90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:30.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:30.889+0000 7ff2b2462640 1 --2- 172.21.15.37:0/2157206731 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff2ac073880 0x7ff2ac15ae90 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ff2a400bfa0 tx=0x7ff2a402e140 comp rx=0 tx=0).stop 2024-04-22T07:22:30.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:30.889+0000 7ff2b2462640 1 -- 172.21.15.37:0/2157206731 shutdown_connections 2024-04-22T07:22:30.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:30.889+0000 7ff2b2462640 1 --2- 172.21.15.37:0/2157206731 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff2ac073880 0x7ff2ac15ae90 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:30.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:30.889+0000 7ff2b2462640 1 --2- 172.21.15.37:0/2157206731 >> v2:172.21.15.196:3300/0 conn(0x7ff2ac151a90 0x7ff2ac073340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:30.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:30.889+0000 7ff2b2462640 1 -- 172.21.15.37:0/2157206731 >> 172.21.15.37:0/2157206731 conn(0x7ff2ac06b970 msgr2=0x7ff2ac06bd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:22:30.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:30.889+0000 7ff2b2462640 1 -- 172.21.15.37:0/2157206731 shutdown_connections 2024-04-22T07:22:30.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:30.889+0000 7ff2b2462640 1 -- 172.21.15.37:0/2157206731 wait complete. 2024-04-22T07:22:30.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:30.890+0000 7ff2b2462640 1 Processor -- start 2024-04-22T07:22:30.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:30.891+0000 7ff2b2462640 1 -- start start 2024-04-22T07:22:30.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:30.891+0000 7ff2b2462640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff2ac073880 0x7ff2ac145cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:30.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:30.891+0000 7ff2b2462640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff2ac0c36d0 0x7ff2ac1560b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:30.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:30.891+0000 7ff2b2462640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff2ac151a90 0x7ff2ac1565f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:30.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:30.891+0000 7ff2b2462640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff2ac151e70 con 0x7ff2ac0c36d0 2024-04-22T07:22:30.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:30.891+0000 7ff2b2462640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7ff2ac158400 con 0x7ff2ac073880 2024-04-22T07:22:30.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:30.891+0000 7ff2b2462640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7ff2ac151ff0 con 0x7ff2ac151a90 2024-04-22T07:22:30.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:30.891+0000 7ff2ab7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff2ac0c36d0 0x7ff2ac1560b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:30.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:30.891+0000 7ff2ab7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff2ac0c36d0 0x7ff2ac1560b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36926/0 (socket says 172.21.15.37:36926) 2024-04-22T07:22:30.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:30.891+0000 7ff2ab7fe640 1 -- 172.21.15.37:0/3617370805 learned_addr learned my addr 172.21.15.37:0/3617370805 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:22:30.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:30.892+0000 7ff2b09ff640 1 --2- 172.21.15.37:0/3617370805 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff2ac151a90 0x7ff2ac1565f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:30.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:30.892+0000 7ff2abfff640 1 --2- 172.21.15.37:0/3617370805 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff2ac073880 0x7ff2ac145cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:30.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:30.892+0000 7ff2ab7fe640 1 -- 172.21.15.37:0/3617370805 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff2ac151a90 msgr2=0x7ff2ac1565f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:30.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:30.892+0000 7ff2ab7fe640 1 --2- 172.21.15.37:0/3617370805 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff2ac151a90 0x7ff2ac1565f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:30.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:30.892+0000 7ff2ab7fe640 1 -- 172.21.15.37:0/3617370805 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff2ac073880 msgr2=0x7ff2ac145cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:30.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:30.892+0000 7ff2ab7fe640 1 --2- 172.21.15.37:0/3617370805 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff2ac073880 0x7ff2ac145cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:30.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:30.892+0000 7ff2ab7fe640 1 -- 172.21.15.37:0/3617370805 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2ac139f00 con 0x7ff2ac0c36d0 2024-04-22T07:22:30.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:30.892+0000 7ff2ab7fe640 1 --2- 172.21.15.37:0/3617370805 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff2ac0c36d0 0x7ff2ac1560b0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7ff2a000c460 tx=0x7ff2a000c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:22:30.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:30.892+0000 7ff2a8ff9640 1 -- 172.21.15.37:0/3617370805 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2a0018070 con 0x7ff2ac0c36d0 2024-04-22T07:22:30.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:30.892+0000 7ff2a8ff9640 1 -- 172.21.15.37:0/3617370805 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2a0007500 con 0x7ff2ac0c36d0 2024-04-22T07:22:30.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:30.892+0000 7ff2b2462640 1 -- 172.21.15.37:0/3617370805 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2ac1570c0 con 0x7ff2ac0c36d0 2024-04-22T07:22:30.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:30.892+0000 7ff2a8ff9640 1 -- 172.21.15.37:0/3617370805 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2a0004a20 con 0x7ff2ac0c36d0 2024-04-22T07:22:30.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:30.892+0000 7ff2b2462640 1 -- 172.21.15.37:0/3617370805 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2ac1558b0 con 0x7ff2ac0c36d0 2024-04-22T07:22:30.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:30.893+0000 7ff2b2462640 1 -- 172.21.15.37:0/3617370805 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2ac1575e0 con 0x7ff2ac0c36d0 2024-04-22T07:22:30.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:30.894+0000 7ff2a8ff9640 1 -- 172.21.15.37:0/3617370805 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff2a001b070 con 0x7ff2ac0c36d0 2024-04-22T07:22:30.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:30.894+0000 7ff2a8ff9640 1 --2- 172.21.15.37:0/3617370805 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7ff29806c8f0 0x7ff29806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:30.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:30.894+0000 7ff2a8ff9640 1 -- 172.21.15.37:0/3617370805 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7ff2a008acc0 con 0x7ff2ac0c36d0 2024-04-22T07:22:30.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:30.894+0000 7ff2abfff640 1 --2- 172.21.15.37:0/3617370805 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7ff29806c8f0 0x7ff29806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:30.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:30.895+0000 7ff2abfff640 1 --2- 172.21.15.37:0/3617370805 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7ff29806c8f0 0x7ff29806edb0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7ff29c009b40 tx=0x7ff29c009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:22:30.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:30.899+0000 7ff2a8ff9640 1 -- 172.21.15.37:0/3617370805 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ff2ac1575e0 con 0x7ff2ac0c36d0 2024-04-22T07:22:31.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:31.085+0000 7ff2b2462640 1 -- 172.21.15.37:0/3617370805 --> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff2ac069cc0 con 0x7ff29806c8f0 2024-04-22T07:22:31.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:31.091+0000 7ff2a8ff9640 1 -- 172.21.15.37:0/3617370805 <== mgr.4103 v2:172.21.15.196:6832/321987173 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+254062 (secure 0 0 0) 0x7ff2ac069cc0 con 0x7ff29806c8f0 2024-04-22T07:22:31.091 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-22T07:22:31.092 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-04-22T07:22:31.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:31.094+0000 7ff2b2462640 1 -- 172.21.15.37:0/3617370805 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7ff29806c8f0 msgr2=0x7ff29806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:31.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:31.094+0000 7ff2b2462640 1 --2- 172.21.15.37:0/3617370805 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7ff29806c8f0 0x7ff29806edb0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7ff29c009b40 tx=0x7ff29c009190 comp rx=0 tx=0).stop 2024-04-22T07:22:31.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:31.094+0000 7ff2b2462640 1 -- 172.21.15.37:0/3617370805 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff2ac0c36d0 msgr2=0x7ff2ac1560b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:31.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:31.094+0000 7ff2b2462640 1 --2- 172.21.15.37:0/3617370805 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff2ac0c36d0 0x7ff2ac1560b0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7ff2a000c460 tx=0x7ff2a000c920 comp rx=0 tx=0).stop 2024-04-22T07:22:31.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:31.094+0000 7ff2b2462640 1 -- 172.21.15.37:0/3617370805 shutdown_connections 2024-04-22T07:22:31.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:31.094+0000 7ff2b2462640 1 --2- 172.21.15.37:0/3617370805 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7ff29806c8f0 0x7ff29806edb0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:31.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:31.094+0000 7ff2b2462640 1 --2- 172.21.15.37:0/3617370805 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff2ac151a90 0x7ff2ac1565f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:31.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:31.094+0000 7ff2b2462640 1 --2- 172.21.15.37:0/3617370805 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff2ac0c36d0 0x7ff2ac1560b0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:31.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:31.094+0000 7ff2b2462640 1 --2- 172.21.15.37:0/3617370805 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff2ac073880 0x7ff2ac145cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:31.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:31.094+0000 7ff2b2462640 1 -- 172.21.15.37:0/3617370805 >> 172.21.15.37:0/3617370805 conn(0x7ff2ac06b970 msgr2=0x7ff2ac0c8a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:22:31.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:31.094+0000 7ff2b2462640 1 -- 172.21.15.37:0/3617370805 shutdown_connections 2024-04-22T07:22:31.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:31.094+0000 7ff2b2462640 1 -- 172.21.15.37:0/3617370805 wait complete. 2024-04-22T07:22:31.103 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":138,"stamp":"2024-04-22T07:22:30.644112+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":5996193988,"num_objects":1454,"num_object_clones":0,"num_object_copies":2908,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1454,"num_whiteouts":0,"num_read":374,"num_read_kb":1048678,"num_write":10964,"num_write_kb":25177088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11342,"ondisk_log_size":11342,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":17362084,"kb_used_data":17037988,"kb_used_omap":12,"kb_used_meta":307635,"kb_avail":737612636,"statfs":{"total":773094113280,"available":755315339264,"internally_reserved":0,"allocated":17446899712,"data_stored":17445652572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":315018800},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,1,2,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-4747946717,"num_objects":-1132,"num_object_clones":0,"num_object_copies":-2264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1132,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1143,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002731"},"pg_stats":[{"pgid":"3.3f","version":"22'125","reported_seq":147,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:29.576470+0000","last_change":"2024-04-22T07:18:36.765825+0000","last_active":"2024-04-22T07:22:29.576470+0000","last_peered":"2024-04-22T07:22:29.576470+0000","last_clean":"2024-04-22T07:22:29.576470+0000","last_became_active":"2024-04-22T07:18:36.765306+0000","last_became_peered":"2024-04-22T07:18:36.765306+0000","last_unstale":"2024-04-22T07:22:29.576470+0000","last_undegraded":"2024-04-22T07:22:29.576470+0000","last_fullsized":"2024-04-22T07:22:29.576470+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":125,"log_dups_size":0,"ondisk_log_size":125,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:00:45.046782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67108864,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":5,"num_read_kb":20480,"num_write":122,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"22'150","reported_seq":170,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:30.536645+0000","last_change":"2024-04-22T07:18:36.772829+0000","last_active":"2024-04-22T07:22:30.536645+0000","last_peered":"2024-04-22T07:22:30.536645+0000","last_clean":"2024-04-22T07:22:30.536645+0000","last_became_active":"2024-04-22T07:18:36.772464+0000","last_became_peered":"2024-04-22T07:18:36.772464+0000","last_unstale":"2024-04-22T07:22:30.536645+0000","last_undegraded":"2024-04-22T07:22:30.536645+0000","last_fullsized":"2024-04-22T07:22:30.536645+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":150,"log_dups_size":0,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:09:08.040513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"22'107","reported_seq":128,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:11.499314+0000","last_change":"2024-04-22T07:18:36.760613+0000","last_active":"2024-04-22T07:22:11.499314+0000","last_peered":"2024-04-22T07:22:11.499314+0000","last_clean":"2024-04-22T07:22:11.499314+0000","last_became_active":"2024-04-22T07:18:36.760313+0000","last_became_peered":"2024-04-22T07:18:36.760313+0000","last_unstale":"2024-04-22T07:22:11.499314+0000","last_undegraded":"2024-04-22T07:22:11.499314+0000","last_fullsized":"2024-04-22T07:22:11.499314+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:51:10.038201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":171966464,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":4,"num_read_kb":16384,"num_write":103,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"22'120","reported_seq":133,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:12.480325+0000","last_change":"2024-04-22T07:19:18.282481+0000","last_active":"2024-04-22T07:22:12.480325+0000","last_peered":"2024-04-22T07:22:12.480325+0000","last_clean":"2024-04-22T07:22:12.480325+0000","last_became_active":"2024-04-22T07:19:18.282077+0000","last_became_peered":"2024-04-22T07:19:18.282077+0000","last_unstale":"2024-04-22T07:22:12.480325+0000","last_undegraded":"2024-04-22T07:22:12.480325+0000","last_fullsized":"2024-04-22T07:22:12.480325+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:45:42.674989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":209715200,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":115,"num_write_kb":450560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"22'129","reported_seq":150,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:29.605299+0000","last_change":"2024-04-22T07:18:36.764361+0000","last_active":"2024-04-22T07:22:29.605299+0000","last_peered":"2024-04-22T07:22:29.605299+0000","last_clean":"2024-04-22T07:22:29.605299+0000","last_became_active":"2024-04-22T07:18:36.763812+0000","last_became_peered":"2024-04-22T07:18:36.763812+0000","last_unstale":"2024-04-22T07:22:29.605299+0000","last_undegraded":"2024-04-22T07:22:29.605299+0000","last_fullsized":"2024-04-22T07:22:29.605299+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:18:59.298766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":4,"num_read_kb":16384,"num_write":124,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"22'129","reported_seq":151,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:30.049001+0000","last_change":"2024-04-22T07:18:36.762804+0000","last_active":"2024-04-22T07:22:30.049001+0000","last_peered":"2024-04-22T07:22:30.049001+0000","last_clean":"2024-04-22T07:22:30.049001+0000","last_became_active":"2024-04-22T07:18:36.762508+0000","last_became_peered":"2024-04-22T07:18:36.762508+0000","last_unstale":"2024-04-22T07:22:30.049001+0000","last_undegraded":"2024-04-22T07:22:30.049001+0000","last_fullsized":"2024-04-22T07:22:30.049001+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:09:08.040513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5,"num_read_kb":20480,"num_write":126,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"22'154","reported_seq":172,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:29.558783+0000","last_change":"2024-04-22T07:18:36.771774+0000","last_active":"2024-04-22T07:22:29.558783+0000","last_peered":"2024-04-22T07:22:29.558783+0000","last_clean":"2024-04-22T07:22:29.558783+0000","last_became_active":"2024-04-22T07:18:36.771425+0000","last_became_peered":"2024-04-22T07:18:36.771425+0000","last_unstale":"2024-04-22T07:22:29.558783+0000","last_undegraded":"2024-04-22T07:22:29.558783+0000","last_fullsized":"2024-04-22T07:22:29.558783+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":154,"log_dups_size":0,"ondisk_log_size":154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:45:27.464772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54525952,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":146,"num_write_kb":434176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"22'129","reported_seq":153,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:13.162133+0000","last_change":"2024-04-22T07:18:36.773631+0000","last_active":"2024-04-22T07:22:13.162133+0000","last_peered":"2024-04-22T07:22:13.162133+0000","last_clean":"2024-04-22T07:22:13.162133+0000","last_became_active":"2024-04-22T07:18:36.773347+0000","last_became_peered":"2024-04-22T07:18:36.773347+0000","last_unstale":"2024-04-22T07:22:13.162133+0000","last_undegraded":"2024-04-22T07:22:13.162133+0000","last_fullsized":"2024-04-22T07:22:13.162133+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:23:03.787574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":213909504,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":7,"num_read_kb":28672,"num_write":126,"num_write_kb":483328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"22'128","reported_seq":150,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:29.512031+0000","last_change":"2024-04-22T07:18:36.773325+0000","last_active":"2024-04-22T07:22:29.512031+0000","last_peered":"2024-04-22T07:22:29.512031+0000","last_clean":"2024-04-22T07:22:29.512031+0000","last_became_active":"2024-04-22T07:18:36.773023+0000","last_became_peered":"2024-04-22T07:18:36.773023+0000","last_unstale":"2024-04-22T07:22:29.512031+0000","last_undegraded":"2024-04-22T07:22:29.512031+0000","last_fullsized":"2024-04-22T07:22:29.512031+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:11:55.496104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":5,"num_read_kb":20480,"num_write":123,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"22'136","reported_seq":157,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:29.703843+0000","last_change":"2024-04-22T07:18:36.769834+0000","last_active":"2024-04-22T07:22:29.703843+0000","last_peered":"2024-04-22T07:22:29.703843+0000","last_clean":"2024-04-22T07:22:29.703843+0000","last_became_active":"2024-04-22T07:18:36.769544+0000","last_became_peered":"2024-04-22T07:18:36.769544+0000","last_unstale":"2024-04-22T07:22:29.703843+0000","last_undegraded":"2024-04-22T07:22:29.703843+0000","last_fullsized":"2024-04-22T07:22:29.703843+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:30:36.755201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50331648,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":4,"num_read_kb":16384,"num_write":129,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"22'175","reported_seq":197,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:29.787310+0000","last_change":"2024-04-22T07:18:36.762325+0000","last_active":"2024-04-22T07:22:29.787310+0000","last_peered":"2024-04-22T07:22:29.787310+0000","last_clean":"2024-04-22T07:22:29.787310+0000","last_became_active":"2024-04-22T07:18:36.762059+0000","last_became_peered":"2024-04-22T07:18:36.762059+0000","last_unstale":"2024-04-22T07:22:29.787310+0000","last_undegraded":"2024-04-22T07:22:29.787310+0000","last_fullsized":"2024-04-22T07:22:29.787310+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:51:10.038201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54525952,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":5,"num_read_kb":20480,"num_write":170,"num_write_kb":499712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"22'104","reported_seq":125,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:13.258058+0000","last_change":"2024-04-22T07:18:36.761961+0000","last_active":"2024-04-22T07:22:13.258058+0000","last_peered":"2024-04-22T07:22:13.258058+0000","last_clean":"2024-04-22T07:22:13.258058+0000","last_became_active":"2024-04-22T07:18:36.761389+0000","last_became_peered":"2024-04-22T07:18:36.761389+0000","last_unstale":"2024-04-22T07:22:13.258058+0000","last_undegraded":"2024-04-22T07:22:13.258058+0000","last_fullsized":"2024-04-22T07:22:13.258058+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T19:09:21.533739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":142606336,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":4,"num_read_kb":16384,"num_write":101,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"22'110","reported_seq":132,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:11.880117+0000","last_change":"2024-04-22T07:18:36.767665+0000","last_active":"2024-04-22T07:22:11.880117+0000","last_peered":"2024-04-22T07:22:11.880117+0000","last_clean":"2024-04-22T07:22:11.880117+0000","last_became_active":"2024-04-22T07:18:36.767386+0000","last_became_peered":"2024-04-22T07:18:36.767386+0000","last_unstale":"2024-04-22T07:22:11.880117+0000","last_undegraded":"2024-04-22T07:22:11.880117+0000","last_fullsized":"2024-04-22T07:22:11.880117+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:09:08.040513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":167772160,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":5,"num_read_kb":20480,"num_write":101,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"22'104","reported_seq":122,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:11.887349+0000","last_change":"2024-04-22T07:18:36.770591+0000","last_active":"2024-04-22T07:22:11.887349+0000","last_peered":"2024-04-22T07:22:11.887349+0000","last_clean":"2024-04-22T07:22:11.887349+0000","last_became_active":"2024-04-22T07:18:36.768507+0000","last_became_peered":"2024-04-22T07:18:36.768507+0000","last_unstale":"2024-04-22T07:22:11.887349+0000","last_undegraded":"2024-04-22T07:22:11.887349+0000","last_fullsized":"2024-04-22T07:22:11.887349+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:00:52.151755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":167772160,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":101,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"22'175","reported_seq":195,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:30.562456+0000","last_change":"2024-04-22T07:18:36.769407+0000","last_active":"2024-04-22T07:22:30.562456+0000","last_peered":"2024-04-22T07:22:30.562456+0000","last_clean":"2024-04-22T07:22:30.562456+0000","last_became_active":"2024-04-22T07:18:36.769114+0000","last_became_peered":"2024-04-22T07:18:36.769114+0000","last_unstale":"2024-04-22T07:22:30.562456+0000","last_undegraded":"2024-04-22T07:22:30.562456+0000","last_fullsized":"2024-04-22T07:22:30.562456+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:30:36.755201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"22'142","reported_seq":163,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:30.076101+0000","last_change":"2024-04-22T07:18:36.766539+0000","last_active":"2024-04-22T07:22:30.076101+0000","last_peered":"2024-04-22T07:22:30.076101+0000","last_clean":"2024-04-22T07:22:30.076101+0000","last_became_active":"2024-04-22T07:18:36.764865+0000","last_became_peered":"2024-04-22T07:18:36.764865+0000","last_unstale":"2024-04-22T07:22:30.076101+0000","last_undegraded":"2024-04-22T07:22:30.076101+0000","last_fullsized":"2024-04-22T07:22:30.076101+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:45:27.464772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":16384,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"22'101","reported_seq":112,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:11.660117+0000","last_change":"2024-04-22T07:19:17.897134+0000","last_active":"2024-04-22T07:22:11.660117+0000","last_peered":"2024-04-22T07:22:11.660117+0000","last_clean":"2024-04-22T07:22:11.660117+0000","last_became_active":"2024-04-22T07:19:17.896886+0000","last_became_peered":"2024-04-22T07:19:17.896886+0000","last_unstale":"2024-04-22T07:22:11.660117+0000","last_undegraded":"2024-04-22T07:22:11.660117+0000","last_fullsized":"2024-04-22T07:22:11.660117+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:59:57.688417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":176160768,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":96,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"22'106","reported_seq":126,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:11.829003+0000","last_change":"2024-04-22T07:18:36.764432+0000","last_active":"2024-04-22T07:22:11.829003+0000","last_peered":"2024-04-22T07:22:11.829003+0000","last_clean":"2024-04-22T07:22:11.829003+0000","last_became_active":"2024-04-22T07:18:36.764113+0000","last_became_peered":"2024-04-22T07:18:36.764113+0000","last_unstale":"2024-04-22T07:22:11.829003+0000","last_undegraded":"2024-04-22T07:22:11.829003+0000","last_fullsized":"2024-04-22T07:22:11.829003+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:32:48.474033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":184549376,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":103,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"22'155","reported_seq":176,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:29.529144+0000","last_change":"2024-04-22T07:18:36.772138+0000","last_active":"2024-04-22T07:22:29.529144+0000","last_peered":"2024-04-22T07:22:29.529144+0000","last_clean":"2024-04-22T07:22:29.529144+0000","last_became_active":"2024-04-22T07:18:36.771878+0000","last_became_peered":"2024-04-22T07:18:36.771878+0000","last_unstale":"2024-04-22T07:22:29.529144+0000","last_undegraded":"2024-04-22T07:22:29.529144+0000","last_fullsized":"2024-04-22T07:22:29.529144+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:36:27.097452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54525952,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":4,"num_read_kb":16384,"num_write":152,"num_write_kb":450560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"22'145","reported_seq":166,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:29.778033+0000","last_change":"2024-04-22T07:18:36.769528+0000","last_active":"2024-04-22T07:22:29.778033+0000","last_peered":"2024-04-22T07:22:29.778033+0000","last_clean":"2024-04-22T07:22:29.778033+0000","last_became_active":"2024-04-22T07:18:36.769240+0000","last_became_peered":"2024-04-22T07:18:36.769240+0000","last_unstale":"2024-04-22T07:22:29.778033+0000","last_undegraded":"2024-04-22T07:22:29.778033+0000","last_fullsized":"2024-04-22T07:22:29.778033+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:09:08.040513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50331648,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":4,"num_read_kb":16384,"num_write":141,"num_write_kb":417792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"22'92","reported_seq":110,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:13.222540+0000","last_change":"2024-04-22T07:18:36.766049+0000","last_active":"2024-04-22T07:22:13.222540+0000","last_peered":"2024-04-22T07:22:13.222540+0000","last_clean":"2024-04-22T07:22:13.222540+0000","last_became_active":"2024-04-22T07:18:36.765724+0000","last_became_peered":"2024-04-22T07:18:36.765724+0000","last_unstale":"2024-04-22T07:22:13.222540+0000","last_undegraded":"2024-04-22T07:22:13.222540+0000","last_fullsized":"2024-04-22T07:22:13.222540+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:32:20.374856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146800640,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":91,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"22'159","reported_seq":180,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:30.046853+0000","last_change":"2024-04-22T07:18:36.765850+0000","last_active":"2024-04-22T07:22:30.046853+0000","last_peered":"2024-04-22T07:22:30.046853+0000","last_clean":"2024-04-22T07:22:30.046853+0000","last_became_active":"2024-04-22T07:18:36.765560+0000","last_became_peered":"2024-04-22T07:18:36.765560+0000","last_unstale":"2024-04-22T07:22:30.046853+0000","last_undegraded":"2024-04-22T07:22:30.046853+0000","last_fullsized":"2024-04-22T07:22:30.046853+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:30:36.755201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":16384,"num_write":153,"num_write_kb":425984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"22'90","reported_seq":111,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:11.264602+0000","last_change":"2024-04-22T07:18:36.769465+0000","last_active":"2024-04-22T07:22:11.264602+0000","last_peered":"2024-04-22T07:22:11.264602+0000","last_clean":"2024-04-22T07:22:11.264602+0000","last_became_active":"2024-04-22T07:18:36.769181+0000","last_became_peered":"2024-04-22T07:18:36.769181+0000","last_unstale":"2024-04-22T07:22:11.264602+0000","last_undegraded":"2024-04-22T07:22:11.264602+0000","last_fullsized":"2024-04-22T07:22:11.264602+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:51:10.038201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":150994944,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":4,"num_read_kb":16384,"num_write":90,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"22'179","reported_seq":201,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:30.048452+0000","last_change":"2024-04-22T07:18:36.763439+0000","last_active":"2024-04-22T07:22:30.048452+0000","last_peered":"2024-04-22T07:22:30.048452+0000","last_clean":"2024-04-22T07:22:30.048452+0000","last_became_active":"2024-04-22T07:18:36.763146+0000","last_became_peered":"2024-04-22T07:18:36.763146+0000","last_unstale":"2024-04-22T07:22:30.048452+0000","last_undegraded":"2024-04-22T07:22:30.048452+0000","last_fullsized":"2024-04-22T07:22:30.048452+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":179,"log_dups_size":0,"ondisk_log_size":179,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:18:59.298766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":20480,"num_write":174,"num_write_kb":475136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"22'99","reported_seq":120,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:12.503842+0000","last_change":"2024-04-22T07:18:36.769533+0000","last_active":"2024-04-22T07:22:12.503842+0000","last_peered":"2024-04-22T07:22:12.503842+0000","last_clean":"2024-04-22T07:22:12.503842+0000","last_became_active":"2024-04-22T07:18:36.769274+0000","last_became_peered":"2024-04-22T07:18:36.769274+0000","last_unstale":"2024-04-22T07:22:12.503842+0000","last_undegraded":"2024-04-22T07:22:12.503842+0000","last_fullsized":"2024-04-22T07:22:12.503842+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:03:50.228822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":159383552,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":4,"num_read_kb":16384,"num_write":94,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"22'173","reported_seq":194,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:29.774823+0000","last_change":"2024-04-22T07:18:36.763931+0000","last_active":"2024-04-22T07:22:29.774823+0000","last_peered":"2024-04-22T07:22:29.774823+0000","last_clean":"2024-04-22T07:22:29.774823+0000","last_became_active":"2024-04-22T07:18:36.763656+0000","last_became_peered":"2024-04-22T07:18:36.763656+0000","last_unstale":"2024-04-22T07:22:29.774823+0000","last_undegraded":"2024-04-22T07:22:29.774823+0000","last_fullsized":"2024-04-22T07:22:29.774823+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:22:58.884168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54525952,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":4,"num_read_kb":16384,"num_write":170,"num_write_kb":499712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"22'159","reported_seq":179,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:30.545019+0000","last_change":"2024-04-22T07:18:36.767158+0000","last_active":"2024-04-22T07:22:30.545019+0000","last_peered":"2024-04-22T07:22:30.545019+0000","last_clean":"2024-04-22T07:22:30.545019+0000","last_became_active":"2024-04-22T07:18:36.766614+0000","last_became_peered":"2024-04-22T07:18:36.766614+0000","last_unstale":"2024-04-22T07:22:30.545019+0000","last_undegraded":"2024-04-22T07:22:30.545019+0000","last_fullsized":"2024-04-22T07:22:30.545019+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:44:30.785178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"22'97","reported_seq":118,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:12.412037+0000","last_change":"2024-04-22T07:18:36.773129+0000","last_active":"2024-04-22T07:22:12.412037+0000","last_peered":"2024-04-22T07:22:12.412037+0000","last_clean":"2024-04-22T07:22:12.412037+0000","last_became_active":"2024-04-22T07:18:36.772827+0000","last_became_peered":"2024-04-22T07:18:36.772827+0000","last_unstale":"2024-04-22T07:22:12.412037+0000","last_undegraded":"2024-04-22T07:22:12.412037+0000","last_fullsized":"2024-04-22T07:22:12.412037+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:45:27.464772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146800640,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":4,"num_read_kb":16384,"num_write":94,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"22'84","reported_seq":107,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:12.457029+0000","last_change":"2024-04-22T07:18:36.763716+0000","last_active":"2024-04-22T07:22:12.457029+0000","last_peered":"2024-04-22T07:22:12.457029+0000","last_clean":"2024-04-22T07:22:12.457029+0000","last_became_active":"2024-04-22T07:18:36.762270+0000","last_became_peered":"2024-04-22T07:18:36.762270+0000","last_unstale":"2024-04-22T07:22:12.457029+0000","last_undegraded":"2024-04-22T07:22:12.457029+0000","last_fullsized":"2024-04-22T07:22:12.457029+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:23:03.787574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117440512,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":6,"num_read_kb":24576,"num_write":83,"num_write_kb":303104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"22'128","reported_seq":151,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:30.054996+0000","last_change":"2024-04-22T07:18:36.764152+0000","last_active":"2024-04-22T07:22:30.054996+0000","last_peered":"2024-04-22T07:22:30.054996+0000","last_clean":"2024-04-22T07:22:30.054996+0000","last_became_active":"2024-04-22T07:18:36.763770+0000","last_became_peered":"2024-04-22T07:18:36.763770+0000","last_unstale":"2024-04-22T07:22:30.054996+0000","last_undegraded":"2024-04-22T07:22:30.054996+0000","last_fullsized":"2024-04-22T07:22:30.054996+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:22:58.884168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":24576,"num_write":122,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"22'92","reported_seq":112,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:10.640334+0000","last_change":"2024-04-22T07:18:36.771121+0000","last_active":"2024-04-22T07:22:10.640334+0000","last_peered":"2024-04-22T07:22:10.640334+0000","last_clean":"2024-04-22T07:22:10.640334+0000","last_became_active":"2024-04-22T07:18:36.770786+0000","last_became_peered":"2024-04-22T07:18:36.770786+0000","last_unstale":"2024-04-22T07:22:10.640334+0000","last_undegraded":"2024-04-22T07:22:10.640334+0000","last_fullsized":"2024-04-22T07:22:10.640334+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:45:15.213668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":138412032,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":90,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"22'135","reported_seq":157,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:29.785572+0000","last_change":"2024-04-22T07:18:36.765462+0000","last_active":"2024-04-22T07:22:29.785572+0000","last_peered":"2024-04-22T07:22:29.785572+0000","last_clean":"2024-04-22T07:22:29.785572+0000","last_became_active":"2024-04-22T07:18:36.765142+0000","last_became_peered":"2024-04-22T07:18:36.765142+0000","last_unstale":"2024-04-22T07:22:29.785572+0000","last_undegraded":"2024-04-22T07:22:29.785572+0000","last_fullsized":"2024-04-22T07:22:29.785572+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:32:20.374856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":5,"num_read_kb":20480,"num_write":133,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"22'93","reported_seq":112,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:11.112135+0000","last_change":"2024-04-22T07:18:36.768234+0000","last_active":"2024-04-22T07:22:11.112135+0000","last_peered":"2024-04-22T07:22:11.112135+0000","last_clean":"2024-04-22T07:22:11.112135+0000","last_became_active":"2024-04-22T07:18:36.767951+0000","last_became_peered":"2024-04-22T07:18:36.767951+0000","last_unstale":"2024-04-22T07:22:11.112135+0000","last_undegraded":"2024-04-22T07:22:11.112135+0000","last_fullsized":"2024-04-22T07:22:11.112135+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:08:05.611868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146800640,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":88,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"22'928","reported_seq":947,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:13.495922+0000","last_change":"2024-04-22T07:18:35.751538+0000","last_active":"2024-04-22T07:22:13.495922+0000","last_peered":"2024-04-22T07:22:13.495922+0000","last_clean":"2024-04-22T07:22:13.495922+0000","last_became_active":"2024-04-22T07:18:35.751219+0000","last_became_peered":"2024-04-22T07:18:35.751219+0000","last_unstale":"2024-04-22T07:22:13.495922+0000","last_undegraded":"2024-04-22T07:22:13.495922+0000","last_fullsized":"2024-04-22T07:22:13.495922+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":928,"log_dups_size":0,"ondisk_log_size":928,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:00:10.289974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1941532,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":927,"num_write_kb":2790,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"22'97","reported_seq":119,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:12.951383+0000","last_change":"2024-04-22T07:18:36.757337+0000","last_active":"2024-04-22T07:22:12.951383+0000","last_peered":"2024-04-22T07:22:12.951383+0000","last_clean":"2024-04-22T07:22:12.951383+0000","last_became_active":"2024-04-22T07:18:36.757039+0000","last_became_peered":"2024-04-22T07:18:36.757039+0000","last_unstale":"2024-04-22T07:22:12.951383+0000","last_undegraded":"2024-04-22T07:22:12.951383+0000","last_fullsized":"2024-04-22T07:22:12.951383+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:09:08.040513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146800640,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":5,"num_read_kb":20480,"num_write":94,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:19:18.280153+0000","last_change":"2024-04-22T07:18:35.746515+0000","last_active":"2024-04-22T07:19:18.280153+0000","last_peered":"2024-04-22T07:19:18.280153+0000","last_clean":"2024-04-22T07:19:18.280153+0000","last_became_active":"2024-04-22T07:18:35.746198+0000","last_became_peered":"2024-04-22T07:18:35.746198+0000","last_unstale":"2024-04-22T07:19:18.280153+0000","last_undegraded":"2024-04-22T07:19:18.280153+0000","last_fullsized":"2024-04-22T07:19:18.280153+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:43:54.682673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:19:18.280622+0000","last_change":"2024-04-22T07:18:35.752307+0000","last_active":"2024-04-22T07:19:18.280622+0000","last_peered":"2024-04-22T07:19:18.280622+0000","last_clean":"2024-04-22T07:19:18.280622+0000","last_became_active":"2024-04-22T07:18:35.751545+0000","last_became_peered":"2024-04-22T07:18:35.751545+0000","last_unstale":"2024-04-22T07:19:18.280622+0000","last_undegraded":"2024-04-22T07:19:18.280622+0000","last_fullsized":"2024-04-22T07:19:18.280622+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:21:55.316649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"22'121","reported_seq":142,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:12.400098+0000","last_change":"2024-04-22T07:18:36.772372+0000","last_active":"2024-04-22T07:22:12.400098+0000","last_peered":"2024-04-22T07:22:12.400098+0000","last_clean":"2024-04-22T07:22:12.400098+0000","last_became_active":"2024-04-22T07:18:36.772067+0000","last_became_peered":"2024-04-22T07:18:36.772067+0000","last_unstale":"2024-04-22T07:22:12.400098+0000","last_undegraded":"2024-04-22T07:22:12.400098+0000","last_fullsized":"2024-04-22T07:22:12.400098+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":121,"log_dups_size":0,"ondisk_log_size":121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:44:30.785178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":197132288,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":4,"num_read_kb":16384,"num_write":115,"num_write_kb":442368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:19:17.876687+0000","last_change":"2024-04-22T07:18:35.740989+0000","last_active":"2024-04-22T07:19:17.876687+0000","last_peered":"2024-04-22T07:19:17.876687+0000","last_clean":"2024-04-22T07:19:17.876687+0000","last_became_active":"2024-04-22T07:18:35.740665+0000","last_became_peered":"2024-04-22T07:18:35.740665+0000","last_unstale":"2024-04-22T07:19:17.876687+0000","last_undegraded":"2024-04-22T07:19:17.876687+0000","last_fullsized":"2024-04-22T07:19:17.876687+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:00:10.289974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"22'181","reported_seq":201,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:30.564910+0000","last_change":"2024-04-22T07:18:36.767022+0000","last_active":"2024-04-22T07:22:30.564910+0000","last_peered":"2024-04-22T07:22:30.564910+0000","last_clean":"2024-04-22T07:22:30.564910+0000","last_became_active":"2024-04-22T07:18:36.766609+0000","last_became_peered":"2024-04-22T07:18:36.766609+0000","last_unstale":"2024-04-22T07:22:30.564910+0000","last_undegraded":"2024-04-22T07:22:30.564910+0000","last_fullsized":"2024-04-22T07:22:30.564910+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":181,"log_dups_size":0,"ondisk_log_size":181,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:32:20.374856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"22'1","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:20:43.848866+0000","last_change":"2024-04-22T07:18:35.752081+0000","last_active":"2024-04-22T07:20:43.848866+0000","last_peered":"2024-04-22T07:20:43.848866+0000","last_clean":"2024-04-22T07:20:43.848866+0000","last_became_active":"2024-04-22T07:18:35.751757+0000","last_became_peered":"2024-04-22T07:18:35.751757+0000","last_unstale":"2024-04-22T07:20:43.848866+0000","last_undegraded":"2024-04-22T07:20:43.848866+0000","last_fullsized":"2024-04-22T07:20:43.848866+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:21:55.316649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"22'217","reported_seq":242,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:30.042586+0000","last_change":"2024-04-22T07:18:36.765937+0000","last_active":"2024-04-22T07:22:30.042586+0000","last_peered":"2024-04-22T07:22:30.042586+0000","last_clean":"2024-04-22T07:22:30.042586+0000","last_became_active":"2024-04-22T07:18:36.765647+0000","last_became_peered":"2024-04-22T07:18:36.765647+0000","last_unstale":"2024-04-22T07:22:30.042586+0000","last_undegraded":"2024-04-22T07:22:30.042586+0000","last_fullsized":"2024-04-22T07:22:30.042586+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:59:57.688417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":8,"num_read_kb":32768,"num_write":214,"num_write_kb":598016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:19:17.877284+0000","last_change":"2024-04-22T07:18:35.747309+0000","last_active":"2024-04-22T07:19:17.877284+0000","last_peered":"2024-04-22T07:19:17.877284+0000","last_clean":"2024-04-22T07:19:17.877284+0000","last_became_active":"2024-04-22T07:18:35.747019+0000","last_became_peered":"2024-04-22T07:18:35.747019+0000","last_unstale":"2024-04-22T07:19:17.877284+0000","last_undegraded":"2024-04-22T07:19:17.877284+0000","last_fullsized":"2024-04-22T07:19:17.877284+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:21:55.316649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"22'97","reported_seq":118,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:12.706549+0000","last_change":"2024-04-22T07:18:36.763436+0000","last_active":"2024-04-22T07:22:12.706549+0000","last_peered":"2024-04-22T07:22:12.706549+0000","last_clean":"2024-04-22T07:22:12.706549+0000","last_became_active":"2024-04-22T07:18:36.763068+0000","last_became_peered":"2024-04-22T07:18:36.763068+0000","last_unstale":"2024-04-22T07:22:12.706549+0000","last_undegraded":"2024-04-22T07:22:12.706549+0000","last_fullsized":"2024-04-22T07:22:12.706549+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:22:58.884168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146800640,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":4,"num_read_kb":16384,"num_write":97,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"22'8","reported_seq":27,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:30.596987+0000","last_change":"2024-04-22T07:18:35.750769+0000","last_active":"2024-04-22T07:22:30.596987+0000","last_peered":"2024-04-22T07:22:30.596987+0000","last_clean":"2024-04-22T07:22:30.596987+0000","last_became_active":"2024-04-22T07:18:35.750406+0000","last_became_peered":"2024-04-22T07:18:35.750406+0000","last_unstale":"2024-04-22T07:22:30.596987+0000","last_undegraded":"2024-04-22T07:22:30.596987+0000","last_fullsized":"2024-04-22T07:22:30.596987+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T19:09:20.529889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"22'104","reported_seq":123,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:13.257565+0000","last_change":"2024-04-22T07:18:36.767426+0000","last_active":"2024-04-22T07:22:13.257565+0000","last_peered":"2024-04-22T07:22:13.257565+0000","last_clean":"2024-04-22T07:22:13.257565+0000","last_became_active":"2024-04-22T07:18:36.767159+0000","last_became_peered":"2024-04-22T07:18:36.767159+0000","last_unstale":"2024-04-22T07:22:13.257565+0000","last_undegraded":"2024-04-22T07:22:13.257565+0000","last_fullsized":"2024-04-22T07:22:13.257565+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:19:49.652644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":163577856,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":99,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"22'2012","reported_seq":2031,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:03.268031+0000","last_change":"2024-04-22T07:18:35.752996+0000","last_active":"2024-04-22T07:22:03.268031+0000","last_peered":"2024-04-22T07:22:03.268031+0000","last_clean":"2024-04-22T07:22:03.268031+0000","last_became_active":"2024-04-22T07:18:35.752686+0000","last_became_peered":"2024-04-22T07:18:35.752686+0000","last_unstale":"2024-04-22T07:22:03.268031+0000","last_undegraded":"2024-04-22T07:22:03.268031+0000","last_fullsized":"2024-04-22T07:22:03.268031+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":2012,"log_dups_size":0,"ondisk_log_size":2012,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:36:55.684427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2011,"num_write_kb":6027,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"22'126","reported_seq":150,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:29.502078+0000","last_change":"2024-04-22T07:18:36.767539+0000","last_active":"2024-04-22T07:22:29.502078+0000","last_peered":"2024-04-22T07:22:29.502078+0000","last_clean":"2024-04-22T07:22:29.502078+0000","last_became_active":"2024-04-22T07:18:36.767273+0000","last_became_peered":"2024-04-22T07:18:36.767273+0000","last_unstale":"2024-04-22T07:22:29.502078+0000","last_undegraded":"2024-04-22T07:22:29.502078+0000","last_fullsized":"2024-04-22T07:22:29.502078+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:03:50.228822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":7,"num_read_kb":28672,"num_write":122,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":21,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:19:18.281247+0000","last_change":"2024-04-22T07:18:35.752382+0000","last_active":"2024-04-22T07:19:18.281247+0000","last_peered":"2024-04-22T07:19:18.281247+0000","last_clean":"2024-04-22T07:19:18.281247+0000","last_became_active":"2024-04-22T07:18:35.752060+0000","last_became_peered":"2024-04-22T07:18:35.752060+0000","last_unstale":"2024-04-22T07:19:18.281247+0000","last_undegraded":"2024-04-22T07:19:18.281247+0000","last_fullsized":"2024-04-22T07:19:18.281247+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:31:33.559251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"22'113","reported_seq":133,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:11.988938+0000","last_change":"2024-04-22T07:18:36.764670+0000","last_active":"2024-04-22T07:22:11.988938+0000","last_peered":"2024-04-22T07:22:11.988938+0000","last_clean":"2024-04-22T07:22:11.988938+0000","last_became_active":"2024-04-22T07:18:36.763834+0000","last_became_peered":"2024-04-22T07:18:36.763834+0000","last_unstale":"2024-04-22T07:22:11.988938+0000","last_undegraded":"2024-04-22T07:22:11.988938+0000","last_fullsized":"2024-04-22T07:22:11.988938+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:41:20.703226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":167772160,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":107,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:19:17.877449+0000","last_change":"2024-04-22T07:18:35.752856+0000","last_active":"2024-04-22T07:19:17.877449+0000","last_peered":"2024-04-22T07:19:17.877449+0000","last_clean":"2024-04-22T07:19:17.877449+0000","last_became_active":"2024-04-22T07:18:35.752527+0000","last_became_peered":"2024-04-22T07:18:35.752527+0000","last_unstale":"2024-04-22T07:19:17.877449+0000","last_undegraded":"2024-04-22T07:19:17.877449+0000","last_fullsized":"2024-04-22T07:19:17.877449+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:40:59.305769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"22'116","reported_seq":128,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:12.199280+0000","last_change":"2024-04-22T07:19:17.878772+0000","last_active":"2024-04-22T07:22:12.199280+0000","last_peered":"2024-04-22T07:22:12.199280+0000","last_clean":"2024-04-22T07:22:12.199280+0000","last_became_active":"2024-04-22T07:19:17.878334+0000","last_became_peered":"2024-04-22T07:19:17.878334+0000","last_unstale":"2024-04-22T07:22:12.199280+0000","last_undegraded":"2024-04-22T07:22:12.199280+0000","last_fullsized":"2024-04-22T07:22:12.199280+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":116,"log_dups_size":0,"ondisk_log_size":116,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:03:50.228822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":197132288,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":109,"num_write_kb":425984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:19:18.280016+0000","last_change":"2024-04-22T07:18:35.749740+0000","last_active":"2024-04-22T07:19:18.280016+0000","last_peered":"2024-04-22T07:19:18.280016+0000","last_clean":"2024-04-22T07:19:18.280016+0000","last_became_active":"2024-04-22T07:18:35.749453+0000","last_became_peered":"2024-04-22T07:18:35.749453+0000","last_unstale":"2024-04-22T07:19:18.280016+0000","last_undegraded":"2024-04-22T07:19:18.280016+0000","last_fullsized":"2024-04-22T07:19:18.280016+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:08:04.608018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"22'156","reported_seq":182,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:29.819186+0000","last_change":"2024-04-22T07:18:36.771940+0000","last_active":"2024-04-22T07:22:29.819186+0000","last_peered":"2024-04-22T07:22:29.819186+0000","last_clean":"2024-04-22T07:22:29.819186+0000","last_became_active":"2024-04-22T07:18:36.771548+0000","last_became_peered":"2024-04-22T07:18:36.771548+0000","last_unstale":"2024-04-22T07:22:29.819186+0000","last_undegraded":"2024-04-22T07:22:29.819186+0000","last_fullsized":"2024-04-22T07:22:29.819186+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:23:03.787574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":9,"num_read_kb":36864,"num_write":151,"num_write_kb":434176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":27,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:19:17.875275+0000","last_change":"2024-04-22T07:18:35.749047+0000","last_active":"2024-04-22T07:19:17.875275+0000","last_peered":"2024-04-22T07:19:17.875275+0000","last_clean":"2024-04-22T07:19:17.875275+0000","last_became_active":"2024-04-22T07:18:35.748757+0000","last_became_peered":"2024-04-22T07:18:35.748757+0000","last_unstale":"2024-04-22T07:19:17.875275+0000","last_undegraded":"2024-04-22T07:19:17.875275+0000","last_fullsized":"2024-04-22T07:19:17.875275+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:40:59.305769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"22'169","reported_seq":193,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:29.604592+0000","last_change":"2024-04-22T07:18:36.769894+0000","last_active":"2024-04-22T07:22:29.604592+0000","last_peered":"2024-04-22T07:22:29.604592+0000","last_clean":"2024-04-22T07:22:29.604592+0000","last_became_active":"2024-04-22T07:18:36.768702+0000","last_became_peered":"2024-04-22T07:18:36.768702+0000","last_unstale":"2024-04-22T07:22:29.604592+0000","last_undegraded":"2024-04-22T07:22:29.604592+0000","last_fullsized":"2024-04-22T07:22:29.604592+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:36:53.716397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":7,"num_read_kb":28672,"num_write":164,"num_write_kb":499712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:19:17.877321+0000","last_change":"2024-04-22T07:18:35.747536+0000","last_active":"2024-04-22T07:19:17.877321+0000","last_peered":"2024-04-22T07:19:17.877321+0000","last_clean":"2024-04-22T07:19:17.877321+0000","last_became_active":"2024-04-22T07:18:35.747271+0000","last_became_peered":"2024-04-22T07:18:35.747271+0000","last_unstale":"2024-04-22T07:19:17.877321+0000","last_undegraded":"2024-04-22T07:19:17.877321+0000","last_fullsized":"2024-04-22T07:19:17.877321+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:51:11.593642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"22'123","reported_seq":144,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:29.498215+0000","last_change":"2024-04-22T07:18:36.773033+0000","last_active":"2024-04-22T07:22:29.498215+0000","last_peered":"2024-04-22T07:22:29.498215+0000","last_clean":"2024-04-22T07:22:29.498215+0000","last_became_active":"2024-04-22T07:18:36.772537+0000","last_became_peered":"2024-04-22T07:18:36.772537+0000","last_unstale":"2024-04-22T07:22:29.498215+0000","last_undegraded":"2024-04-22T07:22:29.498215+0000","last_fullsized":"2024-04-22T07:22:29.498215+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:58:41.509248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":4,"num_read_kb":16384,"num_write":122,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":21,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:19:17.875556+0000","last_change":"2024-04-22T07:18:35.747533+0000","last_active":"2024-04-22T07:19:17.875556+0000","last_peered":"2024-04-22T07:19:17.875556+0000","last_clean":"2024-04-22T07:19:17.875556+0000","last_became_active":"2024-04-22T07:18:35.746881+0000","last_became_peered":"2024-04-22T07:18:35.746881+0000","last_unstale":"2024-04-22T07:19:17.875556+0000","last_undegraded":"2024-04-22T07:19:17.875556+0000","last_fullsized":"2024-04-22T07:19:17.875556+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:43:54.682673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"22'119","reported_seq":138,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:29.579066+0000","last_change":"2024-04-22T07:18:36.773723+0000","last_active":"2024-04-22T07:22:29.579066+0000","last_peered":"2024-04-22T07:22:29.579066+0000","last_clean":"2024-04-22T07:22:29.579066+0000","last_became_active":"2024-04-22T07:18:36.773466+0000","last_became_peered":"2024-04-22T07:18:36.773466+0000","last_unstale":"2024-04-22T07:22:29.579066+0000","last_undegraded":"2024-04-22T07:22:29.579066+0000","last_fullsized":"2024-04-22T07:22:29.579066+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:42:20.611744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":111,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:19:17.878170+0000","last_change":"2024-04-22T07:18:35.750360+0000","last_active":"2024-04-22T07:19:17.878170+0000","last_peered":"2024-04-22T07:19:17.878170+0000","last_clean":"2024-04-22T07:19:17.878170+0000","last_became_active":"2024-04-22T07:18:35.749984+0000","last_became_peered":"2024-04-22T07:18:35.749984+0000","last_unstale":"2024-04-22T07:19:17.878170+0000","last_undegraded":"2024-04-22T07:19:17.878170+0000","last_fullsized":"2024-04-22T07:19:17.878170+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:19:48.648793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"22'137","reported_seq":157,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:30.051930+0000","last_change":"2024-04-22T07:18:36.765767+0000","last_active":"2024-04-22T07:22:30.051930+0000","last_peered":"2024-04-22T07:22:30.051930+0000","last_clean":"2024-04-22T07:22:30.051930+0000","last_became_active":"2024-04-22T07:18:36.764218+0000","last_became_peered":"2024-04-22T07:18:36.764218+0000","last_unstale":"2024-04-22T07:22:30.051930+0000","last_undegraded":"2024-04-22T07:22:30.051930+0000","last_fullsized":"2024-04-22T07:22:30.051930+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:45:42.674989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":137,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:19:17.875606+0000","last_change":"2024-04-22T07:18:35.743323+0000","last_active":"2024-04-22T07:19:17.875606+0000","last_peered":"2024-04-22T07:19:17.875606+0000","last_clean":"2024-04-22T07:19:17.875606+0000","last_became_active":"2024-04-22T07:18:35.743023+0000","last_became_peered":"2024-04-22T07:18:35.743023+0000","last_unstale":"2024-04-22T07:19:17.875606+0000","last_undegraded":"2024-04-22T07:19:17.875606+0000","last_fullsized":"2024-04-22T07:19:17.875606+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:08:04.608018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"22'136","reported_seq":158,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:29.534168+0000","last_change":"2024-04-22T07:18:36.771073+0000","last_active":"2024-04-22T07:22:29.534168+0000","last_peered":"2024-04-22T07:22:29.534168+0000","last_clean":"2024-04-22T07:22:29.534168+0000","last_became_active":"2024-04-22T07:18:36.770678+0000","last_became_peered":"2024-04-22T07:18:36.770678+0000","last_unstale":"2024-04-22T07:22:29.534168+0000","last_undegraded":"2024-04-22T07:22:29.534168+0000","last_fullsized":"2024-04-22T07:22:29.534168+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:59:57.688417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62914560,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":5,"num_read_kb":20480,"num_write":129,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":176,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:20:29.610374+0000","last_change":"2024-04-22T07:18:26.518190+0000","last_active":"2024-04-22T07:20:29.610374+0000","last_peered":"2024-04-22T07:20:29.610374+0000","last_clean":"2024-04-22T07:20:29.610374+0000","last_became_active":"2024-04-22T07:18:26.515489+0000","last_became_peered":"2024-04-22T07:18:26.515489+0000","last_unstale":"2024-04-22T07:20:29.610374+0000","last_undegraded":"2024-04-22T07:20:29.610374+0000","last_fullsized":"2024-04-22T07:20:29.610374+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:24.652061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:24.652061+0000","last_clean_scrub_stamp":"2024-04-22T07:18:24.652061+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:32:54.875706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:19:17.876989+0000","last_change":"2024-04-22T07:18:35.748477+0000","last_active":"2024-04-22T07:19:17.876989+0000","last_peered":"2024-04-22T07:19:17.876989+0000","last_clean":"2024-04-22T07:19:17.876989+0000","last_became_active":"2024-04-22T07:18:35.748176+0000","last_became_peered":"2024-04-22T07:18:35.748176+0000","last_unstale":"2024-04-22T07:19:17.876989+0000","last_undegraded":"2024-04-22T07:19:17.876989+0000","last_fullsized":"2024-04-22T07:19:17.876989+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:36:55.684427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"22'107","reported_seq":125,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:12.286332+0000","last_change":"2024-04-22T07:18:36.771870+0000","last_active":"2024-04-22T07:22:12.286332+0000","last_peered":"2024-04-22T07:22:12.286332+0000","last_clean":"2024-04-22T07:22:12.286332+0000","last_became_active":"2024-04-22T07:18:36.771583+0000","last_became_peered":"2024-04-22T07:18:36.771583+0000","last_unstale":"2024-04-22T07:22:12.286332+0000","last_undegraded":"2024-04-22T07:22:12.286332+0000","last_fullsized":"2024-04-22T07:22:12.286332+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:22:58.884168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":184549376,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":106,"num_write_kb":409600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:19:17.895780+0000","last_change":"2024-04-22T07:18:35.755668+0000","last_active":"2024-04-22T07:19:17.895780+0000","last_peered":"2024-04-22T07:19:17.895780+0000","last_clean":"2024-04-22T07:19:17.895780+0000","last_became_active":"2024-04-22T07:18:35.755471+0000","last_became_peered":"2024-04-22T07:18:35.755471+0000","last_unstale":"2024-04-22T07:19:17.895780+0000","last_undegraded":"2024-04-22T07:19:17.895780+0000","last_fullsized":"2024-04-22T07:19:17.895780+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:36:55.684427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"22'107","reported_seq":130,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:12.366346+0000","last_change":"2024-04-22T07:18:36.758204+0000","last_active":"2024-04-22T07:22:12.366346+0000","last_peered":"2024-04-22T07:22:12.366346+0000","last_clean":"2024-04-22T07:22:12.366346+0000","last_became_active":"2024-04-22T07:18:36.757841+0000","last_became_peered":"2024-04-22T07:18:36.757841+0000","last_unstale":"2024-04-22T07:22:12.366346+0000","last_undegraded":"2024-04-22T07:22:12.366346+0000","last_fullsized":"2024-04-22T07:22:12.366346+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:43:09.058016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130023424,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":6,"num_read_kb":24576,"num_write":95,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"22'3","reported_seq":24,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:21:49.949664+0000","last_change":"2024-04-22T07:18:35.746686+0000","last_active":"2024-04-22T07:21:49.949664+0000","last_peered":"2024-04-22T07:21:49.949664+0000","last_clean":"2024-04-22T07:21:49.949664+0000","last_became_active":"2024-04-22T07:18:35.746371+0000","last_became_peered":"2024-04-22T07:18:35.746371+0000","last_unstale":"2024-04-22T07:21:49.949664+0000","last_undegraded":"2024-04-22T07:21:49.949664+0000","last_fullsized":"2024-04-22T07:21:49.949664+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:36:55.684427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":202,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"22'163","reported_seq":183,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:30.560499+0000","last_change":"2024-04-22T07:18:36.765985+0000","last_active":"2024-04-22T07:22:30.560499+0000","last_peered":"2024-04-22T07:22:30.560499+0000","last_clean":"2024-04-22T07:22:30.560499+0000","last_became_active":"2024-04-22T07:18:36.765661+0000","last_became_peered":"2024-04-22T07:18:36.765661+0000","last_unstale":"2024-04-22T07:22:30.560499+0000","last_undegraded":"2024-04-22T07:22:30.560499+0000","last_fullsized":"2024-04-22T07:22:30.560499+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:23:03.787574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:19:17.876920+0000","last_change":"2024-04-22T07:18:35.754160+0000","last_active":"2024-04-22T07:19:17.876920+0000","last_peered":"2024-04-22T07:19:17.876920+0000","last_clean":"2024-04-22T07:19:17.876920+0000","last_became_active":"2024-04-22T07:18:35.753860+0000","last_became_peered":"2024-04-22T07:18:35.753860+0000","last_unstale":"2024-04-22T07:19:17.876920+0000","last_undegraded":"2024-04-22T07:19:17.876920+0000","last_fullsized":"2024-04-22T07:19:17.876920+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:08:04.608018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"22'103","reported_seq":123,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:13.095777+0000","last_change":"2024-04-22T07:18:36.762349+0000","last_active":"2024-04-22T07:22:13.095777+0000","last_peered":"2024-04-22T07:22:13.095777+0000","last_clean":"2024-04-22T07:22:13.095777+0000","last_became_active":"2024-04-22T07:18:36.762097+0000","last_became_peered":"2024-04-22T07:18:36.762097+0000","last_unstale":"2024-04-22T07:22:13.095777+0000","last_undegraded":"2024-04-22T07:22:13.095777+0000","last_fullsized":"2024-04-22T07:22:13.095777+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:43:55.686523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":167772160,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":98,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:19:17.877984+0000","last_change":"2024-04-22T07:18:35.758810+0000","last_active":"2024-04-22T07:19:17.877984+0000","last_peered":"2024-04-22T07:19:17.877984+0000","last_clean":"2024-04-22T07:19:17.877984+0000","last_became_active":"2024-04-22T07:18:35.758521+0000","last_became_peered":"2024-04-22T07:18:35.758521+0000","last_unstale":"2024-04-22T07:19:17.877984+0000","last_undegraded":"2024-04-22T07:19:17.877984+0000","last_fullsized":"2024-04-22T07:19:17.877984+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:40:59.305769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"22'138","reported_seq":160,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:30.007404+0000","last_change":"2024-04-22T07:18:36.764448+0000","last_active":"2024-04-22T07:22:30.007404+0000","last_peered":"2024-04-22T07:22:30.007404+0000","last_clean":"2024-04-22T07:22:30.007404+0000","last_became_active":"2024-04-22T07:18:36.763728+0000","last_became_peered":"2024-04-22T07:18:36.763728+0000","last_unstale":"2024-04-22T07:22:30.007404+0000","last_undegraded":"2024-04-22T07:22:30.007404+0000","last_fullsized":"2024-04-22T07:22:30.007404+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:58:41.509248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":20480,"num_write":136,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:19:17.896310+0000","last_change":"2024-04-22T07:18:35.758980+0000","last_active":"2024-04-22T07:19:17.896310+0000","last_peered":"2024-04-22T07:19:17.896310+0000","last_clean":"2024-04-22T07:19:17.896310+0000","last_became_active":"2024-04-22T07:18:35.758674+0000","last_became_peered":"2024-04-22T07:18:35.758674+0000","last_unstale":"2024-04-22T07:19:17.896310+0000","last_undegraded":"2024-04-22T07:19:17.896310+0000","last_fullsized":"2024-04-22T07:19:17.896310+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:45:14.209818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"22'160","reported_seq":181,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:30.588721+0000","last_change":"2024-04-22T07:18:36.772908+0000","last_active":"2024-04-22T07:22:30.588721+0000","last_peered":"2024-04-22T07:22:30.588721+0000","last_clean":"2024-04-22T07:22:30.588721+0000","last_became_active":"2024-04-22T07:18:36.772636+0000","last_became_peered":"2024-04-22T07:18:36.772636+0000","last_unstale":"2024-04-22T07:22:30.588721+0000","last_undegraded":"2024-04-22T07:22:30.588721+0000","last_fullsized":"2024-04-22T07:22:30.588721+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:51:10.038201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":16384,"num_write":135,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"22'18","reported_seq":37,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:27.820343+0000","last_change":"2024-04-22T07:18:35.753595+0000","last_active":"2024-04-22T07:22:27.820343+0000","last_peered":"2024-04-22T07:22:27.820343+0000","last_clean":"2024-04-22T07:22:27.820343+0000","last_became_active":"2024-04-22T07:18:35.753295+0000","last_became_peered":"2024-04-22T07:18:35.753295+0000","last_unstale":"2024-04-22T07:22:27.820343+0000","last_undegraded":"2024-04-22T07:22:27.820343+0000","last_fullsized":"2024-04-22T07:22:27.820343+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:08:04.608018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"22'108","reported_seq":131,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:12.510716+0000","last_change":"2024-04-22T07:18:36.768580+0000","last_active":"2024-04-22T07:22:12.510716+0000","last_peered":"2024-04-22T07:22:12.510716+0000","last_clean":"2024-04-22T07:22:12.510716+0000","last_became_active":"2024-04-22T07:18:36.767702+0000","last_became_peered":"2024-04-22T07:18:36.767702+0000","last_unstale":"2024-04-22T07:22:12.510716+0000","last_undegraded":"2024-04-22T07:22:12.510716+0000","last_fullsized":"2024-04-22T07:22:12.510716+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:59:57.688417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":138412032,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":6,"num_read_kb":24576,"num_write":105,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":21,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:19:18.280400+0000","last_change":"2024-04-22T07:18:35.751692+0000","last_active":"2024-04-22T07:19:18.280400+0000","last_peered":"2024-04-22T07:19:18.280400+0000","last_clean":"2024-04-22T07:19:18.280400+0000","last_became_active":"2024-04-22T07:18:35.751393+0000","last_became_peered":"2024-04-22T07:18:35.751393+0000","last_unstale":"2024-04-22T07:19:18.280400+0000","last_undegraded":"2024-04-22T07:19:18.280400+0000","last_fullsized":"2024-04-22T07:19:18.280400+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:40:59.305769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"22'114","reported_seq":136,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:11.519295+0000","last_change":"2024-04-22T07:18:36.768532+0000","last_active":"2024-04-22T07:22:11.519295+0000","last_peered":"2024-04-22T07:22:11.519295+0000","last_clean":"2024-04-22T07:22:11.519295+0000","last_became_active":"2024-04-22T07:18:36.768253+0000","last_became_peered":"2024-04-22T07:18:36.768253+0000","last_unstale":"2024-04-22T07:22:11.519295+0000","last_undegraded":"2024-04-22T07:22:11.519295+0000","last_fullsized":"2024-04-22T07:22:11.519295+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:30:36.755201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":188743680,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":5,"num_read_kb":20480,"num_write":111,"num_write_kb":425984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:19:17.895786+0000","last_change":"2024-04-22T07:18:35.758702+0000","last_active":"2024-04-22T07:19:17.895786+0000","last_peered":"2024-04-22T07:19:17.895786+0000","last_clean":"2024-04-22T07:19:17.895786+0000","last_became_active":"2024-04-22T07:18:35.758415+0000","last_became_peered":"2024-04-22T07:18:35.758415+0000","last_unstale":"2024-04-22T07:19:17.895786+0000","last_undegraded":"2024-04-22T07:19:17.895786+0000","last_fullsized":"2024-04-22T07:19:17.895786+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:08:04.608018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"22'106","reported_seq":130,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:13.261095+0000","last_change":"2024-04-22T07:18:36.763053+0000","last_active":"2024-04-22T07:22:13.261095+0000","last_peered":"2024-04-22T07:22:13.261095+0000","last_clean":"2024-04-22T07:22:13.261095+0000","last_became_active":"2024-04-22T07:18:36.762546+0000","last_became_peered":"2024-04-22T07:18:36.762546+0000","last_unstale":"2024-04-22T07:22:13.261095+0000","last_undegraded":"2024-04-22T07:22:13.261095+0000","last_fullsized":"2024-04-22T07:22:13.261095+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:36:56.688277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130023424,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":7,"num_read_kb":28672,"num_write":101,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:19:17.877836+0000","last_change":"2024-04-22T07:18:35.748837+0000","last_active":"2024-04-22T07:19:17.877836+0000","last_peered":"2024-04-22T07:19:17.877836+0000","last_clean":"2024-04-22T07:19:17.877836+0000","last_became_active":"2024-04-22T07:18:35.748080+0000","last_became_peered":"2024-04-22T07:18:35.748080+0000","last_unstale":"2024-04-22T07:19:17.877836+0000","last_undegraded":"2024-04-22T07:19:17.877836+0000","last_fullsized":"2024-04-22T07:19:17.877836+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:36:55.684427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"22'113","reported_seq":135,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:12.487210+0000","last_change":"2024-04-22T07:18:36.769911+0000","last_active":"2024-04-22T07:22:12.487210+0000","last_peered":"2024-04-22T07:22:12.487210+0000","last_clean":"2024-04-22T07:22:12.487210+0000","last_became_active":"2024-04-22T07:18:36.768682+0000","last_became_peered":"2024-04-22T07:18:36.768682+0000","last_unstale":"2024-04-22T07:22:12.487210+0000","last_undegraded":"2024-04-22T07:22:12.487210+0000","last_fullsized":"2024-04-22T07:22:12.487210+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:30:36.755201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":150994944,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":5,"num_read_kb":20480,"num_write":108,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:19:17.878036+0000","last_change":"2024-04-22T07:18:35.753066+0000","last_active":"2024-04-22T07:19:17.878036+0000","last_peered":"2024-04-22T07:19:17.878036+0000","last_clean":"2024-04-22T07:19:17.878036+0000","last_became_active":"2024-04-22T07:18:35.752804+0000","last_became_peered":"2024-04-22T07:18:35.752804+0000","last_unstale":"2024-04-22T07:19:17.878036+0000","last_undegraded":"2024-04-22T07:19:17.878036+0000","last_fullsized":"2024-04-22T07:19:17.878036+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:43:54.682673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"22'103","reported_seq":125,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:11.993395+0000","last_change":"2024-04-22T07:18:36.774790+0000","last_active":"2024-04-22T07:22:11.993395+0000","last_peered":"2024-04-22T07:22:11.993395+0000","last_clean":"2024-04-22T07:22:11.993395+0000","last_became_active":"2024-04-22T07:18:36.774479+0000","last_became_peered":"2024-04-22T07:18:36.774479+0000","last_unstale":"2024-04-22T07:22:11.993395+0000","last_undegraded":"2024-04-22T07:22:11.993395+0000","last_fullsized":"2024-04-22T07:22:11.993395+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:36:53.716397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":150994944,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":5,"num_read_kb":20480,"num_write":99,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"22'3","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:20:43.848781+0000","last_change":"2024-04-22T07:18:35.754440+0000","last_active":"2024-04-22T07:20:43.848781+0000","last_peered":"2024-04-22T07:20:43.848781+0000","last_clean":"2024-04-22T07:20:43.848781+0000","last_became_active":"2024-04-22T07:18:35.754137+0000","last_became_peered":"2024-04-22T07:18:35.754137+0000","last_unstale":"2024-04-22T07:20:43.848781+0000","last_undegraded":"2024-04-22T07:20:43.848781+0000","last_fullsized":"2024-04-22T07:20:43.848781+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T19:09:20.529889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"22'116","reported_seq":136,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:29.700144+0000","last_change":"2024-04-22T07:18:36.759585+0000","last_active":"2024-04-22T07:22:29.700144+0000","last_peered":"2024-04-22T07:22:29.700144+0000","last_clean":"2024-04-22T07:22:29.700144+0000","last_became_active":"2024-04-22T07:18:36.759342+0000","last_became_peered":"2024-04-22T07:18:36.759342+0000","last_unstale":"2024-04-22T07:22:29.700144+0000","last_undegraded":"2024-04-22T07:22:29.700144+0000","last_fullsized":"2024-04-22T07:22:29.700144+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":116,"log_dups_size":0,"ondisk_log_size":116,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:44:30.785178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":112,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"22'170","reported_seq":191,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:30.042379+0000","last_change":"2024-04-22T07:18:36.762665+0000","last_active":"2024-04-22T07:22:30.042379+0000","last_peered":"2024-04-22T07:22:30.042379+0000","last_clean":"2024-04-22T07:22:30.042379+0000","last_became_active":"2024-04-22T07:18:36.762392+0000","last_became_peered":"2024-04-22T07:18:36.762392+0000","last_unstale":"2024-04-22T07:22:30.042379+0000","last_undegraded":"2024-04-22T07:22:30.042379+0000","last_fullsized":"2024-04-22T07:22:30.042379+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:36:27.097452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":16384,"num_write":165,"num_write_kb":458752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":21,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:19:17.896085+0000","last_change":"2024-04-22T07:18:35.755160+0000","last_active":"2024-04-22T07:19:17.896085+0000","last_peered":"2024-04-22T07:19:17.896085+0000","last_clean":"2024-04-22T07:19:17.896085+0000","last_became_active":"2024-04-22T07:18:35.754877+0000","last_became_peered":"2024-04-22T07:18:35.754877+0000","last_unstale":"2024-04-22T07:19:17.896085+0000","last_undegraded":"2024-04-22T07:19:17.896085+0000","last_fullsized":"2024-04-22T07:19:17.896085+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:43:54.682673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"22'134","reported_seq":154,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:30.071130+0000","last_change":"2024-04-22T07:18:36.761534+0000","last_active":"2024-04-22T07:22:30.071130+0000","last_peered":"2024-04-22T07:22:30.071130+0000","last_clean":"2024-04-22T07:22:30.071130+0000","last_became_active":"2024-04-22T07:18:36.761181+0000","last_became_peered":"2024-04-22T07:18:36.761181+0000","last_unstale":"2024-04-22T07:22:30.071130+0000","last_undegraded":"2024-04-22T07:22:30.071130+0000","last_fullsized":"2024-04-22T07:22:30.071130+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:03:50.228822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":131,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"22'4","reported_seq":23,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:21:09.614846+0000","last_change":"2024-04-22T07:18:35.752282+0000","last_active":"2024-04-22T07:21:09.614846+0000","last_peered":"2024-04-22T07:21:09.614846+0000","last_clean":"2024-04-22T07:21:09.614846+0000","last_became_active":"2024-04-22T07:18:35.751866+0000","last_became_peered":"2024-04-22T07:18:35.751866+0000","last_unstale":"2024-04-22T07:21:09.614846+0000","last_undegraded":"2024-04-22T07:21:09.614846+0000","last_fullsized":"2024-04-22T07:21:09.614846+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:19:48.648793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"22'93","reported_seq":112,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:12.974110+0000","last_change":"2024-04-22T07:18:36.763229+0000","last_active":"2024-04-22T07:22:12.974110+0000","last_peered":"2024-04-22T07:22:12.974110+0000","last_clean":"2024-04-22T07:22:12.974110+0000","last_became_active":"2024-04-22T07:18:36.762882+0000","last_became_peered":"2024-04-22T07:18:36.762882+0000","last_unstale":"2024-04-22T07:22:12.974110+0000","last_undegraded":"2024-04-22T07:22:12.974110+0000","last_fullsized":"2024-04-22T07:22:12.974110+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:44:30.785178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":159383552,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":91,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:19:18.281451+0000","last_change":"2024-04-22T07:18:35.758820+0000","last_active":"2024-04-22T07:19:18.281451+0000","last_peered":"2024-04-22T07:19:18.281451+0000","last_clean":"2024-04-22T07:19:18.281451+0000","last_became_active":"2024-04-22T07:18:35.758514+0000","last_became_peered":"2024-04-22T07:18:35.758514+0000","last_unstale":"2024-04-22T07:19:18.281451+0000","last_undegraded":"2024-04-22T07:19:18.281451+0000","last_fullsized":"2024-04-22T07:19:18.281451+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:40:59.305769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"22'173","reported_seq":187,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:30.562489+0000","last_change":"2024-04-22T07:19:18.281671+0000","last_active":"2024-04-22T07:22:30.562489+0000","last_peered":"2024-04-22T07:22:30.562489+0000","last_clean":"2024-04-22T07:22:30.562489+0000","last_became_active":"2024-04-22T07:19:18.281158+0000","last_became_peered":"2024-04-22T07:19:18.281158+0000","last_unstale":"2024-04-22T07:22:30.562489+0000","last_undegraded":"2024-04-22T07:22:30.562489+0000","last_fullsized":"2024-04-22T07:22:30.562489+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:42:20.611744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":23,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:19:18.281631+0000","last_change":"2024-04-22T07:18:35.754117+0000","last_active":"2024-04-22T07:19:18.281631+0000","last_peered":"2024-04-22T07:19:18.281631+0000","last_clean":"2024-04-22T07:19:18.281631+0000","last_became_active":"2024-04-22T07:18:35.753833+0000","last_became_peered":"2024-04-22T07:18:35.753833+0000","last_unstale":"2024-04-22T07:19:18.281631+0000","last_undegraded":"2024-04-22T07:19:18.281631+0000","last_fullsized":"2024-04-22T07:19:18.281631+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:54:03.123665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":5989466112,"num_objects":1428,"num_object_clones":0,"num_object_copies":2856,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1428,"num_whiteouts":0,"num_read":256,"num_read_kb":1048576,"num_write":7788,"num_write_kb":25165824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":13241417728,"data_stored":13241417728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8224,"ondisk_log_size":8224,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":6137508,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3017,"num_write_kb":8848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12349440,"data_stored":12279484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3001,"ondisk_log_size":3001,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574902,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2382560,"kb_used_data":2333336,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":91989280,"statfs":{"total":96636764160,"available":94197022720,"internally_reserved":0,"allocated":2389336064,"data_stored":2389179042,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574901,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":692528,"kb_used_data":635112,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":93679312,"statfs":{"total":96636764160,"available":95927615488,"internally_reserved":0,"allocated":650354688,"data_stored":650200908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574901,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2472620,"kb_used_data":2433252,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":91899220,"statfs":{"total":96636764160,"available":94104801280,"internally_reserved":0,"allocated":2491650048,"data_stored":2491499782,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1],"upper_bound":4},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574900,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3013300,"kb_used_data":2982124,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":91358540,"statfs":{"total":96636764160,"available":93551144960,"internally_reserved":0,"allocated":3053694976,"data_stored":3053536554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574901,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3152096,"kb_used_data":3098712,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":91219744,"statfs":{"total":96636764160,"available":93409017856,"internally_reserved":0,"allocated":3173081088,"data_stored":3172919346,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":54655431},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574900,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1870508,"kb_used_data":1839332,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":92501332,"statfs":{"total":96636764160,"available":94721363968,"internally_reserved":0,"allocated":1883475968,"data_stored":1883325814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574902,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":801456,"kb_used_data":770280,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93570384,"statfs":{"total":96636764160,"available":95816073216,"internally_reserved":0,"allocated":788766720,"data_stored":788612428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,0,2,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574900,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2977016,"kb_used_data":2945840,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":91394824,"statfs":{"total":96636764160,"available":93588299776,"internally_reserved":0,"allocated":3016540160,"data_stored":3016378698,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":202,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":6152192,"data_stored":6136710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4202496,"data_stored":4194976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1953792,"data_stored":1946582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":3015704576,"data_stored":3015704576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1883242496,"data_stored":1883242496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":3166699520,"data_stored":3166699520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":3053453312,"data_stored":3053453312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":188743680,"data_stored":188743680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":570425344,"data_stored":570425344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1363148800,"data_stored":1363148800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-22T07:22:31.106 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-22T07:22:31.107 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-22T07:22:31.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:31.247+0000 7f0df6359640 1 Processor -- start 2024-04-22T07:22:31.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:31.247+0000 7f0df6359640 1 -- start start 2024-04-22T07:22:31.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:31.247+0000 7f0df6359640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0df0152e00 0x7f0df00c9cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:31.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:31.247+0000 7f0df6359640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0df00b37a0 0x7f0df00ce360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:31.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:31.247+0000 7f0df6359640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0df00c9350 con 0x7f0df00c8e10 2024-04-22T07:22:31.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:31.247+0000 7f0df6359640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f0df01531e0 con 0x7f0df0152e00 2024-04-22T07:22:31.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:31.247+0000 7f0df6359640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f0df00c9860 con 0x7f0df00b37a0 2024-04-22T07:22:31.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:31.248+0000 7f0deffff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0df0152e00 0x7f0df00c9cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:31.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:31.248+0000 7f0deffff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0df0152e00 0x7f0df00c9cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36936/0 (socket says 172.21.15.37:36936) 2024-04-22T07:22:31.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:31.248+0000 7f0deffff640 1 -- 172.21.15.37:0/4211528323 learned_addr learned my addr 172.21.15.37:0/4211528323 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:22:31.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:31.248+0000 7f0df48f6640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f0df00c8e10 0x7f0df00caea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:60334/0 (socket says 172.21.15.37:60334) 2024-04-22T07:22:31.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:31.248+0000 7f0def7fe640 1 --2- 172.21.15.37:0/4211528323 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0df00b37a0 0x7f0df00ce360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:31.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:31.248+0000 7f0deffff640 1 -- 172.21.15.37:0/4211528323 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0df00b37a0 msgr2=0x7f0df00ce360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:22:31.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:31.248+0000 7f0deffff640 1 --2- 172.21.15.37:0/4211528323 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0df00b37a0 0x7f0df00ce360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:31.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:31.248+0000 7f0deffff640 1 -- 172.21.15.37:0/4211528323 >> v1:172.21.15.37:6789/0 conn(0x7f0df00c8e10 legacy=0x7f0df00caea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:31.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:31.248+0000 7f0deffff640 1 -- 172.21.15.37:0/4211528323 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0df00c34d0 con 0x7f0df0152e00 2024-04-22T07:22:31.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:31.248+0000 7f0deeffd640 1 -- 172.21.15.37:0/4211528323 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3041442282 0 0) 0x7f0df00c9350 con 0x7f0df00c8e10 2024-04-22T07:22:31.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:31.248+0000 7f0def7fe640 1 --2- 172.21.15.37:0/4211528323 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0df00b37a0 0x7f0df00ce360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T07:22:31.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:31.249+0000 7f0deffff640 1 --2- 172.21.15.37:0/4211528323 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0df0152e00 0x7f0df00c9cf0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f0de0009870 tx=0x7f0de002b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5896455680ec6e6 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:22:31.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:31.249+0000 7f0deeffd640 1 -- 172.21.15.37:0/4211528323 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0de0034070 con 0x7f0df0152e00 2024-04-22T07:22:31.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:31.249+0000 7f0deeffd640 1 -- 172.21.15.37:0/4211528323 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0de0030840 con 0x7f0df0152e00 2024-04-22T07:22:31.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:31.249+0000 7f0deeffd640 1 -- 172.21.15.37:0/4211528323 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0de0030c10 con 0x7f0df0152e00 2024-04-22T07:22:31.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:31.249+0000 7f0df6359640 1 -- 172.21.15.37:0/4211528323 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0df0152e00 msgr2=0x7f0df00c9cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:31.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:31.249+0000 7f0df6359640 1 --2- 172.21.15.37:0/4211528323 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0df0152e00 0x7f0df00c9cf0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f0de0009870 tx=0x7f0de002b980 comp rx=0 tx=0).stop 2024-04-22T07:22:31.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:31.249+0000 7f0df6359640 1 -- 172.21.15.37:0/4211528323 shutdown_connections 2024-04-22T07:22:31.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:31.249+0000 7f0df6359640 1 --2- 172.21.15.37:0/4211528323 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0df00b37a0 0x7f0df00ce360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:31.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:31.249+0000 7f0df6359640 1 --2- 172.21.15.37:0/4211528323 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0df0152e00 0x7f0df00c9cf0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:31.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:31.249+0000 7f0df6359640 1 -- 172.21.15.37:0/4211528323 >> 172.21.15.37:0/4211528323 conn(0x7f0df006db80 msgr2=0x7f0df006df60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:22:31.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:31.249+0000 7f0df6359640 1 -- 172.21.15.37:0/4211528323 shutdown_connections 2024-04-22T07:22:31.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:31.249+0000 7f0df6359640 1 -- 172.21.15.37:0/4211528323 wait complete. 2024-04-22T07:22:31.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:31.251+0000 7f0df6359640 1 Processor -- start 2024-04-22T07:22:31.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:31.251+0000 7f0df6359640 1 -- start start 2024-04-22T07:22:31.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:31.251+0000 7f0df6359640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0df00b37a0 0x7f0df014d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:31.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:31.251+0000 7f0df6359640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0df00c8e10 0x7f0df006b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:31.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:31.251+0000 7f0df6359640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0df0152e00 0x7f0df006beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:31.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:31.251+0000 7f0df6359640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0df00c3d70 con 0x7f0df00b37a0 2024-04-22T07:22:31.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:31.251+0000 7f0df6359640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f0df00c3a90 con 0x7f0df0152e00 2024-04-22T07:22:31.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:31.251+0000 7f0df6359640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f0df00c5570 con 0x7f0df00c8e10 2024-04-22T07:22:31.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:31.252+0000 7f0deffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0df00b37a0 0x7f0df014d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:31.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:31.252+0000 7f0deffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0df00b37a0 0x7f0df014d1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36938/0 (socket says 172.21.15.37:36938) 2024-04-22T07:22:31.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:31.252+0000 7f0deffff640 1 -- 172.21.15.37:0/2983027434 learned_addr learned my addr 172.21.15.37:0/2983027434 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:22:31.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:31.252+0000 7f0def7fe640 1 --2- 172.21.15.37:0/2983027434 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0df00c8e10 0x7f0df006b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:31.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:31.252+0000 7f0df48f6640 1 --2- 172.21.15.37:0/2983027434 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0df0152e00 0x7f0df006beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:31.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:31.252+0000 7f0deffff640 1 -- 172.21.15.37:0/2983027434 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0df00c8e10 msgr2=0x7f0df006b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:31.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:31.252+0000 7f0deffff640 1 --2- 172.21.15.37:0/2983027434 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0df00c8e10 0x7f0df006b970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:31.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:31.252+0000 7f0deffff640 1 -- 172.21.15.37:0/2983027434 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0df0152e00 msgr2=0x7f0df006beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:31.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:31.252+0000 7f0deffff640 1 --2- 172.21.15.37:0/2983027434 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0df0152e00 0x7f0df006beb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:31.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:31.252+0000 7f0deffff640 1 -- 172.21.15.37:0/2983027434 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0df015a050 con 0x7f0df00b37a0 2024-04-22T07:22:31.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:31.252+0000 7f0def7fe640 1 --2- 172.21.15.37:0/2983027434 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0df00c8e10 0x7f0df006b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T07:22:31.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:31.252+0000 7f0deffff640 1 --2- 172.21.15.37:0/2983027434 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0df00b37a0 0x7f0df014d1a0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f0de00090b0 tx=0x7f0de00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:22:31.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:31.252+0000 7f0decff9640 1 -- 172.21.15.37:0/2983027434 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0de0034040 con 0x7f0df00b37a0 2024-04-22T07:22:31.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:31.252+0000 7f0decff9640 1 -- 172.21.15.37:0/2983027434 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0de003ab90 con 0x7f0df00b37a0 2024-04-22T07:22:31.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:31.252+0000 7f0decff9640 1 -- 172.21.15.37:0/2983027434 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0de0004030 con 0x7f0df00b37a0 2024-04-22T07:22:31.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:31.252+0000 7f0df6359640 1 -- 172.21.15.37:0/2983027434 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0df01f0a20 con 0x7f0df00b37a0 2024-04-22T07:22:31.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:31.252+0000 7f0df6359640 1 -- 172.21.15.37:0/2983027434 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0df01f0fe0 con 0x7f0df00b37a0 2024-04-22T07:22:31.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:31.253+0000 7f0df6359640 1 -- 172.21.15.37:0/2983027434 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0df01f1310 con 0x7f0df00b37a0 2024-04-22T07:22:31.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:31.254+0000 7f0decff9640 1 -- 172.21.15.37:0/2983027434 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0de004b060 con 0x7f0df00b37a0 2024-04-22T07:22:31.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:31.254+0000 7f0decff9640 1 --2- 172.21.15.37:0/2983027434 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f0ddc06c920 0x7f0ddc06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:31.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:31.255+0000 7f0decff9640 1 -- 172.21.15.37:0/2983027434 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f0de00ad980 con 0x7f0df00b37a0 2024-04-22T07:22:31.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:31.255+0000 7f0def7fe640 1 --2- 172.21.15.37:0/2983027434 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f0ddc06c920 0x7f0ddc06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:31.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:31.255+0000 7f0def7fe640 1 --2- 172.21.15.37:0/2983027434 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f0ddc06c920 0x7f0ddc06ede0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f0df014e500 tx=0x7f0de4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:22:31.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:31.259+0000 7f0decff9640 1 -- 172.21.15.37:0/2983027434 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f0de003f070 con 0x7f0df00b37a0 2024-04-22T07:22:31.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:31.444+0000 7f0df6359640 1 -- 172.21.15.37:0/2983027434 --> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0df0069cc0 con 0x7f0ddc06c920 2024-04-22T07:22:31.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:31.450+0000 7f0decff9640 1 -- 172.21.15.37:0/2983027434 <== mgr.4103 v2:172.21.15.196:6832/321987173 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+254062 (secure 0 0 0) 0x7f0df0069cc0 con 0x7f0ddc06c920 2024-04-22T07:22:31.450 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-22T07:22:31.451 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-04-22T07:22:31.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:31.453+0000 7f0df6359640 1 -- 172.21.15.37:0/2983027434 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f0ddc06c920 msgr2=0x7f0ddc06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:31.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:31.453+0000 7f0df6359640 1 --2- 172.21.15.37:0/2983027434 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f0ddc06c920 0x7f0ddc06ede0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f0df014e500 tx=0x7f0de4008040 comp rx=0 tx=0).stop 2024-04-22T07:22:31.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:31.453+0000 7f0df6359640 1 -- 172.21.15.37:0/2983027434 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0df00b37a0 msgr2=0x7f0df014d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:31.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:31.453+0000 7f0df6359640 1 --2- 172.21.15.37:0/2983027434 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0df00b37a0 0x7f0df014d1a0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f0de00090b0 tx=0x7f0de00046c0 comp rx=0 tx=0).stop 2024-04-22T07:22:31.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:31.453+0000 7f0df6359640 1 -- 172.21.15.37:0/2983027434 shutdown_connections 2024-04-22T07:22:31.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:31.453+0000 7f0df6359640 1 --2- 172.21.15.37:0/2983027434 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f0ddc06c920 0x7f0ddc06ede0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:31.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:31.453+0000 7f0df6359640 1 --2- 172.21.15.37:0/2983027434 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0df0152e00 0x7f0df006beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:31.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:31.453+0000 7f0df6359640 1 --2- 172.21.15.37:0/2983027434 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0df00c8e10 0x7f0df006b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:31.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:31.453+0000 7f0df6359640 1 --2- 172.21.15.37:0/2983027434 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0df00b37a0 0x7f0df014d1a0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:31.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:31.453+0000 7f0df6359640 1 -- 172.21.15.37:0/2983027434 >> 172.21.15.37:0/2983027434 conn(0x7f0df006db80 msgr2=0x7f0df006df60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:22:31.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:31.453+0000 7f0df6359640 1 -- 172.21.15.37:0/2983027434 shutdown_connections 2024-04-22T07:22:31.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:31.453+0000 7f0df6359640 1 -- 172.21.15.37:0/2983027434 wait complete. 2024-04-22T07:22:31.461 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":138,"stamp":"2024-04-22T07:22:30.644112+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":5996193988,"num_objects":1454,"num_object_clones":0,"num_object_copies":2908,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1454,"num_whiteouts":0,"num_read":374,"num_read_kb":1048678,"num_write":10964,"num_write_kb":25177088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11342,"ondisk_log_size":11342,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":17362084,"kb_used_data":17037988,"kb_used_omap":12,"kb_used_meta":307635,"kb_avail":737612636,"statfs":{"total":773094113280,"available":755315339264,"internally_reserved":0,"allocated":17446899712,"data_stored":17445652572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":315018800},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,1,2,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-4747946717,"num_objects":-1132,"num_object_clones":0,"num_object_copies":-2264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1132,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1143,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002731"},"pg_stats":[{"pgid":"3.3f","version":"22'125","reported_seq":147,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:29.576470+0000","last_change":"2024-04-22T07:18:36.765825+0000","last_active":"2024-04-22T07:22:29.576470+0000","last_peered":"2024-04-22T07:22:29.576470+0000","last_clean":"2024-04-22T07:22:29.576470+0000","last_became_active":"2024-04-22T07:18:36.765306+0000","last_became_peered":"2024-04-22T07:18:36.765306+0000","last_unstale":"2024-04-22T07:22:29.576470+0000","last_undegraded":"2024-04-22T07:22:29.576470+0000","last_fullsized":"2024-04-22T07:22:29.576470+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":125,"log_dups_size":0,"ondisk_log_size":125,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:00:45.046782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67108864,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":5,"num_read_kb":20480,"num_write":122,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"22'150","reported_seq":170,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:30.536645+0000","last_change":"2024-04-22T07:18:36.772829+0000","last_active":"2024-04-22T07:22:30.536645+0000","last_peered":"2024-04-22T07:22:30.536645+0000","last_clean":"2024-04-22T07:22:30.536645+0000","last_became_active":"2024-04-22T07:18:36.772464+0000","last_became_peered":"2024-04-22T07:18:36.772464+0000","last_unstale":"2024-04-22T07:22:30.536645+0000","last_undegraded":"2024-04-22T07:22:30.536645+0000","last_fullsized":"2024-04-22T07:22:30.536645+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":150,"log_dups_size":0,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:09:08.040513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"22'107","reported_seq":128,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:11.499314+0000","last_change":"2024-04-22T07:18:36.760613+0000","last_active":"2024-04-22T07:22:11.499314+0000","last_peered":"2024-04-22T07:22:11.499314+0000","last_clean":"2024-04-22T07:22:11.499314+0000","last_became_active":"2024-04-22T07:18:36.760313+0000","last_became_peered":"2024-04-22T07:18:36.760313+0000","last_unstale":"2024-04-22T07:22:11.499314+0000","last_undegraded":"2024-04-22T07:22:11.499314+0000","last_fullsized":"2024-04-22T07:22:11.499314+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:51:10.038201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":171966464,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":4,"num_read_kb":16384,"num_write":103,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"22'120","reported_seq":133,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:12.480325+0000","last_change":"2024-04-22T07:19:18.282481+0000","last_active":"2024-04-22T07:22:12.480325+0000","last_peered":"2024-04-22T07:22:12.480325+0000","last_clean":"2024-04-22T07:22:12.480325+0000","last_became_active":"2024-04-22T07:19:18.282077+0000","last_became_peered":"2024-04-22T07:19:18.282077+0000","last_unstale":"2024-04-22T07:22:12.480325+0000","last_undegraded":"2024-04-22T07:22:12.480325+0000","last_fullsized":"2024-04-22T07:22:12.480325+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:45:42.674989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":209715200,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":115,"num_write_kb":450560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"22'129","reported_seq":150,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:29.605299+0000","last_change":"2024-04-22T07:18:36.764361+0000","last_active":"2024-04-22T07:22:29.605299+0000","last_peered":"2024-04-22T07:22:29.605299+0000","last_clean":"2024-04-22T07:22:29.605299+0000","last_became_active":"2024-04-22T07:18:36.763812+0000","last_became_peered":"2024-04-22T07:18:36.763812+0000","last_unstale":"2024-04-22T07:22:29.605299+0000","last_undegraded":"2024-04-22T07:22:29.605299+0000","last_fullsized":"2024-04-22T07:22:29.605299+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:18:59.298766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":4,"num_read_kb":16384,"num_write":124,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"22'129","reported_seq":151,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:30.049001+0000","last_change":"2024-04-22T07:18:36.762804+0000","last_active":"2024-04-22T07:22:30.049001+0000","last_peered":"2024-04-22T07:22:30.049001+0000","last_clean":"2024-04-22T07:22:30.049001+0000","last_became_active":"2024-04-22T07:18:36.762508+0000","last_became_peered":"2024-04-22T07:18:36.762508+0000","last_unstale":"2024-04-22T07:22:30.049001+0000","last_undegraded":"2024-04-22T07:22:30.049001+0000","last_fullsized":"2024-04-22T07:22:30.049001+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:09:08.040513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5,"num_read_kb":20480,"num_write":126,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"22'154","reported_seq":172,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:29.558783+0000","last_change":"2024-04-22T07:18:36.771774+0000","last_active":"2024-04-22T07:22:29.558783+0000","last_peered":"2024-04-22T07:22:29.558783+0000","last_clean":"2024-04-22T07:22:29.558783+0000","last_became_active":"2024-04-22T07:18:36.771425+0000","last_became_peered":"2024-04-22T07:18:36.771425+0000","last_unstale":"2024-04-22T07:22:29.558783+0000","last_undegraded":"2024-04-22T07:22:29.558783+0000","last_fullsized":"2024-04-22T07:22:29.558783+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":154,"log_dups_size":0,"ondisk_log_size":154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:45:27.464772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54525952,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":146,"num_write_kb":434176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"22'129","reported_seq":153,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:13.162133+0000","last_change":"2024-04-22T07:18:36.773631+0000","last_active":"2024-04-22T07:22:13.162133+0000","last_peered":"2024-04-22T07:22:13.162133+0000","last_clean":"2024-04-22T07:22:13.162133+0000","last_became_active":"2024-04-22T07:18:36.773347+0000","last_became_peered":"2024-04-22T07:18:36.773347+0000","last_unstale":"2024-04-22T07:22:13.162133+0000","last_undegraded":"2024-04-22T07:22:13.162133+0000","last_fullsized":"2024-04-22T07:22:13.162133+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:23:03.787574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":213909504,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":7,"num_read_kb":28672,"num_write":126,"num_write_kb":483328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"22'128","reported_seq":150,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:29.512031+0000","last_change":"2024-04-22T07:18:36.773325+0000","last_active":"2024-04-22T07:22:29.512031+0000","last_peered":"2024-04-22T07:22:29.512031+0000","last_clean":"2024-04-22T07:22:29.512031+0000","last_became_active":"2024-04-22T07:18:36.773023+0000","last_became_peered":"2024-04-22T07:18:36.773023+0000","last_unstale":"2024-04-22T07:22:29.512031+0000","last_undegraded":"2024-04-22T07:22:29.512031+0000","last_fullsized":"2024-04-22T07:22:29.512031+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:11:55.496104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":5,"num_read_kb":20480,"num_write":123,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"22'136","reported_seq":157,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:29.703843+0000","last_change":"2024-04-22T07:18:36.769834+0000","last_active":"2024-04-22T07:22:29.703843+0000","last_peered":"2024-04-22T07:22:29.703843+0000","last_clean":"2024-04-22T07:22:29.703843+0000","last_became_active":"2024-04-22T07:18:36.769544+0000","last_became_peered":"2024-04-22T07:18:36.769544+0000","last_unstale":"2024-04-22T07:22:29.703843+0000","last_undegraded":"2024-04-22T07:22:29.703843+0000","last_fullsized":"2024-04-22T07:22:29.703843+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:30:36.755201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50331648,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":4,"num_read_kb":16384,"num_write":129,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"22'175","reported_seq":197,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:29.787310+0000","last_change":"2024-04-22T07:18:36.762325+0000","last_active":"2024-04-22T07:22:29.787310+0000","last_peered":"2024-04-22T07:22:29.787310+0000","last_clean":"2024-04-22T07:22:29.787310+0000","last_became_active":"2024-04-22T07:18:36.762059+0000","last_became_peered":"2024-04-22T07:18:36.762059+0000","last_unstale":"2024-04-22T07:22:29.787310+0000","last_undegraded":"2024-04-22T07:22:29.787310+0000","last_fullsized":"2024-04-22T07:22:29.787310+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:51:10.038201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54525952,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":5,"num_read_kb":20480,"num_write":170,"num_write_kb":499712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"22'104","reported_seq":125,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:13.258058+0000","last_change":"2024-04-22T07:18:36.761961+0000","last_active":"2024-04-22T07:22:13.258058+0000","last_peered":"2024-04-22T07:22:13.258058+0000","last_clean":"2024-04-22T07:22:13.258058+0000","last_became_active":"2024-04-22T07:18:36.761389+0000","last_became_peered":"2024-04-22T07:18:36.761389+0000","last_unstale":"2024-04-22T07:22:13.258058+0000","last_undegraded":"2024-04-22T07:22:13.258058+0000","last_fullsized":"2024-04-22T07:22:13.258058+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T19:09:21.533739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":142606336,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":4,"num_read_kb":16384,"num_write":101,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"22'110","reported_seq":132,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:11.880117+0000","last_change":"2024-04-22T07:18:36.767665+0000","last_active":"2024-04-22T07:22:11.880117+0000","last_peered":"2024-04-22T07:22:11.880117+0000","last_clean":"2024-04-22T07:22:11.880117+0000","last_became_active":"2024-04-22T07:18:36.767386+0000","last_became_peered":"2024-04-22T07:18:36.767386+0000","last_unstale":"2024-04-22T07:22:11.880117+0000","last_undegraded":"2024-04-22T07:22:11.880117+0000","last_fullsized":"2024-04-22T07:22:11.880117+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:09:08.040513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":167772160,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":5,"num_read_kb":20480,"num_write":101,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"22'104","reported_seq":122,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:11.887349+0000","last_change":"2024-04-22T07:18:36.770591+0000","last_active":"2024-04-22T07:22:11.887349+0000","last_peered":"2024-04-22T07:22:11.887349+0000","last_clean":"2024-04-22T07:22:11.887349+0000","last_became_active":"2024-04-22T07:18:36.768507+0000","last_became_peered":"2024-04-22T07:18:36.768507+0000","last_unstale":"2024-04-22T07:22:11.887349+0000","last_undegraded":"2024-04-22T07:22:11.887349+0000","last_fullsized":"2024-04-22T07:22:11.887349+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:00:52.151755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":167772160,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":101,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"22'175","reported_seq":195,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:30.562456+0000","last_change":"2024-04-22T07:18:36.769407+0000","last_active":"2024-04-22T07:22:30.562456+0000","last_peered":"2024-04-22T07:22:30.562456+0000","last_clean":"2024-04-22T07:22:30.562456+0000","last_became_active":"2024-04-22T07:18:36.769114+0000","last_became_peered":"2024-04-22T07:18:36.769114+0000","last_unstale":"2024-04-22T07:22:30.562456+0000","last_undegraded":"2024-04-22T07:22:30.562456+0000","last_fullsized":"2024-04-22T07:22:30.562456+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:30:36.755201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"22'142","reported_seq":163,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:30.076101+0000","last_change":"2024-04-22T07:18:36.766539+0000","last_active":"2024-04-22T07:22:30.076101+0000","last_peered":"2024-04-22T07:22:30.076101+0000","last_clean":"2024-04-22T07:22:30.076101+0000","last_became_active":"2024-04-22T07:18:36.764865+0000","last_became_peered":"2024-04-22T07:18:36.764865+0000","last_unstale":"2024-04-22T07:22:30.076101+0000","last_undegraded":"2024-04-22T07:22:30.076101+0000","last_fullsized":"2024-04-22T07:22:30.076101+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:45:27.464772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":16384,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"22'101","reported_seq":112,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:11.660117+0000","last_change":"2024-04-22T07:19:17.897134+0000","last_active":"2024-04-22T07:22:11.660117+0000","last_peered":"2024-04-22T07:22:11.660117+0000","last_clean":"2024-04-22T07:22:11.660117+0000","last_became_active":"2024-04-22T07:19:17.896886+0000","last_became_peered":"2024-04-22T07:19:17.896886+0000","last_unstale":"2024-04-22T07:22:11.660117+0000","last_undegraded":"2024-04-22T07:22:11.660117+0000","last_fullsized":"2024-04-22T07:22:11.660117+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:59:57.688417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":176160768,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":96,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"22'106","reported_seq":126,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:11.829003+0000","last_change":"2024-04-22T07:18:36.764432+0000","last_active":"2024-04-22T07:22:11.829003+0000","last_peered":"2024-04-22T07:22:11.829003+0000","last_clean":"2024-04-22T07:22:11.829003+0000","last_became_active":"2024-04-22T07:18:36.764113+0000","last_became_peered":"2024-04-22T07:18:36.764113+0000","last_unstale":"2024-04-22T07:22:11.829003+0000","last_undegraded":"2024-04-22T07:22:11.829003+0000","last_fullsized":"2024-04-22T07:22:11.829003+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:32:48.474033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":184549376,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":103,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"22'155","reported_seq":176,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:29.529144+0000","last_change":"2024-04-22T07:18:36.772138+0000","last_active":"2024-04-22T07:22:29.529144+0000","last_peered":"2024-04-22T07:22:29.529144+0000","last_clean":"2024-04-22T07:22:29.529144+0000","last_became_active":"2024-04-22T07:18:36.771878+0000","last_became_peered":"2024-04-22T07:18:36.771878+0000","last_unstale":"2024-04-22T07:22:29.529144+0000","last_undegraded":"2024-04-22T07:22:29.529144+0000","last_fullsized":"2024-04-22T07:22:29.529144+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:36:27.097452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54525952,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":4,"num_read_kb":16384,"num_write":152,"num_write_kb":450560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"22'145","reported_seq":166,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:29.778033+0000","last_change":"2024-04-22T07:18:36.769528+0000","last_active":"2024-04-22T07:22:29.778033+0000","last_peered":"2024-04-22T07:22:29.778033+0000","last_clean":"2024-04-22T07:22:29.778033+0000","last_became_active":"2024-04-22T07:18:36.769240+0000","last_became_peered":"2024-04-22T07:18:36.769240+0000","last_unstale":"2024-04-22T07:22:29.778033+0000","last_undegraded":"2024-04-22T07:22:29.778033+0000","last_fullsized":"2024-04-22T07:22:29.778033+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:09:08.040513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50331648,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":4,"num_read_kb":16384,"num_write":141,"num_write_kb":417792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"22'92","reported_seq":110,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:13.222540+0000","last_change":"2024-04-22T07:18:36.766049+0000","last_active":"2024-04-22T07:22:13.222540+0000","last_peered":"2024-04-22T07:22:13.222540+0000","last_clean":"2024-04-22T07:22:13.222540+0000","last_became_active":"2024-04-22T07:18:36.765724+0000","last_became_peered":"2024-04-22T07:18:36.765724+0000","last_unstale":"2024-04-22T07:22:13.222540+0000","last_undegraded":"2024-04-22T07:22:13.222540+0000","last_fullsized":"2024-04-22T07:22:13.222540+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:32:20.374856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146800640,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":91,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"22'159","reported_seq":180,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:30.046853+0000","last_change":"2024-04-22T07:18:36.765850+0000","last_active":"2024-04-22T07:22:30.046853+0000","last_peered":"2024-04-22T07:22:30.046853+0000","last_clean":"2024-04-22T07:22:30.046853+0000","last_became_active":"2024-04-22T07:18:36.765560+0000","last_became_peered":"2024-04-22T07:18:36.765560+0000","last_unstale":"2024-04-22T07:22:30.046853+0000","last_undegraded":"2024-04-22T07:22:30.046853+0000","last_fullsized":"2024-04-22T07:22:30.046853+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:30:36.755201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":16384,"num_write":153,"num_write_kb":425984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"22'90","reported_seq":111,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:11.264602+0000","last_change":"2024-04-22T07:18:36.769465+0000","last_active":"2024-04-22T07:22:11.264602+0000","last_peered":"2024-04-22T07:22:11.264602+0000","last_clean":"2024-04-22T07:22:11.264602+0000","last_became_active":"2024-04-22T07:18:36.769181+0000","last_became_peered":"2024-04-22T07:18:36.769181+0000","last_unstale":"2024-04-22T07:22:11.264602+0000","last_undegraded":"2024-04-22T07:22:11.264602+0000","last_fullsized":"2024-04-22T07:22:11.264602+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:51:10.038201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":150994944,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":4,"num_read_kb":16384,"num_write":90,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"22'179","reported_seq":201,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:30.048452+0000","last_change":"2024-04-22T07:18:36.763439+0000","last_active":"2024-04-22T07:22:30.048452+0000","last_peered":"2024-04-22T07:22:30.048452+0000","last_clean":"2024-04-22T07:22:30.048452+0000","last_became_active":"2024-04-22T07:18:36.763146+0000","last_became_peered":"2024-04-22T07:18:36.763146+0000","last_unstale":"2024-04-22T07:22:30.048452+0000","last_undegraded":"2024-04-22T07:22:30.048452+0000","last_fullsized":"2024-04-22T07:22:30.048452+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":179,"log_dups_size":0,"ondisk_log_size":179,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:18:59.298766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":20480,"num_write":174,"num_write_kb":475136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"22'99","reported_seq":120,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:12.503842+0000","last_change":"2024-04-22T07:18:36.769533+0000","last_active":"2024-04-22T07:22:12.503842+0000","last_peered":"2024-04-22T07:22:12.503842+0000","last_clean":"2024-04-22T07:22:12.503842+0000","last_became_active":"2024-04-22T07:18:36.769274+0000","last_became_peered":"2024-04-22T07:18:36.769274+0000","last_unstale":"2024-04-22T07:22:12.503842+0000","last_undegraded":"2024-04-22T07:22:12.503842+0000","last_fullsized":"2024-04-22T07:22:12.503842+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:03:50.228822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":159383552,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":4,"num_read_kb":16384,"num_write":94,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"22'173","reported_seq":194,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:29.774823+0000","last_change":"2024-04-22T07:18:36.763931+0000","last_active":"2024-04-22T07:22:29.774823+0000","last_peered":"2024-04-22T07:22:29.774823+0000","last_clean":"2024-04-22T07:22:29.774823+0000","last_became_active":"2024-04-22T07:18:36.763656+0000","last_became_peered":"2024-04-22T07:18:36.763656+0000","last_unstale":"2024-04-22T07:22:29.774823+0000","last_undegraded":"2024-04-22T07:22:29.774823+0000","last_fullsized":"2024-04-22T07:22:29.774823+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:22:58.884168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54525952,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":4,"num_read_kb":16384,"num_write":170,"num_write_kb":499712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"22'159","reported_seq":179,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:30.545019+0000","last_change":"2024-04-22T07:18:36.767158+0000","last_active":"2024-04-22T07:22:30.545019+0000","last_peered":"2024-04-22T07:22:30.545019+0000","last_clean":"2024-04-22T07:22:30.545019+0000","last_became_active":"2024-04-22T07:18:36.766614+0000","last_became_peered":"2024-04-22T07:18:36.766614+0000","last_unstale":"2024-04-22T07:22:30.545019+0000","last_undegraded":"2024-04-22T07:22:30.545019+0000","last_fullsized":"2024-04-22T07:22:30.545019+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:44:30.785178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"22'97","reported_seq":118,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:12.412037+0000","last_change":"2024-04-22T07:18:36.773129+0000","last_active":"2024-04-22T07:22:12.412037+0000","last_peered":"2024-04-22T07:22:12.412037+0000","last_clean":"2024-04-22T07:22:12.412037+0000","last_became_active":"2024-04-22T07:18:36.772827+0000","last_became_peered":"2024-04-22T07:18:36.772827+0000","last_unstale":"2024-04-22T07:22:12.412037+0000","last_undegraded":"2024-04-22T07:22:12.412037+0000","last_fullsized":"2024-04-22T07:22:12.412037+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:45:27.464772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146800640,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":4,"num_read_kb":16384,"num_write":94,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"22'84","reported_seq":107,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:12.457029+0000","last_change":"2024-04-22T07:18:36.763716+0000","last_active":"2024-04-22T07:22:12.457029+0000","last_peered":"2024-04-22T07:22:12.457029+0000","last_clean":"2024-04-22T07:22:12.457029+0000","last_became_active":"2024-04-22T07:18:36.762270+0000","last_became_peered":"2024-04-22T07:18:36.762270+0000","last_unstale":"2024-04-22T07:22:12.457029+0000","last_undegraded":"2024-04-22T07:22:12.457029+0000","last_fullsized":"2024-04-22T07:22:12.457029+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:23:03.787574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117440512,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":6,"num_read_kb":24576,"num_write":83,"num_write_kb":303104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"22'128","reported_seq":151,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:30.054996+0000","last_change":"2024-04-22T07:18:36.764152+0000","last_active":"2024-04-22T07:22:30.054996+0000","last_peered":"2024-04-22T07:22:30.054996+0000","last_clean":"2024-04-22T07:22:30.054996+0000","last_became_active":"2024-04-22T07:18:36.763770+0000","last_became_peered":"2024-04-22T07:18:36.763770+0000","last_unstale":"2024-04-22T07:22:30.054996+0000","last_undegraded":"2024-04-22T07:22:30.054996+0000","last_fullsized":"2024-04-22T07:22:30.054996+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:22:58.884168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":24576,"num_write":122,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"22'92","reported_seq":112,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:10.640334+0000","last_change":"2024-04-22T07:18:36.771121+0000","last_active":"2024-04-22T07:22:10.640334+0000","last_peered":"2024-04-22T07:22:10.640334+0000","last_clean":"2024-04-22T07:22:10.640334+0000","last_became_active":"2024-04-22T07:18:36.770786+0000","last_became_peered":"2024-04-22T07:18:36.770786+0000","last_unstale":"2024-04-22T07:22:10.640334+0000","last_undegraded":"2024-04-22T07:22:10.640334+0000","last_fullsized":"2024-04-22T07:22:10.640334+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:45:15.213668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":138412032,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":90,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"22'135","reported_seq":157,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:29.785572+0000","last_change":"2024-04-22T07:18:36.765462+0000","last_active":"2024-04-22T07:22:29.785572+0000","last_peered":"2024-04-22T07:22:29.785572+0000","last_clean":"2024-04-22T07:22:29.785572+0000","last_became_active":"2024-04-22T07:18:36.765142+0000","last_became_peered":"2024-04-22T07:18:36.765142+0000","last_unstale":"2024-04-22T07:22:29.785572+0000","last_undegraded":"2024-04-22T07:22:29.785572+0000","last_fullsized":"2024-04-22T07:22:29.785572+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:32:20.374856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":5,"num_read_kb":20480,"num_write":133,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"22'93","reported_seq":112,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:11.112135+0000","last_change":"2024-04-22T07:18:36.768234+0000","last_active":"2024-04-22T07:22:11.112135+0000","last_peered":"2024-04-22T07:22:11.112135+0000","last_clean":"2024-04-22T07:22:11.112135+0000","last_became_active":"2024-04-22T07:18:36.767951+0000","last_became_peered":"2024-04-22T07:18:36.767951+0000","last_unstale":"2024-04-22T07:22:11.112135+0000","last_undegraded":"2024-04-22T07:22:11.112135+0000","last_fullsized":"2024-04-22T07:22:11.112135+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:08:05.611868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146800640,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":88,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"22'928","reported_seq":947,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:13.495922+0000","last_change":"2024-04-22T07:18:35.751538+0000","last_active":"2024-04-22T07:22:13.495922+0000","last_peered":"2024-04-22T07:22:13.495922+0000","last_clean":"2024-04-22T07:22:13.495922+0000","last_became_active":"2024-04-22T07:18:35.751219+0000","last_became_peered":"2024-04-22T07:18:35.751219+0000","last_unstale":"2024-04-22T07:22:13.495922+0000","last_undegraded":"2024-04-22T07:22:13.495922+0000","last_fullsized":"2024-04-22T07:22:13.495922+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":928,"log_dups_size":0,"ondisk_log_size":928,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:00:10.289974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1941532,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":927,"num_write_kb":2790,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"22'97","reported_seq":119,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:12.951383+0000","last_change":"2024-04-22T07:18:36.757337+0000","last_active":"2024-04-22T07:22:12.951383+0000","last_peered":"2024-04-22T07:22:12.951383+0000","last_clean":"2024-04-22T07:22:12.951383+0000","last_became_active":"2024-04-22T07:18:36.757039+0000","last_became_peered":"2024-04-22T07:18:36.757039+0000","last_unstale":"2024-04-22T07:22:12.951383+0000","last_undegraded":"2024-04-22T07:22:12.951383+0000","last_fullsized":"2024-04-22T07:22:12.951383+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:09:08.040513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146800640,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":5,"num_read_kb":20480,"num_write":94,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:19:18.280153+0000","last_change":"2024-04-22T07:18:35.746515+0000","last_active":"2024-04-22T07:19:18.280153+0000","last_peered":"2024-04-22T07:19:18.280153+0000","last_clean":"2024-04-22T07:19:18.280153+0000","last_became_active":"2024-04-22T07:18:35.746198+0000","last_became_peered":"2024-04-22T07:18:35.746198+0000","last_unstale":"2024-04-22T07:19:18.280153+0000","last_undegraded":"2024-04-22T07:19:18.280153+0000","last_fullsized":"2024-04-22T07:19:18.280153+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:43:54.682673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:19:18.280622+0000","last_change":"2024-04-22T07:18:35.752307+0000","last_active":"2024-04-22T07:19:18.280622+0000","last_peered":"2024-04-22T07:19:18.280622+0000","last_clean":"2024-04-22T07:19:18.280622+0000","last_became_active":"2024-04-22T07:18:35.751545+0000","last_became_peered":"2024-04-22T07:18:35.751545+0000","last_unstale":"2024-04-22T07:19:18.280622+0000","last_undegraded":"2024-04-22T07:19:18.280622+0000","last_fullsized":"2024-04-22T07:19:18.280622+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:21:55.316649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"22'121","reported_seq":142,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:12.400098+0000","last_change":"2024-04-22T07:18:36.772372+0000","last_active":"2024-04-22T07:22:12.400098+0000","last_peered":"2024-04-22T07:22:12.400098+0000","last_clean":"2024-04-22T07:22:12.400098+0000","last_became_active":"2024-04-22T07:18:36.772067+0000","last_became_peered":"2024-04-22T07:18:36.772067+0000","last_unstale":"2024-04-22T07:22:12.400098+0000","last_undegraded":"2024-04-22T07:22:12.400098+0000","last_fullsized":"2024-04-22T07:22:12.400098+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":121,"log_dups_size":0,"ondisk_log_size":121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:44:30.785178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":197132288,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":4,"num_read_kb":16384,"num_write":115,"num_write_kb":442368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:19:17.876687+0000","last_change":"2024-04-22T07:18:35.740989+0000","last_active":"2024-04-22T07:19:17.876687+0000","last_peered":"2024-04-22T07:19:17.876687+0000","last_clean":"2024-04-22T07:19:17.876687+0000","last_became_active":"2024-04-22T07:18:35.740665+0000","last_became_peered":"2024-04-22T07:18:35.740665+0000","last_unstale":"2024-04-22T07:19:17.876687+0000","last_undegraded":"2024-04-22T07:19:17.876687+0000","last_fullsized":"2024-04-22T07:19:17.876687+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:00:10.289974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"22'181","reported_seq":201,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:30.564910+0000","last_change":"2024-04-22T07:18:36.767022+0000","last_active":"2024-04-22T07:22:30.564910+0000","last_peered":"2024-04-22T07:22:30.564910+0000","last_clean":"2024-04-22T07:22:30.564910+0000","last_became_active":"2024-04-22T07:18:36.766609+0000","last_became_peered":"2024-04-22T07:18:36.766609+0000","last_unstale":"2024-04-22T07:22:30.564910+0000","last_undegraded":"2024-04-22T07:22:30.564910+0000","last_fullsized":"2024-04-22T07:22:30.564910+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":181,"log_dups_size":0,"ondisk_log_size":181,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:32:20.374856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"22'1","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:20:43.848866+0000","last_change":"2024-04-22T07:18:35.752081+0000","last_active":"2024-04-22T07:20:43.848866+0000","last_peered":"2024-04-22T07:20:43.848866+0000","last_clean":"2024-04-22T07:20:43.848866+0000","last_became_active":"2024-04-22T07:18:35.751757+0000","last_became_peered":"2024-04-22T07:18:35.751757+0000","last_unstale":"2024-04-22T07:20:43.848866+0000","last_undegraded":"2024-04-22T07:20:43.848866+0000","last_fullsized":"2024-04-22T07:20:43.848866+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:21:55.316649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"22'217","reported_seq":242,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:30.042586+0000","last_change":"2024-04-22T07:18:36.765937+0000","last_active":"2024-04-22T07:22:30.042586+0000","last_peered":"2024-04-22T07:22:30.042586+0000","last_clean":"2024-04-22T07:22:30.042586+0000","last_became_active":"2024-04-22T07:18:36.765647+0000","last_became_peered":"2024-04-22T07:18:36.765647+0000","last_unstale":"2024-04-22T07:22:30.042586+0000","last_undegraded":"2024-04-22T07:22:30.042586+0000","last_fullsized":"2024-04-22T07:22:30.042586+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:59:57.688417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":8,"num_read_kb":32768,"num_write":214,"num_write_kb":598016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:19:17.877284+0000","last_change":"2024-04-22T07:18:35.747309+0000","last_active":"2024-04-22T07:19:17.877284+0000","last_peered":"2024-04-22T07:19:17.877284+0000","last_clean":"2024-04-22T07:19:17.877284+0000","last_became_active":"2024-04-22T07:18:35.747019+0000","last_became_peered":"2024-04-22T07:18:35.747019+0000","last_unstale":"2024-04-22T07:19:17.877284+0000","last_undegraded":"2024-04-22T07:19:17.877284+0000","last_fullsized":"2024-04-22T07:19:17.877284+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:21:55.316649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"22'97","reported_seq":118,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:12.706549+0000","last_change":"2024-04-22T07:18:36.763436+0000","last_active":"2024-04-22T07:22:12.706549+0000","last_peered":"2024-04-22T07:22:12.706549+0000","last_clean":"2024-04-22T07:22:12.706549+0000","last_became_active":"2024-04-22T07:18:36.763068+0000","last_became_peered":"2024-04-22T07:18:36.763068+0000","last_unstale":"2024-04-22T07:22:12.706549+0000","last_undegraded":"2024-04-22T07:22:12.706549+0000","last_fullsized":"2024-04-22T07:22:12.706549+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:22:58.884168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146800640,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":4,"num_read_kb":16384,"num_write":97,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"22'8","reported_seq":27,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:30.596987+0000","last_change":"2024-04-22T07:18:35.750769+0000","last_active":"2024-04-22T07:22:30.596987+0000","last_peered":"2024-04-22T07:22:30.596987+0000","last_clean":"2024-04-22T07:22:30.596987+0000","last_became_active":"2024-04-22T07:18:35.750406+0000","last_became_peered":"2024-04-22T07:18:35.750406+0000","last_unstale":"2024-04-22T07:22:30.596987+0000","last_undegraded":"2024-04-22T07:22:30.596987+0000","last_fullsized":"2024-04-22T07:22:30.596987+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T19:09:20.529889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"22'104","reported_seq":123,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:13.257565+0000","last_change":"2024-04-22T07:18:36.767426+0000","last_active":"2024-04-22T07:22:13.257565+0000","last_peered":"2024-04-22T07:22:13.257565+0000","last_clean":"2024-04-22T07:22:13.257565+0000","last_became_active":"2024-04-22T07:18:36.767159+0000","last_became_peered":"2024-04-22T07:18:36.767159+0000","last_unstale":"2024-04-22T07:22:13.257565+0000","last_undegraded":"2024-04-22T07:22:13.257565+0000","last_fullsized":"2024-04-22T07:22:13.257565+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:19:49.652644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":163577856,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":99,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"22'2012","reported_seq":2031,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:03.268031+0000","last_change":"2024-04-22T07:18:35.752996+0000","last_active":"2024-04-22T07:22:03.268031+0000","last_peered":"2024-04-22T07:22:03.268031+0000","last_clean":"2024-04-22T07:22:03.268031+0000","last_became_active":"2024-04-22T07:18:35.752686+0000","last_became_peered":"2024-04-22T07:18:35.752686+0000","last_unstale":"2024-04-22T07:22:03.268031+0000","last_undegraded":"2024-04-22T07:22:03.268031+0000","last_fullsized":"2024-04-22T07:22:03.268031+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":2012,"log_dups_size":0,"ondisk_log_size":2012,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:36:55.684427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2011,"num_write_kb":6027,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"22'126","reported_seq":150,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:29.502078+0000","last_change":"2024-04-22T07:18:36.767539+0000","last_active":"2024-04-22T07:22:29.502078+0000","last_peered":"2024-04-22T07:22:29.502078+0000","last_clean":"2024-04-22T07:22:29.502078+0000","last_became_active":"2024-04-22T07:18:36.767273+0000","last_became_peered":"2024-04-22T07:18:36.767273+0000","last_unstale":"2024-04-22T07:22:29.502078+0000","last_undegraded":"2024-04-22T07:22:29.502078+0000","last_fullsized":"2024-04-22T07:22:29.502078+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:03:50.228822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":7,"num_read_kb":28672,"num_write":122,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":21,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:19:18.281247+0000","last_change":"2024-04-22T07:18:35.752382+0000","last_active":"2024-04-22T07:19:18.281247+0000","last_peered":"2024-04-22T07:19:18.281247+0000","last_clean":"2024-04-22T07:19:18.281247+0000","last_became_active":"2024-04-22T07:18:35.752060+0000","last_became_peered":"2024-04-22T07:18:35.752060+0000","last_unstale":"2024-04-22T07:19:18.281247+0000","last_undegraded":"2024-04-22T07:19:18.281247+0000","last_fullsized":"2024-04-22T07:19:18.281247+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:31:33.559251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"22'113","reported_seq":133,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:11.988938+0000","last_change":"2024-04-22T07:18:36.764670+0000","last_active":"2024-04-22T07:22:11.988938+0000","last_peered":"2024-04-22T07:22:11.988938+0000","last_clean":"2024-04-22T07:22:11.988938+0000","last_became_active":"2024-04-22T07:18:36.763834+0000","last_became_peered":"2024-04-22T07:18:36.763834+0000","last_unstale":"2024-04-22T07:22:11.988938+0000","last_undegraded":"2024-04-22T07:22:11.988938+0000","last_fullsized":"2024-04-22T07:22:11.988938+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:41:20.703226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":167772160,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":107,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:19:17.877449+0000","last_change":"2024-04-22T07:18:35.752856+0000","last_active":"2024-04-22T07:19:17.877449+0000","last_peered":"2024-04-22T07:19:17.877449+0000","last_clean":"2024-04-22T07:19:17.877449+0000","last_became_active":"2024-04-22T07:18:35.752527+0000","last_became_peered":"2024-04-22T07:18:35.752527+0000","last_unstale":"2024-04-22T07:19:17.877449+0000","last_undegraded":"2024-04-22T07:19:17.877449+0000","last_fullsized":"2024-04-22T07:19:17.877449+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:40:59.305769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"22'116","reported_seq":128,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:12.199280+0000","last_change":"2024-04-22T07:19:17.878772+0000","last_active":"2024-04-22T07:22:12.199280+0000","last_peered":"2024-04-22T07:22:12.199280+0000","last_clean":"2024-04-22T07:22:12.199280+0000","last_became_active":"2024-04-22T07:19:17.878334+0000","last_became_peered":"2024-04-22T07:19:17.878334+0000","last_unstale":"2024-04-22T07:22:12.199280+0000","last_undegraded":"2024-04-22T07:22:12.199280+0000","last_fullsized":"2024-04-22T07:22:12.199280+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":116,"log_dups_size":0,"ondisk_log_size":116,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:03:50.228822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":197132288,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":109,"num_write_kb":425984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:19:18.280016+0000","last_change":"2024-04-22T07:18:35.749740+0000","last_active":"2024-04-22T07:19:18.280016+0000","last_peered":"2024-04-22T07:19:18.280016+0000","last_clean":"2024-04-22T07:19:18.280016+0000","last_became_active":"2024-04-22T07:18:35.749453+0000","last_became_peered":"2024-04-22T07:18:35.749453+0000","last_unstale":"2024-04-22T07:19:18.280016+0000","last_undegraded":"2024-04-22T07:19:18.280016+0000","last_fullsized":"2024-04-22T07:19:18.280016+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:08:04.608018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"22'156","reported_seq":182,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:29.819186+0000","last_change":"2024-04-22T07:18:36.771940+0000","last_active":"2024-04-22T07:22:29.819186+0000","last_peered":"2024-04-22T07:22:29.819186+0000","last_clean":"2024-04-22T07:22:29.819186+0000","last_became_active":"2024-04-22T07:18:36.771548+0000","last_became_peered":"2024-04-22T07:18:36.771548+0000","last_unstale":"2024-04-22T07:22:29.819186+0000","last_undegraded":"2024-04-22T07:22:29.819186+0000","last_fullsized":"2024-04-22T07:22:29.819186+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:23:03.787574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":9,"num_read_kb":36864,"num_write":151,"num_write_kb":434176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":27,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:19:17.875275+0000","last_change":"2024-04-22T07:18:35.749047+0000","last_active":"2024-04-22T07:19:17.875275+0000","last_peered":"2024-04-22T07:19:17.875275+0000","last_clean":"2024-04-22T07:19:17.875275+0000","last_became_active":"2024-04-22T07:18:35.748757+0000","last_became_peered":"2024-04-22T07:18:35.748757+0000","last_unstale":"2024-04-22T07:19:17.875275+0000","last_undegraded":"2024-04-22T07:19:17.875275+0000","last_fullsized":"2024-04-22T07:19:17.875275+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:40:59.305769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"22'169","reported_seq":193,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:29.604592+0000","last_change":"2024-04-22T07:18:36.769894+0000","last_active":"2024-04-22T07:22:29.604592+0000","last_peered":"2024-04-22T07:22:29.604592+0000","last_clean":"2024-04-22T07:22:29.604592+0000","last_became_active":"2024-04-22T07:18:36.768702+0000","last_became_peered":"2024-04-22T07:18:36.768702+0000","last_unstale":"2024-04-22T07:22:29.604592+0000","last_undegraded":"2024-04-22T07:22:29.604592+0000","last_fullsized":"2024-04-22T07:22:29.604592+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:36:53.716397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":7,"num_read_kb":28672,"num_write":164,"num_write_kb":499712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:19:17.877321+0000","last_change":"2024-04-22T07:18:35.747536+0000","last_active":"2024-04-22T07:19:17.877321+0000","last_peered":"2024-04-22T07:19:17.877321+0000","last_clean":"2024-04-22T07:19:17.877321+0000","last_became_active":"2024-04-22T07:18:35.747271+0000","last_became_peered":"2024-04-22T07:18:35.747271+0000","last_unstale":"2024-04-22T07:19:17.877321+0000","last_undegraded":"2024-04-22T07:19:17.877321+0000","last_fullsized":"2024-04-22T07:19:17.877321+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:51:11.593642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"22'123","reported_seq":144,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:29.498215+0000","last_change":"2024-04-22T07:18:36.773033+0000","last_active":"2024-04-22T07:22:29.498215+0000","last_peered":"2024-04-22T07:22:29.498215+0000","last_clean":"2024-04-22T07:22:29.498215+0000","last_became_active":"2024-04-22T07:18:36.772537+0000","last_became_peered":"2024-04-22T07:18:36.772537+0000","last_unstale":"2024-04-22T07:22:29.498215+0000","last_undegraded":"2024-04-22T07:22:29.498215+0000","last_fullsized":"2024-04-22T07:22:29.498215+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:58:41.509248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":4,"num_read_kb":16384,"num_write":122,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":21,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:19:17.875556+0000","last_change":"2024-04-22T07:18:35.747533+0000","last_active":"2024-04-22T07:19:17.875556+0000","last_peered":"2024-04-22T07:19:17.875556+0000","last_clean":"2024-04-22T07:19:17.875556+0000","last_became_active":"2024-04-22T07:18:35.746881+0000","last_became_peered":"2024-04-22T07:18:35.746881+0000","last_unstale":"2024-04-22T07:19:17.875556+0000","last_undegraded":"2024-04-22T07:19:17.875556+0000","last_fullsized":"2024-04-22T07:19:17.875556+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:43:54.682673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"22'119","reported_seq":138,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:29.579066+0000","last_change":"2024-04-22T07:18:36.773723+0000","last_active":"2024-04-22T07:22:29.579066+0000","last_peered":"2024-04-22T07:22:29.579066+0000","last_clean":"2024-04-22T07:22:29.579066+0000","last_became_active":"2024-04-22T07:18:36.773466+0000","last_became_peered":"2024-04-22T07:18:36.773466+0000","last_unstale":"2024-04-22T07:22:29.579066+0000","last_undegraded":"2024-04-22T07:22:29.579066+0000","last_fullsized":"2024-04-22T07:22:29.579066+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:42:20.611744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":111,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:19:17.878170+0000","last_change":"2024-04-22T07:18:35.750360+0000","last_active":"2024-04-22T07:19:17.878170+0000","last_peered":"2024-04-22T07:19:17.878170+0000","last_clean":"2024-04-22T07:19:17.878170+0000","last_became_active":"2024-04-22T07:18:35.749984+0000","last_became_peered":"2024-04-22T07:18:35.749984+0000","last_unstale":"2024-04-22T07:19:17.878170+0000","last_undegraded":"2024-04-22T07:19:17.878170+0000","last_fullsized":"2024-04-22T07:19:17.878170+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:19:48.648793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"22'137","reported_seq":157,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:30.051930+0000","last_change":"2024-04-22T07:18:36.765767+0000","last_active":"2024-04-22T07:22:30.051930+0000","last_peered":"2024-04-22T07:22:30.051930+0000","last_clean":"2024-04-22T07:22:30.051930+0000","last_became_active":"2024-04-22T07:18:36.764218+0000","last_became_peered":"2024-04-22T07:18:36.764218+0000","last_unstale":"2024-04-22T07:22:30.051930+0000","last_undegraded":"2024-04-22T07:22:30.051930+0000","last_fullsized":"2024-04-22T07:22:30.051930+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:45:42.674989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":137,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:19:17.875606+0000","last_change":"2024-04-22T07:18:35.743323+0000","last_active":"2024-04-22T07:19:17.875606+0000","last_peered":"2024-04-22T07:19:17.875606+0000","last_clean":"2024-04-22T07:19:17.875606+0000","last_became_active":"2024-04-22T07:18:35.743023+0000","last_became_peered":"2024-04-22T07:18:35.743023+0000","last_unstale":"2024-04-22T07:19:17.875606+0000","last_undegraded":"2024-04-22T07:19:17.875606+0000","last_fullsized":"2024-04-22T07:19:17.875606+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:08:04.608018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"22'136","reported_seq":158,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:29.534168+0000","last_change":"2024-04-22T07:18:36.771073+0000","last_active":"2024-04-22T07:22:29.534168+0000","last_peered":"2024-04-22T07:22:29.534168+0000","last_clean":"2024-04-22T07:22:29.534168+0000","last_became_active":"2024-04-22T07:18:36.770678+0000","last_became_peered":"2024-04-22T07:18:36.770678+0000","last_unstale":"2024-04-22T07:22:29.534168+0000","last_undegraded":"2024-04-22T07:22:29.534168+0000","last_fullsized":"2024-04-22T07:22:29.534168+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:59:57.688417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62914560,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":5,"num_read_kb":20480,"num_write":129,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":176,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:20:29.610374+0000","last_change":"2024-04-22T07:18:26.518190+0000","last_active":"2024-04-22T07:20:29.610374+0000","last_peered":"2024-04-22T07:20:29.610374+0000","last_clean":"2024-04-22T07:20:29.610374+0000","last_became_active":"2024-04-22T07:18:26.515489+0000","last_became_peered":"2024-04-22T07:18:26.515489+0000","last_unstale":"2024-04-22T07:20:29.610374+0000","last_undegraded":"2024-04-22T07:20:29.610374+0000","last_fullsized":"2024-04-22T07:20:29.610374+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:24.652061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:24.652061+0000","last_clean_scrub_stamp":"2024-04-22T07:18:24.652061+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:32:54.875706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:19:17.876989+0000","last_change":"2024-04-22T07:18:35.748477+0000","last_active":"2024-04-22T07:19:17.876989+0000","last_peered":"2024-04-22T07:19:17.876989+0000","last_clean":"2024-04-22T07:19:17.876989+0000","last_became_active":"2024-04-22T07:18:35.748176+0000","last_became_peered":"2024-04-22T07:18:35.748176+0000","last_unstale":"2024-04-22T07:19:17.876989+0000","last_undegraded":"2024-04-22T07:19:17.876989+0000","last_fullsized":"2024-04-22T07:19:17.876989+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:36:55.684427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"22'107","reported_seq":125,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:12.286332+0000","last_change":"2024-04-22T07:18:36.771870+0000","last_active":"2024-04-22T07:22:12.286332+0000","last_peered":"2024-04-22T07:22:12.286332+0000","last_clean":"2024-04-22T07:22:12.286332+0000","last_became_active":"2024-04-22T07:18:36.771583+0000","last_became_peered":"2024-04-22T07:18:36.771583+0000","last_unstale":"2024-04-22T07:22:12.286332+0000","last_undegraded":"2024-04-22T07:22:12.286332+0000","last_fullsized":"2024-04-22T07:22:12.286332+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:22:58.884168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":184549376,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":106,"num_write_kb":409600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:19:17.895780+0000","last_change":"2024-04-22T07:18:35.755668+0000","last_active":"2024-04-22T07:19:17.895780+0000","last_peered":"2024-04-22T07:19:17.895780+0000","last_clean":"2024-04-22T07:19:17.895780+0000","last_became_active":"2024-04-22T07:18:35.755471+0000","last_became_peered":"2024-04-22T07:18:35.755471+0000","last_unstale":"2024-04-22T07:19:17.895780+0000","last_undegraded":"2024-04-22T07:19:17.895780+0000","last_fullsized":"2024-04-22T07:19:17.895780+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:36:55.684427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"22'107","reported_seq":130,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:12.366346+0000","last_change":"2024-04-22T07:18:36.758204+0000","last_active":"2024-04-22T07:22:12.366346+0000","last_peered":"2024-04-22T07:22:12.366346+0000","last_clean":"2024-04-22T07:22:12.366346+0000","last_became_active":"2024-04-22T07:18:36.757841+0000","last_became_peered":"2024-04-22T07:18:36.757841+0000","last_unstale":"2024-04-22T07:22:12.366346+0000","last_undegraded":"2024-04-22T07:22:12.366346+0000","last_fullsized":"2024-04-22T07:22:12.366346+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:43:09.058016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130023424,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":6,"num_read_kb":24576,"num_write":95,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"22'3","reported_seq":24,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:21:49.949664+0000","last_change":"2024-04-22T07:18:35.746686+0000","last_active":"2024-04-22T07:21:49.949664+0000","last_peered":"2024-04-22T07:21:49.949664+0000","last_clean":"2024-04-22T07:21:49.949664+0000","last_became_active":"2024-04-22T07:18:35.746371+0000","last_became_peered":"2024-04-22T07:18:35.746371+0000","last_unstale":"2024-04-22T07:21:49.949664+0000","last_undegraded":"2024-04-22T07:21:49.949664+0000","last_fullsized":"2024-04-22T07:21:49.949664+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:36:55.684427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":202,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"22'163","reported_seq":183,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:30.560499+0000","last_change":"2024-04-22T07:18:36.765985+0000","last_active":"2024-04-22T07:22:30.560499+0000","last_peered":"2024-04-22T07:22:30.560499+0000","last_clean":"2024-04-22T07:22:30.560499+0000","last_became_active":"2024-04-22T07:18:36.765661+0000","last_became_peered":"2024-04-22T07:18:36.765661+0000","last_unstale":"2024-04-22T07:22:30.560499+0000","last_undegraded":"2024-04-22T07:22:30.560499+0000","last_fullsized":"2024-04-22T07:22:30.560499+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:23:03.787574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:19:17.876920+0000","last_change":"2024-04-22T07:18:35.754160+0000","last_active":"2024-04-22T07:19:17.876920+0000","last_peered":"2024-04-22T07:19:17.876920+0000","last_clean":"2024-04-22T07:19:17.876920+0000","last_became_active":"2024-04-22T07:18:35.753860+0000","last_became_peered":"2024-04-22T07:18:35.753860+0000","last_unstale":"2024-04-22T07:19:17.876920+0000","last_undegraded":"2024-04-22T07:19:17.876920+0000","last_fullsized":"2024-04-22T07:19:17.876920+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:08:04.608018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"22'103","reported_seq":123,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:13.095777+0000","last_change":"2024-04-22T07:18:36.762349+0000","last_active":"2024-04-22T07:22:13.095777+0000","last_peered":"2024-04-22T07:22:13.095777+0000","last_clean":"2024-04-22T07:22:13.095777+0000","last_became_active":"2024-04-22T07:18:36.762097+0000","last_became_peered":"2024-04-22T07:18:36.762097+0000","last_unstale":"2024-04-22T07:22:13.095777+0000","last_undegraded":"2024-04-22T07:22:13.095777+0000","last_fullsized":"2024-04-22T07:22:13.095777+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:43:55.686523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":167772160,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":98,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:19:17.877984+0000","last_change":"2024-04-22T07:18:35.758810+0000","last_active":"2024-04-22T07:19:17.877984+0000","last_peered":"2024-04-22T07:19:17.877984+0000","last_clean":"2024-04-22T07:19:17.877984+0000","last_became_active":"2024-04-22T07:18:35.758521+0000","last_became_peered":"2024-04-22T07:18:35.758521+0000","last_unstale":"2024-04-22T07:19:17.877984+0000","last_undegraded":"2024-04-22T07:19:17.877984+0000","last_fullsized":"2024-04-22T07:19:17.877984+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:40:59.305769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"22'138","reported_seq":160,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:30.007404+0000","last_change":"2024-04-22T07:18:36.764448+0000","last_active":"2024-04-22T07:22:30.007404+0000","last_peered":"2024-04-22T07:22:30.007404+0000","last_clean":"2024-04-22T07:22:30.007404+0000","last_became_active":"2024-04-22T07:18:36.763728+0000","last_became_peered":"2024-04-22T07:18:36.763728+0000","last_unstale":"2024-04-22T07:22:30.007404+0000","last_undegraded":"2024-04-22T07:22:30.007404+0000","last_fullsized":"2024-04-22T07:22:30.007404+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:58:41.509248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":20480,"num_write":136,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:19:17.896310+0000","last_change":"2024-04-22T07:18:35.758980+0000","last_active":"2024-04-22T07:19:17.896310+0000","last_peered":"2024-04-22T07:19:17.896310+0000","last_clean":"2024-04-22T07:19:17.896310+0000","last_became_active":"2024-04-22T07:18:35.758674+0000","last_became_peered":"2024-04-22T07:18:35.758674+0000","last_unstale":"2024-04-22T07:19:17.896310+0000","last_undegraded":"2024-04-22T07:19:17.896310+0000","last_fullsized":"2024-04-22T07:19:17.896310+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:45:14.209818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"22'160","reported_seq":181,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:30.588721+0000","last_change":"2024-04-22T07:18:36.772908+0000","last_active":"2024-04-22T07:22:30.588721+0000","last_peered":"2024-04-22T07:22:30.588721+0000","last_clean":"2024-04-22T07:22:30.588721+0000","last_became_active":"2024-04-22T07:18:36.772636+0000","last_became_peered":"2024-04-22T07:18:36.772636+0000","last_unstale":"2024-04-22T07:22:30.588721+0000","last_undegraded":"2024-04-22T07:22:30.588721+0000","last_fullsized":"2024-04-22T07:22:30.588721+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:51:10.038201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":16384,"num_write":135,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"22'18","reported_seq":37,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:27.820343+0000","last_change":"2024-04-22T07:18:35.753595+0000","last_active":"2024-04-22T07:22:27.820343+0000","last_peered":"2024-04-22T07:22:27.820343+0000","last_clean":"2024-04-22T07:22:27.820343+0000","last_became_active":"2024-04-22T07:18:35.753295+0000","last_became_peered":"2024-04-22T07:18:35.753295+0000","last_unstale":"2024-04-22T07:22:27.820343+0000","last_undegraded":"2024-04-22T07:22:27.820343+0000","last_fullsized":"2024-04-22T07:22:27.820343+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:08:04.608018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"22'108","reported_seq":131,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:12.510716+0000","last_change":"2024-04-22T07:18:36.768580+0000","last_active":"2024-04-22T07:22:12.510716+0000","last_peered":"2024-04-22T07:22:12.510716+0000","last_clean":"2024-04-22T07:22:12.510716+0000","last_became_active":"2024-04-22T07:18:36.767702+0000","last_became_peered":"2024-04-22T07:18:36.767702+0000","last_unstale":"2024-04-22T07:22:12.510716+0000","last_undegraded":"2024-04-22T07:22:12.510716+0000","last_fullsized":"2024-04-22T07:22:12.510716+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:59:57.688417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":138412032,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":6,"num_read_kb":24576,"num_write":105,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":21,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:19:18.280400+0000","last_change":"2024-04-22T07:18:35.751692+0000","last_active":"2024-04-22T07:19:18.280400+0000","last_peered":"2024-04-22T07:19:18.280400+0000","last_clean":"2024-04-22T07:19:18.280400+0000","last_became_active":"2024-04-22T07:18:35.751393+0000","last_became_peered":"2024-04-22T07:18:35.751393+0000","last_unstale":"2024-04-22T07:19:18.280400+0000","last_undegraded":"2024-04-22T07:19:18.280400+0000","last_fullsized":"2024-04-22T07:19:18.280400+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:40:59.305769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"22'114","reported_seq":136,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:11.519295+0000","last_change":"2024-04-22T07:18:36.768532+0000","last_active":"2024-04-22T07:22:11.519295+0000","last_peered":"2024-04-22T07:22:11.519295+0000","last_clean":"2024-04-22T07:22:11.519295+0000","last_became_active":"2024-04-22T07:18:36.768253+0000","last_became_peered":"2024-04-22T07:18:36.768253+0000","last_unstale":"2024-04-22T07:22:11.519295+0000","last_undegraded":"2024-04-22T07:22:11.519295+0000","last_fullsized":"2024-04-22T07:22:11.519295+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:30:36.755201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":188743680,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":5,"num_read_kb":20480,"num_write":111,"num_write_kb":425984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:19:17.895786+0000","last_change":"2024-04-22T07:18:35.758702+0000","last_active":"2024-04-22T07:19:17.895786+0000","last_peered":"2024-04-22T07:19:17.895786+0000","last_clean":"2024-04-22T07:19:17.895786+0000","last_became_active":"2024-04-22T07:18:35.758415+0000","last_became_peered":"2024-04-22T07:18:35.758415+0000","last_unstale":"2024-04-22T07:19:17.895786+0000","last_undegraded":"2024-04-22T07:19:17.895786+0000","last_fullsized":"2024-04-22T07:19:17.895786+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:08:04.608018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"22'106","reported_seq":130,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:13.261095+0000","last_change":"2024-04-22T07:18:36.763053+0000","last_active":"2024-04-22T07:22:13.261095+0000","last_peered":"2024-04-22T07:22:13.261095+0000","last_clean":"2024-04-22T07:22:13.261095+0000","last_became_active":"2024-04-22T07:18:36.762546+0000","last_became_peered":"2024-04-22T07:18:36.762546+0000","last_unstale":"2024-04-22T07:22:13.261095+0000","last_undegraded":"2024-04-22T07:22:13.261095+0000","last_fullsized":"2024-04-22T07:22:13.261095+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:36:56.688277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130023424,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":7,"num_read_kb":28672,"num_write":101,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:19:17.877836+0000","last_change":"2024-04-22T07:18:35.748837+0000","last_active":"2024-04-22T07:19:17.877836+0000","last_peered":"2024-04-22T07:19:17.877836+0000","last_clean":"2024-04-22T07:19:17.877836+0000","last_became_active":"2024-04-22T07:18:35.748080+0000","last_became_peered":"2024-04-22T07:18:35.748080+0000","last_unstale":"2024-04-22T07:19:17.877836+0000","last_undegraded":"2024-04-22T07:19:17.877836+0000","last_fullsized":"2024-04-22T07:19:17.877836+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:36:55.684427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"22'113","reported_seq":135,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:12.487210+0000","last_change":"2024-04-22T07:18:36.769911+0000","last_active":"2024-04-22T07:22:12.487210+0000","last_peered":"2024-04-22T07:22:12.487210+0000","last_clean":"2024-04-22T07:22:12.487210+0000","last_became_active":"2024-04-22T07:18:36.768682+0000","last_became_peered":"2024-04-22T07:18:36.768682+0000","last_unstale":"2024-04-22T07:22:12.487210+0000","last_undegraded":"2024-04-22T07:22:12.487210+0000","last_fullsized":"2024-04-22T07:22:12.487210+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:30:36.755201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":150994944,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":5,"num_read_kb":20480,"num_write":108,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:19:17.878036+0000","last_change":"2024-04-22T07:18:35.753066+0000","last_active":"2024-04-22T07:19:17.878036+0000","last_peered":"2024-04-22T07:19:17.878036+0000","last_clean":"2024-04-22T07:19:17.878036+0000","last_became_active":"2024-04-22T07:18:35.752804+0000","last_became_peered":"2024-04-22T07:18:35.752804+0000","last_unstale":"2024-04-22T07:19:17.878036+0000","last_undegraded":"2024-04-22T07:19:17.878036+0000","last_fullsized":"2024-04-22T07:19:17.878036+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:43:54.682673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"22'103","reported_seq":125,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:11.993395+0000","last_change":"2024-04-22T07:18:36.774790+0000","last_active":"2024-04-22T07:22:11.993395+0000","last_peered":"2024-04-22T07:22:11.993395+0000","last_clean":"2024-04-22T07:22:11.993395+0000","last_became_active":"2024-04-22T07:18:36.774479+0000","last_became_peered":"2024-04-22T07:18:36.774479+0000","last_unstale":"2024-04-22T07:22:11.993395+0000","last_undegraded":"2024-04-22T07:22:11.993395+0000","last_fullsized":"2024-04-22T07:22:11.993395+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:36:53.716397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":150994944,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":5,"num_read_kb":20480,"num_write":99,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"22'3","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:20:43.848781+0000","last_change":"2024-04-22T07:18:35.754440+0000","last_active":"2024-04-22T07:20:43.848781+0000","last_peered":"2024-04-22T07:20:43.848781+0000","last_clean":"2024-04-22T07:20:43.848781+0000","last_became_active":"2024-04-22T07:18:35.754137+0000","last_became_peered":"2024-04-22T07:18:35.754137+0000","last_unstale":"2024-04-22T07:20:43.848781+0000","last_undegraded":"2024-04-22T07:20:43.848781+0000","last_fullsized":"2024-04-22T07:20:43.848781+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T19:09:20.529889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"22'116","reported_seq":136,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:29.700144+0000","last_change":"2024-04-22T07:18:36.759585+0000","last_active":"2024-04-22T07:22:29.700144+0000","last_peered":"2024-04-22T07:22:29.700144+0000","last_clean":"2024-04-22T07:22:29.700144+0000","last_became_active":"2024-04-22T07:18:36.759342+0000","last_became_peered":"2024-04-22T07:18:36.759342+0000","last_unstale":"2024-04-22T07:22:29.700144+0000","last_undegraded":"2024-04-22T07:22:29.700144+0000","last_fullsized":"2024-04-22T07:22:29.700144+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":116,"log_dups_size":0,"ondisk_log_size":116,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:44:30.785178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":112,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"22'170","reported_seq":191,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:30.042379+0000","last_change":"2024-04-22T07:18:36.762665+0000","last_active":"2024-04-22T07:22:30.042379+0000","last_peered":"2024-04-22T07:22:30.042379+0000","last_clean":"2024-04-22T07:22:30.042379+0000","last_became_active":"2024-04-22T07:18:36.762392+0000","last_became_peered":"2024-04-22T07:18:36.762392+0000","last_unstale":"2024-04-22T07:22:30.042379+0000","last_undegraded":"2024-04-22T07:22:30.042379+0000","last_fullsized":"2024-04-22T07:22:30.042379+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:36:27.097452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":16384,"num_write":165,"num_write_kb":458752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":21,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:19:17.896085+0000","last_change":"2024-04-22T07:18:35.755160+0000","last_active":"2024-04-22T07:19:17.896085+0000","last_peered":"2024-04-22T07:19:17.896085+0000","last_clean":"2024-04-22T07:19:17.896085+0000","last_became_active":"2024-04-22T07:18:35.754877+0000","last_became_peered":"2024-04-22T07:18:35.754877+0000","last_unstale":"2024-04-22T07:19:17.896085+0000","last_undegraded":"2024-04-22T07:19:17.896085+0000","last_fullsized":"2024-04-22T07:19:17.896085+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:43:54.682673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"22'134","reported_seq":154,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:30.071130+0000","last_change":"2024-04-22T07:18:36.761534+0000","last_active":"2024-04-22T07:22:30.071130+0000","last_peered":"2024-04-22T07:22:30.071130+0000","last_clean":"2024-04-22T07:22:30.071130+0000","last_became_active":"2024-04-22T07:18:36.761181+0000","last_became_peered":"2024-04-22T07:18:36.761181+0000","last_unstale":"2024-04-22T07:22:30.071130+0000","last_undegraded":"2024-04-22T07:22:30.071130+0000","last_fullsized":"2024-04-22T07:22:30.071130+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:03:50.228822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":131,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"22'4","reported_seq":23,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:21:09.614846+0000","last_change":"2024-04-22T07:18:35.752282+0000","last_active":"2024-04-22T07:21:09.614846+0000","last_peered":"2024-04-22T07:21:09.614846+0000","last_clean":"2024-04-22T07:21:09.614846+0000","last_became_active":"2024-04-22T07:18:35.751866+0000","last_became_peered":"2024-04-22T07:18:35.751866+0000","last_unstale":"2024-04-22T07:21:09.614846+0000","last_undegraded":"2024-04-22T07:21:09.614846+0000","last_fullsized":"2024-04-22T07:21:09.614846+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:19:48.648793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"22'93","reported_seq":112,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:12.974110+0000","last_change":"2024-04-22T07:18:36.763229+0000","last_active":"2024-04-22T07:22:12.974110+0000","last_peered":"2024-04-22T07:22:12.974110+0000","last_clean":"2024-04-22T07:22:12.974110+0000","last_became_active":"2024-04-22T07:18:36.762882+0000","last_became_peered":"2024-04-22T07:18:36.762882+0000","last_unstale":"2024-04-22T07:22:12.974110+0000","last_undegraded":"2024-04-22T07:22:12.974110+0000","last_fullsized":"2024-04-22T07:22:12.974110+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:44:30.785178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":159383552,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":91,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:19:18.281451+0000","last_change":"2024-04-22T07:18:35.758820+0000","last_active":"2024-04-22T07:19:18.281451+0000","last_peered":"2024-04-22T07:19:18.281451+0000","last_clean":"2024-04-22T07:19:18.281451+0000","last_became_active":"2024-04-22T07:18:35.758514+0000","last_became_peered":"2024-04-22T07:18:35.758514+0000","last_unstale":"2024-04-22T07:19:18.281451+0000","last_undegraded":"2024-04-22T07:19:18.281451+0000","last_fullsized":"2024-04-22T07:19:18.281451+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:40:59.305769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"22'173","reported_seq":187,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:30.562489+0000","last_change":"2024-04-22T07:19:18.281671+0000","last_active":"2024-04-22T07:22:30.562489+0000","last_peered":"2024-04-22T07:22:30.562489+0000","last_clean":"2024-04-22T07:22:30.562489+0000","last_became_active":"2024-04-22T07:19:18.281158+0000","last_became_peered":"2024-04-22T07:19:18.281158+0000","last_unstale":"2024-04-22T07:22:30.562489+0000","last_undegraded":"2024-04-22T07:22:30.562489+0000","last_fullsized":"2024-04-22T07:22:30.562489+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:42:20.611744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":23,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:19:18.281631+0000","last_change":"2024-04-22T07:18:35.754117+0000","last_active":"2024-04-22T07:19:18.281631+0000","last_peered":"2024-04-22T07:19:18.281631+0000","last_clean":"2024-04-22T07:19:18.281631+0000","last_became_active":"2024-04-22T07:18:35.753833+0000","last_became_peered":"2024-04-22T07:18:35.753833+0000","last_unstale":"2024-04-22T07:19:18.281631+0000","last_undegraded":"2024-04-22T07:19:18.281631+0000","last_fullsized":"2024-04-22T07:19:18.281631+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:54:03.123665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":5989466112,"num_objects":1428,"num_object_clones":0,"num_object_copies":2856,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1428,"num_whiteouts":0,"num_read":256,"num_read_kb":1048576,"num_write":7788,"num_write_kb":25165824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":13241417728,"data_stored":13241417728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8224,"ondisk_log_size":8224,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":6137508,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3017,"num_write_kb":8848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12349440,"data_stored":12279484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3001,"ondisk_log_size":3001,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574902,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2382560,"kb_used_data":2333336,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":91989280,"statfs":{"total":96636764160,"available":94197022720,"internally_reserved":0,"allocated":2389336064,"data_stored":2389179042,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574901,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":692528,"kb_used_data":635112,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":93679312,"statfs":{"total":96636764160,"available":95927615488,"internally_reserved":0,"allocated":650354688,"data_stored":650200908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574901,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2472620,"kb_used_data":2433252,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":91899220,"statfs":{"total":96636764160,"available":94104801280,"internally_reserved":0,"allocated":2491650048,"data_stored":2491499782,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1],"upper_bound":4},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574900,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3013300,"kb_used_data":2982124,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":91358540,"statfs":{"total":96636764160,"available":93551144960,"internally_reserved":0,"allocated":3053694976,"data_stored":3053536554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574901,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3152096,"kb_used_data":3098712,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":91219744,"statfs":{"total":96636764160,"available":93409017856,"internally_reserved":0,"allocated":3173081088,"data_stored":3172919346,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":54655431},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574900,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1870508,"kb_used_data":1839332,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":92501332,"statfs":{"total":96636764160,"available":94721363968,"internally_reserved":0,"allocated":1883475968,"data_stored":1883325814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574902,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":801456,"kb_used_data":770280,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93570384,"statfs":{"total":96636764160,"available":95816073216,"internally_reserved":0,"allocated":788766720,"data_stored":788612428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,0,2,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574900,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2977016,"kb_used_data":2945840,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":91394824,"statfs":{"total":96636764160,"available":93588299776,"internally_reserved":0,"allocated":3016540160,"data_stored":3016378698,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":202,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":6152192,"data_stored":6136710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4202496,"data_stored":4194976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1953792,"data_stored":1946582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":3015704576,"data_stored":3015704576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1883242496,"data_stored":1883242496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":3166699520,"data_stored":3166699520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":3053453312,"data_stored":3053453312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":188743680,"data_stored":188743680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":570425344,"data_stored":570425344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1363148800,"data_stored":1363148800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-22T07:22:31.465 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-22T07:22:31.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:31.604+0000 7f38bb011640 1 Processor -- start 2024-04-22T07:22:31.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:31.604+0000 7f38bb011640 1 -- start start 2024-04-22T07:22:31.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:31.605+0000 7f38bb011640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f38b41583a0 0x7f38b40c8e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:31.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:31.605+0000 7f38bb011640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f38b40c5410 0x7f38b406b970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:31.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:31.605+0000 7f38bb011640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38b406c0b0 con 0x7f38b40ce360 2024-04-22T07:22:31.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:31.605+0000 7f38bb011640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f38b40ca1c0 con 0x7f38b41583a0 2024-04-22T07:22:31.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:31.605+0000 7f38bb011640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f38b40c9890 con 0x7f38b40c5410 2024-04-22T07:22:31.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:31.605+0000 7f38b8dad640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f38b41583a0 0x7f38b40c8e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:31.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:31.605+0000 7f38b95ae640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f38b40ce360 0x7f38b415af70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:60342/0 (socket says 172.21.15.37:60342) 2024-04-22T07:22:31.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:31.605+0000 7f38b95ae640 1 -- 172.21.15.37:0/1526304307 learned_addr learned my addr 172.21.15.37:0/1526304307 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-04-22T07:22:31.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:31.605+0000 7f38b8dad640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f38b41583a0 0x7f38b40c8e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36948/0 (socket says 172.21.15.37:36948) 2024-04-22T07:22:31.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:31.605+0000 7f38b3fff640 1 --2- 172.21.15.37:0/1526304307 >> v2:172.21.15.196:3300/0 conn(0x7f38b40c5410 0x7f38b406b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:31.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:31.605+0000 7f38b8dad640 1 -- 172.21.15.37:0/1526304307 >> v2:172.21.15.196:3300/0 conn(0x7f38b40c5410 msgr2=0x7f38b406b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:22:31.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:31.605+0000 7f38b8dad640 1 --2- 172.21.15.37:0/1526304307 >> v2:172.21.15.196:3300/0 conn(0x7f38b40c5410 0x7f38b406b970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:31.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:31.605+0000 7f38b8dad640 1 -- 172.21.15.37:0/1526304307 >> v1:172.21.15.37:6789/0 conn(0x7f38b40ce360 legacy=0x7f38b415af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:31.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:31.605+0000 7f38b37fe640 1 -- 172.21.15.37:0/1526304307 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2266129996 0 0) 0x7f38b406c0b0 con 0x7f38b40ce360 2024-04-22T07:22:31.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:31.605+0000 7f38b8dad640 1 -- 172.21.15.37:0/1526304307 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38b40c9b70 con 0x7f38b41583a0 2024-04-22T07:22:31.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:31.606+0000 7f38b8dad640 1 --2- 172.21.15.37:0/1526304307 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f38b41583a0 0x7f38b40c8e10 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f38b40c9350 tx=0x7f38ac02bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff7b699480b75a9f server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:22:31.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:31.606+0000 7f38b37fe640 1 -- 172.21.15.37:0/1526304307 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38ac039070 con 0x7f38b41583a0 2024-04-22T07:22:31.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:31.606+0000 7f38b37fe640 1 -- 172.21.15.37:0/1526304307 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38ac02cd00 con 0x7f38b41583a0 2024-04-22T07:22:31.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:31.606+0000 7f38b37fe640 1 -- 172.21.15.37:0/1526304307 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38ac034660 con 0x7f38b41583a0 2024-04-22T07:22:31.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:31.607+0000 7f38bb011640 1 -- 172.21.15.37:0/1526304307 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f38b41583a0 msgr2=0x7f38b40c8e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:31.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:31.607+0000 7f38bb011640 1 --2- 172.21.15.37:0/1526304307 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f38b41583a0 0x7f38b40c8e10 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f38b40c9350 tx=0x7f38ac02bf50 comp rx=0 tx=0).stop 2024-04-22T07:22:31.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:31.607+0000 7f38bb011640 1 -- 172.21.15.37:0/1526304307 shutdown_connections 2024-04-22T07:22:31.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:31.607+0000 7f38bb011640 1 --2- 172.21.15.37:0/1526304307 >> v2:172.21.15.196:3300/0 conn(0x7f38b40c5410 0x7f38b406b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:31.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:31.607+0000 7f38bb011640 1 --2- 172.21.15.37:0/1526304307 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f38b41583a0 0x7f38b40c8e10 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:31.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:31.607+0000 7f38bb011640 1 -- 172.21.15.37:0/1526304307 >> 172.21.15.37:0/1526304307 conn(0x7f38b406db80 msgr2=0x7f38b406df60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:22:31.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:31.607+0000 7f38bb011640 1 -- 172.21.15.37:0/1526304307 shutdown_connections 2024-04-22T07:22:31.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:31.607+0000 7f38bb011640 1 -- 172.21.15.37:0/1526304307 wait complete. 2024-04-22T07:22:31.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:31.608+0000 7f38bb011640 1 Processor -- start 2024-04-22T07:22:31.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:31.608+0000 7f38bb011640 1 -- start start 2024-04-22T07:22:31.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:31.609+0000 7f38bb011640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f38b40c5410 0x7f38b40c5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:31.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:31.609+0000 7f38bb011640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f38b40ce360 0x7f38b41f1220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:31.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:31.609+0000 7f38bb011640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f38b41583a0 0x7f38b41532e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:31.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:31.609+0000 7f38bb011640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f38b415b680 con 0x7f38b40ce360 2024-04-22T07:22:31.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:31.609+0000 7f38bb011640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f38b4158780 con 0x7f38b41583a0 2024-04-22T07:22:31.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:31.609+0000 7f38bb011640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f38b415b800 con 0x7f38b40c5410 2024-04-22T07:22:31.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:31.609+0000 7f38b3fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f38b40ce360 0x7f38b41f1220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:31.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:31.609+0000 7f38b3fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f38b40ce360 0x7f38b41f1220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36960/0 (socket says 172.21.15.37:36960) 2024-04-22T07:22:31.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:31.609+0000 7f38b3fff640 1 -- 172.21.15.37:0/3204869609 learned_addr learned my addr 172.21.15.37:0/3204869609 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:22:31.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:31.609+0000 7f38b8dad640 1 --2- 172.21.15.37:0/3204869609 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f38b40c5410 0x7f38b40c5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:31.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:31.609+0000 7f38b95ae640 1 --2- 172.21.15.37:0/3204869609 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f38b41583a0 0x7f38b41532e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:31.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:31.609+0000 7f38b3fff640 1 -- 172.21.15.37:0/3204869609 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f38b40c5410 msgr2=0x7f38b40c5810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:31.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:31.609+0000 7f38b3fff640 1 --2- 172.21.15.37:0/3204869609 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f38b40c5410 0x7f38b40c5810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:31.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:31.609+0000 7f38b3fff640 1 -- 172.21.15.37:0/3204869609 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f38b41583a0 msgr2=0x7f38b41532e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:31.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:31.609+0000 7f38b3fff640 1 --2- 172.21.15.37:0/3204869609 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f38b41583a0 0x7f38b41532e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:31.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:31.609+0000 7f38b3fff640 1 -- 172.21.15.37:0/3204869609 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38b415a5e0 con 0x7f38b40ce360 2024-04-22T07:22:31.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:31.609+0000 7f38b3fff640 1 --2- 172.21.15.37:0/3204869609 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f38b40ce360 0x7f38b41f1220 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f38a800d860 tx=0x7f38a800dd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:22:31.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:31.609+0000 7f38b17fa640 1 -- 172.21.15.37:0/3204869609 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38a800de50 con 0x7f38b40ce360 2024-04-22T07:22:31.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:31.609+0000 7f38b17fa640 1 -- 172.21.15.37:0/3204869609 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38a8019070 con 0x7f38b40ce360 2024-04-22T07:22:31.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:31.609+0000 7f38bb011640 1 -- 172.21.15.37:0/3204869609 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38b415a850 con 0x7f38b40ce360 2024-04-22T07:22:31.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:31.609+0000 7f38b17fa640 1 -- 172.21.15.37:0/3204869609 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38a800baf0 con 0x7f38b40ce360 2024-04-22T07:22:31.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:31.609+0000 7f38bb011640 1 -- 172.21.15.37:0/3204869609 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38b40c66c0 con 0x7f38b40ce360 2024-04-22T07:22:31.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:31.610+0000 7f38bb011640 1 -- 172.21.15.37:0/3204869609 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38b415bad0 con 0x7f38b40ce360 2024-04-22T07:22:31.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:31.611+0000 7f38b17fa640 1 -- 172.21.15.37:0/3204869609 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f38a800bc90 con 0x7f38b40ce360 2024-04-22T07:22:31.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:31.611+0000 7f38b17fa640 1 --2- 172.21.15.37:0/3204869609 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f38a006c8f0 0x7f38a006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:31.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:31.611+0000 7f38b17fa640 1 -- 172.21.15.37:0/3204869609 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f38a808c060 con 0x7f38b40ce360 2024-04-22T07:22:31.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:31.611+0000 7f38b8dad640 1 --2- 172.21.15.37:0/3204869609 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f38a006c8f0 0x7f38a006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:31.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:31.612+0000 7f38b8dad640 1 --2- 172.21.15.37:0/3204869609 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f38a006c8f0 0x7f38a006edb0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f38ac036000 tx=0x7f38ac030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:22:31.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:31.615+0000 7f38b17fa640 1 -- 172.21.15.37:0/3204869609 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f38b415bad0 con 0x7f38b40ce360 2024-04-22T07:22:31.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:31.800+0000 7f38bb011640 1 -- 172.21.15.37:0/3204869609 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f38b415bd80 con 0x7f38b40ce360 2024-04-22T07:22:31.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:31.801+0000 7f38b17fa640 1 -- 172.21.15.37:0/3204869609 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16775 (secure 0 0 0) 0x7f38b415bd80 con 0x7f38b40ce360 2024-04-22T07:22:31.799 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-22T07:22:31.799 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":22,"fsid":"10d90a41-52d3-4e09-8022-c8ac67897ad1","created":"2024-04-22T07:18:12.420756+0000","modified":"2024-04-22T07:19:17.871666+0000","last_up_change":"2024-04-22T07:18:23.649808+0000","last_in_change":"2024-04-22T07:18:14.506974+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-22T07:18:24.602243+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-22T07:18:34.673639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-22T07:18:35.055184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e248f6e1-13ad-48e0-a8f8-ec3059995654","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":1488290385},{"type":"v1","addr":"172.21.15.37:6801","nonce":1488290385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1488290385},{"type":"v1","addr":"172.21.15.37:6803","nonce":1488290385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1488290385},{"type":"v1","addr":"172.21.15.37:6807","nonce":1488290385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1488290385},{"type":"v1","addr":"172.21.15.37:6805","nonce":1488290385}]},"public_addr":"172.21.15.37:6801/1488290385","cluster_addr":"172.21.15.37:6803/1488290385","heartbeat_back_addr":"172.21.15.37:6807/1488290385","heartbeat_front_addr":"172.21.15.37:6805/1488290385","state":["exists","up"]},{"osd":1,"uuid":"01c71ab7-1326-432b-b73a-e5847abe5132","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3918584183},{"type":"v1","addr":"172.21.15.37:6811","nonce":3918584183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6813","nonce":3918584183},{"type":"v1","addr":"172.21.15.37:6816","nonce":3918584183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":3918584183},{"type":"v1","addr":"172.21.15.37:6823","nonce":3918584183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":3918584183},{"type":"v1","addr":"172.21.15.37:6821","nonce":3918584183}]},"public_addr":"172.21.15.37:6811/3918584183","cluster_addr":"172.21.15.37:6816/3918584183","heartbeat_back_addr":"172.21.15.37:6823/3918584183","heartbeat_front_addr":"172.21.15.37:6821/3918584183","state":["exists","up"]},{"osd":2,"uuid":"33a780fd-013a-41c8-9970-136c9e080897","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1895439419},{"type":"v1","addr":"172.21.15.37:6825","nonce":1895439419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1895439419},{"type":"v1","addr":"172.21.15.37:6827","nonce":1895439419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1895439419},{"type":"v1","addr":"172.21.15.37:6831","nonce":1895439419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1895439419},{"type":"v1","addr":"172.21.15.37:6829","nonce":1895439419}]},"public_addr":"172.21.15.37:6825/1895439419","cluster_addr":"172.21.15.37:6827/1895439419","heartbeat_back_addr":"172.21.15.37:6831/1895439419","heartbeat_front_addr":"172.21.15.37:6829/1895439419","state":["exists","up"]},{"osd":3,"uuid":"b46e53c4-e5b9-4098-b243-ab5a0f1f3885","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6809","nonce":1160021017},{"type":"v1","addr":"172.21.15.37:6810","nonce":1160021017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1160021017},{"type":"v1","addr":"172.21.15.37:6814","nonce":1160021017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":1160021017},{"type":"v1","addr":"172.21.15.37:6820","nonce":1160021017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6815","nonce":1160021017},{"type":"v1","addr":"172.21.15.37:6817","nonce":1160021017}]},"public_addr":"172.21.15.37:6810/1160021017","cluster_addr":"172.21.15.37:6814/1160021017","heartbeat_back_addr":"172.21.15.37:6820/1160021017","heartbeat_front_addr":"172.21.15.37:6817/1160021017","state":["exists","up"]},{"osd":4,"uuid":"cd1032c6-6a83-4e33-b7b1-baddf92a83af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":374829049},{"type":"v1","addr":"172.21.15.196:6809","nonce":374829049}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":374829049},{"type":"v1","addr":"172.21.15.196:6811","nonce":374829049}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":374829049},{"type":"v1","addr":"172.21.15.196:6815","nonce":374829049}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":374829049},{"type":"v1","addr":"172.21.15.196:6813","nonce":374829049}]},"public_addr":"172.21.15.196:6809/374829049","cluster_addr":"172.21.15.196:6811/374829049","heartbeat_back_addr":"172.21.15.196:6815/374829049","heartbeat_front_addr":"172.21.15.196:6813/374829049","state":["exists","up"]},{"osd":5,"uuid":"f561d48a-5f2d-4deb-8681-4329aed36bae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":479311302},{"type":"v1","addr":"172.21.15.196:6801","nonce":479311302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":479311302},{"type":"v1","addr":"172.21.15.196:6803","nonce":479311302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":479311302},{"type":"v1","addr":"172.21.15.196:6807","nonce":479311302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":479311302},{"type":"v1","addr":"172.21.15.196:6805","nonce":479311302}]},"public_addr":"172.21.15.196:6801/479311302","cluster_addr":"172.21.15.196:6803/479311302","heartbeat_back_addr":"172.21.15.196:6807/479311302","heartbeat_front_addr":"172.21.15.196:6805/479311302","state":["exists","up"]},{"osd":6,"uuid":"1b239c7e-2504-42e0-b308-70f4e62519c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6817","nonce":691777224},{"type":"v1","addr":"172.21.15.196:6819","nonce":691777224}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6821","nonce":691777224},{"type":"v1","addr":"172.21.15.196:6823","nonce":691777224}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6829","nonce":691777224},{"type":"v1","addr":"172.21.15.196:6831","nonce":691777224}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6825","nonce":691777224},{"type":"v1","addr":"172.21.15.196:6827","nonce":691777224}]},"public_addr":"172.21.15.196:6819/691777224","cluster_addr":"172.21.15.196:6823/691777224","heartbeat_back_addr":"172.21.15.196:6831/691777224","heartbeat_front_addr":"172.21.15.196:6827/691777224","state":["exists","up"]},{"osd":7,"uuid":"084318d4-d1fd-4b58-8c33-b1d7856fe323","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":3106266066},{"type":"v1","addr":"172.21.15.196:6818","nonce":3106266066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":3106266066},{"type":"v1","addr":"172.21.15.196:6822","nonce":3106266066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":3106266066},{"type":"v1","addr":"172.21.15.196:6830","nonce":3106266066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":3106266066},{"type":"v1","addr":"172.21.15.196:6826","nonce":3106266066}]},"public_addr":"172.21.15.196:6818/3106266066","cluster_addr":"172.21.15.196:6822/3106266066","heartbeat_back_addr":"172.21.15.196:6830/3106266066","heartbeat_front_addr":"172.21.15.196:6826/3106266066","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:18:19.587791+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:18:19.706541+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:18:19.690674+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:18:19.648354+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:18:19.666671+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:18:19.560709+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:18:19.661412+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:18:19.770650+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.13","mappings":[{"from":7,"to":2}]},{"pgid":"3.1e","mappings":[{"from":3,"to":1}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.3c","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-22T07:22:31.801 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:31.803+0000 7f38bb011640 1 -- 172.21.15.37:0/3204869609 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f38a006c8f0 msgr2=0x7f38a006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:31.801 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:31.803+0000 7f38bb011640 1 --2- 172.21.15.37:0/3204869609 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f38a006c8f0 0x7f38a006edb0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f38ac036000 tx=0x7f38ac030000 comp rx=0 tx=0).stop 2024-04-22T07:22:31.801 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:31.803+0000 7f38bb011640 1 -- 172.21.15.37:0/3204869609 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f38b40ce360 msgr2=0x7f38b41f1220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:31.801 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:31.803+0000 7f38bb011640 1 --2- 172.21.15.37:0/3204869609 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f38b40ce360 0x7f38b41f1220 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f38a800d860 tx=0x7f38a800dd20 comp rx=0 tx=0).stop 2024-04-22T07:22:31.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:31.803+0000 7f38bb011640 1 -- 172.21.15.37:0/3204869609 shutdown_connections 2024-04-22T07:22:31.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:31.803+0000 7f38bb011640 1 --2- 172.21.15.37:0/3204869609 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f38a006c8f0 0x7f38a006edb0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:31.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:31.803+0000 7f38bb011640 1 --2- 172.21.15.37:0/3204869609 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f38b41583a0 0x7f38b41532e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:31.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:31.803+0000 7f38bb011640 1 --2- 172.21.15.37:0/3204869609 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f38b40ce360 0x7f38b41f1220 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:31.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:31.803+0000 7f38bb011640 1 --2- 172.21.15.37:0/3204869609 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f38b40c5410 0x7f38b40c5810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:31.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:31.803+0000 7f38bb011640 1 -- 172.21.15.37:0/3204869609 >> 172.21.15.37:0/3204869609 conn(0x7f38b406db80 msgr2=0x7f38b406df60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:22:31.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:31.803+0000 7f38bb011640 1 -- 172.21.15.37:0/3204869609 shutdown_connections 2024-04-22T07:22:31.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:31.803+0000 7f38bb011640 1 -- 172.21.15.37:0/3204869609 wait complete. 2024-04-22T07:22:32.814 INFO:tasks.ceph:Scrubbing osd.0 2024-04-22T07:22:32.814 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-04-22T07:22:32.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:32.934+0000 7f2f169bd640 1 Processor -- start 2024-04-22T07:22:32.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:32.934+0000 7f2f169bd640 1 -- start start 2024-04-22T07:22:32.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:32.935+0000 7f2f169bd640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2f101583a0 0x7f2f100c8e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:32.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:32.935+0000 7f2f169bd640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f1006bde0 con 0x7f2f1006b970 2024-04-22T07:22:32.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:32.935+0000 7f2f169bd640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f1006c0b0 con 0x7f2f100c5410 2024-04-22T07:22:32.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:32.935+0000 7f2f169bd640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f2f100ca1c0 con 0x7f2f101583a0 2024-04-22T07:22:32.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:32.935+0000 7f2f14f5a640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f2f1006b970 0x7f2f1015af70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:60358/0 (socket says 172.21.15.37:60358) 2024-04-22T07:22:32.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:32.935+0000 7f2f14f5a640 1 -- 172.21.15.37:0/795656982 learned_addr learned my addr 172.21.15.37:0/795656982 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-04-22T07:22:32.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:32.935+0000 7f2f0ffff640 1 --2- 172.21.15.37:0/795656982 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2f101583a0 0x7f2f100c8e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:32.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:32.935+0000 7f2f0effd640 1 -- 172.21.15.37:0/795656982 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2545268240 0 0) 0x7f2f1006bde0 con 0x7f2f1006b970 2024-04-22T07:22:32.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:32.935+0000 7f2f0effd640 1 -- 172.21.15.37:0/795656982 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2ef8003520 con 0x7f2f1006b970 2024-04-22T07:22:32.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:32.936+0000 7f2f0effd640 1 -- 172.21.15.37:0/795656982 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2149460275 0 0) 0x7f2f1006c0b0 con 0x7f2f100c5410 2024-04-22T07:22:32.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:32.936+0000 7f2f0ffff640 1 -- 172.21.15.37:0/795656982 >> v1:172.21.15.196:6789/0 conn(0x7f2f100c5410 legacy=0x7f2f100ce360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:32.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:32.936+0000 7f2f0ffff640 1 -- 172.21.15.37:0/795656982 >> v1:172.21.15.37:6789/0 conn(0x7f2f1006b970 legacy=0x7f2f1015af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:32.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:32.936+0000 7f2f0ffff640 1 -- 172.21.15.37:0/795656982 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f100c9890 con 0x7f2f101583a0 2024-04-22T07:22:32.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:32.937+0000 7f2f0ffff640 1 --2- 172.21.15.37:0/795656982 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2f101583a0 0x7f2f100c8e10 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f2f040097d0 tx=0x7f2f0402b7b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a88c87a8220ce8a4 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:22:32.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:32.937+0000 7f2f0effd640 1 -- 172.21.15.37:0/795656982 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f04037070 con 0x7f2f101583a0 2024-04-22T07:22:32.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:32.937+0000 7f2f0effd640 1 -- 172.21.15.37:0/795656982 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f04030510 con 0x7f2f101583a0 2024-04-22T07:22:32.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:32.937+0000 7f2f0effd640 1 -- 172.21.15.37:0/795656982 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f080019f0 con 0x7f2f101583a0 2024-04-22T07:22:32.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:32.937+0000 7f2f169bd640 1 -- 172.21.15.37:0/795656982 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2f101583a0 msgr2=0x7f2f100c8e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:32.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:32.937+0000 7f2f169bd640 1 --2- 172.21.15.37:0/795656982 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2f101583a0 0x7f2f100c8e10 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f2f040097d0 tx=0x7f2f0402b7b0 comp rx=0 tx=0).stop 2024-04-22T07:22:32.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:32.937+0000 7f2f169bd640 1 -- 172.21.15.37:0/795656982 shutdown_connections 2024-04-22T07:22:32.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:32.937+0000 7f2f169bd640 1 --2- 172.21.15.37:0/795656982 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2f101583a0 0x7f2f100c8e10 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:32.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:32.937+0000 7f2f169bd640 1 -- 172.21.15.37:0/795656982 >> 172.21.15.37:0/795656982 conn(0x7f2f1006db80 msgr2=0x7f2f1006df60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:22:32.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:32.937+0000 7f2f169bd640 1 -- 172.21.15.37:0/795656982 shutdown_connections 2024-04-22T07:22:32.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:32.937+0000 7f2f169bd640 1 -- 172.21.15.37:0/795656982 wait complete. 2024-04-22T07:22:32.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:32.938+0000 7f2f169bd640 1 Processor -- start 2024-04-22T07:22:32.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:32.939+0000 7f2f169bd640 1 -- start start 2024-04-22T07:22:32.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:32.939+0000 7f2f169bd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2f1006b970 0x7f2f10154040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:32.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:32.939+0000 7f2f169bd640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2f100c5410 0x7f2f10152a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:32.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:32.939+0000 7f2f169bd640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2f101583a0 0x7f2f10152fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:32.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:32.939+0000 7f2f169bd640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f2f10158780 con 0x7f2f1006b970 2024-04-22T07:22:32.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:32.939+0000 7f2f169bd640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f2f100c9e50 con 0x7f2f101583a0 2024-04-22T07:22:32.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:32.939+0000 7f2f169bd640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f2f100cea70 con 0x7f2f100c5410 2024-04-22T07:22:32.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:32.940+0000 7f2f0ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2f1006b970 0x7f2f10154040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:32.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:32.940+0000 7f2f0ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2f1006b970 0x7f2f10154040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36968/0 (socket says 172.21.15.37:36968) 2024-04-22T07:22:32.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:32.940+0000 7f2f0ffff640 1 -- 172.21.15.37:0/3077212904 learned_addr learned my addr 172.21.15.37:0/3077212904 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:22:32.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:32.940+0000 7f2f0f7fe640 1 --2- 172.21.15.37:0/3077212904 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2f100c5410 0x7f2f10152a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:32.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:32.940+0000 7f2f14f5a640 1 --2- 172.21.15.37:0/3077212904 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2f101583a0 0x7f2f10152fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:32.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:32.940+0000 7f2f0ffff640 1 -- 172.21.15.37:0/3077212904 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2f100c5410 msgr2=0x7f2f10152a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:32.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:32.940+0000 7f2f0ffff640 1 --2- 172.21.15.37:0/3077212904 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2f100c5410 0x7f2f10152a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:32.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:32.940+0000 7f2f0ffff640 1 -- 172.21.15.37:0/3077212904 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2f101583a0 msgr2=0x7f2f10152fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:32.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:32.940+0000 7f2f0ffff640 1 --2- 172.21.15.37:0/3077212904 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2f101583a0 0x7f2f10152fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:32.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:32.940+0000 7f2f0ffff640 1 -- 172.21.15.37:0/3077212904 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f101519d0 con 0x7f2f1006b970 2024-04-22T07:22:32.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:32.940+0000 7f2f0ffff640 1 --2- 172.21.15.37:0/3077212904 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2f1006b970 0x7f2f10154040 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f2f0402b7f0 tx=0x7f2f040046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:22:32.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:32.940+0000 7f2f0cff9640 1 -- 172.21.15.37:0/3077212904 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f04042070 con 0x7f2f1006b970 2024-04-22T07:22:32.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:32.940+0000 7f2f0cff9640 1 -- 172.21.15.37:0/3077212904 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f0403d850 con 0x7f2f1006b970 2024-04-22T07:22:32.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:32.940+0000 7f2f0cff9640 1 -- 172.21.15.37:0/3077212904 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f04037040 con 0x7f2f1006b970 2024-04-22T07:22:32.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:32.940+0000 7f2f169bd640 1 -- 172.21.15.37:0/3077212904 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f10151cb0 con 0x7f2f1006b970 2024-04-22T07:22:32.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:32.940+0000 7f2f169bd640 1 -- 172.21.15.37:0/3077212904 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f10152270 con 0x7f2f1006b970 2024-04-22T07:22:32.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:32.941+0000 7f2f169bd640 1 -- 172.21.15.37:0/3077212904 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2f10069cc0 con 0x7f2f1006b970 2024-04-22T07:22:32.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:32.942+0000 7f2f0cff9640 1 -- 172.21.15.37:0/3077212904 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2f04045070 con 0x7f2f1006b970 2024-04-22T07:22:32.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:32.942+0000 7f2f0cff9640 1 --2- 172.21.15.37:0/3077212904 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f2efc06c8f0 0x7f2efc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:32.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:32.942+0000 7f2f0cff9640 1 -- 172.21.15.37:0/3077212904 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f2f040ad650 con 0x7f2f1006b970 2024-04-22T07:22:32.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:32.942+0000 7f2f0cff9640 1 --2- 172.21.15.37:0/3077212904 >> [v2:172.21.15.37:6800/1488290385,v1:172.21.15.37:6801/1488290385] conn(0x7f2efc074c70 0x7f2efc0770f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:32.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:32.942+0000 7f2f0cff9640 1 -- 172.21.15.37:0/3077212904 --> [v2:172.21.15.37:6800/1488290385,v1:172.21.15.37:6801/1488290385] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2f04034e90 con 0x7f2efc074c70 2024-04-22T07:22:32.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:32.942+0000 7f2f0cff9640 1 -- 172.21.15.37:0/3077212904 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f2f040b4050 con 0x7f2f1006b970 2024-04-22T07:22:32.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:32.943+0000 7f2f0f7fe640 1 --2- 172.21.15.37:0/3077212904 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f2efc06c8f0 0x7f2efc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:32.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:32.943+0000 7f2f14f5a640 1 --2- 172.21.15.37:0/3077212904 >> [v2:172.21.15.37:6800/1488290385,v1:172.21.15.37:6801/1488290385] conn(0x7f2efc074c70 0x7f2efc0770f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:32.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:32.943+0000 7f2f14f5a640 1 --2- 172.21.15.37:0/3077212904 >> [v2:172.21.15.37:6800/1488290385,v1:172.21.15.37:6801/1488290385] conn(0x7f2efc074c70 0x7f2efc0770f0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:22:32.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:32.943+0000 7f2f0f7fe640 1 --2- 172.21.15.37:0/3077212904 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f2efc06c8f0 0x7f2efc06edb0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f2f10158c40 tx=0x7f2f00009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:22:32.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:32.944+0000 7f2f0cff9640 1 -- 172.21.15.37:0/3077212904 <== osd.0 v2:172.21.15.37:6800/1488290385 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f2f04034e90 con 0x7f2efc074c70 2024-04-22T07:22:32.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:32.957+0000 7f2f169bd640 1 -- 172.21.15.37:0/3077212904 --> [v2:172.21.15.37:6800/1488290385,v1:172.21.15.37:6801/1488290385] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f2f10154960 con 0x7f2efc074c70 2024-04-22T07:22:32.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:32.957+0000 7f2f0cff9640 1 -- 172.21.15.37:0/3077212904 <== osd.0 v2:172.21.15.37:6800/1488290385 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f2f10154960 con 0x7f2efc074c70 2024-04-22T07:22:32.955 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-04-22T07:22:32.955 INFO:teuthology.orchestra.run.smithi037.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-22T07:22:32.955 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-04-22T07:22:32.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:32.958+0000 7f2f169bd640 1 -- 172.21.15.37:0/3077212904 >> [v2:172.21.15.37:6800/1488290385,v1:172.21.15.37:6801/1488290385] conn(0x7f2efc074c70 msgr2=0x7f2efc0770f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:32.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:32.958+0000 7f2f169bd640 1 --2- 172.21.15.37:0/3077212904 >> [v2:172.21.15.37:6800/1488290385,v1:172.21.15.37:6801/1488290385] conn(0x7f2efc074c70 0x7f2efc0770f0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:32.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:32.958+0000 7f2f169bd640 1 -- 172.21.15.37:0/3077212904 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f2efc06c8f0 msgr2=0x7f2efc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:32.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:32.958+0000 7f2f169bd640 1 --2- 172.21.15.37:0/3077212904 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f2efc06c8f0 0x7f2efc06edb0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f2f10158c40 tx=0x7f2f00009040 comp rx=0 tx=0).stop 2024-04-22T07:22:32.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:32.958+0000 7f2f169bd640 1 -- 172.21.15.37:0/3077212904 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2f1006b970 msgr2=0x7f2f10154040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:32.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:32.958+0000 7f2f169bd640 1 --2- 172.21.15.37:0/3077212904 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2f1006b970 0x7f2f10154040 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f2f0402b7f0 tx=0x7f2f040046c0 comp rx=0 tx=0).stop 2024-04-22T07:22:32.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:32.958+0000 7f2f14f5a640 1 -- 172.21.15.37:0/3077212904 reap_dead start 2024-04-22T07:22:32.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:32.958+0000 7f2f169bd640 1 -- 172.21.15.37:0/3077212904 shutdown_connections 2024-04-22T07:22:32.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:32.958+0000 7f2f169bd640 1 -- 172.21.15.37:0/3077212904 >> 172.21.15.37:0/3077212904 conn(0x7f2f1006db80 msgr2=0x7f2f101574b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:22:32.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:32.958+0000 7f2f169bd640 1 -- 172.21.15.37:0/3077212904 shutdown_connections 2024-04-22T07:22:32.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:32.958+0000 7f2f169bd640 1 -- 172.21.15.37:0/3077212904 wait complete. 2024-04-22T07:22:32.967 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-04-22T07:22:33.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.070+0000 7f4802322640 1 Processor -- start 2024-04-22T07:22:33.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.070+0000 7f4802322640 1 -- start start 2024-04-22T07:22:33.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.071+0000 7f4802322640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f47fc0ccd10 0x7f47fc0cd150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:33.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.071+0000 7f4802322640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47fc15f280 con 0x7f47fc1552f0 2024-04-22T07:22:33.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.071+0000 7f4802322640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47fc0cda00 con 0x7f47fc0b38f0 2024-04-22T07:22:33.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.071+0000 7f4802322640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f47fc0b3100 con 0x7f47fc0ccd10 2024-04-22T07:22:33.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.071+0000 7f47fbfff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f47fc1552f0 0x7f47fc0cb430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:60370/0 (socket says 172.21.15.37:60370) 2024-04-22T07:22:33.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.071+0000 7f47fbfff640 1 -- 172.21.15.37:0/3390555133 learned_addr learned my addr 172.21.15.37:0/3390555133 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-04-22T07:22:33.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.071+0000 7f48008bf640 1 --2- 172.21.15.37:0/3390555133 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f47fc0ccd10 0x7f47fc0cd150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:33.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.072+0000 7f47faffd640 1 -- 172.21.15.37:0/3390555133 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1445911412 0 0) 0x7f47fc15f280 con 0x7f47fc1552f0 2024-04-22T07:22:33.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.072+0000 7f47faffd640 1 -- 172.21.15.37:0/3390555133 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f47e4003520 con 0x7f47fc1552f0 2024-04-22T07:22:33.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.072+0000 7f48008bf640 1 -- 172.21.15.37:0/3390555133 >> v1:172.21.15.196:6789/0 conn(0x7f47fc0b38f0 legacy=0x7f47fc15aeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:33.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.072+0000 7f48008bf640 1 -- 172.21.15.37:0/3390555133 >> v1:172.21.15.37:6789/0 conn(0x7f47fc1552f0 legacy=0x7f47fc0cb430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:33.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.072+0000 7f48008bf640 1 -- 172.21.15.37:0/3390555133 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47fc0b3350 con 0x7f47fc0ccd10 2024-04-22T07:22:33.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.073+0000 7f48008bf640 1 --2- 172.21.15.37:0/3390555133 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f47fc0ccd10 0x7f47fc0cd150 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f47f4009dc0 tx=0x7f47f402bf20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9218795a412ec510 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:22:33.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.073+0000 7f47faffd640 1 -- 172.21.15.37:0/3390555133 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47f4039070 con 0x7f47fc0ccd10 2024-04-22T07:22:33.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.073+0000 7f47faffd640 1 -- 172.21.15.37:0/3390555133 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47f402ccd0 con 0x7f47fc0ccd10 2024-04-22T07:22:33.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.073+0000 7f47faffd640 1 -- 172.21.15.37:0/3390555133 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47f4034660 con 0x7f47fc0ccd10 2024-04-22T07:22:33.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.073+0000 7f4802322640 1 -- 172.21.15.37:0/3390555133 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f47fc0ccd10 msgr2=0x7f47fc0cd150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:33.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.073+0000 7f4802322640 1 --2- 172.21.15.37:0/3390555133 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f47fc0ccd10 0x7f47fc0cd150 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f47f4009dc0 tx=0x7f47f402bf20 comp rx=0 tx=0).stop 2024-04-22T07:22:33.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.073+0000 7f4802322640 1 -- 172.21.15.37:0/3390555133 shutdown_connections 2024-04-22T07:22:33.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.073+0000 7f4802322640 1 --2- 172.21.15.37:0/3390555133 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f47fc0ccd10 0x7f47fc0cd150 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:33.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.073+0000 7f4802322640 1 -- 172.21.15.37:0/3390555133 >> 172.21.15.37:0/3390555133 conn(0x7f47fc071f90 msgr2=0x7f47fc0723a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:22:33.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.073+0000 7f4802322640 1 -- 172.21.15.37:0/3390555133 shutdown_connections 2024-04-22T07:22:33.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.073+0000 7f4802322640 1 -- 172.21.15.37:0/3390555133 wait complete. 2024-04-22T07:22:33.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.074+0000 7f4802322640 1 Processor -- start 2024-04-22T07:22:33.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.075+0000 7f4802322640 1 -- start start 2024-04-22T07:22:33.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.075+0000 7f4802322640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f47fc0b38f0 0x7f47fc15b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:33.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.075+0000 7f4802322640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f47fc0ccd10 0x7f47fc1f21b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:33.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.075+0000 7f4802322640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47fc1552f0 0x7f47fc1f26f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:33.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.075+0000 7f4802322640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f47fc15e7a0 con 0x7f47fc1552f0 2024-04-22T07:22:33.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.075+0000 7f4802322640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f47fc15e4c0 con 0x7f47fc0b38f0 2024-04-22T07:22:33.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.075+0000 7f4802322640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f47fc15ea80 con 0x7f47fc0ccd10 2024-04-22T07:22:33.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.075+0000 7f48008bf640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47fc1552f0 0x7f47fc1f26f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:33.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.075+0000 7f48008bf640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47fc1552f0 0x7f47fc1f26f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36984/0 (socket says 172.21.15.37:36984) 2024-04-22T07:22:33.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.075+0000 7f48008bf640 1 -- 172.21.15.37:0/3485848870 learned_addr learned my addr 172.21.15.37:0/3485848870 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:22:33.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.076+0000 7f47fbfff640 1 --2- 172.21.15.37:0/3485848870 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f47fc0b38f0 0x7f47fc15b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:33.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.076+0000 7f47fb7fe640 1 --2- 172.21.15.37:0/3485848870 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f47fc0ccd10 0x7f47fc1f21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:33.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.076+0000 7f48008bf640 1 -- 172.21.15.37:0/3485848870 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f47fc0ccd10 msgr2=0x7f47fc1f21b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:33.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.076+0000 7f48008bf640 1 --2- 172.21.15.37:0/3485848870 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f47fc0ccd10 0x7f47fc1f21b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:33.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.076+0000 7f48008bf640 1 -- 172.21.15.37:0/3485848870 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f47fc0b38f0 msgr2=0x7f47fc15b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:33.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.076+0000 7f48008bf640 1 --2- 172.21.15.37:0/3485848870 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f47fc0b38f0 0x7f47fc15b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:33.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.076+0000 7f48008bf640 1 -- 172.21.15.37:0/3485848870 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47fc0d0320 con 0x7f47fc1552f0 2024-04-22T07:22:33.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.076+0000 7f47fbfff640 1 --2- 172.21.15.37:0/3485848870 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f47fc0b38f0 0x7f47fc15b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-22T07:22:33.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.076+0000 7f47fb7fe640 1 --2- 172.21.15.37:0/3485848870 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f47fc0ccd10 0x7f47fc1f21b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-22T07:22:33.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.076+0000 7f48008bf640 1 --2- 172.21.15.37:0/3485848870 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47fc1552f0 0x7f47fc1f26f0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f47f4037040 tx=0x7f47f4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:22:33.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.076+0000 7f47f8ff9640 1 -- 172.21.15.37:0/3485848870 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47f4039050 con 0x7f47fc1552f0 2024-04-22T07:22:33.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.076+0000 7f47f8ff9640 1 -- 172.21.15.37:0/3485848870 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47f4045070 con 0x7f47fc1552f0 2024-04-22T07:22:33.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.076+0000 7f4802322640 1 -- 172.21.15.37:0/3485848870 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47fc0d0600 con 0x7f47fc1552f0 2024-04-22T07:22:33.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.076+0000 7f47f8ff9640 1 -- 172.21.15.37:0/3485848870 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47f403e850 con 0x7f47fc1552f0 2024-04-22T07:22:33.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.076+0000 7f4802322640 1 -- 172.21.15.37:0/3485848870 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47fc0d0bc0 con 0x7f47fc1552f0 2024-04-22T07:22:33.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.077+0000 7f4802322640 1 -- 172.21.15.37:0/3485848870 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47fc069cc0 con 0x7f47fc1552f0 2024-04-22T07:22:33.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.077+0000 7f47f8ff9640 1 -- 172.21.15.37:0/3485848870 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f47f403e9f0 con 0x7f47fc1552f0 2024-04-22T07:22:33.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.078+0000 7f47f8ff9640 1 --2- 172.21.15.37:0/3485848870 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f47e806c8f0 0x7f47e806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:33.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.078+0000 7f47f8ff9640 1 -- 172.21.15.37:0/3485848870 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f47f40ae9c0 con 0x7f47fc1552f0 2024-04-22T07:22:33.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.078+0000 7f47fbfff640 1 --2- 172.21.15.37:0/3485848870 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f47e806c8f0 0x7f47e806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:33.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.079+0000 7f47fbfff640 1 --2- 172.21.15.37:0/3485848870 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f47e806c8f0 0x7f47e806edb0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f47ec005880 tx=0x7f47ec009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:22:33.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.082+0000 7f47f8ff9640 1 -- 172.21.15.37:0/3485848870 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f47f40b0e20 con 0x7f47fc1552f0 2024-04-22T07:22:33.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.266+0000 7f4802322640 1 -- 172.21.15.37:0/3485848870 --> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7f47fc0b5f60 con 0x7f47e806c8f0 2024-04-22T07:22:33.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.267+0000 7f47f8ff9640 1 -- 172.21.15.37:0/3485848870 <== mgr.4103 v2:172.21.15.196:6832/321987173 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f47fc0b5f60 con 0x7f47e806c8f0 2024-04-22T07:22:33.265 INFO:teuthology.orchestra.run.smithi037.stderr:instructed osd(s) 0 to deep-scrub 2024-04-22T07:22:33.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.269+0000 7f4802322640 1 -- 172.21.15.37:0/3485848870 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f47e806c8f0 msgr2=0x7f47e806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:33.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.269+0000 7f4802322640 1 --2- 172.21.15.37:0/3485848870 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f47e806c8f0 0x7f47e806edb0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f47ec005880 tx=0x7f47ec009040 comp rx=0 tx=0).stop 2024-04-22T07:22:33.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.269+0000 7f4802322640 1 -- 172.21.15.37:0/3485848870 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47fc1552f0 msgr2=0x7f47fc1f26f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:33.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.269+0000 7f4802322640 1 --2- 172.21.15.37:0/3485848870 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47fc1552f0 0x7f47fc1f26f0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f47f4037040 tx=0x7f47f4004a40 comp rx=0 tx=0).stop 2024-04-22T07:22:33.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.269+0000 7f4802322640 1 -- 172.21.15.37:0/3485848870 shutdown_connections 2024-04-22T07:22:33.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.269+0000 7f4802322640 1 --2- 172.21.15.37:0/3485848870 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f47e806c8f0 0x7f47e806edb0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:33.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.269+0000 7f4802322640 1 --2- 172.21.15.37:0/3485848870 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47fc1552f0 0x7f47fc1f26f0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:33.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.269+0000 7f4802322640 1 --2- 172.21.15.37:0/3485848870 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f47fc0ccd10 0x7f47fc1f21b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:33.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.269+0000 7f4802322640 1 --2- 172.21.15.37:0/3485848870 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f47fc0b38f0 0x7f47fc15b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:33.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.269+0000 7f4802322640 1 -- 172.21.15.37:0/3485848870 >> 172.21.15.37:0/3485848870 conn(0x7f47fc071f90 msgr2=0x7f47fc152fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:22:33.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.269+0000 7f4802322640 1 -- 172.21.15.37:0/3485848870 shutdown_connections 2024-04-22T07:22:33.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.269+0000 7f4802322640 1 -- 172.21.15.37:0/3485848870 wait complete. 2024-04-22T07:22:33.278 INFO:tasks.ceph:Scrubbing osd.1 2024-04-22T07:22:33.278 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-04-22T07:22:33.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.385+0000 7ff75b2a5640 1 Processor -- start 2024-04-22T07:22:33.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.385+0000 7ff75b2a5640 1 -- start start 2024-04-22T07:22:33.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.386+0000 7ff75b2a5640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff7540cb360 0x7ff7540c5550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:33.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.386+0000 7ff75b2a5640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7ff7540d0570 0x7ff7540d09c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:33.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.386+0000 7ff75b2a5640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff754155580 con 0x7ff7541551a0 2024-04-22T07:22:33.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.386+0000 7ff75b2a5640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7ff7540ccad0 con 0x7ff7540cb360 2024-04-22T07:22:33.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.386+0000 7ff75b2a5640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7ff75415e490 con 0x7ff7540d0570 2024-04-22T07:22:33.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.386+0000 7ff758840640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff7540cb360 0x7ff7540c5550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:33.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.386+0000 7ff758840640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff7540cb360 0x7ff7540c5550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37000/0 (socket says 172.21.15.37:37000) 2024-04-22T07:22:33.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.386+0000 7ff758840640 1 -- 172.21.15.37:0/747751497 learned_addr learned my addr 172.21.15.37:0/747751497 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:22:33.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.386+0000 7ff759842640 1 --2- 172.21.15.37:0/747751497 >> v2:172.21.15.196:3300/0 conn(0x7ff7540d0570 0x7ff7540d09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:33.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.386+0000 7ff758840640 1 -- 172.21.15.37:0/747751497 >> v2:172.21.15.196:3300/0 conn(0x7ff7540d0570 msgr2=0x7ff7540d09c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:22:33.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.386+0000 7ff758840640 1 --2- 172.21.15.37:0/747751497 >> v2:172.21.15.196:3300/0 conn(0x7ff7540d0570 0x7ff7540d09c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:33.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.386+0000 7ff758840640 1 -- 172.21.15.37:0/747751497 >> v1:172.21.15.196:6789/0 conn(0x7ff7541551a0 legacy=0x7ff75415b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:22:33.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.386+0000 7ff758840640 1 -- 172.21.15.37:0/747751497 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff75415e770 con 0x7ff7540cb360 2024-04-22T07:22:33.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.387+0000 7ff758840640 1 --2- 172.21.15.37:0/747751497 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff7540cb360 0x7ff7540c5550 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7ff7540b3380 tx=0x7ff74802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50e5cfa67bb19335 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:22:33.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.387+0000 7ff753fff640 1 -- 172.21.15.37:0/747751497 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff748034070 con 0x7ff7540cb360 2024-04-22T07:22:33.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.387+0000 7ff753fff640 1 -- 172.21.15.37:0/747751497 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff748030860 con 0x7ff7540cb360 2024-04-22T07:22:33.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.387+0000 7ff753fff640 1 -- 172.21.15.37:0/747751497 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff748030c30 con 0x7ff7540cb360 2024-04-22T07:22:33.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.388+0000 7ff75b2a5640 1 -- 172.21.15.37:0/747751497 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff7540cb360 msgr2=0x7ff7540c5550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:33.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.388+0000 7ff75b2a5640 1 --2- 172.21.15.37:0/747751497 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff7540cb360 0x7ff7540c5550 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7ff7540b3380 tx=0x7ff74802b9a0 comp rx=0 tx=0).stop 2024-04-22T07:22:33.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.388+0000 7ff75b2a5640 1 -- 172.21.15.37:0/747751497 shutdown_connections 2024-04-22T07:22:33.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.388+0000 7ff75b2a5640 1 --2- 172.21.15.37:0/747751497 >> v2:172.21.15.196:3300/0 conn(0x7ff7540d0570 0x7ff7540d09c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:33.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.388+0000 7ff75b2a5640 1 --2- 172.21.15.37:0/747751497 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff7540cb360 0x7ff7540c5550 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:33.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.388+0000 7ff75b2a5640 1 -- 172.21.15.37:0/747751497 >> 172.21.15.37:0/747751497 conn(0x7ff754067890 msgr2=0x7ff754073490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:22:33.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.388+0000 7ff75b2a5640 1 -- 172.21.15.37:0/747751497 shutdown_connections 2024-04-22T07:22:33.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.388+0000 7ff75b2a5640 1 -- 172.21.15.37:0/747751497 wait complete. 2024-04-22T07:22:33.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.389+0000 7ff75b2a5640 1 Processor -- start 2024-04-22T07:22:33.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.389+0000 7ff75b2a5640 1 -- start start 2024-04-22T07:22:33.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.390+0000 7ff75b2a5640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff7540cb360 0x7ff7541e41d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:33.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.390+0000 7ff75b2a5640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff7540d0570 0x7ff75415a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:33.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.390+0000 7ff75b2a5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff7541551a0 0x7ff75415a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:33.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.390+0000 7ff75b2a5640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff7540cddc0 con 0x7ff7541551a0 2024-04-22T07:22:33.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.390+0000 7ff75b2a5640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7ff75415ed30 con 0x7ff7540d0570 2024-04-22T07:22:33.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.390+0000 7ff75b2a5640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7ff75415f250 con 0x7ff7540cb360 2024-04-22T07:22:33.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.390+0000 7ff759842640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff7541551a0 0x7ff75415a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:33.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.390+0000 7ff759842640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff7541551a0 0x7ff75415a700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37008/0 (socket says 172.21.15.37:37008) 2024-04-22T07:22:33.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.390+0000 7ff759842640 1 -- 172.21.15.37:0/281106724 learned_addr learned my addr 172.21.15.37:0/281106724 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:22:33.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.390+0000 7ff758840640 1 --2- 172.21.15.37:0/281106724 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff7540d0570 0x7ff75415a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:33.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.390+0000 7ff759041640 1 --2- 172.21.15.37:0/281106724 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff7540cb360 0x7ff7541e41d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:33.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.390+0000 7ff759842640 1 -- 172.21.15.37:0/281106724 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff7540cb360 msgr2=0x7ff7541e41d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:33.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.390+0000 7ff759842640 1 --2- 172.21.15.37:0/281106724 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff7540cb360 0x7ff7541e41d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:33.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.390+0000 7ff759842640 1 -- 172.21.15.37:0/281106724 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff7540d0570 msgr2=0x7ff75415a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:33.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.390+0000 7ff759842640 1 --2- 172.21.15.37:0/281106724 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff7540d0570 0x7ff75415a1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:33.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.390+0000 7ff759842640 1 -- 172.21.15.37:0/281106724 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff754152bd0 con 0x7ff7541551a0 2024-04-22T07:22:33.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.390+0000 7ff759041640 1 --2- 172.21.15.37:0/281106724 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff7540cb360 0x7ff7541e41d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T07:22:33.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.390+0000 7ff759842640 1 --2- 172.21.15.37:0/281106724 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff7541551a0 0x7ff75415a700 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7ff744007e70 tx=0x7ff74400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:22:33.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.391+0000 7ff751ffb640 1 -- 172.21.15.37:0/281106724 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff744014620 con 0x7ff7541551a0 2024-04-22T07:22:33.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.391+0000 7ff751ffb640 1 -- 172.21.15.37:0/281106724 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff744019070 con 0x7ff7541551a0 2024-04-22T07:22:33.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.391+0000 7ff75b2a5640 1 -- 172.21.15.37:0/281106724 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff754152eb0 con 0x7ff7541551a0 2024-04-22T07:22:33.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.391+0000 7ff751ffb640 1 -- 172.21.15.37:0/281106724 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff744014a20 con 0x7ff7541551a0 2024-04-22T07:22:33.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.391+0000 7ff75b2a5640 1 -- 172.21.15.37:0/281106724 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7540b62c0 con 0x7ff7541551a0 2024-04-22T07:22:33.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.392+0000 7ff75b2a5640 1 -- 172.21.15.37:0/281106724 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff754069cc0 con 0x7ff7541551a0 2024-04-22T07:22:33.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.392+0000 7ff751ffb640 1 -- 172.21.15.37:0/281106724 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff744014bc0 con 0x7ff7541551a0 2024-04-22T07:22:33.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.393+0000 7ff751ffb640 1 --2- 172.21.15.37:0/281106724 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7ff74006c8f0 0x7ff74006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:33.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.393+0000 7ff751ffb640 1 -- 172.21.15.37:0/281106724 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7ff74408c500 con 0x7ff7541551a0 2024-04-22T07:22:33.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.393+0000 7ff751ffb640 1 --2- 172.21.15.37:0/281106724 >> [v2:172.21.15.37:6808/3918584183,v1:172.21.15.37:6811/3918584183] conn(0x7ff740074c10 0x7ff740077090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:33.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.393+0000 7ff751ffb640 1 -- 172.21.15.37:0/281106724 --> [v2:172.21.15.37:6808/3918584183,v1:172.21.15.37:6811/3918584183] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff74400ce50 con 0x7ff740074c10 2024-04-22T07:22:33.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.393+0000 7ff751ffb640 1 -- 172.21.15.37:0/281106724 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7ff744093050 con 0x7ff7541551a0 2024-04-22T07:22:33.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.393+0000 7ff759041640 1 --2- 172.21.15.37:0/281106724 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7ff74006c8f0 0x7ff74006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:33.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.393+0000 7ff758840640 1 --2- 172.21.15.37:0/281106724 >> [v2:172.21.15.37:6808/3918584183,v1:172.21.15.37:6811/3918584183] conn(0x7ff740074c10 0x7ff740077090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:33.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.393+0000 7ff758840640 1 --2- 172.21.15.37:0/281106724 >> [v2:172.21.15.37:6808/3918584183,v1:172.21.15.37:6811/3918584183] conn(0x7ff740074c10 0x7ff740077090 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:22:33.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.393+0000 7ff759041640 1 --2- 172.21.15.37:0/281106724 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7ff74006c8f0 0x7ff74006edb0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7ff74c003eb0 tx=0x7ff74c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:22:33.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.394+0000 7ff751ffb640 1 -- 172.21.15.37:0/281106724 <== osd.1 v2:172.21.15.37:6808/3918584183 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff74400ce50 con 0x7ff740074c10 2024-04-22T07:22:33.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.407+0000 7ff75b2a5640 1 -- 172.21.15.37:0/281106724 --> [v2:172.21.15.37:6808/3918584183,v1:172.21.15.37:6811/3918584183] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7ff7540cb830 con 0x7ff740074c10 2024-04-22T07:22:33.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.407+0000 7ff751ffb640 1 -- 172.21.15.37:0/281106724 <== osd.1 v2:172.21.15.37:6808/3918584183 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7ff7540cb830 con 0x7ff740074c10 2024-04-22T07:22:33.405 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-04-22T07:22:33.405 INFO:teuthology.orchestra.run.smithi037.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-22T07:22:33.405 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-04-22T07:22:33.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.407+0000 7ff75b2a5640 1 -- 172.21.15.37:0/281106724 >> [v2:172.21.15.37:6808/3918584183,v1:172.21.15.37:6811/3918584183] conn(0x7ff740074c10 msgr2=0x7ff740077090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:33.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.407+0000 7ff75b2a5640 1 --2- 172.21.15.37:0/281106724 >> [v2:172.21.15.37:6808/3918584183,v1:172.21.15.37:6811/3918584183] conn(0x7ff740074c10 0x7ff740077090 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:33.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.408+0000 7ff75b2a5640 1 -- 172.21.15.37:0/281106724 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7ff74006c8f0 msgr2=0x7ff74006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:33.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.408+0000 7ff75b2a5640 1 --2- 172.21.15.37:0/281106724 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7ff74006c8f0 0x7ff74006edb0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7ff74c003eb0 tx=0x7ff74c009040 comp rx=0 tx=0).stop 2024-04-22T07:22:33.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.408+0000 7ff75b2a5640 1 -- 172.21.15.37:0/281106724 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff7541551a0 msgr2=0x7ff75415a700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:33.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.408+0000 7ff75b2a5640 1 --2- 172.21.15.37:0/281106724 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff7541551a0 0x7ff75415a700 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7ff744007e70 tx=0x7ff74400e4b0 comp rx=0 tx=0).stop 2024-04-22T07:22:33.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.408+0000 7ff759842640 1 -- 172.21.15.37:0/281106724 reap_dead start 2024-04-22T07:22:33.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.408+0000 7ff75b2a5640 1 -- 172.21.15.37:0/281106724 shutdown_connections 2024-04-22T07:22:33.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.408+0000 7ff75b2a5640 1 -- 172.21.15.37:0/281106724 >> 172.21.15.37:0/281106724 conn(0x7ff754067890 msgr2=0x7ff754158c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:22:33.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.408+0000 7ff75b2a5640 1 -- 172.21.15.37:0/281106724 shutdown_connections 2024-04-22T07:22:33.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.408+0000 7ff75b2a5640 1 -- 172.21.15.37:0/281106724 wait complete. 2024-04-22T07:22:33.416 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-04-22T07:22:33.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.519+0000 7f0aa377e640 1 Processor -- start 2024-04-22T07:22:33.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.519+0000 7f0aa377e640 1 -- start start 2024-04-22T07:22:33.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.520+0000 7f0aa377e640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f0a9c0b4140 0x7f0a9c15b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:33.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.520+0000 7f0aa377e640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0a9c06b970 0x7f0a9c0c3e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:33.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.520+0000 7f0aa377e640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a9c15be00 con 0x7f0a9c0c4360 2024-04-22T07:22:33.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.520+0000 7f0aa377e640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f0a9c070370 con 0x7f0a9c0b4140 2024-04-22T07:22:33.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.520+0000 7f0aa377e640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f0a9c070800 con 0x7f0a9c06b970 2024-04-22T07:22:33.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.521+0000 7f0aa0d19640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0a9c06b970 0x7f0a9c0c3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:33.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.521+0000 7f0aa151a640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f0a9c0b4140 0x7f0a9c15b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:33.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.521+0000 7f0aa0d19640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0a9c06b970 0x7f0a9c0c3e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.37:51922/0 (socket says 172.21.15.37:51922) 2024-04-22T07:22:33.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.521+0000 7f0aa151a640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f0a9c0b4140 0x7f0a9c15b8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.37:48890/0 (socket says 172.21.15.37:48890) 2024-04-22T07:22:33.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.521+0000 7f0aa1d1b640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7f0a9c0c4360 0x7f0a9c06c350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.37:38040/0 (socket says 172.21.15.37:38040) 2024-04-22T07:22:33.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.521+0000 7f0aa0d19640 1 -- 172.21.15.37:0/1585298650 learned_addr learned my addr 172.21.15.37:0/1585298650 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:22:33.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.521+0000 7f0aa0d19640 1 -- 172.21.15.37:0/1585298650 >> v2:172.21.15.196:3300/0 conn(0x7f0a9c0b4140 msgr2=0x7f0a9c15b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:22:33.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.521+0000 7f0aa0d19640 1 --2- 172.21.15.37:0/1585298650 >> v2:172.21.15.196:3300/0 conn(0x7f0a9c0b4140 0x7f0a9c15b8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:33.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.521+0000 7f0aa0d19640 1 -- 172.21.15.37:0/1585298650 >> v1:172.21.15.196:6789/0 conn(0x7f0a9c0c4360 legacy=0x7f0a9c06c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:33.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.521+0000 7f0aa0d19640 1 -- 172.21.15.37:0/1585298650 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a9c0c92c0 con 0x7f0a9c06b970 2024-04-22T07:22:33.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.521+0000 7f0aa151a640 1 --2- 172.21.15.37:0/1585298650 >> v2:172.21.15.196:3300/0 conn(0x7f0a9c0b4140 0x7f0a9c15b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-22T07:22:33.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.522+0000 7f0aa0d19640 1 --2- 172.21.15.37:0/1585298650 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0a9c06b970 0x7f0a9c0c3e20 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f0a90009870 tx=0x7f0a9002ba10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ac9b424d57d19125 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:22:33.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.522+0000 7f0a9bfff640 1 -- 172.21.15.37:0/1585298650 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a9002f830 con 0x7f0a9c06b970 2024-04-22T07:22:33.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.522+0000 7f0a9bfff640 1 -- 172.21.15.37:0/1585298650 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a9002f9d0 con 0x7f0a9c06b970 2024-04-22T07:22:33.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.522+0000 7f0a9bfff640 1 -- 172.21.15.37:0/1585298650 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a9002fda0 con 0x7f0a9c06b970 2024-04-22T07:22:33.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.522+0000 7f0aa377e640 1 -- 172.21.15.37:0/1585298650 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0a9c06b970 msgr2=0x7f0a9c0c3e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:33.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.522+0000 7f0aa377e640 1 --2- 172.21.15.37:0/1585298650 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0a9c06b970 0x7f0a9c0c3e20 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f0a90009870 tx=0x7f0a9002ba10 comp rx=0 tx=0).stop 2024-04-22T07:22:33.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.522+0000 7f0aa377e640 1 -- 172.21.15.37:0/1585298650 shutdown_connections 2024-04-22T07:22:33.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.522+0000 7f0aa377e640 1 --2- 172.21.15.37:0/1585298650 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0a9c06b970 0x7f0a9c0c3e20 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:33.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.522+0000 7f0aa377e640 1 --2- 172.21.15.37:0/1585298650 >> v2:172.21.15.196:3300/0 conn(0x7f0a9c0b4140 0x7f0a9c15b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:33.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.522+0000 7f0aa377e640 1 -- 172.21.15.37:0/1585298650 >> 172.21.15.37:0/1585298650 conn(0x7f0a9c06e370 msgr2=0x7f0a9c071540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:22:33.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.522+0000 7f0aa377e640 1 -- 172.21.15.37:0/1585298650 shutdown_connections 2024-04-22T07:22:33.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.522+0000 7f0aa377e640 1 -- 172.21.15.37:0/1585298650 wait complete. 2024-04-22T07:22:33.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.524+0000 7f0aa377e640 1 Processor -- start 2024-04-22T07:22:33.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.524+0000 7f0aa377e640 1 -- start start 2024-04-22T07:22:33.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.524+0000 7f0aa377e640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0a9c06b970 0x7f0a9c1556a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:33.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.524+0000 7f0aa377e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a9c0b4140 0x7f0a9c15ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:33.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.524+0000 7f0aa377e640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0a9c0c4360 0x7f0a9c1f4300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:33.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.524+0000 7f0aa377e640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0a9c070000 con 0x7f0a9c0b4140 2024-04-22T07:22:33.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.524+0000 7f0aa377e640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f0a9c06fd20 con 0x7f0a9c06b970 2024-04-22T07:22:33.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.524+0000 7f0aa377e640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f0a9c0b4520 con 0x7f0a9c0c4360 2024-04-22T07:22:33.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.524+0000 7f0aa0d19640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a9c0b4140 0x7f0a9c15ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:33.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.524+0000 7f0aa0d19640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a9c0b4140 0x7f0a9c15ab50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37022/0 (socket says 172.21.15.37:37022) 2024-04-22T07:22:33.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.524+0000 7f0aa0d19640 1 -- 172.21.15.37:0/1353186792 learned_addr learned my addr 172.21.15.37:0/1353186792 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:22:33.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.525+0000 7f0aa1d1b640 1 --2- 172.21.15.37:0/1353186792 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0a9c0c4360 0x7f0a9c1f4300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:33.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.525+0000 7f0aa151a640 1 --2- 172.21.15.37:0/1353186792 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0a9c06b970 0x7f0a9c1556a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:33.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.525+0000 7f0aa0d19640 1 -- 172.21.15.37:0/1353186792 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0a9c0c4360 msgr2=0x7f0a9c1f4300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:33.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.525+0000 7f0aa0d19640 1 --2- 172.21.15.37:0/1353186792 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0a9c0c4360 0x7f0a9c1f4300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:33.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.525+0000 7f0aa0d19640 1 -- 172.21.15.37:0/1353186792 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0a9c06b970 msgr2=0x7f0a9c1556a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:33.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.525+0000 7f0aa0d19640 1 --2- 172.21.15.37:0/1353186792 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0a9c06b970 0x7f0a9c1556a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:33.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.525+0000 7f0aa0d19640 1 -- 172.21.15.37:0/1353186792 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a9c155f30 con 0x7f0a9c0b4140 2024-04-22T07:22:33.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.525+0000 7f0aa0d19640 1 --2- 172.21.15.37:0/1353186792 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a9c0b4140 0x7f0a9c15ab50 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f0a9002ba50 tx=0x7f0a90004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:22:33.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.525+0000 7f0a99ffb640 1 -- 172.21.15.37:0/1353186792 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a90047070 con 0x7f0a9c0b4140 2024-04-22T07:22:33.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.525+0000 7f0a99ffb640 1 -- 172.21.15.37:0/1353186792 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a90037c40 con 0x7f0a9c0b4140 2024-04-22T07:22:33.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.525+0000 7f0aa377e640 1 -- 172.21.15.37:0/1353186792 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a9c14c270 con 0x7f0a9c0b4140 2024-04-22T07:22:33.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.525+0000 7f0a99ffb640 1 -- 172.21.15.37:0/1353186792 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a90042480 con 0x7f0a9c0b4140 2024-04-22T07:22:33.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.525+0000 7f0aa377e640 1 -- 172.21.15.37:0/1353186792 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a9c14c830 con 0x7f0a9c0b4140 2024-04-22T07:22:33.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.526+0000 7f0aa377e640 1 -- 172.21.15.37:0/1353186792 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a9c068b20 con 0x7f0a9c0b4140 2024-04-22T07:22:33.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.527+0000 7f0a99ffb640 1 -- 172.21.15.37:0/1353186792 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0a9002d3c0 con 0x7f0a9c0b4140 2024-04-22T07:22:33.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.527+0000 7f0a99ffb640 1 --2- 172.21.15.37:0/1353186792 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f0a8806c8f0 0x7f0a8806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:33.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.527+0000 7f0a99ffb640 1 -- 172.21.15.37:0/1353186792 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f0a900ade50 con 0x7f0a9c0b4140 2024-04-22T07:22:33.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.528+0000 7f0aa151a640 1 --2- 172.21.15.37:0/1353186792 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f0a8806c8f0 0x7f0a8806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:33.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.528+0000 7f0aa151a640 1 --2- 172.21.15.37:0/1353186792 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f0a8806c8f0 0x7f0a8806edb0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f0a8c009bd0 tx=0x7f0a8c00b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:22:33.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.532+0000 7f0a99ffb640 1 -- 172.21.15.37:0/1353186792 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f0a90033030 con 0x7f0a9c0b4140 2024-04-22T07:22:33.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.721+0000 7f0aa377e640 1 -- 172.21.15.37:0/1353186792 --> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f0a9c0c9710 con 0x7f0a8806c8f0 2024-04-22T07:22:33.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.721+0000 7f0a99ffb640 1 -- 172.21.15.37:0/1353186792 <== mgr.4103 v2:172.21.15.196:6832/321987173 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f0a9c0c9710 con 0x7f0a8806c8f0 2024-04-22T07:22:33.719 INFO:teuthology.orchestra.run.smithi037.stderr:instructed osd(s) 1 to deep-scrub 2024-04-22T07:22:33.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.724+0000 7f0aa377e640 1 -- 172.21.15.37:0/1353186792 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f0a8806c8f0 msgr2=0x7f0a8806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:33.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.724+0000 7f0aa377e640 1 --2- 172.21.15.37:0/1353186792 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f0a8806c8f0 0x7f0a8806edb0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f0a8c009bd0 tx=0x7f0a8c00b040 comp rx=0 tx=0).stop 2024-04-22T07:22:33.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.724+0000 7f0aa377e640 1 -- 172.21.15.37:0/1353186792 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a9c0b4140 msgr2=0x7f0a9c15ab50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:33.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.724+0000 7f0aa377e640 1 --2- 172.21.15.37:0/1353186792 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a9c0b4140 0x7f0a9c15ab50 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f0a9002ba50 tx=0x7f0a90004730 comp rx=0 tx=0).stop 2024-04-22T07:22:33.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.724+0000 7f0aa377e640 1 -- 172.21.15.37:0/1353186792 shutdown_connections 2024-04-22T07:22:33.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.724+0000 7f0aa377e640 1 --2- 172.21.15.37:0/1353186792 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f0a8806c8f0 0x7f0a8806edb0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:33.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.724+0000 7f0aa377e640 1 --2- 172.21.15.37:0/1353186792 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0a9c0c4360 0x7f0a9c1f4300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:33.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.724+0000 7f0aa377e640 1 --2- 172.21.15.37:0/1353186792 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a9c0b4140 0x7f0a9c15ab50 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:33.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.724+0000 7f0aa377e640 1 --2- 172.21.15.37:0/1353186792 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0a9c06b970 0x7f0a9c1556a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:33.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.724+0000 7f0aa377e640 1 -- 172.21.15.37:0/1353186792 >> 172.21.15.37:0/1353186792 conn(0x7f0a9c06e370 msgr2=0x7f0a9c0cdba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:22:33.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.724+0000 7f0aa377e640 1 -- 172.21.15.37:0/1353186792 shutdown_connections 2024-04-22T07:22:33.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.724+0000 7f0aa377e640 1 -- 172.21.15.37:0/1353186792 wait complete. 2024-04-22T07:22:33.732 INFO:tasks.ceph:Scrubbing osd.2 2024-04-22T07:22:33.732 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-04-22T07:22:33.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.839+0000 7f175da88640 1 Processor -- start 2024-04-22T07:22:33.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.839+0000 7f175da88640 1 -- start start 2024-04-22T07:22:33.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.840+0000 7f175da88640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1758152f10 0x7f17580c8f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:33.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.840+0000 7f175da88640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f17580ca940 0x7f17580c9e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:33.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.840+0000 7f175da88640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f17580c9620 con 0x7f17580ca3b0 2024-04-22T07:22:33.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.840+0000 7f175da88640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f17580c99e0 con 0x7f17580ca940 2024-04-22T07:22:33.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.840+0000 7f175da88640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f17580c35b0 con 0x7f1758152f10 2024-04-22T07:22:33.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.840+0000 7f1756ffd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f17580ca940 0x7f17580c9e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:33.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.840+0000 7f1757fff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f17580ca3b0 0x7f175806f570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:60384/0 (socket says 172.21.15.37:60384) 2024-04-22T07:22:33.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.840+0000 7f1756ffd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f17580ca940 0x7f17580c9e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37024/0 (socket says 172.21.15.37:37024) 2024-04-22T07:22:33.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.840+0000 7f1757fff640 1 -- 172.21.15.37:0/2465139272 learned_addr learned my addr 172.21.15.37:0/2465139272 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-04-22T07:22:33.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.841+0000 7f17577fe640 1 --2- 172.21.15.37:0/2465139272 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1758152f10 0x7f17580c8f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:33.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.841+0000 7f1756ffd640 1 -- 172.21.15.37:0/2465139272 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1758152f10 msgr2=0x7f17580c8f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:22:33.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.841+0000 7f1756ffd640 1 --2- 172.21.15.37:0/2465139272 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1758152f10 0x7f17580c8f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:33.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.841+0000 7f1756ffd640 1 -- 172.21.15.37:0/2465139272 >> v1:172.21.15.37:6789/0 conn(0x7f17580ca3b0 legacy=0x7f175806f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:33.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.841+0000 7f17567fc640 1 -- 172.21.15.37:0/2465139272 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 306287464 0 0) 0x7f17580c9620 con 0x7f17580ca3b0 2024-04-22T07:22:33.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.841+0000 7f1756ffd640 1 -- 172.21.15.37:0/2465139272 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17580c3890 con 0x7f17580ca940 2024-04-22T07:22:33.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.841+0000 7f1756ffd640 1 --2- 172.21.15.37:0/2465139272 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f17580ca940 0x7f17580c9e70 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f17580c9b60 tx=0x7f174c02b930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83e454a377527498 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:22:33.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.842+0000 7f17567fc640 1 -- 172.21.15.37:0/2465139272 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f174c035020 con 0x7f17580ca940 2024-04-22T07:22:33.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.842+0000 7f17567fc640 1 -- 172.21.15.37:0/2465139272 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f174c031890 con 0x7f17580ca940 2024-04-22T07:22:33.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.842+0000 7f17567fc640 1 -- 172.21.15.37:0/2465139272 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f174c031c60 con 0x7f17580ca940 2024-04-22T07:22:33.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.842+0000 7f175da88640 1 -- 172.21.15.37:0/2465139272 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f17580ca940 msgr2=0x7f17580c9e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:33.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.842+0000 7f175da88640 1 --2- 172.21.15.37:0/2465139272 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f17580ca940 0x7f17580c9e70 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f17580c9b60 tx=0x7f174c02b930 comp rx=0 tx=0).stop 2024-04-22T07:22:33.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.842+0000 7f175da88640 1 -- 172.21.15.37:0/2465139272 shutdown_connections 2024-04-22T07:22:33.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.842+0000 7f175da88640 1 --2- 172.21.15.37:0/2465139272 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f17580ca940 0x7f17580c9e70 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:33.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.842+0000 7f175da88640 1 --2- 172.21.15.37:0/2465139272 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1758152f10 0x7f17580c8f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:33.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.842+0000 7f175da88640 1 -- 172.21.15.37:0/2465139272 >> 172.21.15.37:0/2465139272 conn(0x7f1758067890 msgr2=0x7f175806db80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:22:33.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.842+0000 7f175da88640 1 -- 172.21.15.37:0/2465139272 shutdown_connections 2024-04-22T07:22:33.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.842+0000 7f175da88640 1 -- 172.21.15.37:0/2465139272 wait complete. 2024-04-22T07:22:33.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.843+0000 7f175da88640 1 Processor -- start 2024-04-22T07:22:33.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.844+0000 7f175da88640 1 -- start start 2024-04-22T07:22:33.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.844+0000 7f175da88640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f17580ca3b0 0x7f17580cef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:33.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.844+0000 7f175da88640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f17580ca940 0x7f17580cd620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:33.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.844+0000 7f175da88640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1758152f10 0x7f175815bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:33.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.844+0000 7f175da88640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f17581532f0 con 0x7f17580ca940 2024-04-22T07:22:33.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.844+0000 7f175da88640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f17580c3e50 con 0x7f17580ca3b0 2024-04-22T07:22:33.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.844+0000 7f175da88640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f175815c3c0 con 0x7f1758152f10 2024-04-22T07:22:33.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.844+0000 7f1756ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f17580ca940 0x7f17580cd620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:33.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.844+0000 7f1756ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f17580ca940 0x7f17580cd620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37032/0 (socket says 172.21.15.37:37032) 2024-04-22T07:22:33.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.844+0000 7f1756ffd640 1 -- 172.21.15.37:0/685340273 learned_addr learned my addr 172.21.15.37:0/685340273 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:22:33.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.845+0000 7f1757fff640 1 --2- 172.21.15.37:0/685340273 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1758152f10 0x7f175815bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:33.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.845+0000 7f17577fe640 1 --2- 172.21.15.37:0/685340273 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f17580ca3b0 0x7f17580cef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:33.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.845+0000 7f1756ffd640 1 -- 172.21.15.37:0/685340273 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1758152f10 msgr2=0x7f175815bb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:33.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.845+0000 7f1756ffd640 1 --2- 172.21.15.37:0/685340273 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1758152f10 0x7f175815bb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:33.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.845+0000 7f1756ffd640 1 -- 172.21.15.37:0/685340273 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f17580ca3b0 msgr2=0x7f17580cef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:33.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.845+0000 7f1756ffd640 1 --2- 172.21.15.37:0/685340273 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f17580ca3b0 0x7f17580cef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:33.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.845+0000 7f1756ffd640 1 -- 172.21.15.37:0/685340273 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17581f0e20 con 0x7f17580ca940 2024-04-22T07:22:33.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.845+0000 7f17577fe640 1 --2- 172.21.15.37:0/685340273 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f17580ca3b0 0x7f17580cef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T07:22:33.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.845+0000 7f1756ffd640 1 --2- 172.21.15.37:0/685340273 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f17580ca940 0x7f17580cd620 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f174c000c00 tx=0x7f174c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:22:33.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.845+0000 7f173ffff640 1 -- 172.21.15.37:0/685340273 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f174c035050 con 0x7f17580ca940 2024-04-22T07:22:33.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.845+0000 7f173ffff640 1 -- 172.21.15.37:0/685340273 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f174c03bcf0 con 0x7f17580ca940 2024-04-22T07:22:33.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.845+0000 7f175da88640 1 -- 172.21.15.37:0/685340273 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17581f1100 con 0x7f17580ca940 2024-04-22T07:22:33.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.845+0000 7f173ffff640 1 -- 172.21.15.37:0/685340273 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f174c004250 con 0x7f17580ca940 2024-04-22T07:22:33.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.845+0000 7f175da88640 1 -- 172.21.15.37:0/685340273 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17581f16c0 con 0x7f17580ca940 2024-04-22T07:22:33.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.846+0000 7f175da88640 1 -- 172.21.15.37:0/685340273 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1758068b20 con 0x7f17580ca940 2024-04-22T07:22:33.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.847+0000 7f173ffff640 1 -- 172.21.15.37:0/685340273 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f174c038020 con 0x7f17580ca940 2024-04-22T07:22:33.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.847+0000 7f173ffff640 1 --2- 172.21.15.37:0/685340273 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f174406c920 0x7f174406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:33.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.847+0000 7f173ffff640 1 -- 172.21.15.37:0/685340273 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f174c0ae4d0 con 0x7f17580ca940 2024-04-22T07:22:33.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.847+0000 7f173ffff640 1 --2- 172.21.15.37:0/685340273 >> [v2:172.21.15.37:6824/1895439419,v1:172.21.15.37:6825/1895439419] conn(0x7f1744074c40 0x7f17440770c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:33.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.847+0000 7f173ffff640 1 -- 172.21.15.37:0/685340273 --> [v2:172.21.15.37:6824/1895439419,v1:172.21.15.37:6825/1895439419] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f174c008eb0 con 0x7f1744074c40 2024-04-22T07:22:33.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.847+0000 7f173ffff640 1 -- 172.21.15.37:0/685340273 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f174c0ae960 con 0x7f17580ca940 2024-04-22T07:22:33.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.848+0000 7f17577fe640 1 --2- 172.21.15.37:0/685340273 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f174406c920 0x7f174406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:33.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.848+0000 7f1757fff640 1 --2- 172.21.15.37:0/685340273 >> [v2:172.21.15.37:6824/1895439419,v1:172.21.15.37:6825/1895439419] conn(0x7f1744074c40 0x7f17440770c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:33.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.848+0000 7f1757fff640 1 --2- 172.21.15.37:0/685340273 >> [v2:172.21.15.37:6824/1895439419,v1:172.21.15.37:6825/1895439419] conn(0x7f1744074c40 0x7f17440770c0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:22:33.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.848+0000 7f17577fe640 1 --2- 172.21.15.37:0/685340273 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f174406c920 0x7f174406ede0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f1748006fd0 tx=0x7f1748008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:22:33.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.848+0000 7f173ffff640 1 -- 172.21.15.37:0/685340273 <== osd.2 v2:172.21.15.37:6824/1895439419 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f174c008eb0 con 0x7f1744074c40 2024-04-22T07:22:33.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.862+0000 7f175da88640 1 -- 172.21.15.37:0/685340273 --> [v2:172.21.15.37:6824/1895439419,v1:172.21.15.37:6825/1895439419] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f175806e0b0 con 0x7f1744074c40 2024-04-22T07:22:33.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.862+0000 7f173ffff640 1 -- 172.21.15.37:0/685340273 <== osd.2 v2:172.21.15.37:6824/1895439419 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f175806e0b0 con 0x7f1744074c40 2024-04-22T07:22:33.860 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-04-22T07:22:33.860 INFO:teuthology.orchestra.run.smithi037.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-22T07:22:33.860 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-04-22T07:22:33.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.862+0000 7f175da88640 1 -- 172.21.15.37:0/685340273 >> [v2:172.21.15.37:6824/1895439419,v1:172.21.15.37:6825/1895439419] conn(0x7f1744074c40 msgr2=0x7f17440770c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:33.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.862+0000 7f175da88640 1 --2- 172.21.15.37:0/685340273 >> [v2:172.21.15.37:6824/1895439419,v1:172.21.15.37:6825/1895439419] conn(0x7f1744074c40 0x7f17440770c0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:33.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.862+0000 7f175da88640 1 -- 172.21.15.37:0/685340273 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f174406c920 msgr2=0x7f174406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:33.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.862+0000 7f175da88640 1 --2- 172.21.15.37:0/685340273 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f174406c920 0x7f174406ede0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f1748006fd0 tx=0x7f1748008040 comp rx=0 tx=0).stop 2024-04-22T07:22:33.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.862+0000 7f175da88640 1 -- 172.21.15.37:0/685340273 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f17580ca940 msgr2=0x7f17580cd620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:33.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.862+0000 7f175da88640 1 --2- 172.21.15.37:0/685340273 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f17580ca940 0x7f17580cd620 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f174c000c00 tx=0x7f174c0046c0 comp rx=0 tx=0).stop 2024-04-22T07:22:33.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.862+0000 7f1757fff640 1 -- 172.21.15.37:0/685340273 reap_dead start 2024-04-22T07:22:33.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.862+0000 7f175da88640 1 -- 172.21.15.37:0/685340273 shutdown_connections 2024-04-22T07:22:33.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.862+0000 7f175da88640 1 -- 172.21.15.37:0/685340273 >> 172.21.15.37:0/685340273 conn(0x7f1758067890 msgr2=0x7f175806c700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:22:33.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.862+0000 7f175da88640 1 -- 172.21.15.37:0/685340273 shutdown_connections 2024-04-22T07:22:33.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.862+0000 7f175da88640 1 -- 172.21.15.37:0/685340273 wait complete. 2024-04-22T07:22:33.871 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-04-22T07:22:33.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.975+0000 7faf218b3640 1 Processor -- start 2024-04-22T07:22:34.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.975+0000 7faf218b3640 1 -- start start 2024-04-22T07:22:34.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.976+0000 7faf218b3640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7faf1c1550b0 0x7faf1c0cbf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:34.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.976+0000 7faf218b3640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf1c15ae70 con 0x7faf1c06c6a0 2024-04-22T07:22:34.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.976+0000 7faf218b3640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf1c0cc440 con 0x7faf1c0d0af0 2024-04-22T07:22:34.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.976+0000 7faf218b3640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7faf1c0c5530 con 0x7faf1c1550b0 2024-04-22T07:22:34.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.976+0000 7faf13fff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7faf1c06c6a0 0x7faf1c15b610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:60396/0 (socket says 172.21.15.37:60396) 2024-04-22T07:22:34.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.976+0000 7faf13fff640 1 -- 172.21.15.37:0/2207508304 learned_addr learned my addr 172.21.15.37:0/2207508304 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-04-22T07:22:34.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.976+0000 7faf1affd640 1 --2- 172.21.15.37:0/2207508304 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7faf1c1550b0 0x7faf1c0cbf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:34.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.976+0000 7faf1a7fc640 1 -- 172.21.15.37:0/2207508304 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1909085943 0 0) 0x7faf04001110 con 0x7faf1c06c6a0 2024-04-22T07:22:34.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.976+0000 7faf1a7fc640 1 -- 172.21.15.37:0/2207508304 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faf08003520 con 0x7faf1c06c6a0 2024-04-22T07:22:34.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.976+0000 7faf1a7fc640 1 -- 172.21.15.37:0/2207508304 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 548394574 0 0) 0x7faf1c0cc440 con 0x7faf1c0d0af0 2024-04-22T07:22:34.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.976+0000 7faf1a7fc640 1 -- 172.21.15.37:0/2207508304 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faf04001110 con 0x7faf1c0d0af0 2024-04-22T07:22:34.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.976+0000 7faf1a7fc640 1 -- 172.21.15.37:0/2207508304 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3916603680 0 0) 0x7faf08003520 con 0x7faf1c06c6a0 2024-04-22T07:22:34.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.976+0000 7faf1a7fc640 1 -- 172.21.15.37:0/2207508304 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7faf1c1550b0 msgr2=0x7faf1c0cbf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:22:34.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.976+0000 7faf1a7fc640 1 --2- 172.21.15.37:0/2207508304 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7faf1c1550b0 0x7faf1c0cbf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:34.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.976+0000 7faf1a7fc640 1 -- 172.21.15.37:0/2207508304 >> v1:172.21.15.196:6789/0 conn(0x7faf1c0d0af0 legacy=0x7faf1c1657f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:34.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.976+0000 7faf1a7fc640 1 -- 172.21.15.37:0/2207508304 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf1c0cc650 con 0x7faf1c06c6a0 2024-04-22T07:22:34.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.976+0000 7faf1a7fc640 1 -- 172.21.15.37:0/2207508304 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2576656170 0 0) 0x7faf040017c0 con 0x7faf1c06c6a0 2024-04-22T07:22:34.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.976+0000 7faf1affd640 1 --2- 172.21.15.37:0/2207508304 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7faf1c1550b0 0x7faf1c0cbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-22T07:22:34.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.976+0000 7faf1a7fc640 1 -- 172.21.15.37:0/2207508304 >> v1:172.21.15.37:6789/0 conn(0x7faf1c06c6a0 legacy=0x7faf1c15b610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:34.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.976+0000 7faf1a7fc640 1 --2- 172.21.15.37:0/2207508304 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faf08003b70 0x7faf08003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:34.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.977+0000 7faf1a7fc640 1 --2- 172.21.15.37:0/2207508304 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7faf08004800 0x7faf08004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:34.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.977+0000 7faf1a7fc640 1 --2- 172.21.15.37:0/2207508304 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7faf1c1550b0 0x7faf080051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:34.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.977+0000 7faf1a7fc640 1 -- 172.21.15.37:0/2207508304 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7faf0800ba70 con 0x7faf08003b70 2024-04-22T07:22:34.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.977+0000 7faf1a7fc640 1 -- 172.21.15.37:0/2207508304 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7faf0800bbf0 con 0x7faf08004800 2024-04-22T07:22:34.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.977+0000 7faf1a7fc640 1 -- 172.21.15.37:0/2207508304 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7faf0800bdc0 con 0x7faf1c1550b0 2024-04-22T07:22:34.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.977+0000 7faf1affd640 1 --2- 172.21.15.37:0/2207508304 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faf08003b70 0x7faf08003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:34.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.977+0000 7faf13fff640 1 --2- 172.21.15.37:0/2207508304 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7faf08004800 0x7faf08004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:34.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.977+0000 7faf1b7fe640 1 --2- 172.21.15.37:0/2207508304 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7faf1c1550b0 0x7faf080051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:34.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.977+0000 7faf1affd640 1 -- 172.21.15.37:0/2207508304 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7faf1c1550b0 msgr2=0x7faf080051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:22:34.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.977+0000 7faf1affd640 1 --2- 172.21.15.37:0/2207508304 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7faf1c1550b0 0x7faf080051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:34.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.977+0000 7faf1affd640 1 -- 172.21.15.37:0/2207508304 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7faf08004800 msgr2=0x7faf08004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:22:34.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.977+0000 7faf1affd640 1 --2- 172.21.15.37:0/2207508304 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7faf08004800 0x7faf08004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:34.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.977+0000 7faf1affd640 1 -- 172.21.15.37:0/2207508304 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf08003520 con 0x7faf08003b70 2024-04-22T07:22:34.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.978+0000 7faf1affd640 1 --2- 172.21.15.37:0/2207508304 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faf08003b70 0x7faf08003f70 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7faf0c009c60 tx=0x7faf08005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd4fd89f14f21294 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:22:34.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.978+0000 7faf1a7fc640 1 -- 172.21.15.37:0/2207508304 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf0c039070 con 0x7faf08003b70 2024-04-22T07:22:34.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.978+0000 7faf1a7fc640 1 -- 172.21.15.37:0/2207508304 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf0c02c8a0 con 0x7faf08003b70 2024-04-22T07:22:34.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.978+0000 7faf1a7fc640 1 -- 172.21.15.37:0/2207508304 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf0c009860 con 0x7faf08003b70 2024-04-22T07:22:34.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.978+0000 7faf218b3640 1 -- 172.21.15.37:0/2207508304 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faf08003b70 msgr2=0x7faf08003f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:34.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.978+0000 7faf218b3640 1 --2- 172.21.15.37:0/2207508304 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faf08003b70 0x7faf08003f70 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7faf0c009c60 tx=0x7faf08005830 comp rx=0 tx=0).stop 2024-04-22T07:22:34.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.979+0000 7faf1b7fe640 1 -- 172.21.15.37:0/2207508304 reap_dead start 2024-04-22T07:22:34.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.979+0000 7faf218b3640 1 -- 172.21.15.37:0/2207508304 shutdown_connections 2024-04-22T07:22:34.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.979+0000 7faf218b3640 1 -- 172.21.15.37:0/2207508304 >> 172.21.15.37:0/2207508304 conn(0x7faf1c073630 msgr2=0x7faf1c073a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:22:34.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.979+0000 7faf218b3640 1 -- 172.21.15.37:0/2207508304 shutdown_connections 2024-04-22T07:22:34.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.979+0000 7faf218b3640 1 -- 172.21.15.37:0/2207508304 wait complete. 2024-04-22T07:22:34.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.980+0000 7faf218b3640 1 Processor -- start 2024-04-22T07:22:34.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.980+0000 7faf218b3640 1 -- start start 2024-04-22T07:22:34.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.980+0000 7faf218b3640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faf08003b70 0x7faf1c0cbd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:34.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.980+0000 7faf218b3640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7faf1c0d00a0 0x7faf1c1f44f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:34.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.981+0000 7faf218b3640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7faf1c1f4a30 0x7faf1c150e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:34.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.981+0000 7faf218b3640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7faf1c0ccbd0 con 0x7faf08003b70 2024-04-22T07:22:34.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.981+0000 7faf218b3640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7faf1c0cc8f0 con 0x7faf1c0d00a0 2024-04-22T07:22:34.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.981+0000 7faf218b3640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7faf1c15b0f0 con 0x7faf1c1f4a30 2024-04-22T07:22:34.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.981+0000 7faf1affd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faf08003b70 0x7faf1c0cbd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:34.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.981+0000 7faf1affd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faf08003b70 0x7faf1c0cbd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37060/0 (socket says 172.21.15.37:37060) 2024-04-22T07:22:34.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.981+0000 7faf1affd640 1 -- 172.21.15.37:0/54364395 learned_addr learned my addr 172.21.15.37:0/54364395 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:22:34.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.981+0000 7faf13fff640 1 --2- 172.21.15.37:0/54364395 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7faf1c0d00a0 0x7faf1c1f44f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:34.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.981+0000 7faf1b7fe640 1 --2- 172.21.15.37:0/54364395 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7faf1c1f4a30 0x7faf1c150e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:34.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.981+0000 7faf1affd640 1 -- 172.21.15.37:0/54364395 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7faf1c1f4a30 msgr2=0x7faf1c150e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:34.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.981+0000 7faf1affd640 1 --2- 172.21.15.37:0/54364395 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7faf1c1f4a30 0x7faf1c150e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:34.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.981+0000 7faf1affd640 1 -- 172.21.15.37:0/54364395 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7faf1c0d00a0 msgr2=0x7faf1c1f44f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:34.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.981+0000 7faf1affd640 1 --2- 172.21.15.37:0/54364395 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7faf1c0d00a0 0x7faf1c1f44f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:34.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.981+0000 7faf1affd640 1 -- 172.21.15.37:0/54364395 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf1c156e20 con 0x7faf08003b70 2024-04-22T07:22:34.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.981+0000 7faf1b7fe640 1 --2- 172.21.15.37:0/54364395 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7faf1c1f4a30 0x7faf1c150e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-22T07:22:34.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.981+0000 7faf1affd640 1 --2- 172.21.15.37:0/54364395 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faf08003b70 0x7faf1c0cbd10 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7faf0c02c450 tx=0x7faf0c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:22:34.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.981+0000 7faf18ff9640 1 -- 172.21.15.37:0/54364395 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf0c042020 con 0x7faf08003b70 2024-04-22T07:22:34.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.981+0000 7faf18ff9640 1 -- 172.21.15.37:0/54364395 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf0c03a040 con 0x7faf08003b70 2024-04-22T07:22:34.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.981+0000 7faf218b3640 1 -- 172.21.15.37:0/54364395 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf1c1f1660 con 0x7faf08003b70 2024-04-22T07:22:34.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.981+0000 7faf18ff9640 1 -- 172.21.15.37:0/54364395 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf0c039070 con 0x7faf08003b70 2024-04-22T07:22:34.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.981+0000 7faf218b3640 1 -- 172.21.15.37:0/54364395 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf1c0c7bf0 con 0x7faf08003b70 2024-04-22T07:22:34.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.982+0000 7faf218b3640 1 -- 172.21.15.37:0/54364395 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf1c069cc0 con 0x7faf08003b70 2024-04-22T07:22:34.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.983+0000 7faf18ff9640 1 -- 172.21.15.37:0/54364395 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7faf0c045020 con 0x7faf08003b70 2024-04-22T07:22:34.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.983+0000 7faf18ff9640 1 --2- 172.21.15.37:0/54364395 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7faefc06c920 0x7faefc06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:34.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.983+0000 7faf18ff9640 1 -- 172.21.15.37:0/54364395 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7faf0c0ad780 con 0x7faf08003b70 2024-04-22T07:22:34.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.983+0000 7faf13fff640 1 --2- 172.21.15.37:0/54364395 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7faefc06c920 0x7faefc06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:34.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.984+0000 7faf13fff640 1 --2- 172.21.15.37:0/54364395 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7faefc06c920 0x7faefc06ede0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7faf1c0c56a0 tx=0x7faf04009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:22:34.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:33.988+0000 7faf18ff9640 1 -- 172.21.15.37:0/54364395 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7faf0c04c020 con 0x7faf08003b70 2024-04-22T07:22:34.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.174+0000 7faf218b3640 1 -- 172.21.15.37:0/54364395 --> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7faf1c0cb560 con 0x7faefc06c920 2024-04-22T07:22:34.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.175+0000 7faf18ff9640 1 -- 172.21.15.37:0/54364395 <== mgr.4103 v2:172.21.15.196:6832/321987173 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7faf1c0cb560 con 0x7faefc06c920 2024-04-22T07:22:34.205 INFO:teuthology.orchestra.run.smithi037.stderr:instructed osd(s) 2 to deep-scrub 2024-04-22T07:22:34.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.177+0000 7faf218b3640 1 -- 172.21.15.37:0/54364395 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7faefc06c920 msgr2=0x7faefc06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:34.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.177+0000 7faf218b3640 1 --2- 172.21.15.37:0/54364395 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7faefc06c920 0x7faefc06ede0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7faf1c0c56a0 tx=0x7faf04009040 comp rx=0 tx=0).stop 2024-04-22T07:22:34.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.177+0000 7faf218b3640 1 -- 172.21.15.37:0/54364395 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faf08003b70 msgr2=0x7faf1c0cbd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:34.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.177+0000 7faf218b3640 1 --2- 172.21.15.37:0/54364395 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faf08003b70 0x7faf1c0cbd10 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7faf0c02c450 tx=0x7faf0c004730 comp rx=0 tx=0).stop 2024-04-22T07:22:34.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.177+0000 7faf218b3640 1 -- 172.21.15.37:0/54364395 shutdown_connections 2024-04-22T07:22:34.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.177+0000 7faf218b3640 1 --2- 172.21.15.37:0/54364395 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7faefc06c920 0x7faefc06ede0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:34.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.177+0000 7faf218b3640 1 --2- 172.21.15.37:0/54364395 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7faf1c1f4a30 0x7faf1c150e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:34.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.177+0000 7faf218b3640 1 --2- 172.21.15.37:0/54364395 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7faf1c0d00a0 0x7faf1c1f44f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:34.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.177+0000 7faf218b3640 1 --2- 172.21.15.37:0/54364395 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faf08003b70 0x7faf1c0cbd10 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:34.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.177+0000 7faf218b3640 1 -- 172.21.15.37:0/54364395 >> 172.21.15.37:0/54364395 conn(0x7faf1c073630 msgr2=0x7faf1c159f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:22:34.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.177+0000 7faf218b3640 1 -- 172.21.15.37:0/54364395 shutdown_connections 2024-04-22T07:22:34.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.177+0000 7faf218b3640 1 -- 172.21.15.37:0/54364395 wait complete. 2024-04-22T07:22:34.206 INFO:tasks.ceph:Scrubbing osd.3 2024-04-22T07:22:34.206 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-04-22T07:22:34.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.314+0000 7ff620eeb640 1 Processor -- start 2024-04-22T07:22:34.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.314+0000 7ff620eeb640 1 -- start start 2024-04-22T07:22:34.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.315+0000 7ff620eeb640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff61c15b680 0x7ff61c0c8e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:34.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.315+0000 7ff620eeb640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff61c06c0b0 con 0x7ff61c1583a0 2024-04-22T07:22:34.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.315+0000 7ff620eeb640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff61c0c9890 con 0x7ff61c0c5410 2024-04-22T07:22:34.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.315+0000 7ff620eeb640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7ff61c0ca1c0 con 0x7ff61c15b680 2024-04-22T07:22:34.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.315+0000 7ff61ad9d640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff61c15b680 0x7ff61c0c8e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:34.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.315+0000 7ff61a59c640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7ff61c1583a0 0x7ff61c0ce360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:60406/0 (socket says 172.21.15.37:60406) 2024-04-22T07:22:34.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.315+0000 7ff61a59c640 1 -- 172.21.15.37:0/4187704174 learned_addr learned my addr 172.21.15.37:0/4187704174 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-04-22T07:22:34.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.315+0000 7ff61ad9d640 1 -- 172.21.15.37:0/4187704174 >> v1:172.21.15.196:6789/0 conn(0x7ff61c0c5410 legacy=0x7ff61c15af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:34.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.315+0000 7ff61ad9d640 1 -- 172.21.15.37:0/4187704174 >> v1:172.21.15.37:6789/0 conn(0x7ff61c1583a0 legacy=0x7ff61c0ce360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:34.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.315+0000 7ff61ad9d640 1 -- 172.21.15.37:0/4187704174 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff61c0c9b70 con 0x7ff61c15b680 2024-04-22T07:22:34.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.315+0000 7ff619d9b640 1 -- 172.21.15.37:0/4187704174 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2788168121 0 0) 0x7ff61c06c0b0 con 0x7ff61c1583a0 2024-04-22T07:22:34.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.316+0000 7ff61ad9d640 1 --2- 172.21.15.37:0/4187704174 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff61c15b680 0x7ff61c0c8e10 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7ff61c0ca340 tx=0x7ff61402bfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3a36f428f30fcc5 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:22:34.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.316+0000 7ff619d9b640 1 -- 172.21.15.37:0/4187704174 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff614039070 con 0x7ff61c15b680 2024-04-22T07:22:34.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.316+0000 7ff619d9b640 1 -- 172.21.15.37:0/4187704174 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff61402cd80 con 0x7ff61c15b680 2024-04-22T07:22:34.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.316+0000 7ff619d9b640 1 -- 172.21.15.37:0/4187704174 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff614034660 con 0x7ff61c15b680 2024-04-22T07:22:34.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.317+0000 7ff620eeb640 1 -- 172.21.15.37:0/4187704174 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff61c15b680 msgr2=0x7ff61c0c8e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:34.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.317+0000 7ff620eeb640 1 --2- 172.21.15.37:0/4187704174 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff61c15b680 0x7ff61c0c8e10 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7ff61c0ca340 tx=0x7ff61402bfd0 comp rx=0 tx=0).stop 2024-04-22T07:22:34.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.317+0000 7ff620eeb640 1 -- 172.21.15.37:0/4187704174 shutdown_connections 2024-04-22T07:22:34.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.317+0000 7ff620eeb640 1 --2- 172.21.15.37:0/4187704174 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff61c15b680 0x7ff61c0c8e10 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:34.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.317+0000 7ff620eeb640 1 -- 172.21.15.37:0/4187704174 >> 172.21.15.37:0/4187704174 conn(0x7ff61c06db80 msgr2=0x7ff61c06df60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:22:34.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.317+0000 7ff620eeb640 1 -- 172.21.15.37:0/4187704174 shutdown_connections 2024-04-22T07:22:34.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.317+0000 7ff620eeb640 1 -- 172.21.15.37:0/4187704174 wait complete. 2024-04-22T07:22:34.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.318+0000 7ff620eeb640 1 Processor -- start 2024-04-22T07:22:34.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.318+0000 7ff620eeb640 1 -- start start 2024-04-22T07:22:34.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.319+0000 7ff620eeb640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff61c0c5410 0x7ff61c157170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:34.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.319+0000 7ff620eeb640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff61c1583a0 0x7ff61c0c6590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:34.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.319+0000 7ff620eeb640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff61c15b680 0x7ff61c0c6ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:34.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.319+0000 7ff620eeb640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff61c0cea70 con 0x7ff61c0c5410 2024-04-22T07:22:34.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.319+0000 7ff620eeb640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7ff61c158780 con 0x7ff61c1583a0 2024-04-22T07:22:34.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.319+0000 7ff620eeb640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7ff61c0cebf0 con 0x7ff61c15b680 2024-04-22T07:22:34.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.319+0000 7ff61a59c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff61c0c5410 0x7ff61c157170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:34.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.319+0000 7ff61a59c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff61c0c5410 0x7ff61c157170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37070/0 (socket says 172.21.15.37:37070) 2024-04-22T07:22:34.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.319+0000 7ff61a59c640 1 -- 172.21.15.37:0/3404817343 learned_addr learned my addr 172.21.15.37:0/3404817343 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:22:34.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.319+0000 7ff61ad9d640 1 --2- 172.21.15.37:0/3404817343 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff61c15b680 0x7ff61c0c6ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:34.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.319+0000 7ff613fff640 1 --2- 172.21.15.37:0/3404817343 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff61c1583a0 0x7ff61c0c6590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:34.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.319+0000 7ff61a59c640 1 -- 172.21.15.37:0/3404817343 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff61c15b680 msgr2=0x7ff61c0c6ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:34.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.319+0000 7ff61a59c640 1 --2- 172.21.15.37:0/3404817343 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff61c15b680 0x7ff61c0c6ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:34.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.319+0000 7ff61a59c640 1 -- 172.21.15.37:0/3404817343 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff61c1583a0 msgr2=0x7ff61c0c6590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:34.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.319+0000 7ff61a59c640 1 --2- 172.21.15.37:0/3404817343 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff61c1583a0 0x7ff61c0c6590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:34.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.319+0000 7ff61a59c640 1 -- 172.21.15.37:0/3404817343 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff61c158aa0 con 0x7ff61c0c5410 2024-04-22T07:22:34.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.319+0000 7ff61a59c640 1 --2- 172.21.15.37:0/3404817343 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff61c0c5410 0x7ff61c157170 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7ff60c00c4d0 tx=0x7ff60c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:22:34.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.319+0000 7ff612ffd640 1 -- 172.21.15.37:0/3404817343 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff60c018070 con 0x7ff61c0c5410 2024-04-22T07:22:34.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.319+0000 7ff612ffd640 1 -- 172.21.15.37:0/3404817343 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff60c0074e0 con 0x7ff61c0c5410 2024-04-22T07:22:34.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.319+0000 7ff620eeb640 1 -- 172.21.15.37:0/3404817343 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff61c158d80 con 0x7ff61c0c5410 2024-04-22T07:22:34.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.319+0000 7ff612ffd640 1 -- 172.21.15.37:0/3404817343 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff60c004a20 con 0x7ff61c0c5410 2024-04-22T07:22:34.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.320+0000 7ff620eeb640 1 -- 172.21.15.37:0/3404817343 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff61c159340 con 0x7ff61c0c5410 2024-04-22T07:22:34.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.320+0000 7ff620eeb640 1 -- 172.21.15.37:0/3404817343 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff61c069cc0 con 0x7ff61c0c5410 2024-04-22T07:22:34.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.321+0000 7ff612ffd640 1 -- 172.21.15.37:0/3404817343 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff60c01b070 con 0x7ff61c0c5410 2024-04-22T07:22:34.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.321+0000 7ff612ffd640 1 --2- 172.21.15.37:0/3404817343 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7ff5fc06c8f0 0x7ff5fc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:34.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.321+0000 7ff612ffd640 1 -- 172.21.15.37:0/3404817343 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7ff60c08aeb0 con 0x7ff61c0c5410 2024-04-22T07:22:34.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.321+0000 7ff613fff640 1 --2- 172.21.15.37:0/3404817343 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7ff5fc06c8f0 0x7ff5fc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:34.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.322+0000 7ff612ffd640 1 --2- 172.21.15.37:0/3404817343 >> [v2:172.21.15.37:6809/1160021017,v1:172.21.15.37:6810/1160021017] conn(0x7ff5fc074c10 0x7ff5fc077090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:34.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.322+0000 7ff612ffd640 1 -- 172.21.15.37:0/3404817343 --> [v2:172.21.15.37:6809/1160021017,v1:172.21.15.37:6810/1160021017] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff5fc077760 con 0x7ff5fc074c10 2024-04-22T07:22:34.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.322+0000 7ff612ffd640 1 -- 172.21.15.37:0/3404817343 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7ff60c08d5b0 con 0x7ff61c0c5410 2024-04-22T07:22:34.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.322+0000 7ff61ad9d640 1 --2- 172.21.15.37:0/3404817343 >> [v2:172.21.15.37:6809/1160021017,v1:172.21.15.37:6810/1160021017] conn(0x7ff5fc074c10 0x7ff5fc077090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:34.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.322+0000 7ff613fff640 1 --2- 172.21.15.37:0/3404817343 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7ff5fc06c8f0 0x7ff5fc06edb0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7ff61c06f7e0 tx=0x7ff604009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:22:34.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.322+0000 7ff61ad9d640 1 --2- 172.21.15.37:0/3404817343 >> [v2:172.21.15.37:6809/1160021017,v1:172.21.15.37:6810/1160021017] conn(0x7ff5fc074c10 0x7ff5fc077090 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:22:34.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.323+0000 7ff612ffd640 1 -- 172.21.15.37:0/3404817343 <== osd.3 v2:172.21.15.37:6809/1160021017 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff5fc077760 con 0x7ff5fc074c10 2024-04-22T07:22:34.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.336+0000 7ff620eeb640 1 -- 172.21.15.37:0/3404817343 --> [v2:172.21.15.37:6809/1160021017,v1:172.21.15.37:6810/1160021017] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7ff61c1576b0 con 0x7ff5fc074c10 2024-04-22T07:22:34.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.336+0000 7ff612ffd640 1 -- 172.21.15.37:0/3404817343 <== osd.3 v2:172.21.15.37:6809/1160021017 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7ff61c1576b0 con 0x7ff5fc074c10 2024-04-22T07:22:34.334 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-04-22T07:22:34.334 INFO:teuthology.orchestra.run.smithi037.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-22T07:22:34.334 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-04-22T07:22:34.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.337+0000 7ff620eeb640 1 -- 172.21.15.37:0/3404817343 >> [v2:172.21.15.37:6809/1160021017,v1:172.21.15.37:6810/1160021017] conn(0x7ff5fc074c10 msgr2=0x7ff5fc077090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:34.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.337+0000 7ff620eeb640 1 --2- 172.21.15.37:0/3404817343 >> [v2:172.21.15.37:6809/1160021017,v1:172.21.15.37:6810/1160021017] conn(0x7ff5fc074c10 0x7ff5fc077090 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:34.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.337+0000 7ff620eeb640 1 -- 172.21.15.37:0/3404817343 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7ff5fc06c8f0 msgr2=0x7ff5fc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:34.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.337+0000 7ff620eeb640 1 --2- 172.21.15.37:0/3404817343 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7ff5fc06c8f0 0x7ff5fc06edb0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7ff61c06f7e0 tx=0x7ff604009040 comp rx=0 tx=0).stop 2024-04-22T07:22:34.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.337+0000 7ff620eeb640 1 -- 172.21.15.37:0/3404817343 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff61c0c5410 msgr2=0x7ff61c157170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:34.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.337+0000 7ff620eeb640 1 --2- 172.21.15.37:0/3404817343 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff61c0c5410 0x7ff61c157170 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7ff60c00c4d0 tx=0x7ff60c00c990 comp rx=0 tx=0).stop 2024-04-22T07:22:34.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.337+0000 7ff61ad9d640 1 -- 172.21.15.37:0/3404817343 reap_dead start 2024-04-22T07:22:34.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.337+0000 7ff620eeb640 1 -- 172.21.15.37:0/3404817343 shutdown_connections 2024-04-22T07:22:34.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.337+0000 7ff620eeb640 1 -- 172.21.15.37:0/3404817343 >> 172.21.15.37:0/3404817343 conn(0x7ff61c06db80 msgr2=0x7ff61c0cb520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:22:34.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.337+0000 7ff620eeb640 1 -- 172.21.15.37:0/3404817343 shutdown_connections 2024-04-22T07:22:34.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.337+0000 7ff620eeb640 1 -- 172.21.15.37:0/3404817343 wait complete. 2024-04-22T07:22:34.346 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-04-22T07:22:34.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.452+0000 7f8257f0d640 1 Processor -- start 2024-04-22T07:22:34.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.452+0000 7f8257f0d640 1 -- start start 2024-04-22T07:22:34.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.453+0000 7f8257f0d640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f82501550b0 0x7f82500cbf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:34.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.453+0000 7f8257f0d640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f82500d0af0 0x7f82500d0f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:34.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.453+0000 7f8257f0d640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f825015ae70 con 0x7f825006c6a0 2024-04-22T07:22:34.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.453+0000 7f8257f0d640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f82500c5530 con 0x7f82501550b0 2024-04-22T07:22:34.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.453+0000 7f8257f0d640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f82500cc440 con 0x7f82500d0af0 2024-04-22T07:22:34.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.453+0000 7f8255ca9640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f82501550b0 0x7f82500cbf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:34.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.453+0000 7f82554a8640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f825006c6a0 0x7f825015b610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:60412/0 (socket says 172.21.15.37:60412) 2024-04-22T07:22:34.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.453+0000 7f82554a8640 1 -- 172.21.15.37:0/593187900 learned_addr learned my addr 172.21.15.37:0/593187900 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-04-22T07:22:34.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.453+0000 7f82564aa640 1 --2- 172.21.15.37:0/593187900 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f82500d0af0 0x7f82500d0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:34.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.453+0000 7f8255ca9640 1 -- 172.21.15.37:0/593187900 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f82500d0af0 msgr2=0x7f82500d0f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:22:34.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.453+0000 7f8255ca9640 1 --2- 172.21.15.37:0/593187900 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f82500d0af0 0x7f82500d0f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:34.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.453+0000 7f8255ca9640 1 -- 172.21.15.37:0/593187900 >> v1:172.21.15.37:6789/0 conn(0x7f825006c6a0 legacy=0x7f825015b610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:34.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.453+0000 7f8255ca9640 1 -- 172.21.15.37:0/593187900 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82500cc650 con 0x7f82501550b0 2024-04-22T07:22:34.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.454+0000 7f8255ca9640 1 --2- 172.21.15.37:0/593187900 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f82501550b0 0x7f82500cbf00 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f824c0097a0 tx=0x7f824c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aade332b186c87e3 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:22:34.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.454+0000 7f8254ca7640 1 -- 172.21.15.37:0/593187900 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f824c035020 con 0x7f82501550b0 2024-04-22T07:22:34.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.454+0000 7f8254ca7640 1 -- 172.21.15.37:0/593187900 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f824c031830 con 0x7f82501550b0 2024-04-22T07:22:34.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.454+0000 7f8254ca7640 1 -- 172.21.15.37:0/593187900 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f824c031c00 con 0x7f82501550b0 2024-04-22T07:22:34.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.455+0000 7f8257f0d640 1 -- 172.21.15.37:0/593187900 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f82501550b0 msgr2=0x7f82500cbf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:34.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.455+0000 7f8257f0d640 1 --2- 172.21.15.37:0/593187900 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f82501550b0 0x7f82500cbf00 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f824c0097a0 tx=0x7f824c02b8d0 comp rx=0 tx=0).stop 2024-04-22T07:22:34.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.455+0000 7f8257f0d640 1 -- 172.21.15.37:0/593187900 shutdown_connections 2024-04-22T07:22:34.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.455+0000 7f8257f0d640 1 --2- 172.21.15.37:0/593187900 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f82500d0af0 0x7f82500d0f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:34.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.455+0000 7f8257f0d640 1 --2- 172.21.15.37:0/593187900 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f82501550b0 0x7f82500cbf00 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:34.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.455+0000 7f8257f0d640 1 -- 172.21.15.37:0/593187900 >> 172.21.15.37:0/593187900 conn(0x7f8250073630 msgr2=0x7f8250073a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:22:34.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.455+0000 7f8257f0d640 1 -- 172.21.15.37:0/593187900 shutdown_connections 2024-04-22T07:22:34.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.455+0000 7f8257f0d640 1 -- 172.21.15.37:0/593187900 wait complete. 2024-04-22T07:22:34.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.456+0000 7f8257f0d640 1 Processor -- start 2024-04-22T07:22:34.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.456+0000 7f8257f0d640 1 -- start start 2024-04-22T07:22:34.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.457+0000 7f8257f0d640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f825006c6a0 0x7f82500cf880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:34.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.457+0000 7f8257f0d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f82500d0af0 0x7f82501f0d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:34.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.457+0000 7f8257f0d640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f82501550b0 0x7f82501f1250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:34.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.457+0000 7f8257f0d640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f82500ccbd0 con 0x7f82500d0af0 2024-04-22T07:22:34.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.457+0000 7f8257f0d640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f82500cc8f0 con 0x7f825006c6a0 2024-04-22T07:22:34.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.457+0000 7f8257f0d640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f825015b0f0 con 0x7f82501550b0 2024-04-22T07:22:34.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.457+0000 7f82554a8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f82500d0af0 0x7f82501f0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:34.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.457+0000 7f82554a8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f82500d0af0 0x7f82501f0d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37092/0 (socket says 172.21.15.37:37092) 2024-04-22T07:22:34.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.457+0000 7f82554a8640 1 -- 172.21.15.37:0/3700588151 learned_addr learned my addr 172.21.15.37:0/3700588151 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:22:34.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.457+0000 7f82564aa640 1 --2- 172.21.15.37:0/3700588151 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f82501550b0 0x7f82501f1250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:34.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.457+0000 7f8255ca9640 1 --2- 172.21.15.37:0/3700588151 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f825006c6a0 0x7f82500cf880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:34.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.457+0000 7f82554a8640 1 -- 172.21.15.37:0/3700588151 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f82501550b0 msgr2=0x7f82501f1250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:34.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.457+0000 7f82554a8640 1 --2- 172.21.15.37:0/3700588151 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f82501550b0 0x7f82501f1250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:34.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.457+0000 7f82554a8640 1 -- 172.21.15.37:0/3700588151 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f825006c6a0 msgr2=0x7f82500cf880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:34.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.457+0000 7f82554a8640 1 --2- 172.21.15.37:0/3700588151 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f825006c6a0 0x7f82500cf880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:34.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.457+0000 7f82554a8640 1 -- 172.21.15.37:0/3700588151 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82500b3530 con 0x7f82500d0af0 2024-04-22T07:22:34.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.457+0000 7f82554a8640 1 --2- 172.21.15.37:0/3700588151 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f82500d0af0 0x7f82501f0d10 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f824000c3f0 tx=0x7f824000c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:22:34.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.457+0000 7f82467fc640 1 -- 172.21.15.37:0/3700588151 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8240017070 con 0x7f82500d0af0 2024-04-22T07:22:34.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.457+0000 7f82467fc640 1 -- 172.21.15.37:0/3700588151 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8240005ce0 con 0x7f82500d0af0 2024-04-22T07:22:34.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.457+0000 7f8257f0d640 1 -- 172.21.15.37:0/3700588151 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8250158490 con 0x7f82500d0af0 2024-04-22T07:22:34.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.458+0000 7f82467fc640 1 -- 172.21.15.37:0/3700588151 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82400072f0 con 0x7f82500d0af0 2024-04-22T07:22:34.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.458+0000 7f8257f0d640 1 -- 172.21.15.37:0/3700588151 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82501f4560 con 0x7f82500d0af0 2024-04-22T07:22:34.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.458+0000 7f8257f0d640 1 -- 172.21.15.37:0/3700588151 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8250069cc0 con 0x7f82500d0af0 2024-04-22T07:22:34.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.459+0000 7f82467fc640 1 -- 172.21.15.37:0/3700588151 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f824001a070 con 0x7f82500d0af0 2024-04-22T07:22:34.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.459+0000 7f82467fc640 1 --2- 172.21.15.37:0/3700588151 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f823406c8f0 0x7f823406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:34.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.460+0000 7f82467fc640 1 -- 172.21.15.37:0/3700588151 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f824008afe0 con 0x7f82500d0af0 2024-04-22T07:22:34.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.460+0000 7f8255ca9640 1 --2- 172.21.15.37:0/3700588151 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f823406c8f0 0x7f823406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:34.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.460+0000 7f8255ca9640 1 --2- 172.21.15.37:0/3700588151 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f823406c8f0 0x7f823406edb0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f824c036000 tx=0x7f824c008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:22:34.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.464+0000 7f82467fc640 1 -- 172.21.15.37:0/3700588151 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f825015ae70 con 0x7f82500d0af0 2024-04-22T07:22:34.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.649+0000 7f8257f0d640 1 -- 172.21.15.37:0/3700588151 --> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7f8250158ac0 con 0x7f823406c8f0 2024-04-22T07:22:34.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.650+0000 7f82467fc640 1 -- 172.21.15.37:0/3700588151 <== mgr.4103 v2:172.21.15.196:6832/321987173 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f8250158ac0 con 0x7f823406c8f0 2024-04-22T07:22:34.648 INFO:teuthology.orchestra.run.smithi037.stderr:instructed osd(s) 3 to deep-scrub 2024-04-22T07:22:34.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.652+0000 7f8257f0d640 1 -- 172.21.15.37:0/3700588151 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f823406c8f0 msgr2=0x7f823406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:34.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.652+0000 7f8257f0d640 1 --2- 172.21.15.37:0/3700588151 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f823406c8f0 0x7f823406edb0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f824c036000 tx=0x7f824c008030 comp rx=0 tx=0).stop 2024-04-22T07:22:34.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.652+0000 7f8257f0d640 1 -- 172.21.15.37:0/3700588151 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f82500d0af0 msgr2=0x7f82501f0d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:34.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.652+0000 7f8257f0d640 1 --2- 172.21.15.37:0/3700588151 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f82500d0af0 0x7f82501f0d10 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f824000c3f0 tx=0x7f824000c8b0 comp rx=0 tx=0).stop 2024-04-22T07:22:34.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.652+0000 7f8257f0d640 1 -- 172.21.15.37:0/3700588151 shutdown_connections 2024-04-22T07:22:34.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.652+0000 7f8257f0d640 1 --2- 172.21.15.37:0/3700588151 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f823406c8f0 0x7f823406edb0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:34.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.652+0000 7f8257f0d640 1 --2- 172.21.15.37:0/3700588151 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f82501550b0 0x7f82501f1250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:34.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.652+0000 7f8257f0d640 1 --2- 172.21.15.37:0/3700588151 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f82500d0af0 0x7f82501f0d10 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:34.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.652+0000 7f8257f0d640 1 --2- 172.21.15.37:0/3700588151 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f825006c6a0 0x7f82500cf880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:34.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.652+0000 7f8257f0d640 1 -- 172.21.15.37:0/3700588151 >> 172.21.15.37:0/3700588151 conn(0x7f8250073630 msgr2=0x7f82500c5f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:22:34.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.652+0000 7f8257f0d640 1 -- 172.21.15.37:0/3700588151 shutdown_connections 2024-04-22T07:22:34.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.652+0000 7f8257f0d640 1 -- 172.21.15.37:0/3700588151 wait complete. 2024-04-22T07:22:34.661 INFO:tasks.ceph:Scrubbing osd.4 2024-04-22T07:22:34.661 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-04-22T07:22:34.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.769+0000 7f39b0011640 1 Processor -- start 2024-04-22T07:22:34.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.769+0000 7f39b0011640 1 -- start start 2024-04-22T07:22:34.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.770+0000 7f39b0011640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f39a81551a0 0x7f39a815b880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:34.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.770+0000 7f39b0011640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f39a80d0570 0x7f39a80d09c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:34.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.770+0000 7f39b0011640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39a815bdc0 con 0x7f39a80cb360 2024-04-22T07:22:34.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.770+0000 7f39b0011640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f39a8155580 con 0x7f39a81551a0 2024-04-22T07:22:34.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.770+0000 7f39b0011640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f39a80c5c60 con 0x7f39a80d0570 2024-04-22T07:22:34.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.770+0000 7f39addad640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f39a81551a0 0x7f39a815b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:34.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.770+0000 7f39ad5ac640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f39a80cb360 0x7f39a80c5550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:60416/0 (socket says 172.21.15.37:60416) 2024-04-22T07:22:34.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.770+0000 7f39addad640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f39a81551a0 0x7f39a815b880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37106/0 (socket says 172.21.15.37:37106) 2024-04-22T07:22:34.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.770+0000 7f39ad5ac640 1 -- 172.21.15.37:0/2815360350 learned_addr learned my addr 172.21.15.37:0/2815360350 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-04-22T07:22:34.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.770+0000 7f39ae5ae640 1 --2- 172.21.15.37:0/2815360350 >> v2:172.21.15.196:3300/0 conn(0x7f39a80d0570 0x7f39a80d09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:34.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.770+0000 7f39addad640 1 -- 172.21.15.37:0/2815360350 >> v2:172.21.15.196:3300/0 conn(0x7f39a80d0570 msgr2=0x7f39a80d09c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:22:34.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.770+0000 7f39addad640 1 --2- 172.21.15.37:0/2815360350 >> v2:172.21.15.196:3300/0 conn(0x7f39a80d0570 0x7f39a80d09c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:34.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.770+0000 7f39addad640 1 -- 172.21.15.37:0/2815360350 >> v1:172.21.15.37:6789/0 conn(0x7f39a80cb360 legacy=0x7f39a80c5550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:34.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.770+0000 7f39acdab640 1 -- 172.21.15.37:0/2815360350 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1983987356 0 0) 0x7f3998001110 con 0x7f39a80cb360 2024-04-22T07:22:34.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.770+0000 7f39addad640 1 -- 172.21.15.37:0/2815360350 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39a80ccad0 con 0x7f39a81551a0 2024-04-22T07:22:34.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.770+0000 7f39ae5ae640 1 --2- 172.21.15.37:0/2815360350 >> v2:172.21.15.196:3300/0 conn(0x7f39a80d0570 0x7f39a80d09c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-22T07:22:34.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.771+0000 7f39addad640 1 --2- 172.21.15.37:0/2815360350 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f39a81551a0 0x7f39a815b880 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f39a80b3380 tx=0x7f39a402b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=777587bb2c6ff17b server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:22:34.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.771+0000 7f39acdab640 1 -- 172.21.15.37:0/2815360350 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39a4034070 con 0x7f39a81551a0 2024-04-22T07:22:34.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.771+0000 7f39acdab640 1 -- 172.21.15.37:0/2815360350 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39a4030610 con 0x7f39a81551a0 2024-04-22T07:22:34.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.771+0000 7f39acdab640 1 -- 172.21.15.37:0/2815360350 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39a40309e0 con 0x7f39a81551a0 2024-04-22T07:22:34.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.772+0000 7f39b0011640 1 -- 172.21.15.37:0/2815360350 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f39a81551a0 msgr2=0x7f39a815b880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:34.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.772+0000 7f39b0011640 1 --2- 172.21.15.37:0/2815360350 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f39a81551a0 0x7f39a815b880 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f39a80b3380 tx=0x7f39a402b960 comp rx=0 tx=0).stop 2024-04-22T07:22:34.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.772+0000 7f39b0011640 1 -- 172.21.15.37:0/2815360350 shutdown_connections 2024-04-22T07:22:34.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.772+0000 7f39b0011640 1 --2- 172.21.15.37:0/2815360350 >> v2:172.21.15.196:3300/0 conn(0x7f39a80d0570 0x7f39a80d09c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:34.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.772+0000 7f39b0011640 1 --2- 172.21.15.37:0/2815360350 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f39a81551a0 0x7f39a815b880 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:34.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.772+0000 7f39b0011640 1 -- 172.21.15.37:0/2815360350 >> 172.21.15.37:0/2815360350 conn(0x7f39a8067890 msgr2=0x7f39a8073490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:22:34.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.772+0000 7f39b0011640 1 -- 172.21.15.37:0/2815360350 shutdown_connections 2024-04-22T07:22:34.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.772+0000 7f39b0011640 1 -- 172.21.15.37:0/2815360350 wait complete. 2024-04-22T07:22:34.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.773+0000 7f39b0011640 1 Processor -- start 2024-04-22T07:22:34.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.773+0000 7f39b0011640 1 -- start start 2024-04-22T07:22:34.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.774+0000 7f39b0011640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f39a80cb360 0x7f39a80b6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:34.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.774+0000 7f39b0011640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f39a80d0570 0x7f39a8143260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:34.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.774+0000 7f39b0011640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f39a81551a0 0x7f39a813ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:34.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.774+0000 7f39b0011640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f39a815ea50 con 0x7f39a80cb360 2024-04-22T07:22:34.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.774+0000 7f39b0011640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f39a815e770 con 0x7f39a80d0570 2024-04-22T07:22:34.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.774+0000 7f39b0011640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f39a815ed30 con 0x7f39a81551a0 2024-04-22T07:22:34.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.774+0000 7f39addad640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f39a80cb360 0x7f39a80b6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:34.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.774+0000 7f39addad640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f39a80cb360 0x7f39a80b6120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37116/0 (socket says 172.21.15.37:37116) 2024-04-22T07:22:34.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.774+0000 7f39addad640 1 -- 172.21.15.37:0/1671594843 learned_addr learned my addr 172.21.15.37:0/1671594843 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:22:34.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.774+0000 7f39ad5ac640 1 --2- 172.21.15.37:0/1671594843 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f39a80d0570 0x7f39a8143260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:34.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.774+0000 7f39ae5ae640 1 --2- 172.21.15.37:0/1671594843 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f39a81551a0 0x7f39a813ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:34.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.774+0000 7f39addad640 1 -- 172.21.15.37:0/1671594843 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f39a81551a0 msgr2=0x7f39a813ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:34.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.774+0000 7f39addad640 1 --2- 172.21.15.37:0/1671594843 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f39a81551a0 0x7f39a813ee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:34.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.774+0000 7f39addad640 1 -- 172.21.15.37:0/1671594843 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f39a80d0570 msgr2=0x7f39a8143260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:34.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.774+0000 7f39addad640 1 --2- 172.21.15.37:0/1671594843 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f39a80d0570 0x7f39a8143260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:34.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.774+0000 7f39addad640 1 -- 172.21.15.37:0/1671594843 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39a815c060 con 0x7f39a80cb360 2024-04-22T07:22:34.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.774+0000 7f39ad5ac640 1 --2- 172.21.15.37:0/1671594843 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f39a80d0570 0x7f39a8143260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T07:22:34.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.774+0000 7f39addad640 1 --2- 172.21.15.37:0/1671594843 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f39a80cb360 0x7f39a80b6120 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f39a4009890 tx=0x7f39a40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:22:34.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.775+0000 7f399e7fc640 1 -- 172.21.15.37:0/1671594843 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39a4034040 con 0x7f39a80cb360 2024-04-22T07:22:34.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.775+0000 7f399e7fc640 1 -- 172.21.15.37:0/1671594843 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39a403acc0 con 0x7f39a80cb360 2024-04-22T07:22:34.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.775+0000 7f39b0011640 1 -- 172.21.15.37:0/1671594843 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39a81e5090 con 0x7f39a80cb360 2024-04-22T07:22:34.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.775+0000 7f399e7fc640 1 -- 172.21.15.37:0/1671594843 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39a4044640 con 0x7f39a80cb360 2024-04-22T07:22:34.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.775+0000 7f39b0011640 1 -- 172.21.15.37:0/1671594843 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39a815da10 con 0x7f39a80cb360 2024-04-22T07:22:34.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.775+0000 7f39b0011640 1 -- 172.21.15.37:0/1671594843 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f39a8069cc0 con 0x7f39a80cb360 2024-04-22T07:22:34.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.776+0000 7f399e7fc640 1 -- 172.21.15.37:0/1671594843 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f39a4037070 con 0x7f39a80cb360 2024-04-22T07:22:34.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.777+0000 7f399e7fc640 1 --2- 172.21.15.37:0/1671594843 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f398c06c8f0 0x7f398c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:34.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.777+0000 7f399e7fc640 1 -- 172.21.15.37:0/1671594843 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f39a40ad7e0 con 0x7f39a80cb360 2024-04-22T07:22:34.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.777+0000 7f399e7fc640 1 --2- 172.21.15.37:0/1671594843 >> [v2:172.21.15.196:6808/374829049,v1:172.21.15.196:6809/374829049] conn(0x7f398c074c70 0x7f398c0770f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:34.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.777+0000 7f399e7fc640 1 -- 172.21.15.37:0/1671594843 --> [v2:172.21.15.196:6808/374829049,v1:172.21.15.196:6809/374829049] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f39a4032e50 con 0x7f398c074c70 2024-04-22T07:22:34.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.777+0000 7f399e7fc640 1 -- 172.21.15.37:0/1671594843 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f39a40b4050 con 0x7f39a80cb360 2024-04-22T07:22:34.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.777+0000 7f39ad5ac640 1 --2- 172.21.15.37:0/1671594843 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f398c06c8f0 0x7f398c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:34.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.777+0000 7f39ae5ae640 1 --2- 172.21.15.37:0/1671594843 >> [v2:172.21.15.196:6808/374829049,v1:172.21.15.196:6809/374829049] conn(0x7f398c074c70 0x7f398c0770f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:34.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.777+0000 7f39ad5ac640 1 --2- 172.21.15.37:0/1671594843 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f398c06c8f0 0x7f398c06edb0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f39a8142ee0 tx=0x7f3998007a30 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:22:34.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.777+0000 7f39ae5ae640 1 --2- 172.21.15.37:0/1671594843 >> [v2:172.21.15.196:6808/374829049,v1:172.21.15.196:6809/374829049] conn(0x7f398c074c70 0x7f398c0770f0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:22:34.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.778+0000 7f399e7fc640 1 -- 172.21.15.37:0/1671594843 <== osd.4 v2:172.21.15.196:6808/374829049 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f39a4032e50 con 0x7f398c074c70 2024-04-22T07:22:34.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.791+0000 7f39b0011640 1 -- 172.21.15.37:0/1671594843 --> [v2:172.21.15.196:6808/374829049,v1:172.21.15.196:6809/374829049] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f39a815dcf0 con 0x7f398c074c70 2024-04-22T07:22:34.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.792+0000 7f399e7fc640 1 -- 172.21.15.37:0/1671594843 <== osd.4 v2:172.21.15.196:6808/374829049 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f39a815dcf0 con 0x7f398c074c70 2024-04-22T07:22:34.790 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-04-22T07:22:34.790 INFO:teuthology.orchestra.run.smithi037.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-22T07:22:34.790 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-04-22T07:22:34.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.792+0000 7f39b0011640 1 -- 172.21.15.37:0/1671594843 >> [v2:172.21.15.196:6808/374829049,v1:172.21.15.196:6809/374829049] conn(0x7f398c074c70 msgr2=0x7f398c0770f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:34.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.792+0000 7f39b0011640 1 --2- 172.21.15.37:0/1671594843 >> [v2:172.21.15.196:6808/374829049,v1:172.21.15.196:6809/374829049] conn(0x7f398c074c70 0x7f398c0770f0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:34.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.792+0000 7f39b0011640 1 -- 172.21.15.37:0/1671594843 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f398c06c8f0 msgr2=0x7f398c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:34.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.792+0000 7f39b0011640 1 --2- 172.21.15.37:0/1671594843 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f398c06c8f0 0x7f398c06edb0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f39a8142ee0 tx=0x7f3998007a30 comp rx=0 tx=0).stop 2024-04-22T07:22:34.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.792+0000 7f39b0011640 1 -- 172.21.15.37:0/1671594843 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f39a80cb360 msgr2=0x7f39a80b6120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:34.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.792+0000 7f39b0011640 1 --2- 172.21.15.37:0/1671594843 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f39a80cb360 0x7f39a80b6120 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f39a4009890 tx=0x7f39a40046c0 comp rx=0 tx=0).stop 2024-04-22T07:22:34.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.792+0000 7f39ae5ae640 1 -- 172.21.15.37:0/1671594843 reap_dead start 2024-04-22T07:22:34.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.792+0000 7f39b0011640 1 -- 172.21.15.37:0/1671594843 shutdown_connections 2024-04-22T07:22:34.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.792+0000 7f39b0011640 1 -- 172.21.15.37:0/1671594843 >> 172.21.15.37:0/1671594843 conn(0x7f39a8067890 msgr2=0x7f39a80cf030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:22:34.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.792+0000 7f39b0011640 1 -- 172.21.15.37:0/1671594843 shutdown_connections 2024-04-22T07:22:34.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.792+0000 7f39b0011640 1 -- 172.21.15.37:0/1671594843 wait complete. 2024-04-22T07:22:34.801 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-04-22T07:22:34.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.904+0000 7f550394b640 1 Processor -- start 2024-04-22T07:22:34.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.905+0000 7f550394b640 1 -- start start 2024-04-22T07:22:34.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.905+0000 7f550394b640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f54fc0d0c20 0x7f54fc15b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:34.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.905+0000 7f550394b640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f54fc0cafa0 0x7f54fc15c430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:34.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.905+0000 7f550394b640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f54fc0cb430 con 0x7f54fc0d1000 2024-04-22T07:22:34.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.905+0000 7f550394b640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f54fc0c5560 con 0x7f54fc0cafa0 2024-04-22T07:22:34.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.905+0000 7f550394b640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f54fc0c6660 con 0x7f54fc0d0c20 2024-04-22T07:22:34.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.906+0000 7f5500ee6640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f54fc0d1000 0x7f54fc154b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:60422/0 (socket says 172.21.15.37:60422) 2024-04-22T07:22:34.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.906+0000 7f5500ee6640 1 -- 172.21.15.37:0/3488628193 learned_addr learned my addr 172.21.15.37:0/3488628193 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-04-22T07:22:34.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.906+0000 7f5501ee8640 1 --2- 172.21.15.37:0/3488628193 >> v2:172.21.15.196:3300/0 conn(0x7f54fc0cafa0 0x7f54fc15c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:34.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.906+0000 7f55016e7640 1 --2- 172.21.15.37:0/3488628193 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f54fc0d0c20 0x7f54fc15b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:34.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.906+0000 7f54f3fff640 1 -- 172.21.15.37:0/3488628193 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2884428765 0 0) 0x7f54ec001110 con 0x7f54fc0d1000 2024-04-22T07:22:34.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.906+0000 7f54f3fff640 1 -- 172.21.15.37:0/3488628193 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f54e8003520 con 0x7f54fc0d1000 2024-04-22T07:22:34.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.906+0000 7f5501ee8640 1 -- 172.21.15.37:0/3488628193 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f54fc0d0c20 msgr2=0x7f54fc15b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:22:34.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.906+0000 7f5501ee8640 1 --2- 172.21.15.37:0/3488628193 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f54fc0d0c20 0x7f54fc15b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:34.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.906+0000 7f5501ee8640 1 -- 172.21.15.37:0/3488628193 >> v1:172.21.15.37:6789/0 conn(0x7f54fc0d1000 legacy=0x7f54fc154b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:34.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.906+0000 7f5501ee8640 1 -- 172.21.15.37:0/3488628193 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54fc0c5790 con 0x7f54fc0cafa0 2024-04-22T07:22:34.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.907+0000 7f5501ee8640 1 --2- 172.21.15.37:0/3488628193 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f54fc0cafa0 0x7f54fc15c430 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f54f4009d90 tx=0x7f54f402bf30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4006d3c500584e38 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:22:34.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.907+0000 7f54f3fff640 1 -- 172.21.15.37:0/3488628193 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54f4039070 con 0x7f54fc0cafa0 2024-04-22T07:22:34.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.907+0000 7f54f3fff640 1 -- 172.21.15.37:0/3488628193 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54f402cce0 con 0x7f54fc0cafa0 2024-04-22T07:22:34.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.907+0000 7f54f3fff640 1 -- 172.21.15.37:0/3488628193 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54f4034640 con 0x7f54fc0cafa0 2024-04-22T07:22:34.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.908+0000 7f550394b640 1 -- 172.21.15.37:0/3488628193 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f54fc0cafa0 msgr2=0x7f54fc15c430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:34.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.908+0000 7f550394b640 1 --2- 172.21.15.37:0/3488628193 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f54fc0cafa0 0x7f54fc15c430 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f54f4009d90 tx=0x7f54f402bf30 comp rx=0 tx=0).stop 2024-04-22T07:22:34.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.908+0000 7f550394b640 1 -- 172.21.15.37:0/3488628193 shutdown_connections 2024-04-22T07:22:34.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.908+0000 7f550394b640 1 --2- 172.21.15.37:0/3488628193 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f54fc0cafa0 0x7f54fc15c430 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:34.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.908+0000 7f550394b640 1 --2- 172.21.15.37:0/3488628193 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f54fc0d0c20 0x7f54fc15b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:34.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.908+0000 7f550394b640 1 -- 172.21.15.37:0/3488628193 >> 172.21.15.37:0/3488628193 conn(0x7f54fc0676b0 msgr2=0x7f54fc067ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:22:34.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.908+0000 7f550394b640 1 -- 172.21.15.37:0/3488628193 shutdown_connections 2024-04-22T07:22:34.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.908+0000 7f550394b640 1 -- 172.21.15.37:0/3488628193 wait complete. 2024-04-22T07:22:34.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.909+0000 7f550394b640 1 Processor -- start 2024-04-22T07:22:34.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.909+0000 7f550394b640 1 -- start start 2024-04-22T07:22:34.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.909+0000 7f550394b640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f54fc0cafa0 0x7f54fc0b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:34.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.909+0000 7f550394b640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f54fc0d0c20 0x7f54fc147ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:34.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.909+0000 7f550394b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54fc0d1000 0x7f54fc1481e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:34.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.910+0000 7f550394b640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f54fc0c6010 con 0x7f54fc0d1000 2024-04-22T07:22:34.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.910+0000 7f550394b640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f54fc0c5d30 con 0x7f54fc0cafa0 2024-04-22T07:22:34.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.910+0000 7f550394b640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f54fc0c62f0 con 0x7f54fc0d0c20 2024-04-22T07:22:34.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.910+0000 7f5501ee8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54fc0d1000 0x7f54fc1481e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:34.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.910+0000 7f5501ee8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54fc0d1000 0x7f54fc1481e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37130/0 (socket says 172.21.15.37:37130) 2024-04-22T07:22:34.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.910+0000 7f5501ee8640 1 -- 172.21.15.37:0/3700495936 learned_addr learned my addr 172.21.15.37:0/3700495936 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:22:34.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.910+0000 7f5500ee6640 1 --2- 172.21.15.37:0/3700495936 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f54fc0d0c20 0x7f54fc147ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:34.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.910+0000 7f55016e7640 1 --2- 172.21.15.37:0/3700495936 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f54fc0cafa0 0x7f54fc0b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:34.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.910+0000 7f5501ee8640 1 -- 172.21.15.37:0/3700495936 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f54fc0d0c20 msgr2=0x7f54fc147ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:34.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.910+0000 7f5501ee8640 1 --2- 172.21.15.37:0/3700495936 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f54fc0d0c20 0x7f54fc147ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:34.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.910+0000 7f5501ee8640 1 -- 172.21.15.37:0/3700495936 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f54fc0cafa0 msgr2=0x7f54fc0b4dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:34.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.910+0000 7f5501ee8640 1 --2- 172.21.15.37:0/3700495936 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f54fc0cafa0 0x7f54fc0b4dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:34.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.910+0000 7f5501ee8640 1 -- 172.21.15.37:0/3700495936 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54fc15a500 con 0x7f54fc0d1000 2024-04-22T07:22:34.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.910+0000 7f5501ee8640 1 --2- 172.21.15.37:0/3700495936 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54fc0d1000 0x7f54fc1481e0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f54f4009d90 tx=0x7f54f4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:22:34.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.910+0000 7f54f1ffb640 1 -- 172.21.15.37:0/3700495936 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54f4039050 con 0x7f54fc0d1000 2024-04-22T07:22:34.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.910+0000 7f54f1ffb640 1 -- 172.21.15.37:0/3700495936 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54f4045070 con 0x7f54fc0d1000 2024-04-22T07:22:34.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.910+0000 7f550394b640 1 -- 172.21.15.37:0/3700495936 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54fc15a7e0 con 0x7f54fc0d1000 2024-04-22T07:22:34.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.910+0000 7f54f1ffb640 1 -- 172.21.15.37:0/3700495936 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54f4009450 con 0x7f54fc0d1000 2024-04-22T07:22:34.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.911+0000 7f550394b640 1 -- 172.21.15.37:0/3700495936 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54fc15ada0 con 0x7f54fc0d1000 2024-04-22T07:22:34.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.912+0000 7f550394b640 1 -- 172.21.15.37:0/3700495936 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f54fc0c6f20 con 0x7f54fc0d1000 2024-04-22T07:22:34.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.912+0000 7f54f1ffb640 1 -- 172.21.15.37:0/3700495936 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f54f403e830 con 0x7f54fc0d1000 2024-04-22T07:22:34.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.912+0000 7f54f1ffb640 1 --2- 172.21.15.37:0/3700495936 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f54e006c8f0 0x7f54e006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:34.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.913+0000 7f54f1ffb640 1 -- 172.21.15.37:0/3700495936 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f54f40ae7c0 con 0x7f54fc0d1000 2024-04-22T07:22:34.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.913+0000 7f55016e7640 1 --2- 172.21.15.37:0/3700495936 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f54e006c8f0 0x7f54e006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:34.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.913+0000 7f55016e7640 1 --2- 172.21.15.37:0/3700495936 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f54e006c8f0 0x7f54e006edb0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f54f8009b40 tx=0x7f54f8009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:22:34.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:34.917+0000 7f54f1ffb640 1 -- 172.21.15.37:0/3700495936 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f54fc0c6f20 con 0x7f54fc0d1000 2024-04-22T07:22:35.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.110+0000 7f550394b640 1 -- 172.21.15.37:0/3700495936 --> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7f54fc068b20 con 0x7f54e006c8f0 2024-04-22T07:22:35.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.110+0000 7f54f1ffb640 1 -- 172.21.15.37:0/3700495936 <== mgr.4103 v2:172.21.15.196:6832/321987173 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f54fc068b20 con 0x7f54e006c8f0 2024-04-22T07:22:35.108 INFO:teuthology.orchestra.run.smithi037.stderr:instructed osd(s) 4 to deep-scrub 2024-04-22T07:22:35.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.112+0000 7f550394b640 1 -- 172.21.15.37:0/3700495936 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f54e006c8f0 msgr2=0x7f54e006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:35.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.112+0000 7f550394b640 1 --2- 172.21.15.37:0/3700495936 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f54e006c8f0 0x7f54e006edb0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f54f8009b40 tx=0x7f54f8009190 comp rx=0 tx=0).stop 2024-04-22T07:22:35.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.112+0000 7f550394b640 1 -- 172.21.15.37:0/3700495936 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54fc0d1000 msgr2=0x7f54fc1481e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:35.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.112+0000 7f550394b640 1 --2- 172.21.15.37:0/3700495936 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54fc0d1000 0x7f54fc1481e0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f54f4009d90 tx=0x7f54f4004a40 comp rx=0 tx=0).stop 2024-04-22T07:22:35.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.112+0000 7f550394b640 1 -- 172.21.15.37:0/3700495936 shutdown_connections 2024-04-22T07:22:35.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.112+0000 7f550394b640 1 --2- 172.21.15.37:0/3700495936 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f54e006c8f0 0x7f54e006edb0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:35.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.112+0000 7f550394b640 1 --2- 172.21.15.37:0/3700495936 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54fc0d1000 0x7f54fc1481e0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:35.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.112+0000 7f550394b640 1 --2- 172.21.15.37:0/3700495936 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f54fc0d0c20 0x7f54fc147ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:35.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.112+0000 7f550394b640 1 --2- 172.21.15.37:0/3700495936 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f54fc0cafa0 0x7f54fc0b4dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:35.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.112+0000 7f550394b640 1 -- 172.21.15.37:0/3700495936 >> 172.21.15.37:0/3700495936 conn(0x7f54fc0676b0 msgr2=0x7f54fc1e7040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:22:35.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.112+0000 7f550394b640 1 -- 172.21.15.37:0/3700495936 shutdown_connections 2024-04-22T07:22:35.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.112+0000 7f550394b640 1 -- 172.21.15.37:0/3700495936 wait complete. 2024-04-22T07:22:35.121 INFO:tasks.ceph:Scrubbing osd.5 2024-04-22T07:22:35.121 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-04-22T07:22:35.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.228+0000 7fcc35506640 1 Processor -- start 2024-04-22T07:22:35.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.228+0000 7fcc35506640 1 -- start start 2024-04-22T07:22:35.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.229+0000 7fcc35506640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fcc30152f10 0x7fcc300c8f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:35.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.229+0000 7fcc35506640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcc300c9620 con 0x7fcc3006f570 2024-04-22T07:22:35.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.229+0000 7fcc35506640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcc300c35b0 con 0x7fcc300ca940 2024-04-22T07:22:35.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.229+0000 7fcc35506640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fcc300c99e0 con 0x7fcc30152f10 2024-04-22T07:22:35.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.229+0000 7fcc2effd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fcc30152f10 0x7fcc300c8f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:35.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.229+0000 7fcc2f7fe640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fcc3006f570 0x7fcc301635f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:60438/0 (socket says 172.21.15.37:60438) 2024-04-22T07:22:35.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.229+0000 7fcc2effd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fcc30152f10 0x7fcc300c8f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37142/0 (socket says 172.21.15.37:37142) 2024-04-22T07:22:35.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.229+0000 7fcc2f7fe640 1 -- 172.21.15.37:0/2576359821 learned_addr learned my addr 172.21.15.37:0/2576359821 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-04-22T07:22:35.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.230+0000 7fcc2effd640 1 -- 172.21.15.37:0/2576359821 >> v1:172.21.15.196:6789/0 conn(0x7fcc300ca940 legacy=0x7fcc300c9e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:22:35.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.230+0000 7fcc2effd640 1 -- 172.21.15.37:0/2576359821 >> v1:172.21.15.37:6789/0 conn(0x7fcc3006f570 legacy=0x7fcc301635f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:35.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.230+0000 7fcc2effd640 1 -- 172.21.15.37:0/2576359821 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc300c3890 con 0x7fcc30152f10 2024-04-22T07:22:35.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.230+0000 7fcc2dffb640 1 -- 172.21.15.37:0/2576359821 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3052622484 0 0) 0x7fcc300c9620 con 0x7fcc3006f570 2024-04-22T07:22:35.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.230+0000 7fcc2effd640 1 --2- 172.21.15.37:0/2576359821 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcc30152f10 0x7fcc300c8f90 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fcc280097a0 tx=0x7fcc2802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20156c8f3cbf328b server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:22:35.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.231+0000 7fcc2dffb640 1 -- 172.21.15.37:0/2576359821 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc28035020 con 0x7fcc30152f10 2024-04-22T07:22:35.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.231+0000 7fcc2dffb640 1 -- 172.21.15.37:0/2576359821 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc28031830 con 0x7fcc30152f10 2024-04-22T07:22:35.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.231+0000 7fcc2dffb640 1 -- 172.21.15.37:0/2576359821 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc28031c00 con 0x7fcc30152f10 2024-04-22T07:22:35.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.231+0000 7fcc35506640 1 -- 172.21.15.37:0/2576359821 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcc30152f10 msgr2=0x7fcc300c8f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:35.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.231+0000 7fcc35506640 1 --2- 172.21.15.37:0/2576359821 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcc30152f10 0x7fcc300c8f90 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fcc280097a0 tx=0x7fcc2802b8d0 comp rx=0 tx=0).stop 2024-04-22T07:22:35.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.231+0000 7fcc35506640 1 -- 172.21.15.37:0/2576359821 shutdown_connections 2024-04-22T07:22:35.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.231+0000 7fcc35506640 1 --2- 172.21.15.37:0/2576359821 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcc30152f10 0x7fcc300c8f90 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:35.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.231+0000 7fcc35506640 1 -- 172.21.15.37:0/2576359821 >> 172.21.15.37:0/2576359821 conn(0x7fcc30067890 msgr2=0x7fcc3006db80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:22:35.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.231+0000 7fcc35506640 1 -- 172.21.15.37:0/2576359821 shutdown_connections 2024-04-22T07:22:35.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.231+0000 7fcc35506640 1 -- 172.21.15.37:0/2576359821 wait complete. 2024-04-22T07:22:35.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.232+0000 7fcc35506640 1 Processor -- start 2024-04-22T07:22:35.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.232+0000 7fcc35506640 1 -- start start 2024-04-22T07:22:35.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.233+0000 7fcc35506640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcc3006f570 0x7fcc3014dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:35.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.233+0000 7fcc35506640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcc300ca940 0x7fcc300c7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:35.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.233+0000 7fcc35506640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcc30152f10 0x7fcc300c5f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:35.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.233+0000 7fcc35506640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fcc301532f0 con 0x7fcc3006f570 2024-04-22T07:22:35.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.233+0000 7fcc35506640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fcc300c3e50 con 0x7fcc30152f10 2024-04-22T07:22:35.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.233+0000 7fcc35506640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fcc301ef650 con 0x7fcc300ca940 2024-04-22T07:22:35.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.233+0000 7fcc2effd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcc3006f570 0x7fcc3014dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:35.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.233+0000 7fcc2effd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcc3006f570 0x7fcc3014dbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37148/0 (socket says 172.21.15.37:37148) 2024-04-22T07:22:35.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.233+0000 7fcc2effd640 1 -- 172.21.15.37:0/2942540443 learned_addr learned my addr 172.21.15.37:0/2942540443 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:22:35.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.234+0000 7fcc2effd640 1 -- 172.21.15.37:0/2942540443 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcc300ca940 msgr2=0x7fcc300c7ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:35.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.234+0000 7fcc2e7fc640 1 --2- 172.21.15.37:0/2942540443 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcc300ca940 0x7fcc300c7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:35.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.234+0000 7fcc2f7fe640 1 --2- 172.21.15.37:0/2942540443 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcc30152f10 0x7fcc300c5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:35.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.234+0000 7fcc2effd640 1 --2- 172.21.15.37:0/2942540443 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcc300ca940 0x7fcc300c7ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:35.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.234+0000 7fcc2effd640 1 -- 172.21.15.37:0/2942540443 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcc30152f10 msgr2=0x7fcc300c5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:35.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.234+0000 7fcc2effd640 1 --2- 172.21.15.37:0/2942540443 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcc30152f10 0x7fcc300c5f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:35.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.234+0000 7fcc2effd640 1 -- 172.21.15.37:0/2942540443 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc301ef0f0 con 0x7fcc3006f570 2024-04-22T07:22:35.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.234+0000 7fcc2effd640 1 --2- 172.21.15.37:0/2942540443 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcc3006f570 0x7fcc3014dbe0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fcc280097a0 tx=0x7fcc280046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:22:35.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.234+0000 7fcc177fe640 1 -- 172.21.15.37:0/2942540443 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc2803aa70 con 0x7fcc3006f570 2024-04-22T07:22:35.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.234+0000 7fcc177fe640 1 -- 172.21.15.37:0/2942540443 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc2803ac10 con 0x7fcc3006f570 2024-04-22T07:22:35.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.234+0000 7fcc177fe640 1 -- 172.21.15.37:0/2942540443 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc280443f0 con 0x7fcc3006f570 2024-04-22T07:22:35.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.234+0000 7fcc35506640 1 -- 172.21.15.37:0/2942540443 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc3015a6a0 con 0x7fcc3006f570 2024-04-22T07:22:35.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.234+0000 7fcc35506640 1 -- 172.21.15.37:0/2942540443 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc301ef370 con 0x7fcc3006f570 2024-04-22T07:22:35.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.235+0000 7fcc35506640 1 -- 172.21.15.37:0/2942540443 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fcc30068b20 con 0x7fcc3006f570 2024-04-22T07:22:35.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.235+0000 7fcc177fe640 1 -- 172.21.15.37:0/2942540443 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fcc2804b060 con 0x7fcc3006f570 2024-04-22T07:22:35.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.236+0000 7fcc177fe640 1 --2- 172.21.15.37:0/2942540443 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fcc1c06c920 0x7fcc1c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:35.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.236+0000 7fcc177fe640 1 -- 172.21.15.37:0/2942540443 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7fcc280ad8e0 con 0x7fcc3006f570 2024-04-22T07:22:35.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.236+0000 7fcc177fe640 1 --2- 172.21.15.37:0/2942540443 >> [v2:172.21.15.196:6800/479311302,v1:172.21.15.196:6801/479311302] conn(0x7fcc1c074ca0 0x7fcc1c077120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:35.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.236+0000 7fcc177fe640 1 -- 172.21.15.37:0/2942540443 --> [v2:172.21.15.196:6800/479311302,v1:172.21.15.196:6801/479311302] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fcc2804ee50 con 0x7fcc1c074ca0 2024-04-22T07:22:35.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.236+0000 7fcc177fe640 1 -- 172.21.15.37:0/2942540443 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7fcc280b22a0 con 0x7fcc3006f570 2024-04-22T07:22:35.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.236+0000 7fcc2e7fc640 1 --2- 172.21.15.37:0/2942540443 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fcc1c06c920 0x7fcc1c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:35.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.236+0000 7fcc2f7fe640 1 --2- 172.21.15.37:0/2942540443 >> [v2:172.21.15.196:6800/479311302,v1:172.21.15.196:6801/479311302] conn(0x7fcc1c074ca0 0x7fcc1c077120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:35.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.237+0000 7fcc2e7fc640 1 --2- 172.21.15.37:0/2942540443 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fcc1c06c920 0x7fcc1c06ede0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fcc3006ff70 tx=0x7fcc24009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:22:35.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.237+0000 7fcc2f7fe640 1 --2- 172.21.15.37:0/2942540443 >> [v2:172.21.15.196:6800/479311302,v1:172.21.15.196:6801/479311302] conn(0x7fcc1c074ca0 0x7fcc1c077120 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:22:35.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.237+0000 7fcc177fe640 1 -- 172.21.15.37:0/2942540443 <== osd.5 v2:172.21.15.196:6800/479311302 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fcc2804ee50 con 0x7fcc1c074ca0 2024-04-22T07:22:35.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.250+0000 7fcc35506640 1 -- 172.21.15.37:0/2942540443 --> [v2:172.21.15.196:6800/479311302,v1:172.21.15.196:6801/479311302] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fcc300cbe60 con 0x7fcc1c074ca0 2024-04-22T07:22:35.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.251+0000 7fcc177fe640 1 -- 172.21.15.37:0/2942540443 <== osd.5 v2:172.21.15.196:6800/479311302 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fcc300cbe60 con 0x7fcc1c074ca0 2024-04-22T07:22:35.249 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-04-22T07:22:35.249 INFO:teuthology.orchestra.run.smithi037.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-22T07:22:35.249 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-04-22T07:22:35.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.251+0000 7fcc35506640 1 -- 172.21.15.37:0/2942540443 >> [v2:172.21.15.196:6800/479311302,v1:172.21.15.196:6801/479311302] conn(0x7fcc1c074ca0 msgr2=0x7fcc1c077120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:35.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.251+0000 7fcc35506640 1 --2- 172.21.15.37:0/2942540443 >> [v2:172.21.15.196:6800/479311302,v1:172.21.15.196:6801/479311302] conn(0x7fcc1c074ca0 0x7fcc1c077120 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:35.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.252+0000 7fcc35506640 1 -- 172.21.15.37:0/2942540443 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fcc1c06c920 msgr2=0x7fcc1c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:35.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.252+0000 7fcc35506640 1 --2- 172.21.15.37:0/2942540443 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fcc1c06c920 0x7fcc1c06ede0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fcc3006ff70 tx=0x7fcc24009040 comp rx=0 tx=0).stop 2024-04-22T07:22:35.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.252+0000 7fcc35506640 1 -- 172.21.15.37:0/2942540443 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcc3006f570 msgr2=0x7fcc3014dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:35.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.252+0000 7fcc35506640 1 --2- 172.21.15.37:0/2942540443 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcc3006f570 0x7fcc3014dbe0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fcc280097a0 tx=0x7fcc280046c0 comp rx=0 tx=0).stop 2024-04-22T07:22:35.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.252+0000 7fcc2f7fe640 1 -- 172.21.15.37:0/2942540443 reap_dead start 2024-04-22T07:22:35.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.252+0000 7fcc35506640 1 -- 172.21.15.37:0/2942540443 shutdown_connections 2024-04-22T07:22:35.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.252+0000 7fcc35506640 1 -- 172.21.15.37:0/2942540443 >> 172.21.15.37:0/2942540443 conn(0x7fcc30067890 msgr2=0x7fcc300c9e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:22:35.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.252+0000 7fcc35506640 1 -- 172.21.15.37:0/2942540443 shutdown_connections 2024-04-22T07:22:35.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.252+0000 7fcc35506640 1 -- 172.21.15.37:0/2942540443 wait complete. 2024-04-22T07:22:35.260 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-04-22T07:22:35.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.364+0000 7f460f425640 1 Processor -- start 2024-04-22T07:22:35.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.364+0000 7f460f425640 1 -- start start 2024-04-22T07:22:35.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.365+0000 7f460f425640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4608072070 0x7f46080c62b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:35.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.365+0000 7f460f425640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f46080c3b30 0x7f46080c67f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:35.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.365+0000 7f460f425640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46080c25f0 con 0x7f4608152f20 2024-04-22T07:22:35.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.365+0000 7f460f425640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f46081592c0 con 0x7f46080c3b30 2024-04-22T07:22:35.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.365+0000 7f460f425640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f46080ca490 con 0x7f4608072070 2024-04-22T07:22:35.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.365+0000 7f460d1c1640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f4608152f20 0x7f4608159750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:60442/0 (socket says 172.21.15.37:60442) 2024-04-22T07:22:35.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.365+0000 7f460d1c1640 1 -- 172.21.15.37:0/4060514205 learned_addr learned my addr 172.21.15.37:0/4060514205 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-04-22T07:22:35.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.365+0000 7f460d9c2640 1 --2- 172.21.15.37:0/4060514205 >> v2:172.21.15.196:3300/0 conn(0x7f46080c3b30 0x7f46080c67f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:35.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.365+0000 7f460c9c0640 1 --2- 172.21.15.37:0/4060514205 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4608072070 0x7f46080c62b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:35.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.365+0000 7f45fffff640 1 -- 172.21.15.37:0/4060514205 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2064554664 0 0) 0x7f46080c25f0 con 0x7f4608152f20 2024-04-22T07:22:35.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.365+0000 7f45fffff640 1 -- 172.21.15.37:0/4060514205 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f45f4003520 con 0x7f4608152f20 2024-04-22T07:22:35.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.365+0000 7f460d9c2640 1 -- 172.21.15.37:0/4060514205 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4608072070 msgr2=0x7f46080c62b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:22:35.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.365+0000 7f45fffff640 1 -- 172.21.15.37:0/4060514205 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4262021769 0 0) 0x7f45f4003520 con 0x7f4608152f20 2024-04-22T07:22:35.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.366+0000 7f460d9c2640 1 --2- 172.21.15.37:0/4060514205 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4608072070 0x7f46080c62b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:35.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.366+0000 7f460d9c2640 1 -- 172.21.15.37:0/4060514205 >> v1:172.21.15.37:6789/0 conn(0x7f4608152f20 legacy=0x7f4608159750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:35.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.366+0000 7f460d9c2640 1 -- 172.21.15.37:0/4060514205 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46080c2030 con 0x7f46080c3b30 2024-04-22T07:22:35.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.366+0000 7f460c9c0640 1 --2- 172.21.15.37:0/4060514205 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4608072070 0x7f46080c62b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-22T07:22:35.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.366+0000 7f460d9c2640 1 --2- 172.21.15.37:0/4060514205 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f46080c3b30 0x7f46080c67f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f4600009d90 tx=0x7f460002be00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f022766f0c94d18a server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:22:35.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.367+0000 7f45fffff640 1 -- 172.21.15.37:0/4060514205 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4600039070 con 0x7f46080c3b30 2024-04-22T07:22:35.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.367+0000 7f45fffff640 1 -- 172.21.15.37:0/4060514205 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f460002c930 con 0x7f46080c3b30 2024-04-22T07:22:35.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.367+0000 7f45fffff640 1 -- 172.21.15.37:0/4060514205 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4604001670 con 0x7f46080c3b30 2024-04-22T07:22:35.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.367+0000 7f460f425640 1 -- 172.21.15.37:0/4060514205 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f46080c3b30 msgr2=0x7f46080c67f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:35.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.367+0000 7f460f425640 1 --2- 172.21.15.37:0/4060514205 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f46080c3b30 0x7f46080c67f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f4600009d90 tx=0x7f460002be00 comp rx=0 tx=0).stop 2024-04-22T07:22:35.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.367+0000 7f460f425640 1 -- 172.21.15.37:0/4060514205 shutdown_connections 2024-04-22T07:22:35.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.367+0000 7f460f425640 1 --2- 172.21.15.37:0/4060514205 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f46080c3b30 0x7f46080c67f0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:35.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.367+0000 7f460f425640 1 --2- 172.21.15.37:0/4060514205 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4608072070 0x7f46080c62b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:35.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.367+0000 7f460f425640 1 -- 172.21.15.37:0/4060514205 >> 172.21.15.37:0/4060514205 conn(0x7f460806ed30 msgr2=0x7f460806fc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:22:35.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.368+0000 7f460f425640 1 -- 172.21.15.37:0/4060514205 shutdown_connections 2024-04-22T07:22:35.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.368+0000 7f460f425640 1 -- 172.21.15.37:0/4060514205 wait complete. 2024-04-22T07:22:35.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.369+0000 7f460f425640 1 Processor -- start 2024-04-22T07:22:35.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.369+0000 7f460f425640 1 -- start start 2024-04-22T07:22:35.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.370+0000 7f460f425640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4608072070 0x7f4608158580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:35.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.370+0000 7f460f425640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f46080c3b30 0x7f460815b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:35.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.370+0000 7f460f425640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4608152f20 0x7f460815ba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:35.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.370+0000 7f460f425640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f4608153300 con 0x7f4608072070 2024-04-22T07:22:35.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.370+0000 7f460f425640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f4608158f50 con 0x7f46080c3b30 2024-04-22T07:22:35.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.370+0000 7f460f425640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f4608153480 con 0x7f4608152f20 2024-04-22T07:22:35.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.370+0000 7f460d1c1640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4608072070 0x7f4608158580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:35.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.370+0000 7f460d1c1640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4608072070 0x7f4608158580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37160/0 (socket says 172.21.15.37:37160) 2024-04-22T07:22:35.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.370+0000 7f460d1c1640 1 -- 172.21.15.37:0/1268048244 learned_addr learned my addr 172.21.15.37:0/1268048244 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:22:35.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.370+0000 7f460d9c2640 1 --2- 172.21.15.37:0/1268048244 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4608152f20 0x7f460815ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:35.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.370+0000 7f460c9c0640 1 --2- 172.21.15.37:0/1268048244 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f46080c3b30 0x7f460815b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:35.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.370+0000 7f460d1c1640 1 -- 172.21.15.37:0/1268048244 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4608152f20 msgr2=0x7f460815ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:35.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.370+0000 7f460d1c1640 1 --2- 172.21.15.37:0/1268048244 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4608152f20 0x7f460815ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:35.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.370+0000 7f460d1c1640 1 -- 172.21.15.37:0/1268048244 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f46080c3b30 msgr2=0x7f460815b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:35.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.370+0000 7f460d1c1640 1 --2- 172.21.15.37:0/1268048244 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f46080c3b30 0x7f460815b4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:35.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.370+0000 7f460d1c1640 1 -- 172.21.15.37:0/1268048244 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f460814c870 con 0x7f4608072070 2024-04-22T07:22:35.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.370+0000 7f460d1c1640 1 --2- 172.21.15.37:0/1268048244 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4608072070 0x7f4608158580 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f46040017e0 tx=0x7f460400cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:22:35.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.370+0000 7f45fdffb640 1 -- 172.21.15.37:0/1268048244 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4604005ad0 con 0x7f4608072070 2024-04-22T07:22:35.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.370+0000 7f45fdffb640 1 -- 172.21.15.37:0/1268048244 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4604005c90 con 0x7f4608072070 2024-04-22T07:22:35.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.370+0000 7f460f425640 1 -- 172.21.15.37:0/1268048244 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46081eeca0 con 0x7f4608072070 2024-04-22T07:22:35.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.370+0000 7f45fdffb640 1 -- 172.21.15.37:0/1268048244 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46040072b0 con 0x7f4608072070 2024-04-22T07:22:35.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.371+0000 7f460f425640 1 -- 172.21.15.37:0/1268048244 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46081ef260 con 0x7f4608072070 2024-04-22T07:22:35.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.372+0000 7f460f425640 1 -- 172.21.15.37:0/1268048244 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4608069cc0 con 0x7f4608072070 2024-04-22T07:22:35.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.372+0000 7f45fdffb640 1 -- 172.21.15.37:0/1268048244 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4604007450 con 0x7f4608072070 2024-04-22T07:22:35.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.372+0000 7f45fdffb640 1 --2- 172.21.15.37:0/1268048244 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f45ec06c8f0 0x7f45ec06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:35.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.373+0000 7f45fdffb640 1 -- 172.21.15.37:0/1268048244 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f460408b8d0 con 0x7f4608072070 2024-04-22T07:22:35.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.373+0000 7f460c9c0640 1 --2- 172.21.15.37:0/1268048244 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f45ec06c8f0 0x7f45ec06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:35.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.373+0000 7f460c9c0640 1 --2- 172.21.15.37:0/1268048244 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f45ec06c8f0 0x7f45ec06edb0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f45f8009560 tx=0x7f45f8009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:22:35.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.377+0000 7f45fdffb640 1 -- 172.21.15.37:0/1268048244 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f46040595a0 con 0x7f4608072070 2024-04-22T07:22:35.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.562+0000 7f460f425640 1 -- 172.21.15.37:0/1268048244 --> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7f46080ca120 con 0x7f45ec06c8f0 2024-04-22T07:22:35.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.563+0000 7f45fdffb640 1 -- 172.21.15.37:0/1268048244 <== mgr.4103 v2:172.21.15.196:6832/321987173 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f46080ca120 con 0x7f45ec06c8f0 2024-04-22T07:22:35.561 INFO:teuthology.orchestra.run.smithi037.stderr:instructed osd(s) 5 to deep-scrub 2024-04-22T07:22:35.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.565+0000 7f460f425640 1 -- 172.21.15.37:0/1268048244 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f45ec06c8f0 msgr2=0x7f45ec06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:35.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.565+0000 7f460f425640 1 --2- 172.21.15.37:0/1268048244 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f45ec06c8f0 0x7f45ec06edb0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f45f8009560 tx=0x7f45f8009190 comp rx=0 tx=0).stop 2024-04-22T07:22:35.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.565+0000 7f460f425640 1 -- 172.21.15.37:0/1268048244 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4608072070 msgr2=0x7f4608158580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:35.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.565+0000 7f460f425640 1 --2- 172.21.15.37:0/1268048244 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4608072070 0x7f4608158580 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f46040017e0 tx=0x7f460400cbe0 comp rx=0 tx=0).stop 2024-04-22T07:22:35.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.565+0000 7f460f425640 1 -- 172.21.15.37:0/1268048244 shutdown_connections 2024-04-22T07:22:35.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.565+0000 7f460f425640 1 --2- 172.21.15.37:0/1268048244 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f45ec06c8f0 0x7f45ec06edb0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:35.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.565+0000 7f460f425640 1 --2- 172.21.15.37:0/1268048244 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4608152f20 0x7f460815ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:35.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.565+0000 7f460f425640 1 --2- 172.21.15.37:0/1268048244 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f46080c3b30 0x7f460815b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:35.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.565+0000 7f460f425640 1 --2- 172.21.15.37:0/1268048244 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4608072070 0x7f4608158580 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:35.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.565+0000 7f460f425640 1 -- 172.21.15.37:0/1268048244 >> 172.21.15.37:0/1268048244 conn(0x7f460806ed30 msgr2=0x7f46081513f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:22:35.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.565+0000 7f460f425640 1 -- 172.21.15.37:0/1268048244 shutdown_connections 2024-04-22T07:22:35.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.565+0000 7f460f425640 1 -- 172.21.15.37:0/1268048244 wait complete. 2024-04-22T07:22:35.574 INFO:tasks.ceph:Scrubbing osd.6 2024-04-22T07:22:35.574 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-04-22T07:22:35.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.682+0000 7ff52af7e640 1 Processor -- start 2024-04-22T07:22:35.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.682+0000 7ff52af7e640 1 -- start start 2024-04-22T07:22:35.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.682+0000 7ff52af7e640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff5241552c0 0x7ff5240c5fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:35.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.682+0000 7ff52af7e640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5240c6990 con 0x7ff5240cb010 2024-04-22T07:22:35.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.682+0000 7ff52af7e640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5240c66b0 con 0x7ff5240cdd60 2024-04-22T07:22:35.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.682+0000 7ff52af7e640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7ff5241556a0 con 0x7ff5241552c0 2024-04-22T07:22:35.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.683+0000 7ff523fff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7ff5240cb010 0x7ff5240676b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:60454/0 (socket says 172.21.15.37:60454) 2024-04-22T07:22:35.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.683+0000 7ff523fff640 1 -- 172.21.15.37:0/4227859251 learned_addr learned my addr 172.21.15.37:0/4227859251 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-04-22T07:22:35.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.683+0000 7ff528d1a640 1 --2- 172.21.15.37:0/4227859251 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff5241552c0 0x7ff5240c5fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:35.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.683+0000 7ff5237fe640 1 -- 172.21.15.37:0/4227859251 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2218911010 0 0) 0x7ff5240c6990 con 0x7ff5240cb010 2024-04-22T07:22:35.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.683+0000 7ff5237fe640 1 -- 172.21.15.37:0/4227859251 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff514003520 con 0x7ff5240cb010 2024-04-22T07:22:35.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.683+0000 7ff5237fe640 1 -- 172.21.15.37:0/4227859251 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2534051298 0 0) 0x7ff5240c66b0 con 0x7ff5240cdd60 2024-04-22T07:22:35.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.683+0000 7ff5237fe640 1 -- 172.21.15.37:0/4227859251 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff5240c6990 con 0x7ff5240cdd60 2024-04-22T07:22:35.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.683+0000 7ff5237fe640 1 -- 172.21.15.37:0/4227859251 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3390886540 0 0) 0x7ff514003520 con 0x7ff5240cb010 2024-04-22T07:22:35.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.683+0000 7ff5237fe640 1 -- 172.21.15.37:0/4227859251 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff5241552c0 msgr2=0x7ff5240c5fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:22:35.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.683+0000 7ff5237fe640 1 --2- 172.21.15.37:0/4227859251 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff5241552c0 0x7ff5240c5fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:35.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.683+0000 7ff5237fe640 1 -- 172.21.15.37:0/4227859251 >> v1:172.21.15.196:6789/0 conn(0x7ff5240cdd60 legacy=0x7ff52415b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:35.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.683+0000 7ff5237fe640 1 -- 172.21.15.37:0/4227859251 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5240cc560 con 0x7ff5240cb010 2024-04-22T07:22:35.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.683+0000 7ff5237fe640 1 -- 172.21.15.37:0/4227859251 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2576656170 0 0) 0x7ff510001670 con 0x7ff5240cb010 2024-04-22T07:22:35.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.683+0000 7ff5237fe640 1 -- 172.21.15.37:0/4227859251 >> v1:172.21.15.37:6789/0 conn(0x7ff5240cb010 legacy=0x7ff5240676b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:35.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.683+0000 7ff5237fe640 1 --2- 172.21.15.37:0/4227859251 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff514003b70 0x7ff514003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:35.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.683+0000 7ff5237fe640 1 --2- 172.21.15.37:0/4227859251 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff5241552c0 0x7ff514004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:35.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.683+0000 7ff5237fe640 1 --2- 172.21.15.37:0/4227859251 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff514004d40 0x7ff5140051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:35.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.683+0000 7ff5237fe640 1 -- 172.21.15.37:0/4227859251 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff5241556a0 con 0x7ff514004d40 2024-04-22T07:22:35.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.683+0000 7ff5237fe640 1 -- 172.21.15.37:0/4227859251 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7ff51400ba70 con 0x7ff514003b70 2024-04-22T07:22:35.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.683+0000 7ff5237fe640 1 -- 172.21.15.37:0/4227859251 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7ff51400bc20 con 0x7ff5241552c0 2024-04-22T07:22:35.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.683+0000 7ff52951b640 1 --2- 172.21.15.37:0/4227859251 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff514004d40 0x7ff5140051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:35.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.683+0000 7ff528d1a640 1 --2- 172.21.15.37:0/4227859251 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff514003b70 0x7ff514003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:35.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.683+0000 7ff523fff640 1 --2- 172.21.15.37:0/4227859251 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff5241552c0 0x7ff514004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:35.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.684+0000 7ff52951b640 1 -- 172.21.15.37:0/4227859251 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff5241552c0 msgr2=0x7ff514004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:22:35.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.684+0000 7ff52951b640 1 --2- 172.21.15.37:0/4227859251 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff5241552c0 0x7ff514004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:35.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.684+0000 7ff52951b640 1 -- 172.21.15.37:0/4227859251 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff514003b70 msgr2=0x7ff514003f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:22:35.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.684+0000 7ff52951b640 1 --2- 172.21.15.37:0/4227859251 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff514003b70 0x7ff514003f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:35.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.684+0000 7ff52951b640 1 -- 172.21.15.37:0/4227859251 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff514003520 con 0x7ff514004d40 2024-04-22T07:22:35.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.684+0000 7ff52951b640 1 --2- 172.21.15.37:0/4227859251 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff514004d40 0x7ff5140051c0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7ff51c001fd0 tx=0x7ff514005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d49739bed669b90 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:22:35.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.685+0000 7ff5237fe640 1 -- 172.21.15.37:0/4227859251 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff51c001bf0 con 0x7ff514004d40 2024-04-22T07:22:35.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.685+0000 7ff5237fe640 1 -- 172.21.15.37:0/4227859251 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff51c003b70 con 0x7ff514004d40 2024-04-22T07:22:35.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.685+0000 7ff5237fe640 1 -- 172.21.15.37:0/4227859251 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff51c0050d0 con 0x7ff514004d40 2024-04-22T07:22:35.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.685+0000 7ff52af7e640 1 -- 172.21.15.37:0/4227859251 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff514004d40 msgr2=0x7ff5140051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:35.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.685+0000 7ff52af7e640 1 --2- 172.21.15.37:0/4227859251 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff514004d40 0x7ff5140051c0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7ff51c001fd0 tx=0x7ff514005830 comp rx=0 tx=0).stop 2024-04-22T07:22:35.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.685+0000 7ff52951b640 1 -- 172.21.15.37:0/4227859251 reap_dead start 2024-04-22T07:22:35.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.685+0000 7ff52af7e640 1 -- 172.21.15.37:0/4227859251 shutdown_connections 2024-04-22T07:22:35.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.685+0000 7ff52af7e640 1 -- 172.21.15.37:0/4227859251 >> 172.21.15.37:0/4227859251 conn(0x7ff52406d330 msgr2=0x7ff52406c290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:22:35.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.685+0000 7ff52af7e640 1 -- 172.21.15.37:0/4227859251 shutdown_connections 2024-04-22T07:22:35.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.685+0000 7ff52af7e640 1 -- 172.21.15.37:0/4227859251 wait complete. 2024-04-22T07:22:35.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.686+0000 7ff52af7e640 1 Processor -- start 2024-04-22T07:22:35.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.686+0000 7ff52af7e640 1 -- start start 2024-04-22T07:22:35.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.687+0000 7ff52af7e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff514004d40 0x7ff5241f1190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:35.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.687+0000 7ff52af7e640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff5240c9fc0 0x7ff52414d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:35.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.687+0000 7ff52af7e640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff52414df30 0x7ff5240d0bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:35.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.687+0000 7ff52af7e640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff5240cce00 con 0x7ff514004d40 2024-04-22T07:22:35.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.687+0000 7ff52af7e640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7ff5240ccb20 con 0x7ff5240c9fc0 2024-04-22T07:22:35.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.687+0000 7ff52af7e640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7ff524067dc0 con 0x7ff52414df30 2024-04-22T07:22:35.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.687+0000 7ff528d1a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff514004d40 0x7ff5241f1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:35.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.687+0000 7ff528d1a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff514004d40 0x7ff5241f1190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37182/0 (socket says 172.21.15.37:37182) 2024-04-22T07:22:35.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.687+0000 7ff528d1a640 1 -- 172.21.15.37:0/457472057 learned_addr learned my addr 172.21.15.37:0/457472057 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:22:35.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.687+0000 7ff523fff640 1 --2- 172.21.15.37:0/457472057 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff5240c9fc0 0x7ff52414d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:35.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.687+0000 7ff52951b640 1 --2- 172.21.15.37:0/457472057 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff52414df30 0x7ff5240d0bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:35.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.688+0000 7ff528d1a640 1 -- 172.21.15.37:0/457472057 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff52414df30 msgr2=0x7ff5240d0bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:35.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.688+0000 7ff528d1a640 1 --2- 172.21.15.37:0/457472057 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff52414df30 0x7ff5240d0bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:35.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.688+0000 7ff528d1a640 1 -- 172.21.15.37:0/457472057 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff5240c9fc0 msgr2=0x7ff52414d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:35.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.688+0000 7ff528d1a640 1 --2- 172.21.15.37:0/457472057 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff5240c9fc0 0x7ff52414d9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:35.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.688+0000 7ff528d1a640 1 -- 172.21.15.37:0/457472057 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5240ca870 con 0x7ff514004d40 2024-04-22T07:22:35.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.688+0000 7ff528d1a640 1 --2- 172.21.15.37:0/457472057 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff514004d40 0x7ff5241f1190 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7ff5180119d0 tx=0x7ff518011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:22:35.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.688+0000 7ff5217fa640 1 -- 172.21.15.37:0/457472057 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff51800faf0 con 0x7ff514004d40 2024-04-22T07:22:35.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.688+0000 7ff5217fa640 1 -- 172.21.15.37:0/457472057 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff51800fc90 con 0x7ff514004d40 2024-04-22T07:22:35.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.688+0000 7ff52af7e640 1 -- 172.21.15.37:0/457472057 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5241f16d0 con 0x7ff514004d40 2024-04-22T07:22:35.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.688+0000 7ff5217fa640 1 -- 172.21.15.37:0/457472057 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff518014440 con 0x7ff514004d40 2024-04-22T07:22:35.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.688+0000 7ff52af7e640 1 -- 172.21.15.37:0/457472057 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5240ca590 con 0x7ff514004d40 2024-04-22T07:22:35.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.689+0000 7ff52af7e640 1 -- 172.21.15.37:0/457472057 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff524069cc0 con 0x7ff514004d40 2024-04-22T07:22:35.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.690+0000 7ff5217fa640 1 -- 172.21.15.37:0/457472057 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff518012040 con 0x7ff514004d40 2024-04-22T07:22:35.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.690+0000 7ff5217fa640 1 --2- 172.21.15.37:0/457472057 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7ff50806c8f0 0x7ff50806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:35.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.690+0000 7ff5217fa640 1 -- 172.21.15.37:0/457472057 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7ff51808c1a0 con 0x7ff514004d40 2024-04-22T07:22:35.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.690+0000 7ff5217fa640 1 --2- 172.21.15.37:0/457472057 >> [v2:172.21.15.196:6817/691777224,v1:172.21.15.196:6819/691777224] conn(0x7ff508074c70 0x7ff5080770f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:35.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.690+0000 7ff523fff640 1 --2- 172.21.15.37:0/457472057 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7ff50806c8f0 0x7ff50806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:35.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.690+0000 7ff5217fa640 1 -- 172.21.15.37:0/457472057 --> [v2:172.21.15.196:6817/691777224,v1:172.21.15.196:6819/691777224] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff518015e50 con 0x7ff508074c70 2024-04-22T07:22:35.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.690+0000 7ff5217fa640 1 -- 172.21.15.37:0/457472057 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7ff518093050 con 0x7ff514004d40 2024-04-22T07:22:35.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.690+0000 7ff52951b640 1 --2- 172.21.15.37:0/457472057 >> [v2:172.21.15.196:6817/691777224,v1:172.21.15.196:6819/691777224] conn(0x7ff508074c70 0x7ff5080770f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:35.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.691+0000 7ff523fff640 1 --2- 172.21.15.37:0/457472057 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7ff50806c8f0 0x7ff50806edb0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7ff5241e70f0 tx=0x7ff510001e30 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:22:35.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.691+0000 7ff52951b640 1 --2- 172.21.15.37:0/457472057 >> [v2:172.21.15.196:6817/691777224,v1:172.21.15.196:6819/691777224] conn(0x7ff508074c70 0x7ff5080770f0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:22:35.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.692+0000 7ff5217fa640 1 -- 172.21.15.37:0/457472057 <== osd.6 v2:172.21.15.196:6817/691777224 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff518015e50 con 0x7ff508074c70 2024-04-22T07:22:35.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.705+0000 7ff52af7e640 1 -- 172.21.15.37:0/457472057 --> [v2:172.21.15.196:6817/691777224,v1:172.21.15.196:6819/691777224] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7ff5240cb660 con 0x7ff508074c70 2024-04-22T07:22:35.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.705+0000 7ff5217fa640 1 -- 172.21.15.37:0/457472057 <== osd.6 v2:172.21.15.196:6817/691777224 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7ff5240cb660 con 0x7ff508074c70 2024-04-22T07:22:35.703 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-04-22T07:22:35.703 INFO:teuthology.orchestra.run.smithi037.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-22T07:22:35.703 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-04-22T07:22:35.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.706+0000 7ff52af7e640 1 -- 172.21.15.37:0/457472057 >> [v2:172.21.15.196:6817/691777224,v1:172.21.15.196:6819/691777224] conn(0x7ff508074c70 msgr2=0x7ff5080770f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:35.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.706+0000 7ff52af7e640 1 --2- 172.21.15.37:0/457472057 >> [v2:172.21.15.196:6817/691777224,v1:172.21.15.196:6819/691777224] conn(0x7ff508074c70 0x7ff5080770f0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:35.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.706+0000 7ff52af7e640 1 -- 172.21.15.37:0/457472057 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7ff50806c8f0 msgr2=0x7ff50806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:35.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.706+0000 7ff52af7e640 1 --2- 172.21.15.37:0/457472057 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7ff50806c8f0 0x7ff50806edb0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7ff5241e70f0 tx=0x7ff510001e30 comp rx=0 tx=0).stop 2024-04-22T07:22:35.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.706+0000 7ff52af7e640 1 -- 172.21.15.37:0/457472057 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff514004d40 msgr2=0x7ff5241f1190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:35.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.706+0000 7ff52af7e640 1 --2- 172.21.15.37:0/457472057 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff514004d40 0x7ff5241f1190 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7ff5180119d0 tx=0x7ff518011e90 comp rx=0 tx=0).stop 2024-04-22T07:22:35.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.706+0000 7ff52951b640 1 -- 172.21.15.37:0/457472057 reap_dead start 2024-04-22T07:22:35.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.706+0000 7ff52af7e640 1 -- 172.21.15.37:0/457472057 shutdown_connections 2024-04-22T07:22:35.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.706+0000 7ff52af7e640 1 -- 172.21.15.37:0/457472057 >> 172.21.15.37:0/457472057 conn(0x7ff52406d330 msgr2=0x7ff52414f560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:22:35.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.706+0000 7ff52af7e640 1 -- 172.21.15.37:0/457472057 shutdown_connections 2024-04-22T07:22:35.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.706+0000 7ff52af7e640 1 -- 172.21.15.37:0/457472057 wait complete. 2024-04-22T07:22:35.714 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-04-22T07:22:35.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.818+0000 7f154aeb3640 1 Processor -- start 2024-04-22T07:22:35.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.818+0000 7f154aeb3640 1 -- start start 2024-04-22T07:22:35.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.819+0000 7f154aeb3640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f15440b38f0 0x7f154415aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:35.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.819+0000 7f154aeb3640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f154415b3f0 0x7f15440ccd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:35.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.819+0000 7f154aeb3640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f154415f280 con 0x7f15441552f0 2024-04-22T07:22:35.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.819+0000 7f154aeb3640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f15440b3100 con 0x7f15440b38f0 2024-04-22T07:22:35.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.819+0000 7f154aeb3640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f15440cda00 con 0x7f154415b3f0 2024-04-22T07:22:35.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.819+0000 7f1548c4f640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f15441552f0 0x7f15440cb430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:60456/0 (socket says 172.21.15.37:60456) 2024-04-22T07:22:35.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.819+0000 7f1548c4f640 1 -- 172.21.15.37:0/1525880323 learned_addr learned my addr 172.21.15.37:0/1525880323 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-04-22T07:22:35.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.820+0000 7f15437fe640 1 -- 172.21.15.37:0/1525880323 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1472281038 0 0) 0x7f154415f280 con 0x7f15441552f0 2024-04-22T07:22:35.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.820+0000 7f1543fff640 1 --2- 172.21.15.37:0/1525880323 >> v2:172.21.15.196:3300/0 conn(0x7f15440b38f0 0x7f154415aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:35.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.820+0000 7f1549450640 1 --2- 172.21.15.37:0/1525880323 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f154415b3f0 0x7f15440ccd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:35.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.820+0000 7f15437fe640 1 -- 172.21.15.37:0/1525880323 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1530003520 con 0x7f15441552f0 2024-04-22T07:22:35.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.820+0000 7f15437fe640 1 -- 172.21.15.37:0/1525880323 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2471080353 0 0) 0x7f1530003520 con 0x7f15441552f0 2024-04-22T07:22:35.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.820+0000 7f15437fe640 1 -- 172.21.15.37:0/1525880323 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f154415b3f0 msgr2=0x7f15440ccd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:22:35.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.820+0000 7f15437fe640 1 --2- 172.21.15.37:0/1525880323 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f154415b3f0 0x7f15440ccd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:35.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.820+0000 7f15437fe640 1 -- 172.21.15.37:0/1525880323 >> v2:172.21.15.196:3300/0 conn(0x7f15440b38f0 msgr2=0x7f154415aeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:22:35.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.820+0000 7f15437fe640 1 --2- 172.21.15.37:0/1525880323 >> v2:172.21.15.196:3300/0 conn(0x7f15440b38f0 0x7f154415aeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:35.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.820+0000 7f15437fe640 1 -- 172.21.15.37:0/1525880323 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15440b3350 con 0x7f15441552f0 2024-04-22T07:22:35.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.820+0000 7f15437fe640 1 -- 172.21.15.37:0/1525880323 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2576656170 0 0) 0x7f153c001a10 con 0x7f15441552f0 2024-04-22T07:22:35.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.820+0000 7f15437fe640 1 -- 172.21.15.37:0/1525880323 >> v1:172.21.15.37:6789/0 conn(0x7f15441552f0 legacy=0x7f15440cb430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:35.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.820+0000 7f15437fe640 1 --2- 172.21.15.37:0/1525880323 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15300039b0 0x7f1530003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:35.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.820+0000 7f15437fe640 1 --2- 172.21.15.37:0/1525880323 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1530004800 0x7f1530004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:35.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.820+0000 7f15437fe640 1 --2- 172.21.15.37:0/1525880323 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f154415b3f0 0x7f15300051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:35.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.820+0000 7f15437fe640 1 -- 172.21.15.37:0/1525880323 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f15440b3100 con 0x7f15300039b0 2024-04-22T07:22:35.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.820+0000 7f15437fe640 1 -- 172.21.15.37:0/1525880323 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f15440cda00 con 0x7f1530004800 2024-04-22T07:22:35.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.820+0000 7f15437fe640 1 -- 172.21.15.37:0/1525880323 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f153000b9c0 con 0x7f154415b3f0 2024-04-22T07:22:35.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.820+0000 7f1548c4f640 1 --2- 172.21.15.37:0/1525880323 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15300039b0 0x7f1530003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:35.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.820+0000 7f1543fff640 1 --2- 172.21.15.37:0/1525880323 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1530004800 0x7f1530004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:35.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.820+0000 7f1549450640 1 --2- 172.21.15.37:0/1525880323 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f154415b3f0 0x7f15300051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:35.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.820+0000 7f1548c4f640 1 -- 172.21.15.37:0/1525880323 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f154415b3f0 msgr2=0x7f15300051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:22:35.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.820+0000 7f1548c4f640 1 --2- 172.21.15.37:0/1525880323 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f154415b3f0 0x7f15300051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:35.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.820+0000 7f1548c4f640 1 -- 172.21.15.37:0/1525880323 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1530004800 msgr2=0x7f1530004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:22:35.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.820+0000 7f1548c4f640 1 --2- 172.21.15.37:0/1525880323 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1530004800 0x7f1530004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:35.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.820+0000 7f1548c4f640 1 -- 172.21.15.37:0/1525880323 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1530003520 con 0x7f15300039b0 2024-04-22T07:22:35.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.821+0000 7f1548c4f640 1 --2- 172.21.15.37:0/1525880323 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15300039b0 0x7f1530003dd0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f15440c77a0 tx=0x7f1530005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c232cc41a137e71f server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:22:35.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.821+0000 7f15437fe640 1 -- 172.21.15.37:0/1525880323 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f153c00a500 con 0x7f15300039b0 2024-04-22T07:22:35.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.821+0000 7f15437fe640 1 -- 172.21.15.37:0/1525880323 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f153c0072d0 con 0x7f15300039b0 2024-04-22T07:22:35.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.821+0000 7f15437fe640 1 -- 172.21.15.37:0/1525880323 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f153c0076c0 con 0x7f15300039b0 2024-04-22T07:22:35.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.822+0000 7f154aeb3640 1 -- 172.21.15.37:0/1525880323 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15300039b0 msgr2=0x7f1530003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:35.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.822+0000 7f154aeb3640 1 --2- 172.21.15.37:0/1525880323 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15300039b0 0x7f1530003dd0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f15440c77a0 tx=0x7f1530005830 comp rx=0 tx=0).stop 2024-04-22T07:22:35.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.822+0000 7f1549450640 1 -- 172.21.15.37:0/1525880323 reap_dead start 2024-04-22T07:22:35.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.822+0000 7f154aeb3640 1 -- 172.21.15.37:0/1525880323 shutdown_connections 2024-04-22T07:22:35.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.822+0000 7f154aeb3640 1 -- 172.21.15.37:0/1525880323 >> 172.21.15.37:0/1525880323 conn(0x7f1544071f90 msgr2=0x7f15440723a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:22:35.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.822+0000 7f154aeb3640 1 -- 172.21.15.37:0/1525880323 shutdown_connections 2024-04-22T07:22:35.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.822+0000 7f154aeb3640 1 -- 172.21.15.37:0/1525880323 wait complete. 2024-04-22T07:22:35.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.823+0000 7f154aeb3640 1 Processor -- start 2024-04-22T07:22:35.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.823+0000 7f154aeb3640 1 -- start start 2024-04-22T07:22:35.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.824+0000 7f154aeb3640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f15300039b0 0x7f15441543c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:35.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.824+0000 7f154aeb3640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f15441e7d70 0x7f15441f4600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:35.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.824+0000 7f154aeb3640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15441e41c0 0x7f15441f4b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:35.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.824+0000 7f154aeb3640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f154415e7a0 con 0x7f15441e41c0 2024-04-22T07:22:35.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.824+0000 7f154aeb3640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f154415e4c0 con 0x7f15441e7d70 2024-04-22T07:22:35.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.824+0000 7f154aeb3640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f154415ea80 con 0x7f15300039b0 2024-04-22T07:22:35.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.824+0000 7f1549450640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15441e41c0 0x7f15441f4b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:35.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.824+0000 7f1549450640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15441e41c0 0x7f15441f4b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37210/0 (socket says 172.21.15.37:37210) 2024-04-22T07:22:35.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.824+0000 7f1549450640 1 -- 172.21.15.37:0/2383051944 learned_addr learned my addr 172.21.15.37:0/2383051944 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:22:35.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.824+0000 7f1548c4f640 1 --2- 172.21.15.37:0/2383051944 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f15300039b0 0x7f15441543c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:35.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.824+0000 7f1543fff640 1 --2- 172.21.15.37:0/2383051944 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f15441e7d70 0x7f15441f4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:35.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.824+0000 7f1549450640 1 -- 172.21.15.37:0/2383051944 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f15300039b0 msgr2=0x7f15441543c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:35.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.824+0000 7f1549450640 1 --2- 172.21.15.37:0/2383051944 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f15300039b0 0x7f15441543c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:35.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.824+0000 7f1549450640 1 -- 172.21.15.37:0/2383051944 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f15441e7d70 msgr2=0x7f15441f4600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:35.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.824+0000 7f1549450640 1 --2- 172.21.15.37:0/2383051944 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f15441e7d70 0x7f15441f4600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:35.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.824+0000 7f1549450640 1 -- 172.21.15.37:0/2383051944 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15440c8a70 con 0x7f15441e41c0 2024-04-22T07:22:35.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.825+0000 7f1549450640 1 --2- 172.21.15.37:0/2383051944 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15441e41c0 0x7f15441f4b40 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f15440ce5d0 tx=0x7f152c011c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:22:35.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.825+0000 7f15417fa640 1 -- 172.21.15.37:0/2383051944 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f152c004030 con 0x7f15441e41c0 2024-04-22T07:22:35.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.825+0000 7f15417fa640 1 -- 172.21.15.37:0/2383051944 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f152c01b070 con 0x7f15441e41c0 2024-04-22T07:22:35.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.825+0000 7f154aeb3640 1 -- 172.21.15.37:0/2383051944 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15440c8d10 con 0x7f15441e41c0 2024-04-22T07:22:35.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.825+0000 7f15417fa640 1 -- 172.21.15.37:0/2383051944 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f152c0043f0 con 0x7f15441e41c0 2024-04-22T07:22:35.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.825+0000 7f154aeb3640 1 -- 172.21.15.37:0/2383051944 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15440c92d0 con 0x7f15441e41c0 2024-04-22T07:22:35.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.826+0000 7f154aeb3640 1 -- 172.21.15.37:0/2383051944 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1544069cc0 con 0x7f15441e41c0 2024-04-22T07:22:35.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.826+0000 7f15417fa640 1 -- 172.21.15.37:0/2383051944 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f152c012040 con 0x7f15441e41c0 2024-04-22T07:22:35.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.827+0000 7f15417fa640 1 --2- 172.21.15.37:0/2383051944 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f152406c8f0 0x7f152406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:35.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.827+0000 7f15417fa640 1 -- 172.21.15.37:0/2383051944 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f152c08b8b0 con 0x7f15441e41c0 2024-04-22T07:22:35.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.827+0000 7f1548c4f640 1 --2- 172.21.15.37:0/2383051944 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f152406c8f0 0x7f152406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:35.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.827+0000 7f1548c4f640 1 --2- 172.21.15.37:0/2383051944 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f152406c8f0 0x7f152406edb0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f153c034000 tx=0x7f153c007000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:22:35.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:35.831+0000 7f15417fa640 1 -- 172.21.15.37:0/2383051944 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f152c059bc0 con 0x7f15441e41c0 2024-04-22T07:22:36.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.019+0000 7f154aeb3640 1 -- 172.21.15.37:0/2383051944 --> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7f15440cbfe0 con 0x7f152406c8f0 2024-04-22T07:22:36.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.020+0000 7f15417fa640 1 -- 172.21.15.37:0/2383051944 <== mgr.4103 v2:172.21.15.196:6832/321987173 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f15440cbfe0 con 0x7f152406c8f0 2024-04-22T07:22:36.017 INFO:teuthology.orchestra.run.smithi037.stderr:instructed osd(s) 6 to deep-scrub 2024-04-22T07:22:36.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.022+0000 7f154aeb3640 1 -- 172.21.15.37:0/2383051944 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f152406c8f0 msgr2=0x7f152406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:36.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.022+0000 7f154aeb3640 1 --2- 172.21.15.37:0/2383051944 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f152406c8f0 0x7f152406edb0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f153c034000 tx=0x7f153c007000 comp rx=0 tx=0).stop 2024-04-22T07:22:36.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.022+0000 7f154aeb3640 1 -- 172.21.15.37:0/2383051944 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15441e41c0 msgr2=0x7f15441f4b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:36.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.022+0000 7f154aeb3640 1 --2- 172.21.15.37:0/2383051944 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15441e41c0 0x7f15441f4b40 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f15440ce5d0 tx=0x7f152c011c30 comp rx=0 tx=0).stop 2024-04-22T07:22:36.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.022+0000 7f154aeb3640 1 -- 172.21.15.37:0/2383051944 shutdown_connections 2024-04-22T07:22:36.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.022+0000 7f154aeb3640 1 --2- 172.21.15.37:0/2383051944 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f152406c8f0 0x7f152406edb0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:36.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.022+0000 7f154aeb3640 1 --2- 172.21.15.37:0/2383051944 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15441e41c0 0x7f15441f4b40 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:36.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.022+0000 7f154aeb3640 1 --2- 172.21.15.37:0/2383051944 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f15441e7d70 0x7f15441f4600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:36.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.022+0000 7f154aeb3640 1 --2- 172.21.15.37:0/2383051944 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f15300039b0 0x7f15441543c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:36.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.022+0000 7f154aeb3640 1 -- 172.21.15.37:0/2383051944 >> 172.21.15.37:0/2383051944 conn(0x7f1544071f90 msgr2=0x7f15440b4ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:22:36.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.022+0000 7f154aeb3640 1 -- 172.21.15.37:0/2383051944 shutdown_connections 2024-04-22T07:22:36.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.022+0000 7f154aeb3640 1 -- 172.21.15.37:0/2383051944 wait complete. 2024-04-22T07:22:36.031 INFO:tasks.ceph:Scrubbing osd.7 2024-04-22T07:22:36.031 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-04-22T07:22:36.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.138+0000 7fcd55e88640 1 Processor -- start 2024-04-22T07:22:36.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.138+0000 7fcd55e88640 1 -- start start 2024-04-22T07:22:36.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.139+0000 7fcd55e88640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fcd50155040 0x7fcd500cc750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:36.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.139+0000 7fcd55e88640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcd500c5860 0x7fcd500cbc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:36.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.139+0000 7fcd55e88640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcd50155420 con 0x7fcd500cc150 2024-04-22T07:22:36.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.139+0000 7fcd55e88640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fcd500b3a20 con 0x7fcd50155040 2024-04-22T07:22:36.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.139+0000 7fcd55e88640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fcd500cb570 con 0x7fcd500c5860 2024-04-22T07:22:36.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.139+0000 7fcd4f7fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fcd50155040 0x7fcd500cc750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:36.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.139+0000 7fcd4f7fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fcd50155040 0x7fcd500cc750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37220/0 (socket says 172.21.15.37:37220) 2024-04-22T07:22:36.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.139+0000 7fcd4f7fe640 1 -- 172.21.15.37:0/2291293766 learned_addr learned my addr 172.21.15.37:0/2291293766 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:22:36.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.139+0000 7fcd4effd640 1 --2- 172.21.15.37:0/2291293766 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcd500c5860 0x7fcd500cbc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:36.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.140+0000 7fcd4f7fe640 1 -- 172.21.15.37:0/2291293766 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcd500c5860 msgr2=0x7fcd500cbc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:22:36.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.140+0000 7fcd4f7fe640 1 --2- 172.21.15.37:0/2291293766 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcd500c5860 0x7fcd500cbc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:36.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.140+0000 7fcd4f7fe640 1 -- 172.21.15.37:0/2291293766 >> v1:172.21.15.196:6789/0 conn(0x7fcd500cc150 legacy=0x7fcd5015e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:36.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.140+0000 7fcd4f7fe640 1 -- 172.21.15.37:0/2291293766 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd500cb290 con 0x7fcd50155040 2024-04-22T07:22:36.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.140+0000 7fcd4f7fe640 1 --2- 172.21.15.37:0/2291293766 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd50155040 0x7fcd500cc750 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fcd38009870 tx=0x7fcd3802b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16d0de70fa3478b8 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:22:36.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.140+0000 7fcd4e7fc640 1 -- 172.21.15.37:0/2291293766 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd38034070 con 0x7fcd50155040 2024-04-22T07:22:36.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.141+0000 7fcd4e7fc640 1 -- 172.21.15.37:0/2291293766 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd38030840 con 0x7fcd50155040 2024-04-22T07:22:36.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.141+0000 7fcd4e7fc640 1 -- 172.21.15.37:0/2291293766 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd38030c10 con 0x7fcd50155040 2024-04-22T07:22:36.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.141+0000 7fcd55e88640 1 -- 172.21.15.37:0/2291293766 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd50155040 msgr2=0x7fcd500cc750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:36.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.141+0000 7fcd55e88640 1 --2- 172.21.15.37:0/2291293766 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd50155040 0x7fcd500cc750 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fcd38009870 tx=0x7fcd3802b980 comp rx=0 tx=0).stop 2024-04-22T07:22:36.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.141+0000 7fcd55e88640 1 -- 172.21.15.37:0/2291293766 shutdown_connections 2024-04-22T07:22:36.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.141+0000 7fcd55e88640 1 --2- 172.21.15.37:0/2291293766 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcd500c5860 0x7fcd500cbc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:36.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.141+0000 7fcd55e88640 1 --2- 172.21.15.37:0/2291293766 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd50155040 0x7fcd500cc750 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:36.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.141+0000 7fcd55e88640 1 -- 172.21.15.37:0/2291293766 >> 172.21.15.37:0/2291293766 conn(0x7fcd50067ce0 msgr2=0x7fcd500d0610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:22:36.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.141+0000 7fcd55e88640 1 -- 172.21.15.37:0/2291293766 shutdown_connections 2024-04-22T07:22:36.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.141+0000 7fcd55e88640 1 -- 172.21.15.37:0/2291293766 wait complete. 2024-04-22T07:22:36.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.142+0000 7fcd55e88640 1 Processor -- start 2024-04-22T07:22:36.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.142+0000 7fcd55e88640 1 -- start start 2024-04-22T07:22:36.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.143+0000 7fcd55e88640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcd500c5860 0x7fcd500b43e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:36.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.143+0000 7fcd55e88640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcd500cc150 0x7fcd50157d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:36.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.143+0000 7fcd55e88640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd50155040 0x7fcd500cd050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:36.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.143+0000 7fcd55e88640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fcd500c6370 con 0x7fcd50155040 2024-04-22T07:22:36.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.143+0000 7fcd55e88640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fcd500c69c0 con 0x7fcd500cc150 2024-04-22T07:22:36.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.143+0000 7fcd55e88640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fcd500c6650 con 0x7fcd500c5860 2024-04-22T07:22:36.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.143+0000 7fcd4ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd50155040 0x7fcd500cd050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:36.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.143+0000 7fcd4ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd50155040 0x7fcd500cd050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37228/0 (socket says 172.21.15.37:37228) 2024-04-22T07:22:36.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.143+0000 7fcd4ffff640 1 -- 172.21.15.37:0/1320577652 learned_addr learned my addr 172.21.15.37:0/1320577652 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:22:36.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.143+0000 7fcd4f7fe640 1 --2- 172.21.15.37:0/1320577652 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcd500c5860 0x7fcd500b43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:36.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.143+0000 7fcd4effd640 1 --2- 172.21.15.37:0/1320577652 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcd500cc150 0x7fcd50157d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:36.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.143+0000 7fcd4ffff640 1 -- 172.21.15.37:0/1320577652 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcd500c5860 msgr2=0x7fcd500b43e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:36.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.143+0000 7fcd4ffff640 1 --2- 172.21.15.37:0/1320577652 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcd500c5860 0x7fcd500b43e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:36.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.143+0000 7fcd4ffff640 1 -- 172.21.15.37:0/1320577652 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcd500cc150 msgr2=0x7fcd50157d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:36.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.143+0000 7fcd4ffff640 1 --2- 172.21.15.37:0/1320577652 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcd500cc150 0x7fcd50157d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:36.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.143+0000 7fcd4ffff640 1 -- 172.21.15.37:0/1320577652 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd50149400 con 0x7fcd50155040 2024-04-22T07:22:36.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.144+0000 7fcd4ffff640 1 --2- 172.21.15.37:0/1320577652 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd50155040 0x7fcd500cd050 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fcd4800c7a0 tx=0x7fcd4800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:22:36.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.144+0000 7fcd47fff640 1 -- 172.21.15.37:0/1320577652 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd48003b70 con 0x7fcd50155040 2024-04-22T07:22:36.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.144+0000 7fcd47fff640 1 -- 172.21.15.37:0/1320577652 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd48003d30 con 0x7fcd50155040 2024-04-22T07:22:36.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.144+0000 7fcd55e88640 1 -- 172.21.15.37:0/1320577652 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd501f1740 con 0x7fcd50155040 2024-04-22T07:22:36.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.144+0000 7fcd47fff640 1 -- 172.21.15.37:0/1320577652 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd4800aa30 con 0x7fcd50155040 2024-04-22T07:22:36.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.144+0000 7fcd55e88640 1 -- 172.21.15.37:0/1320577652 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd500b5c70 con 0x7fcd50155040 2024-04-22T07:22:36.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.145+0000 7fcd55e88640 1 -- 172.21.15.37:0/1320577652 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fcd501f14f0 con 0x7fcd50155040 2024-04-22T07:22:36.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.145+0000 7fcd47fff640 1 -- 172.21.15.37:0/1320577652 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fcd4800abd0 con 0x7fcd50155040 2024-04-22T07:22:36.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.146+0000 7fcd47fff640 1 --2- 172.21.15.37:0/1320577652 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fcd3006c8f0 0x7fcd3006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:36.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.146+0000 7fcd47fff640 1 -- 172.21.15.37:0/1320577652 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7fcd4808bab0 con 0x7fcd50155040 2024-04-22T07:22:36.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.146+0000 7fcd47fff640 1 --2- 172.21.15.37:0/1320577652 >> [v2:172.21.15.196:6816/3106266066,v1:172.21.15.196:6818/3106266066] conn(0x7fcd30074c70 0x7fcd300770f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:36.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.146+0000 7fcd47fff640 1 -- 172.21.15.37:0/1320577652 --> [v2:172.21.15.196:6816/3106266066,v1:172.21.15.196:6818/3106266066] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fcd300777c0 con 0x7fcd30074c70 2024-04-22T07:22:36.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.146+0000 7fcd47fff640 1 -- 172.21.15.37:0/1320577652 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7fcd480902c0 con 0x7fcd50155040 2024-04-22T07:22:36.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.146+0000 7fcd4f7fe640 1 --2- 172.21.15.37:0/1320577652 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fcd3006c8f0 0x7fcd3006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:36.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.146+0000 7fcd4effd640 1 --2- 172.21.15.37:0/1320577652 >> [v2:172.21.15.196:6816/3106266066,v1:172.21.15.196:6818/3106266066] conn(0x7fcd30074c70 0x7fcd300770f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:36.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.146+0000 7fcd4f7fe640 1 --2- 172.21.15.37:0/1320577652 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fcd3006c8f0 0x7fcd3006edb0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fcd38036000 tx=0x7fcd3803b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:22:36.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.146+0000 7fcd4effd640 1 --2- 172.21.15.37:0/1320577652 >> [v2:172.21.15.196:6816/3106266066,v1:172.21.15.196:6818/3106266066] conn(0x7fcd30074c70 0x7fcd300770f0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:22:36.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.147+0000 7fcd47fff640 1 -- 172.21.15.37:0/1320577652 <== osd.7 v2:172.21.15.196:6816/3106266066 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fcd300777c0 con 0x7fcd30074c70 2024-04-22T07:22:36.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.161+0000 7fcd55e88640 1 -- 172.21.15.37:0/1320577652 --> [v2:172.21.15.196:6816/3106266066,v1:172.21.15.196:6818/3106266066] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fcd501f1a20 con 0x7fcd30074c70 2024-04-22T07:22:36.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.161+0000 7fcd47fff640 1 -- 172.21.15.37:0/1320577652 <== osd.7 v2:172.21.15.196:6816/3106266066 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fcd501f1a20 con 0x7fcd30074c70 2024-04-22T07:22:36.159 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-04-22T07:22:36.159 INFO:teuthology.orchestra.run.smithi037.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-22T07:22:36.159 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-04-22T07:22:36.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.161+0000 7fcd55e88640 1 -- 172.21.15.37:0/1320577652 >> [v2:172.21.15.196:6816/3106266066,v1:172.21.15.196:6818/3106266066] conn(0x7fcd30074c70 msgr2=0x7fcd300770f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:36.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.161+0000 7fcd55e88640 1 --2- 172.21.15.37:0/1320577652 >> [v2:172.21.15.196:6816/3106266066,v1:172.21.15.196:6818/3106266066] conn(0x7fcd30074c70 0x7fcd300770f0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:36.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.162+0000 7fcd55e88640 1 -- 172.21.15.37:0/1320577652 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fcd3006c8f0 msgr2=0x7fcd3006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:36.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.162+0000 7fcd55e88640 1 --2- 172.21.15.37:0/1320577652 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fcd3006c8f0 0x7fcd3006edb0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fcd38036000 tx=0x7fcd3803b040 comp rx=0 tx=0).stop 2024-04-22T07:22:36.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.162+0000 7fcd55e88640 1 -- 172.21.15.37:0/1320577652 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd50155040 msgr2=0x7fcd500cd050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:36.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.162+0000 7fcd55e88640 1 --2- 172.21.15.37:0/1320577652 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd50155040 0x7fcd500cd050 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fcd4800c7a0 tx=0x7fcd4800cc60 comp rx=0 tx=0).stop 2024-04-22T07:22:36.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.162+0000 7fcd4ffff640 1 -- 172.21.15.37:0/1320577652 reap_dead start 2024-04-22T07:22:36.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.162+0000 7fcd55e88640 1 -- 172.21.15.37:0/1320577652 shutdown_connections 2024-04-22T07:22:36.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.162+0000 7fcd55e88640 1 -- 172.21.15.37:0/1320577652 >> 172.21.15.37:0/1320577652 conn(0x7fcd50067ce0 msgr2=0x7fcd5015ad40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:22:36.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.162+0000 7fcd55e88640 1 -- 172.21.15.37:0/1320577652 shutdown_connections 2024-04-22T07:22:36.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.162+0000 7fcd55e88640 1 -- 172.21.15.37:0/1320577652 wait complete. 2024-04-22T07:22:36.170 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-04-22T07:22:36.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.273+0000 7f67b038f640 1 Processor -- start 2024-04-22T07:22:36.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.273+0000 7f67b038f640 1 -- start start 2024-04-22T07:22:36.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.274+0000 7f67b038f640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f67a81552f0 0x7f67a80cb430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:36.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.274+0000 7f67b038f640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f67a80ccd10 0x7f67a80cd150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:36.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.274+0000 7f67b038f640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67a815f280 con 0x7f67a80b38f0 2024-04-22T07:22:36.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.274+0000 7f67b038f640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f67a80b3100 con 0x7f67a81552f0 2024-04-22T07:22:36.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.274+0000 7f67b038f640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f67a80cda00 con 0x7f67a80ccd10 2024-04-22T07:22:36.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.274+0000 7f67ae12b640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f67a81552f0 0x7f67a80cb430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:36.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.274+0000 7f67ae92c640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f67a80ccd10 0x7f67a80cd150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:36.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.275+0000 7f67ad92a640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7f67a80b38f0 0x7f67a815aeb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.37:38096/0 (socket says 172.21.15.37:38096) 2024-04-22T07:22:36.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.275+0000 7f67ad92a640 1 -- 172.21.15.37:0/1702627730 learned_addr learned my addr 172.21.15.37:0/1702627730 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-04-22T07:22:36.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.275+0000 7f67ae12b640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f67a81552f0 0x7f67a80cb430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.37:49046/0 (socket says 172.21.15.37:49046) 2024-04-22T07:22:36.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.275+0000 7f67ae92c640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f67a80ccd10 0x7f67a80cd150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.37:52098/0 (socket says 172.21.15.37:52098) 2024-04-22T07:22:36.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.275+0000 7f67ae12b640 1 -- 172.21.15.37:0/1702627730 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f67a80ccd10 msgr2=0x7f67a80cd150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:22:36.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.275+0000 7f67ae12b640 1 --2- 172.21.15.37:0/1702627730 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f67a80ccd10 0x7f67a80cd150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:36.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.275+0000 7f67ae12b640 1 -- 172.21.15.37:0/1702627730 >> v1:172.21.15.196:6789/0 conn(0x7f67a80b38f0 legacy=0x7f67a815aeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:36.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.275+0000 7f67ad129640 1 -- 172.21.15.37:0/1702627730 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2810489152 0 0) 0x7f67a815f280 con 0x7f67a80b38f0 2024-04-22T07:22:36.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.275+0000 7f67ae12b640 1 -- 172.21.15.37:0/1702627730 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67a80b3350 con 0x7f67a81552f0 2024-04-22T07:22:36.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.276+0000 7f67ae12b640 1 --2- 172.21.15.37:0/1702627730 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f67a81552f0 0x7f67a80cb430 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f67a00097a0 tx=0x7f67a002b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=706aefa3b78bab51 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:22:36.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.276+0000 7f67ad129640 1 -- 172.21.15.37:0/1702627730 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67a0035020 con 0x7f67a81552f0 2024-04-22T07:22:36.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.276+0000 7f67ad129640 1 -- 172.21.15.37:0/1702627730 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67a0031830 con 0x7f67a81552f0 2024-04-22T07:22:36.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.276+0000 7f67ad129640 1 -- 172.21.15.37:0/1702627730 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67a0031c00 con 0x7f67a81552f0 2024-04-22T07:22:36.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.276+0000 7f67b038f640 1 -- 172.21.15.37:0/1702627730 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f67a81552f0 msgr2=0x7f67a80cb430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:36.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.276+0000 7f67b038f640 1 --2- 172.21.15.37:0/1702627730 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f67a81552f0 0x7f67a80cb430 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f67a00097a0 tx=0x7f67a002b8d0 comp rx=0 tx=0).stop 2024-04-22T07:22:36.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.277+0000 7f67b038f640 1 -- 172.21.15.37:0/1702627730 shutdown_connections 2024-04-22T07:22:36.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.277+0000 7f67b038f640 1 --2- 172.21.15.37:0/1702627730 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f67a80ccd10 0x7f67a80cd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:36.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.277+0000 7f67b038f640 1 --2- 172.21.15.37:0/1702627730 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f67a81552f0 0x7f67a80cb430 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:36.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.277+0000 7f67b038f640 1 -- 172.21.15.37:0/1702627730 >> 172.21.15.37:0/1702627730 conn(0x7f67a8071f90 msgr2=0x7f67a80723a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:22:36.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.277+0000 7f67b038f640 1 -- 172.21.15.37:0/1702627730 shutdown_connections 2024-04-22T07:22:36.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.277+0000 7f67b038f640 1 -- 172.21.15.37:0/1702627730 wait complete. 2024-04-22T07:22:36.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.278+0000 7f67b038f640 1 Processor -- start 2024-04-22T07:22:36.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.278+0000 7f67b038f640 1 -- start start 2024-04-22T07:22:36.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.278+0000 7f67b038f640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f67a80b38f0 0x7f67a80cfb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:36.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.278+0000 7f67b038f640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f67a80ccd10 0x7f67a80b5020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:36.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.278+0000 7f67b038f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67a81552f0 0x7f67a814cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:36.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.278+0000 7f67b038f640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f67a815e7a0 con 0x7f67a81552f0 2024-04-22T07:22:36.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.278+0000 7f67b038f640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f67a815e4c0 con 0x7f67a80ccd10 2024-04-22T07:22:36.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.278+0000 7f67b038f640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f67a815ea80 con 0x7f67a80b38f0 2024-04-22T07:22:36.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.279+0000 7f67ae92c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67a81552f0 0x7f67a814cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:36.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.279+0000 7f67ae92c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67a81552f0 0x7f67a814cb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37244/0 (socket says 172.21.15.37:37244) 2024-04-22T07:22:36.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.279+0000 7f67ae92c640 1 -- 172.21.15.37:0/414492574 learned_addr learned my addr 172.21.15.37:0/414492574 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:22:36.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.279+0000 7f67ad92a640 1 --2- 172.21.15.37:0/414492574 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f67a80ccd10 0x7f67a80b5020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:36.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.279+0000 7f67ae12b640 1 --2- 172.21.15.37:0/414492574 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f67a80b38f0 0x7f67a80cfb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:36.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.279+0000 7f67ae92c640 1 -- 172.21.15.37:0/414492574 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f67a80b38f0 msgr2=0x7f67a80cfb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:36.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.279+0000 7f67ae92c640 1 --2- 172.21.15.37:0/414492574 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f67a80b38f0 0x7f67a80cfb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:36.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.279+0000 7f67ae92c640 1 -- 172.21.15.37:0/414492574 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f67a80ccd10 msgr2=0x7f67a80b5020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:36.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.279+0000 7f67ae92c640 1 --2- 172.21.15.37:0/414492574 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f67a80ccd10 0x7f67a80b5020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:36.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.279+0000 7f67ae92c640 1 -- 172.21.15.37:0/414492574 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67a81f3f90 con 0x7f67a81552f0 2024-04-22T07:22:36.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.279+0000 7f67ae92c640 1 --2- 172.21.15.37:0/414492574 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67a81552f0 0x7f67a814cb90 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f679800efc0 tx=0x7f679800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:22:36.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.279+0000 7f67a6ffd640 1 -- 172.21.15.37:0/414492574 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6798018020 con 0x7f67a81552f0 2024-04-22T07:22:36.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.279+0000 7f67a6ffd640 1 -- 172.21.15.37:0/414492574 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6798014480 con 0x7f67a81552f0 2024-04-22T07:22:36.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.279+0000 7f67a6ffd640 1 -- 172.21.15.37:0/414492574 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6798014870 con 0x7f67a81552f0 2024-04-22T07:22:36.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.279+0000 7f67b038f640 1 -- 172.21.15.37:0/414492574 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67a81e5f90 con 0x7f67a81552f0 2024-04-22T07:22:36.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.279+0000 7f67b038f640 1 -- 172.21.15.37:0/414492574 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67a81f4510 con 0x7f67a81552f0 2024-04-22T07:22:36.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.280+0000 7f67b038f640 1 -- 172.21.15.37:0/414492574 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67a8069cc0 con 0x7f67a81552f0 2024-04-22T07:22:36.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.281+0000 7f67a6ffd640 1 -- 172.21.15.37:0/414492574 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6798005d10 con 0x7f67a81552f0 2024-04-22T07:22:36.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.281+0000 7f67a6ffd640 1 --2- 172.21.15.37:0/414492574 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f679406c8f0 0x7f679406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:36.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.281+0000 7f67a6ffd640 1 -- 172.21.15.37:0/414492574 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f679808c580 con 0x7f67a81552f0 2024-04-22T07:22:36.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.281+0000 7f67ae12b640 1 --2- 172.21.15.37:0/414492574 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f679406c8f0 0x7f679406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:36.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.282+0000 7f67ae12b640 1 --2- 172.21.15.37:0/414492574 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f679406c8f0 0x7f679406edb0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f67a0036000 tx=0x7f67a0008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:22:36.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.285+0000 7f67a6ffd640 1 -- 172.21.15.37:0/414492574 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f6798022070 con 0x7f67a81552f0 2024-04-22T07:22:36.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.473+0000 7f67b038f640 1 -- 172.21.15.37:0/414492574 --> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7f67a80d00a0 con 0x7f679406c8f0 2024-04-22T07:22:36.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.474+0000 7f67a6ffd640 1 -- 172.21.15.37:0/414492574 <== mgr.4103 v2:172.21.15.196:6832/321987173 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f67a80d00a0 con 0x7f679406c8f0 2024-04-22T07:22:36.472 INFO:teuthology.orchestra.run.smithi037.stderr:instructed osd(s) 7 to deep-scrub 2024-04-22T07:22:36.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.476+0000 7f67b038f640 1 -- 172.21.15.37:0/414492574 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f679406c8f0 msgr2=0x7f679406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:36.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.476+0000 7f67b038f640 1 --2- 172.21.15.37:0/414492574 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f679406c8f0 0x7f679406edb0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f67a0036000 tx=0x7f67a0008030 comp rx=0 tx=0).stop 2024-04-22T07:22:36.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.476+0000 7f67b038f640 1 -- 172.21.15.37:0/414492574 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67a81552f0 msgr2=0x7f67a814cb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:36.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.476+0000 7f67b038f640 1 --2- 172.21.15.37:0/414492574 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67a81552f0 0x7f67a814cb90 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f679800efc0 tx=0x7f679800c490 comp rx=0 tx=0).stop 2024-04-22T07:22:36.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.476+0000 7f67b038f640 1 -- 172.21.15.37:0/414492574 shutdown_connections 2024-04-22T07:22:36.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.476+0000 7f67b038f640 1 --2- 172.21.15.37:0/414492574 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f679406c8f0 0x7f679406edb0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:36.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.476+0000 7f67b038f640 1 --2- 172.21.15.37:0/414492574 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67a81552f0 0x7f67a814cb90 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:36.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.476+0000 7f67b038f640 1 --2- 172.21.15.37:0/414492574 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f67a80ccd10 0x7f67a80b5020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:36.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.476+0000 7f67b038f640 1 --2- 172.21.15.37:0/414492574 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f67a80b38f0 0x7f67a80cfb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:36.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.477+0000 7f67b038f640 1 -- 172.21.15.37:0/414492574 >> 172.21.15.37:0/414492574 conn(0x7f67a8071f90 msgr2=0x7f67a81543c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:22:36.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.477+0000 7f67b038f640 1 -- 172.21.15.37:0/414492574 shutdown_connections 2024-04-22T07:22:36.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.477+0000 7f67b038f640 1 -- 172.21.15.37:0/414492574 wait complete. 2024-04-22T07:22:36.485 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-22T07:22:36.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.588+0000 7fd339006640 1 Processor -- start 2024-04-22T07:22:36.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.588+0000 7fd339006640 1 -- start start 2024-04-22T07:22:36.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.589+0000 7fd339006640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd334152e20 0x7fd33415ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:36.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.589+0000 7fd339006640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd3340c3ec0 0x7fd3340c4310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:36.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.589+0000 7fd339006640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd334153200 con 0x7fd3340c9000 2024-04-22T07:22:36.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.589+0000 7fd339006640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fd334159a90 con 0x7fd334152e20 2024-04-22T07:22:36.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.589+0000 7fd339006640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fd3340706b0 con 0x7fd3340c3ec0 2024-04-22T07:22:36.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.589+0000 7fd332d9d640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd334152e20 0x7fd33415ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:36.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.589+0000 7fd332d9d640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd334152e20 0x7fd33415ca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37256/0 (socket says 172.21.15.37:37256) 2024-04-22T07:22:36.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.589+0000 7fd332d9d640 1 -- 172.21.15.37:0/1609451858 learned_addr learned my addr 172.21.15.37:0/1609451858 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:22:36.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.589+0000 7fd33359e640 1 --2- 172.21.15.37:0/1609451858 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd3340c3ec0 0x7fd3340c4310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:36.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.589+0000 7fd332d9d640 1 -- 172.21.15.37:0/1609451858 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd3340c3ec0 msgr2=0x7fd3340c4310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:22:36.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.589+0000 7fd332d9d640 1 --2- 172.21.15.37:0/1609451858 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd3340c3ec0 0x7fd3340c4310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:36.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.589+0000 7fd332d9d640 1 -- 172.21.15.37:0/1609451858 >> v1:172.21.15.196:6789/0 conn(0x7fd3340c9000 legacy=0x7fd3340ca090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:36.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.589+0000 7fd332d9d640 1 -- 172.21.15.37:0/1609451858 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3340c3980 con 0x7fd334152e20 2024-04-22T07:22:36.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.590+0000 7fd332d9d640 1 --2- 172.21.15.37:0/1609451858 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd334152e20 0x7fd33415ca70 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fd324009870 tx=0x7fd32402ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b5a5daee611685c server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:22:36.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.590+0000 7fd33259c640 1 -- 172.21.15.37:0/1609451858 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd32402f840 con 0x7fd334152e20 2024-04-22T07:22:36.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.590+0000 7fd33259c640 1 -- 172.21.15.37:0/1609451858 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd32402f9e0 con 0x7fd334152e20 2024-04-22T07:22:36.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.590+0000 7fd33259c640 1 -- 172.21.15.37:0/1609451858 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd32402fdb0 con 0x7fd334152e20 2024-04-22T07:22:36.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.591+0000 7fd339006640 1 -- 172.21.15.37:0/1609451858 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd334152e20 msgr2=0x7fd33415ca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:36.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.591+0000 7fd339006640 1 --2- 172.21.15.37:0/1609451858 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd334152e20 0x7fd33415ca70 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fd324009870 tx=0x7fd32402ba20 comp rx=0 tx=0).stop 2024-04-22T07:22:36.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.591+0000 7fd339006640 1 -- 172.21.15.37:0/1609451858 shutdown_connections 2024-04-22T07:22:36.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.591+0000 7fd339006640 1 --2- 172.21.15.37:0/1609451858 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd3340c3ec0 0x7fd3340c4310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:36.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.591+0000 7fd339006640 1 --2- 172.21.15.37:0/1609451858 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd334152e20 0x7fd33415ca70 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:36.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.591+0000 7fd339006640 1 -- 172.21.15.37:0/1609451858 >> 172.21.15.37:0/1609451858 conn(0x7fd334071580 msgr2=0x7fd334071960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:22:36.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.591+0000 7fd339006640 1 -- 172.21.15.37:0/1609451858 shutdown_connections 2024-04-22T07:22:36.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.591+0000 7fd339006640 1 -- 172.21.15.37:0/1609451858 wait complete. 2024-04-22T07:22:36.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.592+0000 7fd339006640 1 Processor -- start 2024-04-22T07:22:36.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.592+0000 7fd339006640 1 -- start start 2024-04-22T07:22:36.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.593+0000 7fd339006640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3340c3ec0 0x7fd3340cc750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:36.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.593+0000 7fd339006640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd3340c9000 0x7fd3341eed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:36.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.593+0000 7fd339006640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd334152e20 0x7fd3341ef270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:36.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.593+0000 7fd339006640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd334159290 con 0x7fd3340c3ec0 2024-04-22T07:22:36.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.593+0000 7fd339006640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fd334158fb0 con 0x7fd3340c9000 2024-04-22T07:22:36.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.593+0000 7fd339006640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fd334159570 con 0x7fd334152e20 2024-04-22T07:22:36.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.593+0000 7fd332d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3340c3ec0 0x7fd3340cc750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:36.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.593+0000 7fd332d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3340c3ec0 0x7fd3340cc750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37270/0 (socket says 172.21.15.37:37270) 2024-04-22T07:22:36.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.593+0000 7fd332d9d640 1 -- 172.21.15.37:0/4125395473 learned_addr learned my addr 172.21.15.37:0/4125395473 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:22:36.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.593+0000 7fd32bfff640 1 --2- 172.21.15.37:0/4125395473 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd3340c9000 0x7fd3341eed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:36.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.593+0000 7fd33359e640 1 --2- 172.21.15.37:0/4125395473 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd334152e20 0x7fd3341ef270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:36.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.593+0000 7fd332d9d640 1 -- 172.21.15.37:0/4125395473 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd334152e20 msgr2=0x7fd3341ef270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:36.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.593+0000 7fd332d9d640 1 --2- 172.21.15.37:0/4125395473 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd334152e20 0x7fd3341ef270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:36.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.593+0000 7fd332d9d640 1 -- 172.21.15.37:0/4125395473 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd3340c9000 msgr2=0x7fd3341eed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:36.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.593+0000 7fd332d9d640 1 --2- 172.21.15.37:0/4125395473 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd3340c9000 0x7fd3341eed30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:36.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.593+0000 7fd332d9d640 1 -- 172.21.15.37:0/4125395473 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd33414cbb0 con 0x7fd3340c3ec0 2024-04-22T07:22:36.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.593+0000 7fd332d9d640 1 --2- 172.21.15.37:0/4125395473 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3340c3ec0 0x7fd3340cc750 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fd324000c00 tx=0x7fd324004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:22:36.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.593+0000 7fd32b7fe640 1 -- 172.21.15.37:0/4125395473 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd324037c90 con 0x7fd3340c3ec0 2024-04-22T07:22:36.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.593+0000 7fd32b7fe640 1 -- 172.21.15.37:0/4125395473 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd324046070 con 0x7fd3340c3ec0 2024-04-22T07:22:36.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.593+0000 7fd339006640 1 -- 172.21.15.37:0/4125395473 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd33414c030 con 0x7fd3340c3ec0 2024-04-22T07:22:36.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.593+0000 7fd32b7fe640 1 -- 172.21.15.37:0/4125395473 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd324041640 con 0x7fd3340c3ec0 2024-04-22T07:22:36.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.594+0000 7fd339006640 1 -- 172.21.15.37:0/4125395473 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd33414c5f0 con 0x7fd3340c3ec0 2024-04-22T07:22:36.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.595+0000 7fd339006640 1 -- 172.21.15.37:0/4125395473 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd334069cc0 con 0x7fd3340c3ec0 2024-04-22T07:22:36.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.595+0000 7fd32b7fe640 1 -- 172.21.15.37:0/4125395473 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd324040070 con 0x7fd3340c3ec0 2024-04-22T07:22:36.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.596+0000 7fd32b7fe640 1 --2- 172.21.15.37:0/4125395473 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fd31406c8f0 0x7fd31406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:36.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.596+0000 7fd32b7fe640 1 -- 172.21.15.37:0/4125395473 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7fd3240ae190 con 0x7fd3340c3ec0 2024-04-22T07:22:36.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.596+0000 7fd32bfff640 1 --2- 172.21.15.37:0/4125395473 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fd31406c8f0 0x7fd31406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:36.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.596+0000 7fd32bfff640 1 --2- 172.21.15.37:0/4125395473 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fd31406c8f0 0x7fd31406edb0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fd3340ce0c0 tx=0x7fd31c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:22:36.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.600+0000 7fd32b7fe640 1 -- 172.21.15.37:0/4125395473 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fd324033030 con 0x7fd3340c3ec0 2024-04-22T07:22:36.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.781+0000 7fd339006640 1 -- 172.21.15.37:0/4125395473 --> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd3340c9710 con 0x7fd31406c8f0 2024-04-22T07:22:36.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.788+0000 7fd32b7fe640 1 -- 172.21.15.37:0/4125395473 <== mgr.4103 v2:172.21.15.196:6832/321987173 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251661 (secure 0 0 0) 0x7fd3340c9710 con 0x7fd31406c8f0 2024-04-22T07:22:36.788 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-22T07:22:36.789 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-04-22T07:22:36.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.791+0000 7fd339006640 1 -- 172.21.15.37:0/4125395473 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fd31406c8f0 msgr2=0x7fd31406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:36.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.791+0000 7fd339006640 1 --2- 172.21.15.37:0/4125395473 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fd31406c8f0 0x7fd31406edb0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fd3340ce0c0 tx=0x7fd31c009040 comp rx=0 tx=0).stop 2024-04-22T07:22:36.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.791+0000 7fd339006640 1 -- 172.21.15.37:0/4125395473 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3340c3ec0 msgr2=0x7fd3340cc750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:36.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.791+0000 7fd339006640 1 --2- 172.21.15.37:0/4125395473 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3340c3ec0 0x7fd3340cc750 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fd324000c00 tx=0x7fd324004730 comp rx=0 tx=0).stop 2024-04-22T07:22:36.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.791+0000 7fd339006640 1 -- 172.21.15.37:0/4125395473 shutdown_connections 2024-04-22T07:22:36.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.791+0000 7fd339006640 1 --2- 172.21.15.37:0/4125395473 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fd31406c8f0 0x7fd31406edb0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:36.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.791+0000 7fd339006640 1 --2- 172.21.15.37:0/4125395473 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd334152e20 0x7fd3341ef270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:36.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.791+0000 7fd339006640 1 --2- 172.21.15.37:0/4125395473 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd3340c9000 0x7fd3341eed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:36.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.791+0000 7fd339006640 1 --2- 172.21.15.37:0/4125395473 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3340c3ec0 0x7fd3340cc750 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:36.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.791+0000 7fd339006640 1 -- 172.21.15.37:0/4125395473 >> 172.21.15.37:0/4125395473 conn(0x7fd334071580 msgr2=0x7fd33406f8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:22:36.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.792+0000 7fd339006640 1 -- 172.21.15.37:0/4125395473 shutdown_connections 2024-04-22T07:22:36.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:36.792+0000 7fd339006640 1 -- 172.21.15.37:0/4125395473 wait complete. 2024-04-22T07:22:36.800 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":141,"stamp":"2024-04-22T07:22:36.645386+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":6737665,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":377,"num_read_kb":1048681,"num_write":12403,"num_write_kb":25177105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14133,"ondisk_log_size":14133,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":343536,"kb_used_data":15024,"kb_used_omap":12,"kb_used_meta":328435,"kb_avail":754631184,"statfs":{"total":773094113280,"available":772742332416,"internally_reserved":0,"allocated":15384576,"data_stored":14140258,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":336318000},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-10737403040,"num_objects":-2560,"num_object_clones":0,"num_object_copies":-5120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-2560,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":2582,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002549"},"pg_stats":[{"pgid":"3.3f","version":"22'166","reported_seq":188,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:30.550936+0000","last_change":"2024-04-22T07:18:36.765825+0000","last_active":"2024-04-22T07:22:30.550936+0000","last_peered":"2024-04-22T07:22:30.550936+0000","last_clean":"2024-04-22T07:22:30.550936+0000","last_became_active":"2024-04-22T07:18:36.765306+0000","last_became_peered":"2024-04-22T07:18:36.765306+0000","last_unstale":"2024-04-22T07:22:30.550936+0000","last_undegraded":"2024-04-22T07:22:30.550936+0000","last_fullsized":"2024-04-22T07:22:30.550936+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:00:45.046782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":20480,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"22'150","reported_seq":171,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:30.591610+0000","last_change":"2024-04-22T07:18:36.772829+0000","last_active":"2024-04-22T07:22:30.591610+0000","last_peered":"2024-04-22T07:22:30.591610+0000","last_clean":"2024-04-22T07:22:30.591610+0000","last_became_active":"2024-04-22T07:18:36.772464+0000","last_became_peered":"2024-04-22T07:18:36.772464+0000","last_unstale":"2024-04-22T07:22:30.591610+0000","last_undegraded":"2024-04-22T07:22:30.591610+0000","last_fullsized":"2024-04-22T07:22:30.591610+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":150,"log_dups_size":0,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"22'176","reported_seq":198,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:30.591724+0000","last_change":"2024-04-22T07:18:36.760613+0000","last_active":"2024-04-22T07:22:30.591724+0000","last_peered":"2024-04-22T07:22:30.591724+0000","last_clean":"2024-04-22T07:22:30.591724+0000","last_became_active":"2024-04-22T07:18:36.760313+0000","last_became_peered":"2024-04-22T07:18:36.760313+0000","last_unstale":"2024-04-22T07:22:30.591724+0000","last_undegraded":"2024-04-22T07:22:30.591724+0000","last_fullsized":"2024-04-22T07:22:30.591724+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":176,"log_dups_size":0,"ondisk_log_size":176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":16384,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"22'188","reported_seq":202,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:30.593357+0000","last_change":"2024-04-22T07:19:18.282481+0000","last_active":"2024-04-22T07:22:30.593357+0000","last_peered":"2024-04-22T07:22:30.593357+0000","last_clean":"2024-04-22T07:22:30.593357+0000","last_became_active":"2024-04-22T07:19:18.282077+0000","last_became_peered":"2024-04-22T07:19:18.282077+0000","last_unstale":"2024-04-22T07:22:30.593357+0000","last_undegraded":"2024-04-22T07:22:30.593357+0000","last_fullsized":"2024-04-22T07:22:30.593357+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":188,"log_dups_size":0,"ondisk_log_size":188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":165,"num_write_kb":450560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"22'172","reported_seq":193,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:30.554600+0000","last_change":"2024-04-22T07:18:36.764361+0000","last_active":"2024-04-22T07:22:30.554600+0000","last_peered":"2024-04-22T07:22:30.554600+0000","last_clean":"2024-04-22T07:22:30.554600+0000","last_became_active":"2024-04-22T07:18:36.763812+0000","last_became_peered":"2024-04-22T07:18:36.763812+0000","last_unstale":"2024-04-22T07:22:30.554600+0000","last_undegraded":"2024-04-22T07:22:30.554600+0000","last_fullsized":"2024-04-22T07:22:30.554600+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":172,"log_dups_size":0,"ondisk_log_size":172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:18:59.298766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":16384,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"22'156","reported_seq":178,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:30.580766+0000","last_change":"2024-04-22T07:18:36.762804+0000","last_active":"2024-04-22T07:22:30.580766+0000","last_peered":"2024-04-22T07:22:30.580766+0000","last_clean":"2024-04-22T07:22:30.580766+0000","last_became_active":"2024-04-22T07:18:36.762508+0000","last_became_peered":"2024-04-22T07:18:36.762508+0000","last_unstale":"2024-04-22T07:22:30.580766+0000","last_undegraded":"2024-04-22T07:22:30.580766+0000","last_fullsized":"2024-04-22T07:22:30.580766+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:09:08.040513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":20480,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"22'185","reported_seq":203,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:30.487015+0000","last_change":"2024-04-22T07:18:36.771774+0000","last_active":"2024-04-22T07:22:30.487015+0000","last_peered":"2024-04-22T07:22:30.487015+0000","last_clean":"2024-04-22T07:22:30.487015+0000","last_became_active":"2024-04-22T07:18:36.771425+0000","last_became_peered":"2024-04-22T07:18:36.771425+0000","last_unstale":"2024-04-22T07:22:30.487015+0000","last_undegraded":"2024-04-22T07:22:30.487015+0000","last_fullsized":"2024-04-22T07:22:30.487015+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":185,"log_dups_size":0,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:45:27.464772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":159,"num_write_kb":434176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"22'202","reported_seq":227,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:30.583760+0000","last_change":"2024-04-22T07:18:36.773631+0000","last_active":"2024-04-22T07:22:30.583760+0000","last_peered":"2024-04-22T07:22:30.583760+0000","last_clean":"2024-04-22T07:22:30.583760+0000","last_became_active":"2024-04-22T07:18:36.773347+0000","last_became_peered":"2024-04-22T07:18:36.773347+0000","last_unstale":"2024-04-22T07:22:30.583760+0000","last_undegraded":"2024-04-22T07:22:30.583760+0000","last_fullsized":"2024-04-22T07:22:30.583760+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":28672,"num_write":177,"num_write_kb":483328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"22'172","reported_seq":194,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:30.508345+0000","last_change":"2024-04-22T07:18:36.773325+0000","last_active":"2024-04-22T07:22:30.508345+0000","last_peered":"2024-04-22T07:22:30.508345+0000","last_clean":"2024-04-22T07:22:30.508345+0000","last_became_active":"2024-04-22T07:18:36.773023+0000","last_became_peered":"2024-04-22T07:18:36.773023+0000","last_unstale":"2024-04-22T07:22:30.508345+0000","last_undegraded":"2024-04-22T07:22:30.508345+0000","last_fullsized":"2024-04-22T07:22:30.508345+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":172,"log_dups_size":0,"ondisk_log_size":172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:11:55.496104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":20480,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"22'183","reported_seq":204,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:30.561260+0000","last_change":"2024-04-22T07:18:36.769834+0000","last_active":"2024-04-22T07:22:30.561260+0000","last_peered":"2024-04-22T07:22:30.561260+0000","last_clean":"2024-04-22T07:22:30.561260+0000","last_became_active":"2024-04-22T07:18:36.769544+0000","last_became_peered":"2024-04-22T07:18:36.769544+0000","last_unstale":"2024-04-22T07:22:30.561260+0000","last_undegraded":"2024-04-22T07:22:30.561260+0000","last_fullsized":"2024-04-22T07:22:30.561260+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:30:36.755201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":16384,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"22'213","reported_seq":235,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:30.569744+0000","last_change":"2024-04-22T07:18:36.762325+0000","last_active":"2024-04-22T07:22:30.569744+0000","last_peered":"2024-04-22T07:22:30.569744+0000","last_clean":"2024-04-22T07:22:30.569744+0000","last_became_active":"2024-04-22T07:18:36.762059+0000","last_became_peered":"2024-04-22T07:18:36.762059+0000","last_unstale":"2024-04-22T07:22:30.569744+0000","last_undegraded":"2024-04-22T07:22:30.569744+0000","last_fullsized":"2024-04-22T07:22:30.569744+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":213,"log_dups_size":0,"ondisk_log_size":213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:51:10.038201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":20480,"num_write":183,"num_write_kb":499712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"22'163","reported_seq":185,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:30.595554+0000","last_change":"2024-04-22T07:18:36.761961+0000","last_active":"2024-04-22T07:22:30.595554+0000","last_peered":"2024-04-22T07:22:30.595554+0000","last_clean":"2024-04-22T07:22:30.595554+0000","last_became_active":"2024-04-22T07:18:36.761389+0000","last_became_peered":"2024-04-22T07:18:36.761389+0000","last_unstale":"2024-04-22T07:22:30.595554+0000","last_undegraded":"2024-04-22T07:22:30.595554+0000","last_fullsized":"2024-04-22T07:22:30.595554+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":16384,"num_write":135,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"22'175","reported_seq":198,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:30.583722+0000","last_change":"2024-04-22T07:18:36.767665+0000","last_active":"2024-04-22T07:22:30.583722+0000","last_peered":"2024-04-22T07:22:30.583722+0000","last_clean":"2024-04-22T07:22:30.583722+0000","last_became_active":"2024-04-22T07:18:36.767386+0000","last_became_peered":"2024-04-22T07:18:36.767386+0000","last_unstale":"2024-04-22T07:22:30.583722+0000","last_undegraded":"2024-04-22T07:22:30.583722+0000","last_fullsized":"2024-04-22T07:22:30.583722+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":20480,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"22'169","reported_seq":188,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:30.504011+0000","last_change":"2024-04-22T07:18:36.770591+0000","last_active":"2024-04-22T07:22:30.504011+0000","last_peered":"2024-04-22T07:22:30.504011+0000","last_clean":"2024-04-22T07:22:30.504011+0000","last_became_active":"2024-04-22T07:18:36.768507+0000","last_became_peered":"2024-04-22T07:18:36.768507+0000","last_unstale":"2024-04-22T07:22:30.504011+0000","last_undegraded":"2024-04-22T07:22:30.504011+0000","last_fullsized":"2024-04-22T07:22:30.504011+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"22'175","reported_seq":196,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:30.569385+0000","last_change":"2024-04-22T07:18:36.769407+0000","last_active":"2024-04-22T07:22:30.569385+0000","last_peered":"2024-04-22T07:22:30.569385+0000","last_clean":"2024-04-22T07:22:30.569385+0000","last_became_active":"2024-04-22T07:18:36.769114+0000","last_became_peered":"2024-04-22T07:18:36.769114+0000","last_unstale":"2024-04-22T07:22:30.569385+0000","last_undegraded":"2024-04-22T07:22:30.569385+0000","last_fullsized":"2024-04-22T07:22:30.569385+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"22'161","reported_seq":182,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:30.523652+0000","last_change":"2024-04-22T07:18:36.766539+0000","last_active":"2024-04-22T07:22:30.523652+0000","last_peered":"2024-04-22T07:22:30.523652+0000","last_clean":"2024-04-22T07:22:30.523652+0000","last_became_active":"2024-04-22T07:18:36.764865+0000","last_became_peered":"2024-04-22T07:18:36.764865+0000","last_unstale":"2024-04-22T07:22:30.523652+0000","last_undegraded":"2024-04-22T07:22:30.523652+0000","last_fullsized":"2024-04-22T07:22:30.523652+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:45:27.464772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":16384,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"22'173","reported_seq":185,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:30.591507+0000","last_change":"2024-04-22T07:19:17.897134+0000","last_active":"2024-04-22T07:22:30.591507+0000","last_peered":"2024-04-22T07:22:30.591507+0000","last_clean":"2024-04-22T07:22:30.591507+0000","last_became_active":"2024-04-22T07:19:17.896886+0000","last_became_peered":"2024-04-22T07:19:17.896886+0000","last_unstale":"2024-04-22T07:22:30.591507+0000","last_undegraded":"2024-04-22T07:22:30.591507+0000","last_fullsized":"2024-04-22T07:22:30.591507+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"22'176","reported_seq":197,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:30.583676+0000","last_change":"2024-04-22T07:18:36.764432+0000","last_active":"2024-04-22T07:22:30.583676+0000","last_peered":"2024-04-22T07:22:30.583676+0000","last_clean":"2024-04-22T07:22:30.583676+0000","last_became_active":"2024-04-22T07:18:36.764113+0000","last_became_peered":"2024-04-22T07:18:36.764113+0000","last_unstale":"2024-04-22T07:22:30.583676+0000","last_undegraded":"2024-04-22T07:22:30.583676+0000","last_fullsized":"2024-04-22T07:22:30.583676+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":176,"log_dups_size":0,"ondisk_log_size":176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"22'200","reported_seq":221,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:30.574299+0000","last_change":"2024-04-22T07:18:36.772138+0000","last_active":"2024-04-22T07:22:30.574299+0000","last_peered":"2024-04-22T07:22:30.574299+0000","last_clean":"2024-04-22T07:22:30.574299+0000","last_became_active":"2024-04-22T07:18:36.771878+0000","last_became_peered":"2024-04-22T07:18:36.771878+0000","last_unstale":"2024-04-22T07:22:30.574299+0000","last_undegraded":"2024-04-22T07:22:30.574299+0000","last_fullsized":"2024-04-22T07:22:30.574299+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:36:27.097452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":16384,"num_write":165,"num_write_kb":450560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"22'177","reported_seq":198,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:30.583755+0000","last_change":"2024-04-22T07:18:36.769528+0000","last_active":"2024-04-22T07:22:30.583755+0000","last_peered":"2024-04-22T07:22:30.583755+0000","last_clean":"2024-04-22T07:22:30.583755+0000","last_became_active":"2024-04-22T07:18:36.769240+0000","last_became_peered":"2024-04-22T07:18:36.769240+0000","last_unstale":"2024-04-22T07:22:30.583755+0000","last_undegraded":"2024-04-22T07:22:30.583755+0000","last_fullsized":"2024-04-22T07:22:30.583755+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:09:08.040513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":16384,"num_write":153,"num_write_kb":417792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"22'151","reported_seq":170,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:30.554776+0000","last_change":"2024-04-22T07:18:36.766049+0000","last_active":"2024-04-22T07:22:30.554776+0000","last_peered":"2024-04-22T07:22:30.554776+0000","last_clean":"2024-04-22T07:22:30.554776+0000","last_became_active":"2024-04-22T07:18:36.765724+0000","last_became_peered":"2024-04-22T07:18:36.765724+0000","last_unstale":"2024-04-22T07:22:30.554776+0000","last_undegraded":"2024-04-22T07:22:30.554776+0000","last_fullsized":"2024-04-22T07:22:30.554776+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"22'191","reported_seq":212,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:30.547019+0000","last_change":"2024-04-22T07:18:36.765850+0000","last_active":"2024-04-22T07:22:30.547019+0000","last_peered":"2024-04-22T07:22:30.547019+0000","last_clean":"2024-04-22T07:22:30.547019+0000","last_became_active":"2024-04-22T07:18:36.765560+0000","last_became_peered":"2024-04-22T07:18:36.765560+0000","last_unstale":"2024-04-22T07:22:30.547019+0000","last_undegraded":"2024-04-22T07:22:30.547019+0000","last_fullsized":"2024-04-22T07:22:30.547019+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:30:36.755201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":16384,"num_write":156,"num_write_kb":425984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"22'147","reported_seq":169,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:30.543683+0000","last_change":"2024-04-22T07:18:36.769465+0000","last_active":"2024-04-22T07:22:30.543683+0000","last_peered":"2024-04-22T07:22:30.543683+0000","last_clean":"2024-04-22T07:22:30.543683+0000","last_became_active":"2024-04-22T07:18:36.769181+0000","last_became_peered":"2024-04-22T07:18:36.769181+0000","last_unstale":"2024-04-22T07:22:30.543683+0000","last_undegraded":"2024-04-22T07:22:30.543683+0000","last_fullsized":"2024-04-22T07:22:30.543683+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":16384,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"22'205","reported_seq":227,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:30.582280+0000","last_change":"2024-04-22T07:18:36.763439+0000","last_active":"2024-04-22T07:22:30.582280+0000","last_peered":"2024-04-22T07:22:30.582280+0000","last_clean":"2024-04-22T07:22:30.582280+0000","last_became_active":"2024-04-22T07:18:36.763146+0000","last_became_peered":"2024-04-22T07:18:36.763146+0000","last_unstale":"2024-04-22T07:22:30.582280+0000","last_undegraded":"2024-04-22T07:22:30.582280+0000","last_fullsized":"2024-04-22T07:22:30.582280+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:18:59.298766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":20480,"num_write":174,"num_write_kb":475136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"22'155","reported_seq":177,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:30.550968+0000","last_change":"2024-04-22T07:18:36.769533+0000","last_active":"2024-04-22T07:22:30.550968+0000","last_peered":"2024-04-22T07:22:30.550968+0000","last_clean":"2024-04-22T07:22:30.550968+0000","last_became_active":"2024-04-22T07:18:36.769274+0000","last_became_peered":"2024-04-22T07:18:36.769274+0000","last_unstale":"2024-04-22T07:22:30.550968+0000","last_undegraded":"2024-04-22T07:22:30.550968+0000","last_fullsized":"2024-04-22T07:22:30.550968+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":16384,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"22'213","reported_seq":234,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:30.482787+0000","last_change":"2024-04-22T07:18:36.763931+0000","last_active":"2024-04-22T07:22:30.482787+0000","last_peered":"2024-04-22T07:22:30.482787+0000","last_clean":"2024-04-22T07:22:30.482787+0000","last_became_active":"2024-04-22T07:18:36.763656+0000","last_became_peered":"2024-04-22T07:18:36.763656+0000","last_unstale":"2024-04-22T07:22:30.482787+0000","last_undegraded":"2024-04-22T07:22:30.482787+0000","last_fullsized":"2024-04-22T07:22:30.482787+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":213,"log_dups_size":0,"ondisk_log_size":213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:22:58.884168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":16384,"num_write":183,"num_write_kb":499712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"22'159","reported_seq":180,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:30.575032+0000","last_change":"2024-04-22T07:18:36.767158+0000","last_active":"2024-04-22T07:22:30.575032+0000","last_peered":"2024-04-22T07:22:30.575032+0000","last_clean":"2024-04-22T07:22:30.575032+0000","last_became_active":"2024-04-22T07:18:36.766614+0000","last_became_peered":"2024-04-22T07:18:36.766614+0000","last_unstale":"2024-04-22T07:22:30.575032+0000","last_undegraded":"2024-04-22T07:22:30.575032+0000","last_fullsized":"2024-04-22T07:22:30.575032+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"22'149","reported_seq":171,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:30.558725+0000","last_change":"2024-04-22T07:18:36.773129+0000","last_active":"2024-04-22T07:22:30.558725+0000","last_peered":"2024-04-22T07:22:30.558725+0000","last_clean":"2024-04-22T07:22:30.558725+0000","last_became_active":"2024-04-22T07:18:36.772827+0000","last_became_peered":"2024-04-22T07:18:36.772827+0000","last_unstale":"2024-04-22T07:22:30.558725+0000","last_undegraded":"2024-04-22T07:22:30.558725+0000","last_fullsized":"2024-04-22T07:22:30.558725+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":16384,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"22'130","reported_seq":154,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:30.563029+0000","last_change":"2024-04-22T07:18:36.763716+0000","last_active":"2024-04-22T07:22:30.563029+0000","last_peered":"2024-04-22T07:22:30.563029+0000","last_clean":"2024-04-22T07:22:30.563029+0000","last_became_active":"2024-04-22T07:18:36.762270+0000","last_became_peered":"2024-04-22T07:18:36.762270+0000","last_unstale":"2024-04-22T07:22:30.563029+0000","last_undegraded":"2024-04-22T07:22:30.563029+0000","last_fullsized":"2024-04-22T07:22:30.563029+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":130,"log_dups_size":0,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":24576,"num_write":111,"num_write_kb":303104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"22'149","reported_seq":172,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:30.490070+0000","last_change":"2024-04-22T07:18:36.764152+0000","last_active":"2024-04-22T07:22:30.490070+0000","last_peered":"2024-04-22T07:22:30.490070+0000","last_clean":"2024-04-22T07:22:30.490070+0000","last_became_active":"2024-04-22T07:18:36.763770+0000","last_became_peered":"2024-04-22T07:18:36.763770+0000","last_unstale":"2024-04-22T07:22:30.490070+0000","last_undegraded":"2024-04-22T07:22:30.490070+0000","last_fullsized":"2024-04-22T07:22:30.490070+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:22:58.884168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":24576,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"22'148","reported_seq":169,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:30.591541+0000","last_change":"2024-04-22T07:18:36.771121+0000","last_active":"2024-04-22T07:22:30.591541+0000","last_peered":"2024-04-22T07:22:30.591541+0000","last_clean":"2024-04-22T07:22:30.591541+0000","last_became_active":"2024-04-22T07:18:36.770786+0000","last_became_peered":"2024-04-22T07:18:36.770786+0000","last_unstale":"2024-04-22T07:22:30.591541+0000","last_undegraded":"2024-04-22T07:22:30.591541+0000","last_fullsized":"2024-04-22T07:22:30.591541+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"22'176","reported_seq":198,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:30.569755+0000","last_change":"2024-04-22T07:18:36.765462+0000","last_active":"2024-04-22T07:22:30.569755+0000","last_peered":"2024-04-22T07:22:30.569755+0000","last_clean":"2024-04-22T07:22:30.569755+0000","last_became_active":"2024-04-22T07:18:36.765142+0000","last_became_peered":"2024-04-22T07:18:36.765142+0000","last_unstale":"2024-04-22T07:22:30.569755+0000","last_undegraded":"2024-04-22T07:22:30.569755+0000","last_fullsized":"2024-04-22T07:22:30.569755+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":176,"log_dups_size":0,"ondisk_log_size":176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:32:20.374856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":20480,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"22'144","reported_seq":164,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:30.554736+0000","last_change":"2024-04-22T07:18:36.768234+0000","last_active":"2024-04-22T07:22:30.554736+0000","last_peered":"2024-04-22T07:22:30.554736+0000","last_clean":"2024-04-22T07:22:30.554736+0000","last_became_active":"2024-04-22T07:18:36.767951+0000","last_became_peered":"2024-04-22T07:18:36.767951+0000","last_unstale":"2024-04-22T07:22:30.554736+0000","last_undegraded":"2024-04-22T07:22:30.554736+0000","last_fullsized":"2024-04-22T07:22:30.554736+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"22'933","reported_seq":961,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:35.529733+0000","last_change":"2024-04-22T07:22:35.529759+0000","last_active":"2024-04-22T07:22:35.529733+0000","last_peered":"2024-04-22T07:22:35.529733+0000","last_clean":"2024-04-22T07:22:35.529733+0000","last_became_active":"2024-04-22T07:18:35.751219+0000","last_became_peered":"2024-04-22T07:18:35.751219+0000","last_unstale":"2024-04-22T07:22:35.529733+0000","last_undegraded":"2024-04-22T07:22:35.529733+0000","last_fullsized":"2024-04-22T07:22:35.529733+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'933","last_scrub_stamp":"2024-04-22T07:22:35.529644+0000","last_deep_scrub":"22'933","last_deep_scrub_stamp":"2024-04-22T07:22:35.529644+0000","last_clean_scrub_stamp":"2024-04-22T07:22:35.529644+0000","objects_scrubbed":1,"log_size":933,"log_dups_size":0,"ondisk_log_size":933,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:51:35.098152+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1951018,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":932,"num_write_kb":2803,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"22'154","reported_seq":185,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:36.002426+0000","last_change":"2024-04-22T07:22:36.002477+0000","last_active":"2024-04-22T07:22:36.002426+0000","last_peered":"2024-04-22T07:22:36.002426+0000","last_clean":"2024-04-22T07:22:36.002426+0000","last_became_active":"2024-04-22T07:18:36.757039+0000","last_became_peered":"2024-04-22T07:18:36.757039+0000","last_unstale":"2024-04-22T07:22:36.002426+0000","last_undegraded":"2024-04-22T07:22:36.002426+0000","last_fullsized":"2024-04-22T07:22:36.002426+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'154","last_scrub_stamp":"2024-04-22T07:22:36.002329+0000","last_deep_scrub":"22'154","last_deep_scrub_stamp":"2024-04-22T07:22:36.002329+0000","last_clean_scrub_stamp":"2024-04-22T07:22:36.002329+0000","objects_scrubbed":0,"log_size":154,"log_dups_size":0,"ondisk_log_size":154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:51:35.570836+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":20480,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:19:18.280153+0000","last_change":"2024-04-22T07:18:35.746515+0000","last_active":"2024-04-22T07:19:18.280153+0000","last_peered":"2024-04-22T07:19:18.280153+0000","last_clean":"2024-04-22T07:19:18.280153+0000","last_became_active":"2024-04-22T07:18:35.746198+0000","last_became_peered":"2024-04-22T07:18:35.746198+0000","last_unstale":"2024-04-22T07:19:18.280153+0000","last_undegraded":"2024-04-22T07:19:18.280153+0000","last_fullsized":"2024-04-22T07:19:18.280153+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:43:54.682673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":28,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:36.504281+0000","last_change":"2024-04-22T07:22:36.504304+0000","last_active":"2024-04-22T07:22:36.504281+0000","last_peered":"2024-04-22T07:22:36.504281+0000","last_clean":"2024-04-22T07:22:36.504281+0000","last_became_active":"2024-04-22T07:18:35.751545+0000","last_became_peered":"2024-04-22T07:18:35.751545+0000","last_unstale":"2024-04-22T07:22:36.504281+0000","last_undegraded":"2024-04-22T07:22:36.504281+0000","last_fullsized":"2024-04-22T07:22:36.504281+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:22:36.504196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:22:36.504196+0000","last_clean_scrub_stamp":"2024-04-22T07:22:36.504196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:18:35.392716+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"22'189","reported_seq":211,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:30.564213+0000","last_change":"2024-04-22T07:18:36.772372+0000","last_active":"2024-04-22T07:22:30.564213+0000","last_peered":"2024-04-22T07:22:30.564213+0000","last_clean":"2024-04-22T07:22:30.564213+0000","last_became_active":"2024-04-22T07:18:36.772067+0000","last_became_peered":"2024-04-22T07:18:36.772067+0000","last_unstale":"2024-04-22T07:22:30.564213+0000","last_undegraded":"2024-04-22T07:22:30.564213+0000","last_fullsized":"2024-04-22T07:22:30.564213+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":189,"log_dups_size":0,"ondisk_log_size":189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":16384,"num_write":162,"num_write_kb":442368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:19:17.876687+0000","last_change":"2024-04-22T07:18:35.740989+0000","last_active":"2024-04-22T07:19:17.876687+0000","last_peered":"2024-04-22T07:19:17.876687+0000","last_clean":"2024-04-22T07:19:17.876687+0000","last_became_active":"2024-04-22T07:18:35.740665+0000","last_became_peered":"2024-04-22T07:18:35.740665+0000","last_unstale":"2024-04-22T07:19:17.876687+0000","last_undegraded":"2024-04-22T07:19:17.876687+0000","last_fullsized":"2024-04-22T07:19:17.876687+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:00:10.289974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"22'181","reported_seq":202,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:30.594177+0000","last_change":"2024-04-22T07:18:36.767022+0000","last_active":"2024-04-22T07:22:30.594177+0000","last_peered":"2024-04-22T07:22:30.594177+0000","last_clean":"2024-04-22T07:22:30.594177+0000","last_became_active":"2024-04-22T07:18:36.766609+0000","last_became_peered":"2024-04-22T07:18:36.766609+0000","last_unstale":"2024-04-22T07:22:30.594177+0000","last_undegraded":"2024-04-22T07:22:30.594177+0000","last_fullsized":"2024-04-22T07:22:30.594177+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":181,"log_dups_size":0,"ondisk_log_size":181,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"22'1","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:20:43.848866+0000","last_change":"2024-04-22T07:18:35.752081+0000","last_active":"2024-04-22T07:20:43.848866+0000","last_peered":"2024-04-22T07:20:43.848866+0000","last_clean":"2024-04-22T07:20:43.848866+0000","last_became_active":"2024-04-22T07:18:35.751757+0000","last_became_peered":"2024-04-22T07:18:35.751757+0000","last_unstale":"2024-04-22T07:20:43.848866+0000","last_undegraded":"2024-04-22T07:20:43.848866+0000","last_fullsized":"2024-04-22T07:20:43.848866+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:21:55.316649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"22'244","reported_seq":269,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:30.569195+0000","last_change":"2024-04-22T07:18:36.765937+0000","last_active":"2024-04-22T07:22:30.569195+0000","last_peered":"2024-04-22T07:22:30.569195+0000","last_clean":"2024-04-22T07:22:30.569195+0000","last_became_active":"2024-04-22T07:18:36.765647+0000","last_became_peered":"2024-04-22T07:18:36.765647+0000","last_unstale":"2024-04-22T07:22:30.569195+0000","last_undegraded":"2024-04-22T07:22:30.569195+0000","last_fullsized":"2024-04-22T07:22:30.569195+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":244,"log_dups_size":0,"ondisk_log_size":244,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:59:57.688417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":32768,"num_write":219,"num_write_kb":598016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:19:17.877284+0000","last_change":"2024-04-22T07:18:35.747309+0000","last_active":"2024-04-22T07:19:17.877284+0000","last_peered":"2024-04-22T07:19:17.877284+0000","last_clean":"2024-04-22T07:19:17.877284+0000","last_became_active":"2024-04-22T07:18:35.747019+0000","last_became_peered":"2024-04-22T07:18:35.747019+0000","last_unstale":"2024-04-22T07:19:17.877284+0000","last_undegraded":"2024-04-22T07:19:17.877284+0000","last_fullsized":"2024-04-22T07:19:17.877284+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:21:55.316649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"22'156","reported_seq":178,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:30.580040+0000","last_change":"2024-04-22T07:18:36.763436+0000","last_active":"2024-04-22T07:22:30.580040+0000","last_peered":"2024-04-22T07:22:30.580040+0000","last_clean":"2024-04-22T07:22:30.580040+0000","last_became_active":"2024-04-22T07:18:36.763068+0000","last_became_peered":"2024-04-22T07:18:36.763068+0000","last_unstale":"2024-04-22T07:22:30.580040+0000","last_undegraded":"2024-04-22T07:22:30.580040+0000","last_fullsized":"2024-04-22T07:22:30.580040+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":16384,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"22'9","reported_seq":29,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:30.908304+0000","last_change":"2024-04-22T07:18:35.750769+0000","last_active":"2024-04-22T07:22:30.908304+0000","last_peered":"2024-04-22T07:22:30.908304+0000","last_clean":"2024-04-22T07:22:30.908304+0000","last_became_active":"2024-04-22T07:18:35.750406+0000","last_became_peered":"2024-04-22T07:18:35.750406+0000","last_unstale":"2024-04-22T07:22:30.908304+0000","last_undegraded":"2024-04-22T07:22:30.908304+0000","last_fullsized":"2024-04-22T07:22:30.908304+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"22'165","reported_seq":185,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:30.558567+0000","last_change":"2024-04-22T07:18:36.767426+0000","last_active":"2024-04-22T07:22:30.558567+0000","last_peered":"2024-04-22T07:22:30.558567+0000","last_clean":"2024-04-22T07:22:30.558567+0000","last_became_active":"2024-04-22T07:18:36.767159+0000","last_became_peered":"2024-04-22T07:18:36.767159+0000","last_unstale":"2024-04-22T07:22:30.558567+0000","last_undegraded":"2024-04-22T07:22:30.558567+0000","last_fullsized":"2024-04-22T07:22:30.558567+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"22'2012","reported_seq":2031,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:03.268031+0000","last_change":"2024-04-22T07:18:35.752996+0000","last_active":"2024-04-22T07:22:03.268031+0000","last_peered":"2024-04-22T07:22:03.268031+0000","last_clean":"2024-04-22T07:22:03.268031+0000","last_became_active":"2024-04-22T07:18:35.752686+0000","last_became_peered":"2024-04-22T07:18:35.752686+0000","last_unstale":"2024-04-22T07:22:03.268031+0000","last_undegraded":"2024-04-22T07:22:03.268031+0000","last_fullsized":"2024-04-22T07:22:03.268031+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":2012,"log_dups_size":0,"ondisk_log_size":2012,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:36:55.684427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2011,"num_write_kb":6027,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"22'175","reported_seq":199,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:30.558957+0000","last_change":"2024-04-22T07:18:36.767539+0000","last_active":"2024-04-22T07:22:30.558957+0000","last_peered":"2024-04-22T07:22:30.558957+0000","last_clean":"2024-04-22T07:22:30.558957+0000","last_became_active":"2024-04-22T07:18:36.767273+0000","last_became_peered":"2024-04-22T07:18:36.767273+0000","last_unstale":"2024-04-22T07:22:30.558957+0000","last_undegraded":"2024-04-22T07:22:30.558957+0000","last_fullsized":"2024-04-22T07:22:30.558957+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:03:50.228822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":28672,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"22'4","reported_seq":32,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:33.998335+0000","last_change":"2024-04-22T07:22:33.998390+0000","last_active":"2024-04-22T07:22:33.998335+0000","last_peered":"2024-04-22T07:22:33.998335+0000","last_clean":"2024-04-22T07:22:33.998335+0000","last_became_active":"2024-04-22T07:18:35.752060+0000","last_became_peered":"2024-04-22T07:18:35.752060+0000","last_unstale":"2024-04-22T07:22:33.998335+0000","last_undegraded":"2024-04-22T07:22:33.998335+0000","last_fullsized":"2024-04-22T07:22:33.998335+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'4","last_scrub_stamp":"2024-04-22T07:22:33.998248+0000","last_deep_scrub":"22'4","last_deep_scrub_stamp":"2024-04-22T07:22:33.998248+0000","last_clean_scrub_stamp":"2024-04-22T07:22:33.998248+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:22:03.016674+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"22'173","reported_seq":194,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:30.554944+0000","last_change":"2024-04-22T07:18:36.764670+0000","last_active":"2024-04-22T07:22:30.554944+0000","last_peered":"2024-04-22T07:22:30.554944+0000","last_clean":"2024-04-22T07:22:30.554944+0000","last_became_active":"2024-04-22T07:18:36.763834+0000","last_became_peered":"2024-04-22T07:18:36.763834+0000","last_unstale":"2024-04-22T07:22:30.554944+0000","last_undegraded":"2024-04-22T07:22:30.554944+0000","last_fullsized":"2024-04-22T07:22:30.554944+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:19:17.877449+0000","last_change":"2024-04-22T07:18:35.752856+0000","last_active":"2024-04-22T07:19:17.877449+0000","last_peered":"2024-04-22T07:19:17.877449+0000","last_clean":"2024-04-22T07:19:17.877449+0000","last_became_active":"2024-04-22T07:18:35.752527+0000","last_became_peered":"2024-04-22T07:18:35.752527+0000","last_unstale":"2024-04-22T07:19:17.877449+0000","last_undegraded":"2024-04-22T07:19:17.877449+0000","last_fullsized":"2024-04-22T07:19:17.877449+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:40:59.305769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"22'196","reported_seq":209,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:30.591657+0000","last_change":"2024-04-22T07:19:17.878772+0000","last_active":"2024-04-22T07:22:30.591657+0000","last_peered":"2024-04-22T07:22:30.591657+0000","last_clean":"2024-04-22T07:22:30.591657+0000","last_became_active":"2024-04-22T07:19:17.878334+0000","last_became_peered":"2024-04-22T07:19:17.878334+0000","last_unstale":"2024-04-22T07:22:30.591657+0000","last_undegraded":"2024-04-22T07:22:30.591657+0000","last_fullsized":"2024-04-22T07:22:30.591657+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":196,"log_dups_size":0,"ondisk_log_size":196,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":156,"num_write_kb":425984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:19:18.280016+0000","last_change":"2024-04-22T07:18:35.749740+0000","last_active":"2024-04-22T07:19:18.280016+0000","last_peered":"2024-04-22T07:19:18.280016+0000","last_clean":"2024-04-22T07:19:18.280016+0000","last_became_active":"2024-04-22T07:18:35.749453+0000","last_became_peered":"2024-04-22T07:18:35.749453+0000","last_unstale":"2024-04-22T07:19:18.280016+0000","last_undegraded":"2024-04-22T07:19:18.280016+0000","last_fullsized":"2024-04-22T07:19:18.280016+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:08:04.608018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"22'188","reported_seq":214,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:30.575565+0000","last_change":"2024-04-22T07:18:36.771940+0000","last_active":"2024-04-22T07:22:30.575565+0000","last_peered":"2024-04-22T07:22:30.575565+0000","last_clean":"2024-04-22T07:22:30.575565+0000","last_became_active":"2024-04-22T07:18:36.771548+0000","last_became_peered":"2024-04-22T07:18:36.771548+0000","last_unstale":"2024-04-22T07:22:30.575565+0000","last_undegraded":"2024-04-22T07:22:30.575565+0000","last_fullsized":"2024-04-22T07:22:30.575565+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":188,"log_dups_size":0,"ondisk_log_size":188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:23:03.787574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":36864,"num_write":159,"num_write_kb":434176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"22'9","reported_seq":29,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:30.906789+0000","last_change":"2024-04-22T07:18:35.749047+0000","last_active":"2024-04-22T07:22:30.906789+0000","last_peered":"2024-04-22T07:22:30.906789+0000","last_clean":"2024-04-22T07:22:30.906789+0000","last_became_active":"2024-04-22T07:18:35.748757+0000","last_became_peered":"2024-04-22T07:18:35.748757+0000","last_unstale":"2024-04-22T07:22:30.906789+0000","last_undegraded":"2024-04-22T07:22:30.906789+0000","last_fullsized":"2024-04-22T07:22:30.906789+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"22'212","reported_seq":236,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:30.492700+0000","last_change":"2024-04-22T07:18:36.769894+0000","last_active":"2024-04-22T07:22:30.492700+0000","last_peered":"2024-04-22T07:22:30.492700+0000","last_clean":"2024-04-22T07:22:30.492700+0000","last_became_active":"2024-04-22T07:18:36.768702+0000","last_became_peered":"2024-04-22T07:18:36.768702+0000","last_unstale":"2024-04-22T07:22:30.492700+0000","last_undegraded":"2024-04-22T07:22:30.492700+0000","last_fullsized":"2024-04-22T07:22:30.492700+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":212,"log_dups_size":0,"ondisk_log_size":212,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:36:53.716397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":28672,"num_write":183,"num_write_kb":499712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"22'2","reported_seq":30,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:35.842189+0000","last_change":"2024-04-22T07:22:35.842218+0000","last_active":"2024-04-22T07:22:35.842189+0000","last_peered":"2024-04-22T07:22:35.842189+0000","last_clean":"2024-04-22T07:22:35.842189+0000","last_became_active":"2024-04-22T07:18:35.747271+0000","last_became_peered":"2024-04-22T07:18:35.747271+0000","last_unstale":"2024-04-22T07:22:35.842189+0000","last_undegraded":"2024-04-22T07:22:35.842189+0000","last_fullsized":"2024-04-22T07:22:35.842189+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'2","last_scrub_stamp":"2024-04-22T07:22:35.842097+0000","last_deep_scrub":"22'2","last_deep_scrub_stamp":"2024-04-22T07:22:35.842097+0000","last_clean_scrub_stamp":"2024-04-22T07:22:35.842097+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:42:06.469535+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"22'170","reported_seq":191,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:30.593483+0000","last_change":"2024-04-22T07:18:36.773033+0000","last_active":"2024-04-22T07:22:30.593483+0000","last_peered":"2024-04-22T07:22:30.593483+0000","last_clean":"2024-04-22T07:22:30.593483+0000","last_became_active":"2024-04-22T07:18:36.772537+0000","last_became_peered":"2024-04-22T07:18:36.772537+0000","last_unstale":"2024-04-22T07:22:30.593483+0000","last_undegraded":"2024-04-22T07:22:30.593483+0000","last_fullsized":"2024-04-22T07:22:30.593483+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:58:41.509248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":16384,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.613930+0000","last_change":"2024-04-22T07:18:35.747533+0000","last_active":"2024-04-22T07:20:54.613930+0000","last_peered":"2024-04-22T07:20:54.613930+0000","last_clean":"2024-04-22T07:20:54.613930+0000","last_became_active":"2024-04-22T07:18:35.746881+0000","last_became_peered":"2024-04-22T07:18:35.746881+0000","last_unstale":"2024-04-22T07:20:54.613930+0000","last_undegraded":"2024-04-22T07:20:54.613930+0000","last_fullsized":"2024-04-22T07:20:54.613930+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"22'159","reported_seq":178,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:30.480960+0000","last_change":"2024-04-22T07:18:36.773723+0000","last_active":"2024-04-22T07:22:30.480960+0000","last_peered":"2024-04-22T07:22:30.480960+0000","last_clean":"2024-04-22T07:22:30.480960+0000","last_became_active":"2024-04-22T07:18:36.773466+0000","last_became_peered":"2024-04-22T07:18:36.773466+0000","last_unstale":"2024-04-22T07:22:30.480960+0000","last_undegraded":"2024-04-22T07:22:30.480960+0000","last_fullsized":"2024-04-22T07:22:30.480960+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:42:20.611744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":21,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.615734+0000","last_change":"2024-04-22T07:18:35.750360+0000","last_active":"2024-04-22T07:20:54.615734+0000","last_peered":"2024-04-22T07:20:54.615734+0000","last_clean":"2024-04-22T07:20:54.615734+0000","last_became_active":"2024-04-22T07:18:35.749984+0000","last_became_peered":"2024-04-22T07:18:35.749984+0000","last_unstale":"2024-04-22T07:20:54.615734+0000","last_undegraded":"2024-04-22T07:20:54.615734+0000","last_fullsized":"2024-04-22T07:20:54.615734+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"22'162","reported_seq":182,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:30.574371+0000","last_change":"2024-04-22T07:18:36.765767+0000","last_active":"2024-04-22T07:22:30.574371+0000","last_peered":"2024-04-22T07:22:30.574371+0000","last_clean":"2024-04-22T07:22:30.574371+0000","last_became_active":"2024-04-22T07:18:36.764218+0000","last_became_peered":"2024-04-22T07:18:36.764218+0000","last_unstale":"2024-04-22T07:22:30.574371+0000","last_undegraded":"2024-04-22T07:22:30.574371+0000","last_fullsized":"2024-04-22T07:22:30.574371+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:45:42.674989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":28,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:34.341514+0000","last_change":"2024-04-22T07:22:34.341533+0000","last_active":"2024-04-22T07:22:34.341514+0000","last_peered":"2024-04-22T07:22:34.341514+0000","last_clean":"2024-04-22T07:22:34.341514+0000","last_became_active":"2024-04-22T07:18:35.743023+0000","last_became_peered":"2024-04-22T07:18:35.743023+0000","last_unstale":"2024-04-22T07:22:34.341514+0000","last_undegraded":"2024-04-22T07:22:34.341514+0000","last_fullsized":"2024-04-22T07:22:34.341514+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:22:34.341444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:22:34.341444+0000","last_clean_scrub_stamp":"2024-04-22T07:22:34.341444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:54:55.662166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"22'173","reported_seq":195,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:30.543926+0000","last_change":"2024-04-22T07:18:36.771073+0000","last_active":"2024-04-22T07:22:30.543926+0000","last_peered":"2024-04-22T07:22:30.543926+0000","last_clean":"2024-04-22T07:22:30.543926+0000","last_became_active":"2024-04-22T07:18:36.770678+0000","last_became_peered":"2024-04-22T07:18:36.770678+0000","last_unstale":"2024-04-22T07:22:30.543926+0000","last_undegraded":"2024-04-22T07:22:30.543926+0000","last_fullsized":"2024-04-22T07:22:30.543926+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:59:57.688417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":20480,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":176,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:20:29.610374+0000","last_change":"2024-04-22T07:18:26.518190+0000","last_active":"2024-04-22T07:20:29.610374+0000","last_peered":"2024-04-22T07:20:29.610374+0000","last_clean":"2024-04-22T07:20:29.610374+0000","last_became_active":"2024-04-22T07:18:26.515489+0000","last_became_peered":"2024-04-22T07:18:26.515489+0000","last_unstale":"2024-04-22T07:20:29.610374+0000","last_undegraded":"2024-04-22T07:20:29.610374+0000","last_fullsized":"2024-04-22T07:20:29.610374+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:24.652061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:24.652061+0000","last_clean_scrub_stamp":"2024-04-22T07:18:24.652061+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:32:54.875706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:19:17.876989+0000","last_change":"2024-04-22T07:18:35.748477+0000","last_active":"2024-04-22T07:19:17.876989+0000","last_peered":"2024-04-22T07:19:17.876989+0000","last_clean":"2024-04-22T07:19:17.876989+0000","last_became_active":"2024-04-22T07:18:35.748176+0000","last_became_peered":"2024-04-22T07:18:35.748176+0000","last_unstale":"2024-04-22T07:19:17.876989+0000","last_undegraded":"2024-04-22T07:19:17.876989+0000","last_fullsized":"2024-04-22T07:19:17.876989+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:36:55.684427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"22'178","reported_seq":197,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:30.543670+0000","last_change":"2024-04-22T07:18:36.771870+0000","last_active":"2024-04-22T07:22:30.543670+0000","last_peered":"2024-04-22T07:22:30.543670+0000","last_clean":"2024-04-22T07:22:30.543670+0000","last_became_active":"2024-04-22T07:18:36.771583+0000","last_became_peered":"2024-04-22T07:18:36.771583+0000","last_unstale":"2024-04-22T07:22:30.543670+0000","last_undegraded":"2024-04-22T07:22:30.543670+0000","last_fullsized":"2024-04-22T07:22:30.543670+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":178,"log_dups_size":0,"ondisk_log_size":178,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":150,"num_write_kb":409600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:19:17.895780+0000","last_change":"2024-04-22T07:18:35.755668+0000","last_active":"2024-04-22T07:19:17.895780+0000","last_peered":"2024-04-22T07:19:17.895780+0000","last_clean":"2024-04-22T07:19:17.895780+0000","last_became_active":"2024-04-22T07:18:35.755471+0000","last_became_peered":"2024-04-22T07:18:35.755471+0000","last_unstale":"2024-04-22T07:19:17.895780+0000","last_undegraded":"2024-04-22T07:19:17.895780+0000","last_fullsized":"2024-04-22T07:19:17.895780+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:36:55.684427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"22'165","reported_seq":189,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:30.595481+0000","last_change":"2024-04-22T07:18:36.758204+0000","last_active":"2024-04-22T07:22:30.595481+0000","last_peered":"2024-04-22T07:22:30.595481+0000","last_clean":"2024-04-22T07:22:30.595481+0000","last_became_active":"2024-04-22T07:18:36.757841+0000","last_became_peered":"2024-04-22T07:18:36.757841+0000","last_unstale":"2024-04-22T07:22:30.595481+0000","last_undegraded":"2024-04-22T07:22:30.595481+0000","last_fullsized":"2024-04-22T07:22:30.595481+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":24576,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"22'6","reported_seq":39,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:35.369396+0000","last_change":"2024-04-22T07:22:35.369435+0000","last_active":"2024-04-22T07:22:35.369396+0000","last_peered":"2024-04-22T07:22:35.369396+0000","last_clean":"2024-04-22T07:22:35.369396+0000","last_became_active":"2024-04-22T07:18:35.746371+0000","last_became_peered":"2024-04-22T07:18:35.746371+0000","last_unstale":"2024-04-22T07:22:35.369396+0000","last_undegraded":"2024-04-22T07:22:35.369396+0000","last_fullsized":"2024-04-22T07:22:35.369396+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'6","last_scrub_stamp":"2024-04-22T07:22:35.369307+0000","last_deep_scrub":"22'6","last_deep_scrub_stamp":"2024-04-22T07:22:35.369307+0000","last_clean_scrub_stamp":"2024-04-22T07:22:35.369307+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:51:08.282588+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":505,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"22'163","reported_seq":184,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:30.575622+0000","last_change":"2024-04-22T07:18:36.765985+0000","last_active":"2024-04-22T07:22:30.575622+0000","last_peered":"2024-04-22T07:22:30.575622+0000","last_clean":"2024-04-22T07:22:30.575622+0000","last_became_active":"2024-04-22T07:18:36.765661+0000","last_became_peered":"2024-04-22T07:18:36.765661+0000","last_unstale":"2024-04-22T07:22:30.575622+0000","last_undegraded":"2024-04-22T07:22:30.575622+0000","last_fullsized":"2024-04-22T07:22:30.575622+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:19:17.876920+0000","last_change":"2024-04-22T07:18:35.754160+0000","last_active":"2024-04-22T07:19:17.876920+0000","last_peered":"2024-04-22T07:19:17.876920+0000","last_clean":"2024-04-22T07:19:17.876920+0000","last_became_active":"2024-04-22T07:18:35.753860+0000","last_became_peered":"2024-04-22T07:18:35.753860+0000","last_unstale":"2024-04-22T07:19:17.876920+0000","last_undegraded":"2024-04-22T07:19:17.876920+0000","last_fullsized":"2024-04-22T07:19:17.876920+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:08:04.608018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"22'169","reported_seq":190,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:30.595577+0000","last_change":"2024-04-22T07:18:36.762349+0000","last_active":"2024-04-22T07:22:30.595577+0000","last_peered":"2024-04-22T07:22:30.595577+0000","last_clean":"2024-04-22T07:22:30.595577+0000","last_became_active":"2024-04-22T07:18:36.762097+0000","last_became_peered":"2024-04-22T07:18:36.762097+0000","last_unstale":"2024-04-22T07:22:30.595577+0000","last_undegraded":"2024-04-22T07:22:30.595577+0000","last_fullsized":"2024-04-22T07:22:30.595577+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:20:44.614918+0000","last_change":"2024-04-22T07:18:35.758810+0000","last_active":"2024-04-22T07:20:44.614918+0000","last_peered":"2024-04-22T07:20:44.614918+0000","last_clean":"2024-04-22T07:20:44.614918+0000","last_became_active":"2024-04-22T07:18:35.758521+0000","last_became_peered":"2024-04-22T07:18:35.758521+0000","last_unstale":"2024-04-22T07:20:44.614918+0000","last_undegraded":"2024-04-22T07:20:44.614918+0000","last_fullsized":"2024-04-22T07:20:44.614918+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"22'153","reported_seq":175,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:30.523664+0000","last_change":"2024-04-22T07:18:36.764448+0000","last_active":"2024-04-22T07:22:30.523664+0000","last_peered":"2024-04-22T07:22:30.523664+0000","last_clean":"2024-04-22T07:22:30.523664+0000","last_became_active":"2024-04-22T07:18:36.763728+0000","last_became_peered":"2024-04-22T07:18:36.763728+0000","last_unstale":"2024-04-22T07:22:30.523664+0000","last_undegraded":"2024-04-22T07:22:30.523664+0000","last_fullsized":"2024-04-22T07:22:30.523664+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:58:41.509248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":20480,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:19:17.896310+0000","last_change":"2024-04-22T07:18:35.758980+0000","last_active":"2024-04-22T07:19:17.896310+0000","last_peered":"2024-04-22T07:19:17.896310+0000","last_clean":"2024-04-22T07:19:17.896310+0000","last_became_active":"2024-04-22T07:18:35.758674+0000","last_became_peered":"2024-04-22T07:18:35.758674+0000","last_unstale":"2024-04-22T07:19:17.896310+0000","last_undegraded":"2024-04-22T07:19:17.896310+0000","last_fullsized":"2024-04-22T07:19:17.896310+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:45:14.209818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"22'160","reported_seq":182,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:30.594612+0000","last_change":"2024-04-22T07:18:36.772908+0000","last_active":"2024-04-22T07:22:30.594612+0000","last_peered":"2024-04-22T07:22:30.594612+0000","last_clean":"2024-04-22T07:22:30.594612+0000","last_became_active":"2024-04-22T07:18:36.772636+0000","last_became_peered":"2024-04-22T07:18:36.772636+0000","last_unstale":"2024-04-22T07:22:30.594612+0000","last_undegraded":"2024-04-22T07:22:30.594612+0000","last_fullsized":"2024-04-22T07:22:30.594612+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":16384,"num_write":135,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"22'19","reported_seq":39,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:30.820737+0000","last_change":"2024-04-22T07:18:35.753595+0000","last_active":"2024-04-22T07:22:30.820737+0000","last_peered":"2024-04-22T07:22:30.820737+0000","last_clean":"2024-04-22T07:22:30.820737+0000","last_became_active":"2024-04-22T07:18:35.753295+0000","last_became_peered":"2024-04-22T07:18:35.753295+0000","last_unstale":"2024-04-22T07:22:30.820737+0000","last_undegraded":"2024-04-22T07:22:30.820737+0000","last_fullsized":"2024-04-22T07:22:30.820737+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"22'160","reported_seq":184,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:30.571898+0000","last_change":"2024-04-22T07:18:36.768580+0000","last_active":"2024-04-22T07:22:30.571898+0000","last_peered":"2024-04-22T07:22:30.571898+0000","last_clean":"2024-04-22T07:22:30.571898+0000","last_became_active":"2024-04-22T07:18:36.767702+0000","last_became_peered":"2024-04-22T07:18:36.767702+0000","last_unstale":"2024-04-22T07:22:30.571898+0000","last_undegraded":"2024-04-22T07:22:30.571898+0000","last_fullsized":"2024-04-22T07:22:30.571898+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":24576,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"22'3","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:20:49.612584+0000","last_change":"2024-04-22T07:18:35.751692+0000","last_active":"2024-04-22T07:20:49.612584+0000","last_peered":"2024-04-22T07:20:49.612584+0000","last_clean":"2024-04-22T07:20:49.612584+0000","last_became_active":"2024-04-22T07:18:35.751393+0000","last_became_peered":"2024-04-22T07:18:35.751393+0000","last_unstale":"2024-04-22T07:20:49.612584+0000","last_undegraded":"2024-04-22T07:20:49.612584+0000","last_fullsized":"2024-04-22T07:20:49.612584+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:40:59.305769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"22'181","reported_seq":204,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:30.577969+0000","last_change":"2024-04-22T07:18:36.768532+0000","last_active":"2024-04-22T07:22:30.577969+0000","last_peered":"2024-04-22T07:22:30.577969+0000","last_clean":"2024-04-22T07:22:30.577969+0000","last_became_active":"2024-04-22T07:18:36.768253+0000","last_became_peered":"2024-04-22T07:18:36.768253+0000","last_unstale":"2024-04-22T07:22:30.577969+0000","last_undegraded":"2024-04-22T07:22:30.577969+0000","last_fullsized":"2024-04-22T07:22:30.577969+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":181,"log_dups_size":0,"ondisk_log_size":181,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":20480,"num_write":156,"num_write_kb":425984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:19:17.895786+0000","last_change":"2024-04-22T07:18:35.758702+0000","last_active":"2024-04-22T07:19:17.895786+0000","last_peered":"2024-04-22T07:19:17.895786+0000","last_clean":"2024-04-22T07:19:17.895786+0000","last_became_active":"2024-04-22T07:18:35.758415+0000","last_became_peered":"2024-04-22T07:18:35.758415+0000","last_unstale":"2024-04-22T07:19:17.895786+0000","last_undegraded":"2024-04-22T07:19:17.895786+0000","last_fullsized":"2024-04-22T07:19:17.895786+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:08:04.608018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"22'154","reported_seq":179,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:30.592091+0000","last_change":"2024-04-22T07:18:36.763053+0000","last_active":"2024-04-22T07:22:30.592091+0000","last_peered":"2024-04-22T07:22:30.592091+0000","last_clean":"2024-04-22T07:22:30.592091+0000","last_became_active":"2024-04-22T07:18:36.762546+0000","last_became_peered":"2024-04-22T07:18:36.762546+0000","last_unstale":"2024-04-22T07:22:30.592091+0000","last_undegraded":"2024-04-22T07:22:30.592091+0000","last_fullsized":"2024-04-22T07:22:30.592091+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":154,"log_dups_size":0,"ondisk_log_size":154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":28672,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":28,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:34.651780+0000","last_change":"2024-04-22T07:22:34.651800+0000","last_active":"2024-04-22T07:22:34.651780+0000","last_peered":"2024-04-22T07:22:34.651780+0000","last_clean":"2024-04-22T07:22:34.651780+0000","last_became_active":"2024-04-22T07:18:35.748080+0000","last_became_peered":"2024-04-22T07:18:35.748080+0000","last_unstale":"2024-04-22T07:22:34.651780+0000","last_undegraded":"2024-04-22T07:22:34.651780+0000","last_fullsized":"2024-04-22T07:22:34.651780+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:22:34.651694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:22:34.651694+0000","last_clean_scrub_stamp":"2024-04-22T07:22:34.651694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:22:03.670120+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"22'170","reported_seq":193,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:30.538028+0000","last_change":"2024-04-22T07:18:36.769911+0000","last_active":"2024-04-22T07:22:30.538028+0000","last_peered":"2024-04-22T07:22:30.538028+0000","last_clean":"2024-04-22T07:22:30.538028+0000","last_became_active":"2024-04-22T07:18:36.768682+0000","last_became_peered":"2024-04-22T07:18:36.768682+0000","last_unstale":"2024-04-22T07:22:30.538028+0000","last_undegraded":"2024-04-22T07:22:30.538028+0000","last_fullsized":"2024-04-22T07:22:30.538028+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":20480,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:20:49.615314+0000","last_change":"2024-04-22T07:18:35.753066+0000","last_active":"2024-04-22T07:20:49.615314+0000","last_peered":"2024-04-22T07:20:49.615314+0000","last_clean":"2024-04-22T07:20:49.615314+0000","last_became_active":"2024-04-22T07:18:35.752804+0000","last_became_peered":"2024-04-22T07:18:35.752804+0000","last_unstale":"2024-04-22T07:20:49.615314+0000","last_undegraded":"2024-04-22T07:20:49.615314+0000","last_fullsized":"2024-04-22T07:20:49.615314+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"22'162","reported_seq":185,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:30.593618+0000","last_change":"2024-04-22T07:18:36.774790+0000","last_active":"2024-04-22T07:22:30.593618+0000","last_peered":"2024-04-22T07:22:30.593618+0000","last_clean":"2024-04-22T07:22:30.593618+0000","last_became_active":"2024-04-22T07:18:36.774479+0000","last_became_peered":"2024-04-22T07:18:36.774479+0000","last_unstale":"2024-04-22T07:22:30.593618+0000","last_undegraded":"2024-04-22T07:22:30.593618+0000","last_fullsized":"2024-04-22T07:22:30.593618+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":20480,"num_write":135,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"22'3","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:20:43.848781+0000","last_change":"2024-04-22T07:18:35.754440+0000","last_active":"2024-04-22T07:20:43.848781+0000","last_peered":"2024-04-22T07:20:43.848781+0000","last_clean":"2024-04-22T07:20:43.848781+0000","last_became_active":"2024-04-22T07:18:35.754137+0000","last_became_peered":"2024-04-22T07:18:35.754137+0000","last_unstale":"2024-04-22T07:20:43.848781+0000","last_undegraded":"2024-04-22T07:20:43.848781+0000","last_fullsized":"2024-04-22T07:20:43.848781+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T19:09:20.529889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"22'150","reported_seq":170,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:30.579818+0000","last_change":"2024-04-22T07:18:36.759585+0000","last_active":"2024-04-22T07:22:30.579818+0000","last_peered":"2024-04-22T07:22:30.579818+0000","last_clean":"2024-04-22T07:22:30.579818+0000","last_became_active":"2024-04-22T07:18:36.759342+0000","last_became_peered":"2024-04-22T07:18:36.759342+0000","last_unstale":"2024-04-22T07:22:30.579818+0000","last_undegraded":"2024-04-22T07:22:30.579818+0000","last_fullsized":"2024-04-22T07:22:30.579818+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":150,"log_dups_size":0,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:44:30.785178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"22'202","reported_seq":223,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:30.576918+0000","last_change":"2024-04-22T07:18:36.762665+0000","last_active":"2024-04-22T07:22:30.576918+0000","last_peered":"2024-04-22T07:22:30.576918+0000","last_clean":"2024-04-22T07:22:30.576918+0000","last_became_active":"2024-04-22T07:18:36.762392+0000","last_became_peered":"2024-04-22T07:18:36.762392+0000","last_unstale":"2024-04-22T07:22:30.576918+0000","last_undegraded":"2024-04-22T07:22:30.576918+0000","last_fullsized":"2024-04-22T07:22:30.576918+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:36:27.097452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":16384,"num_write":168,"num_write_kb":458752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":21,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:19:17.896085+0000","last_change":"2024-04-22T07:18:35.755160+0000","last_active":"2024-04-22T07:19:17.896085+0000","last_peered":"2024-04-22T07:19:17.896085+0000","last_clean":"2024-04-22T07:19:17.896085+0000","last_became_active":"2024-04-22T07:18:35.754877+0000","last_became_peered":"2024-04-22T07:18:35.754877+0000","last_unstale":"2024-04-22T07:19:17.896085+0000","last_undegraded":"2024-04-22T07:19:17.896085+0000","last_fullsized":"2024-04-22T07:19:17.896085+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:43:54.682673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"22'156","reported_seq":176,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:30.551041+0000","last_change":"2024-04-22T07:18:36.761534+0000","last_active":"2024-04-22T07:22:30.551041+0000","last_peered":"2024-04-22T07:22:30.551041+0000","last_clean":"2024-04-22T07:22:30.551041+0000","last_became_active":"2024-04-22T07:18:36.761181+0000","last_became_peered":"2024-04-22T07:18:36.761181+0000","last_unstale":"2024-04-22T07:22:30.551041+0000","last_undegraded":"2024-04-22T07:22:30.551041+0000","last_fullsized":"2024-04-22T07:22:30.551041+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:03:50.228822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"22'4","reported_seq":23,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:21:09.614846+0000","last_change":"2024-04-22T07:18:35.752282+0000","last_active":"2024-04-22T07:21:09.614846+0000","last_peered":"2024-04-22T07:21:09.614846+0000","last_clean":"2024-04-22T07:21:09.614846+0000","last_became_active":"2024-04-22T07:18:35.751866+0000","last_became_peered":"2024-04-22T07:18:35.751866+0000","last_unstale":"2024-04-22T07:21:09.614846+0000","last_undegraded":"2024-04-22T07:21:09.614846+0000","last_fullsized":"2024-04-22T07:21:09.614846+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:19:48.648793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"22'156","reported_seq":176,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:30.539333+0000","last_change":"2024-04-22T07:18:36.763229+0000","last_active":"2024-04-22T07:22:30.539333+0000","last_peered":"2024-04-22T07:22:30.539333+0000","last_clean":"2024-04-22T07:22:30.539333+0000","last_became_active":"2024-04-22T07:18:36.762882+0000","last_became_peered":"2024-04-22T07:18:36.762882+0000","last_unstale":"2024-04-22T07:22:30.539333+0000","last_undegraded":"2024-04-22T07:22:30.539333+0000","last_fullsized":"2024-04-22T07:22:30.539333+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":21,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:20:39.614779+0000","last_change":"2024-04-22T07:18:35.758820+0000","last_active":"2024-04-22T07:20:39.614779+0000","last_peered":"2024-04-22T07:20:39.614779+0000","last_clean":"2024-04-22T07:20:39.614779+0000","last_became_active":"2024-04-22T07:18:35.758514+0000","last_became_peered":"2024-04-22T07:18:35.758514+0000","last_unstale":"2024-04-22T07:20:39.614779+0000","last_undegraded":"2024-04-22T07:20:39.614779+0000","last_fullsized":"2024-04-22T07:20:39.614779+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:34.725012+0000","last_clean_scrub_stamp":"2024-04-22T07:18:34.725012+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"22'173","reported_seq":188,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:30.586046+0000","last_change":"2024-04-22T07:19:18.281671+0000","last_active":"2024-04-22T07:22:30.586046+0000","last_peered":"2024-04-22T07:22:30.586046+0000","last_clean":"2024-04-22T07:22:30.586046+0000","last_became_active":"2024-04-22T07:19:18.281158+0000","last_became_peered":"2024-04-22T07:19:18.281158+0000","last_unstale":"2024-04-22T07:22:30.586046+0000","last_undegraded":"2024-04-22T07:22:30.586046+0000","last_fullsized":"2024-04-22T07:22:30.586046+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:18:35.728863+0000","last_clean_scrub_stamp":"2024-04-22T07:18:35.728863+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1f","version":"22'6","reported_seq":34,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:34.993608+0000","last_change":"2024-04-22T07:22:34.993655+0000","last_active":"2024-04-22T07:22:34.993608+0000","last_peered":"2024-04-22T07:22:34.993608+0000","last_clean":"2024-04-22T07:22:34.993608+0000","last_became_active":"2024-04-22T07:18:35.753833+0000","last_became_peered":"2024-04-22T07:18:35.753833+0000","last_unstale":"2024-04-22T07:22:34.993608+0000","last_undegraded":"2024-04-22T07:22:34.993608+0000","last_fullsized":"2024-04-22T07:22:34.993608+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'6","last_scrub_stamp":"2024-04-22T07:22:34.993521+0000","last_deep_scrub":"22'6","last_deep_scrub_stamp":"2024-04-22T07:22:34.993521+0000","last_clean_scrub_stamp":"2024-04-22T07:22:34.993521+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:48:02.092396+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":256,"num_read_kb":1048576,"num_write":9216,"num_write_kb":25165824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10998,"ondisk_log_size":10998,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":6147297,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":3028,"num_write_kb":8865,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12361728,"data_stored":12294594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3018,"ondisk_log_size":3018,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574903,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56100,"kb_used_data":2716,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315740,"statfs":{"total":96636764160,"available":96579317760,"internally_reserved":0,"allocated":2781184,"data_stored":2625084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":54655434},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574902,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":57712,"kb_used_data":4328,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94314128,"statfs":{"total":96636764160,"available":96577667072,"internally_reserved":0,"allocated":4431872,"data_stored":4278092,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574902,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31404,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340436,"statfs":{"total":96636764160,"available":96604606464,"internally_reserved":0,"allocated":233472,"data_stored":83206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574902,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35572,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336268,"statfs":{"total":96636764160,"available":96600338432,"internally_reserved":0,"allocated":241664,"data_stored":83242,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574903,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":63784,"kb_used_data":6240,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94308056,"statfs":{"total":96636764160,"available":96571449344,"internally_reserved":0,"allocated":6389760,"data_stored":6229615,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":58915271},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574902,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31404,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340436,"statfs":{"total":96636764160,"available":96604606464,"internally_reserved":0,"allocated":233472,"data_stored":83621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574903,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31408,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340432,"statfs":{"total":96636764160,"available":96604602368,"internally_reserved":0,"allocated":237568,"data_stored":83276,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574902,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36152,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335688,"statfs":{"total":96636764160,"available":96599744512,"internally_reserved":0,"allocated":835584,"data_stored":674122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":6160384,"data_stored":6146499,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4202496,"data_stored":4194976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1957888,"data_stored":1951600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-22T07:22:36.806 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-04-22T07:18:35.728863+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=18, tm_sec=35, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=22, tm_sec=31, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T07:22:36.806 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-04-22T07:18:35.728863+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=18, tm_sec=35, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=22, tm_sec=31, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T07:22:36.807 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-04-22T07:18:35.728863+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=18, tm_sec=35, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=22, tm_sec=31, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T07:22:36.807 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-04-22T07:18:35.728863+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=18, tm_sec=35, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=22, tm_sec=31, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T07:22:36.807 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-04-22T07:18:35.728863+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=18, tm_sec=35, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=22, tm_sec=31, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T07:22:36.807 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-04-22T07:18:35.728863+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=18, tm_sec=35, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=22, tm_sec=31, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T07:22:36.807 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-04-22T07:18:35.728863+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=18, tm_sec=35, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=22, tm_sec=31, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T07:22:36.807 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-04-22T07:18:35.728863+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=18, tm_sec=35, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=22, tm_sec=31, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T07:22:36.807 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-04-22T07:18:35.728863+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=18, tm_sec=35, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=22, tm_sec=31, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T07:22:36.807 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-04-22T07:18:35.728863+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=18, tm_sec=35, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=22, tm_sec=31, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T07:22:36.807 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-04-22T07:18:35.728863+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=18, tm_sec=35, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=22, tm_sec=31, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T07:22:36.807 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-04-22T07:18:35.728863+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=18, tm_sec=35, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=22, tm_sec=31, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T07:22:36.808 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-04-22T07:18:35.728863+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=18, tm_sec=35, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=22, tm_sec=31, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T07:22:36.808 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-04-22T07:18:35.728863+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=18, tm_sec=35, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=22, tm_sec=31, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T07:22:36.808 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-04-22T07:18:35.728863+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=18, tm_sec=35, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=22, tm_sec=31, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T07:22:36.808 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-04-22T07:18:35.728863+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=18, tm_sec=35, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=22, tm_sec=31, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T07:22:36.808 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-04-22T07:18:35.728863+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=18, tm_sec=35, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=22, tm_sec=31, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T07:22:36.808 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-04-22T07:18:35.728863+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=18, tm_sec=35, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=22, tm_sec=31, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T07:22:36.808 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-04-22T07:18:35.728863+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=18, tm_sec=35, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=22, tm_sec=31, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T07:22:36.808 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-04-22T07:18:35.728863+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=18, tm_sec=35, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=22, tm_sec=31, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T07:22:36.808 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-04-22T07:18:35.728863+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=18, tm_sec=35, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=22, tm_sec=31, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T07:22:36.808 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-04-22T07:18:35.728863+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=18, tm_sec=35, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=22, tm_sec=31, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T07:22:36.809 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-04-22T07:18:35.728863+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=18, tm_sec=35, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=22, tm_sec=31, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T07:22:36.809 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-04-22T07:18:35.728863+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=18, tm_sec=35, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=22, tm_sec=31, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T07:22:36.809 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-04-22T07:18:35.728863+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=18, tm_sec=35, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=22, tm_sec=31, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T07:22:36.809 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-04-22T07:18:35.728863+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=18, tm_sec=35, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=22, tm_sec=31, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T07:22:36.809 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-04-22T07:18:35.728863+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=18, tm_sec=35, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=22, tm_sec=31, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T07:22:36.809 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-04-22T07:18:35.728863+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=18, tm_sec=35, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=22, tm_sec=31, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T07:22:36.809 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-04-22T07:18:35.728863+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=18, tm_sec=35, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=22, tm_sec=31, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T07:22:36.809 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-04-22T07:18:35.728863+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=18, tm_sec=35, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=22, tm_sec=31, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T07:22:36.809 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-04-22T07:18:35.728863+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=18, tm_sec=35, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=22, tm_sec=31, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T07:22:36.809 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-04-22T07:18:35.728863+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=18, tm_sec=35, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=22, tm_sec=31, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T07:22:36.810 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-04-22T07:18:35.728863+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=18, tm_sec=35, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=22, tm_sec=31, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T07:22:36.810 INFO:tasks.ceph:pgid 2.1a last_scrub_stamp 2024-04-22T07:18:34.725012+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=18, tm_sec=34, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=22, tm_sec=31, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T07:22:36.810 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-04-22T07:18:35.728863+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=18, tm_sec=35, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=22, tm_sec=31, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T07:22:36.810 INFO:tasks.ceph:pgid 2.18 last_scrub_stamp 2024-04-22T07:18:34.725012+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=18, tm_sec=34, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=22, tm_sec=31, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T07:22:36.810 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-04-22T07:18:35.728863+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=18, tm_sec=35, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=22, tm_sec=31, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T07:22:36.810 INFO:tasks.ceph:pgid 2.17 last_scrub_stamp 2024-04-22T07:18:34.725012+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=18, tm_sec=34, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=22, tm_sec=31, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T07:22:36.810 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-04-22T07:18:35.728863+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=18, tm_sec=35, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=22, tm_sec=31, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T07:22:36.810 INFO:tasks.ceph:pgid 2.16 last_scrub_stamp 2024-04-22T07:18:34.725012+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=18, tm_sec=34, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=22, tm_sec=31, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T07:22:36.810 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-04-22T07:18:35.728863+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=18, tm_sec=35, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=22, tm_sec=31, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T07:22:36.811 INFO:tasks.ceph:pgid 2.15 last_scrub_stamp 2024-04-22T07:18:34.725012+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=18, tm_sec=34, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=22, tm_sec=31, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T07:22:36.811 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-04-22T07:18:35.728863+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=18, tm_sec=35, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=22, tm_sec=31, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T07:22:36.811 INFO:tasks.ceph:pgid 2.14 last_scrub_stamp 2024-04-22T07:18:34.725012+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=18, tm_sec=34, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=22, tm_sec=31, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T07:22:36.811 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-04-22T07:18:35.728863+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=18, tm_sec=35, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=22, tm_sec=31, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T07:22:36.811 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-04-22T07:18:35.728863+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=18, tm_sec=35, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=22, tm_sec=31, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T07:22:36.811 INFO:tasks.ceph:pgid 2.12 last_scrub_stamp 2024-04-22T07:18:34.725012+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=18, tm_sec=34, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=22, tm_sec=31, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T07:22:36.811 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-04-22T07:18:35.728863+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=18, tm_sec=35, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=22, tm_sec=31, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T07:22:36.811 INFO:tasks.ceph:pgid 2.11 last_scrub_stamp 2024-04-22T07:18:34.725012+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=18, tm_sec=34, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=22, tm_sec=31, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T07:22:36.811 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-04-22T07:18:35.728863+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=18, tm_sec=35, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=22, tm_sec=31, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T07:22:36.812 INFO:tasks.ceph:pgid 2.10 last_scrub_stamp 2024-04-22T07:18:34.725012+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=18, tm_sec=34, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=22, tm_sec=31, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T07:22:36.812 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-04-22T07:18:35.728863+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=18, tm_sec=35, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=22, tm_sec=31, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T07:22:36.812 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-04-22T07:18:35.728863+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=18, tm_sec=35, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=22, tm_sec=31, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T07:22:36.812 INFO:tasks.ceph:pgid 2.e last_scrub_stamp 2024-04-22T07:18:34.725012+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=18, tm_sec=34, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=22, tm_sec=31, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T07:22:36.812 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-04-22T07:18:35.728863+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=18, tm_sec=35, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=22, tm_sec=31, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T07:22:36.812 INFO:tasks.ceph:pgid 2.d last_scrub_stamp 2024-04-22T07:18:34.725012+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=18, tm_sec=34, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=22, tm_sec=31, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T07:22:36.812 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-04-22T07:18:35.728863+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=18, tm_sec=35, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=22, tm_sec=31, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T07:22:36.812 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-04-22T07:18:35.728863+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=18, tm_sec=35, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=22, tm_sec=31, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T07:22:36.812 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-22T07:18:24.652061+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=18, tm_sec=24, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=22, tm_sec=31, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T07:22:36.812 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-04-22T07:18:34.725012+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=18, tm_sec=34, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=22, tm_sec=31, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T07:22:36.813 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-04-22T07:18:35.728863+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=18, tm_sec=35, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=22, tm_sec=31, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T07:22:36.813 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-04-22T07:18:34.725012+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=18, tm_sec=34, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=22, tm_sec=31, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T07:22:36.813 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-04-22T07:18:35.728863+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=18, tm_sec=35, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=22, tm_sec=31, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T07:22:36.813 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-04-22T07:18:35.728863+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=18, tm_sec=35, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=22, tm_sec=31, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T07:22:36.813 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-04-22T07:18:34.725012+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=18, tm_sec=34, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=22, tm_sec=31, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T07:22:36.813 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-04-22T07:18:35.728863+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=18, tm_sec=35, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=22, tm_sec=31, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T07:22:36.813 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-04-22T07:18:34.725012+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=18, tm_sec=34, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=22, tm_sec=31, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T07:22:36.813 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-04-22T07:18:35.728863+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=18, tm_sec=35, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=22, tm_sec=31, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T07:22:36.814 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-04-22T07:18:34.725012+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=18, tm_sec=34, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=22, tm_sec=31, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T07:22:36.814 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-04-22T07:18:35.728863+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=18, tm_sec=35, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=22, tm_sec=31, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T07:22:36.814 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-04-22T07:18:34.725012+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=18, tm_sec=34, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=22, tm_sec=31, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T07:22:36.814 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-04-22T07:18:35.728863+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=18, tm_sec=35, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=22, tm_sec=31, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T07:22:36.814 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-04-22T07:18:34.725012+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=18, tm_sec=34, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=22, tm_sec=31, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T07:22:36.814 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-04-22T07:18:35.728863+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=18, tm_sec=35, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=22, tm_sec=31, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T07:22:36.814 INFO:tasks.ceph:pgid 2.8 last_scrub_stamp 2024-04-22T07:18:34.725012+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=18, tm_sec=34, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=22, tm_sec=31, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T07:22:36.814 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-04-22T07:18:35.728863+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=18, tm_sec=35, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=22, tm_sec=31, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T07:22:36.814 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-04-22T07:18:35.728863+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=18, tm_sec=35, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=22, tm_sec=31, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T07:22:36.814 INFO:tasks.ceph:pgid 2.a last_scrub_stamp 2024-04-22T07:18:34.725012+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=18, tm_sec=34, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=22, tm_sec=31, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T07:22:36.815 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-04-22T07:18:35.728863+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=18, tm_sec=35, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=22, tm_sec=31, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T07:22:36.815 INFO:tasks.ceph:pgid 2.b last_scrub_stamp 2024-04-22T07:18:34.725012+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=18, tm_sec=34, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=22, tm_sec=31, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T07:22:36.815 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-04-22T07:18:35.728863+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=18, tm_sec=35, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=22, tm_sec=31, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T07:22:36.815 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-04-22T07:18:35.728863+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=18, tm_sec=35, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=22, tm_sec=31, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T07:22:36.815 INFO:tasks.ceph:pgid 2.1c last_scrub_stamp 2024-04-22T07:18:34.725012+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=18, tm_sec=34, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=22, tm_sec=31, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T07:22:36.815 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-04-22T07:18:35.728863+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=18, tm_sec=35, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=22, tm_sec=31, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T07:22:36.815 INFO:tasks.ceph:pgid 2.1d last_scrub_stamp 2024-04-22T07:18:34.725012+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=18, tm_sec=34, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=22, tm_sec=31, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T07:22:36.815 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-04-22T07:18:35.728863+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=18, tm_sec=35, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=22, tm_sec=31, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T07:22:36.815 INFO:tasks.ceph:pgid 2.1e last_scrub_stamp 2024-04-22T07:18:34.725012+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=18, tm_sec=34, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=22, tm_sec=31, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T07:22:36.815 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-04-22T07:18:35.728863+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=18, tm_sec=35, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=22, tm_sec=31, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T07:22:36.816 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-22T07:22:37.350 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-22T07:22:37.353 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-22T07:22:56.816 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-22T07:22:56.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:56.932+0000 7f7f6e359640 1 Processor -- start 2024-04-22T07:22:56.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:56.932+0000 7f7f6e359640 1 -- start start 2024-04-22T07:22:56.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:56.932+0000 7f7f6e359640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7f68152eb0 0x7f7f680c1e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:56.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:56.932+0000 7f7f6e359640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f7f680c62b0 0x7f7f680c6740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:56.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:56.933+0000 7f7f6e359640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7f680c9bd0 con 0x7f7f6815c160 2024-04-22T07:22:56.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:56.933+0000 7f7f6e359640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f7f680c8b00 con 0x7f7f68152eb0 2024-04-22T07:22:56.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:56.933+0000 7f7f6e359640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f7f680c9e20 con 0x7f7f680c62b0 2024-04-22T07:22:56.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:56.933+0000 7f7f67fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7f68152eb0 0x7f7f680c1e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:56.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:56.933+0000 7f7f67fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7f68152eb0 0x7f7f680c1e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42014/0 (socket says 172.21.15.37:42014) 2024-04-22T07:22:56.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:56.933+0000 7f7f67fff640 1 -- 172.21.15.37:0/260931298 learned_addr learned my addr 172.21.15.37:0/260931298 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:22:56.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:56.933+0000 7f7f677fe640 1 --2- 172.21.15.37:0/260931298 >> v2:172.21.15.196:3300/0 conn(0x7f7f680c62b0 0x7f7f680c6740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:56.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:56.933+0000 7f7f67fff640 1 -- 172.21.15.37:0/260931298 >> v2:172.21.15.196:3300/0 conn(0x7f7f680c62b0 msgr2=0x7f7f680c6740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:22:56.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:56.933+0000 7f7f67fff640 1 --2- 172.21.15.37:0/260931298 >> v2:172.21.15.196:3300/0 conn(0x7f7f680c62b0 0x7f7f680c6740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:56.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:56.933+0000 7f7f67fff640 1 -- 172.21.15.37:0/260931298 >> v1:172.21.15.196:6789/0 conn(0x7f7f6815c160 legacy=0x7f7f6815c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:56.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:56.933+0000 7f7f67fff640 1 -- 172.21.15.37:0/260931298 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f680ca100 con 0x7f7f68152eb0 2024-04-22T07:22:56.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:56.934+0000 7f7f67fff640 1 --2- 172.21.15.37:0/260931298 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f68152eb0 0x7f7f680c1e90 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f7f680c2c60 tx=0x7f7f5802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=389af6c5a9136499 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:22:56.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:56.934+0000 7f7f66ffd640 1 -- 172.21.15.37:0/260931298 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f58034070 con 0x7f7f68152eb0 2024-04-22T07:22:56.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:56.934+0000 7f7f66ffd640 1 -- 172.21.15.37:0/260931298 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f58030860 con 0x7f7f68152eb0 2024-04-22T07:22:56.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:56.934+0000 7f7f66ffd640 1 -- 172.21.15.37:0/260931298 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f58030c30 con 0x7f7f68152eb0 2024-04-22T07:22:56.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:56.935+0000 7f7f6e359640 1 -- 172.21.15.37:0/260931298 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f68152eb0 msgr2=0x7f7f680c1e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:56.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:56.935+0000 7f7f6e359640 1 --2- 172.21.15.37:0/260931298 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f68152eb0 0x7f7f680c1e90 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f7f680c2c60 tx=0x7f7f5802b9a0 comp rx=0 tx=0).stop 2024-04-22T07:22:56.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:56.935+0000 7f7f6e359640 1 -- 172.21.15.37:0/260931298 shutdown_connections 2024-04-22T07:22:56.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:56.935+0000 7f7f6e359640 1 --2- 172.21.15.37:0/260931298 >> v2:172.21.15.196:3300/0 conn(0x7f7f680c62b0 0x7f7f680c6740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:56.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:56.935+0000 7f7f6e359640 1 --2- 172.21.15.37:0/260931298 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f68152eb0 0x7f7f680c1e90 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:56.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:56.935+0000 7f7f6e359640 1 -- 172.21.15.37:0/260931298 >> 172.21.15.37:0/260931298 conn(0x7f7f6806ed30 msgr2=0x7f7f6806fc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:22:56.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:56.935+0000 7f7f6e359640 1 -- 172.21.15.37:0/260931298 shutdown_connections 2024-04-22T07:22:56.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:56.935+0000 7f7f6e359640 1 -- 172.21.15.37:0/260931298 wait complete. 2024-04-22T07:22:56.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:56.936+0000 7f7f6e359640 1 Processor -- start 2024-04-22T07:22:56.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:56.936+0000 7f7f6e359640 1 -- start start 2024-04-22T07:22:56.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:56.937+0000 7f7f6e359640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7f680c62b0 0x7f7f681f2320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:56.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:56.937+0000 7f7f6e359640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f68152eb0 0x7f7f6814a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:56.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:56.937+0000 7f7f6e359640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7f6815c160 0x7f7f6815afb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:56.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:56.937+0000 7f7f6e359640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f7f680c9010 con 0x7f7f68152eb0 2024-04-22T07:22:56.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:56.937+0000 7f7f6e359640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f7f680c8d30 con 0x7f7f6815c160 2024-04-22T07:22:56.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:56.937+0000 7f7f6e359640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f7f680c23d0 con 0x7f7f680c62b0 2024-04-22T07:22:56.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:56.937+0000 7f7f677fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f68152eb0 0x7f7f6814a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:56.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:56.937+0000 7f7f677fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f68152eb0 0x7f7f6814a670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42022/0 (socket says 172.21.15.37:42022) 2024-04-22T07:22:56.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:56.937+0000 7f7f677fe640 1 -- 172.21.15.37:0/4117979685 learned_addr learned my addr 172.21.15.37:0/4117979685 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:22:56.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:56.937+0000 7f7f67fff640 1 --2- 172.21.15.37:0/4117979685 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7f680c62b0 0x7f7f681f2320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:56.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:56.937+0000 7f7f6c8f6640 1 --2- 172.21.15.37:0/4117979685 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7f6815c160 0x7f7f6815afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:56.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:56.937+0000 7f7f677fe640 1 -- 172.21.15.37:0/4117979685 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7f680c62b0 msgr2=0x7f7f681f2320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:56.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:56.937+0000 7f7f677fe640 1 --2- 172.21.15.37:0/4117979685 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7f680c62b0 0x7f7f681f2320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:56.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:56.937+0000 7f7f677fe640 1 -- 172.21.15.37:0/4117979685 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7f6815c160 msgr2=0x7f7f6815afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:56.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:56.937+0000 7f7f677fe640 1 --2- 172.21.15.37:0/4117979685 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7f6815c160 0x7f7f6815afb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:56.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:56.937+0000 7f7f677fe640 1 -- 172.21.15.37:0/4117979685 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f681eef10 con 0x7f7f68152eb0 2024-04-22T07:22:56.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:56.938+0000 7f7f677fe640 1 --2- 172.21.15.37:0/4117979685 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f68152eb0 0x7f7f6814a670 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f7f5c00d830 tx=0x7f7f5c00dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:22:56.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:56.938+0000 7f7f64ff9640 1 -- 172.21.15.37:0/4117979685 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f5c00b6c0 con 0x7f7f68152eb0 2024-04-22T07:22:56.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:56.938+0000 7f7f64ff9640 1 -- 172.21.15.37:0/4117979685 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f5c019070 con 0x7f7f68152eb0 2024-04-22T07:22:56.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:56.938+0000 7f7f6e359640 1 -- 172.21.15.37:0/4117979685 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f681efd90 con 0x7f7f68152eb0 2024-04-22T07:22:56.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:56.938+0000 7f7f64ff9640 1 -- 172.21.15.37:0/4117979685 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f5c00ba80 con 0x7f7f68152eb0 2024-04-22T07:22:56.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:56.938+0000 7f7f6e359640 1 -- 172.21.15.37:0/4117979685 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f681ef460 con 0x7f7f68152eb0 2024-04-22T07:22:56.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:56.939+0000 7f7f6e359640 1 -- 172.21.15.37:0/4117979685 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f68076120 con 0x7f7f68152eb0 2024-04-22T07:22:56.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:56.939+0000 7f7f64ff9640 1 -- 172.21.15.37:0/4117979685 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7f5c01e460 con 0x7f7f68152eb0 2024-04-22T07:22:56.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:56.940+0000 7f7f64ff9640 1 --2- 172.21.15.37:0/4117979685 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f7f5406c8f0 0x7f7f5406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:56.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:56.940+0000 7f7f64ff9640 1 -- 172.21.15.37:0/4117979685 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f7f5c08c160 con 0x7f7f68152eb0 2024-04-22T07:22:56.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:56.940+0000 7f7f67fff640 1 --2- 172.21.15.37:0/4117979685 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f7f5406c8f0 0x7f7f5406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:56.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:56.941+0000 7f7f67fff640 1 --2- 172.21.15.37:0/4117979685 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f7f5406c8f0 0x7f7f5406edb0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f7f58036000 tx=0x7f7f58008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:22:56.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:56.944+0000 7f7f64ff9640 1 -- 172.21.15.37:0/4117979685 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f7f68076120 con 0x7f7f68152eb0 2024-04-22T07:22:57.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.125+0000 7f7f6e359640 1 -- 172.21.15.37:0/4117979685 --> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7f6814cf70 con 0x7f7f5406c8f0 2024-04-22T07:22:57.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.132+0000 7f7f64ff9640 1 -- 172.21.15.37:0/4117979685 <== mgr.4103 v2:172.21.15.196:6832/321987173 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+253635 (secure 0 0 0) 0x7f7f6814cf70 con 0x7f7f5406c8f0 2024-04-22T07:22:57.133 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-22T07:22:57.135 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-04-22T07:22:57.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.135+0000 7f7f6e359640 1 -- 172.21.15.37:0/4117979685 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f7f5406c8f0 msgr2=0x7f7f5406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:57.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.135+0000 7f7f6e359640 1 --2- 172.21.15.37:0/4117979685 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f7f5406c8f0 0x7f7f5406edb0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f7f58036000 tx=0x7f7f58008030 comp rx=0 tx=0).stop 2024-04-22T07:22:57.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.135+0000 7f7f6e359640 1 -- 172.21.15.37:0/4117979685 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f68152eb0 msgr2=0x7f7f6814a670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:57.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.135+0000 7f7f6e359640 1 --2- 172.21.15.37:0/4117979685 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f68152eb0 0x7f7f6814a670 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f7f5c00d830 tx=0x7f7f5c00dcf0 comp rx=0 tx=0).stop 2024-04-22T07:22:57.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.135+0000 7f7f6e359640 1 -- 172.21.15.37:0/4117979685 shutdown_connections 2024-04-22T07:22:57.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.135+0000 7f7f6e359640 1 --2- 172.21.15.37:0/4117979685 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f7f5406c8f0 0x7f7f5406edb0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:57.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.135+0000 7f7f6e359640 1 --2- 172.21.15.37:0/4117979685 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7f6815c160 0x7f7f6815afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:57.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.135+0000 7f7f6e359640 1 --2- 172.21.15.37:0/4117979685 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f68152eb0 0x7f7f6814a670 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:57.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.135+0000 7f7f6e359640 1 --2- 172.21.15.37:0/4117979685 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7f680c62b0 0x7f7f681f2320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:57.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.135+0000 7f7f6e359640 1 -- 172.21.15.37:0/4117979685 >> 172.21.15.37:0/4117979685 conn(0x7f7f6806ed30 msgr2=0x7f7f6814b3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:22:57.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.135+0000 7f7f6e359640 1 -- 172.21.15.37:0/4117979685 shutdown_connections 2024-04-22T07:22:57.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.135+0000 7f7f6e359640 1 -- 172.21.15.37:0/4117979685 wait complete. 2024-04-22T07:22:57.145 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":151,"stamp":"2024-04-22T07:22:56.650148+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":6738803,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":377,"num_read_kb":1048681,"num_write":12404,"num_write_kb":25177107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14150,"ondisk_log_size":14150,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":347696,"kb_used_data":15024,"kb_used_omap":12,"kb_used_meta":332595,"kb_avail":754627024,"statfs":{"total":773094113280,"available":772738072576,"internally_reserved":0,"allocated":15384576,"data_stored":14142534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":340577840},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002999"},"pg_stats":[{"pgid":"3.3f","version":"22'166","reported_seq":198,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:37.298278+0000","last_change":"2024-04-22T07:22:37.298278+0000","last_active":"2024-04-22T07:22:37.298278+0000","last_peered":"2024-04-22T07:22:37.298278+0000","last_clean":"2024-04-22T07:22:37.298278+0000","last_became_active":"2024-04-22T07:18:36.765306+0000","last_became_peered":"2024-04-22T07:18:36.765306+0000","last_unstale":"2024-04-22T07:22:37.298278+0000","last_undegraded":"2024-04-22T07:22:37.298278+0000","last_fullsized":"2024-04-22T07:22:37.298278+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'166","last_scrub_stamp":"2024-04-22T07:22:37.298164+0000","last_deep_scrub":"22'166","last_deep_scrub_stamp":"2024-04-22T07:22:37.298164+0000","last_clean_scrub_stamp":"2024-04-22T07:22:37.298164+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:35:39.425663+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":20480,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"22'150","reported_seq":180,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:44.545998+0000","last_change":"2024-04-22T07:22:44.545998+0000","last_active":"2024-04-22T07:22:44.545998+0000","last_peered":"2024-04-22T07:22:44.545998+0000","last_clean":"2024-04-22T07:22:44.545998+0000","last_became_active":"2024-04-22T07:18:36.772464+0000","last_became_peered":"2024-04-22T07:18:36.772464+0000","last_unstale":"2024-04-22T07:22:44.545998+0000","last_undegraded":"2024-04-22T07:22:44.545998+0000","last_fullsized":"2024-04-22T07:22:44.545998+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'150","last_scrub_stamp":"2024-04-22T07:22:44.545858+0000","last_deep_scrub":"22'150","last_deep_scrub_stamp":"2024-04-22T07:22:44.545858+0000","last_clean_scrub_stamp":"2024-04-22T07:22:44.545858+0000","objects_scrubbed":0,"log_size":150,"log_dups_size":0,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T19:14:33.235989+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"22'176","reported_seq":207,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:37.960126+0000","last_change":"2024-04-22T07:22:37.960126+0000","last_active":"2024-04-22T07:22:37.960126+0000","last_peered":"2024-04-22T07:22:37.960126+0000","last_clean":"2024-04-22T07:22:37.960126+0000","last_became_active":"2024-04-22T07:18:36.760313+0000","last_became_peered":"2024-04-22T07:18:36.760313+0000","last_unstale":"2024-04-22T07:22:37.960126+0000","last_undegraded":"2024-04-22T07:22:37.960126+0000","last_fullsized":"2024-04-22T07:22:37.960126+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'176","last_scrub_stamp":"2024-04-22T07:22:37.960003+0000","last_deep_scrub":"22'176","last_deep_scrub_stamp":"2024-04-22T07:22:37.960003+0000","last_clean_scrub_stamp":"2024-04-22T07:22:37.960003+0000","objects_scrubbed":0,"log_size":176,"log_dups_size":0,"ondisk_log_size":176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:37:09.830549+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":16384,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"22'188","reported_seq":210,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:42.361283+0000","last_change":"2024-04-22T07:22:42.361355+0000","last_active":"2024-04-22T07:22:42.361283+0000","last_peered":"2024-04-22T07:22:42.361283+0000","last_clean":"2024-04-22T07:22:42.361283+0000","last_became_active":"2024-04-22T07:19:18.282077+0000","last_became_peered":"2024-04-22T07:19:18.282077+0000","last_unstale":"2024-04-22T07:22:42.361283+0000","last_undegraded":"2024-04-22T07:22:42.361283+0000","last_fullsized":"2024-04-22T07:22:42.361283+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'188","last_scrub_stamp":"2024-04-22T07:22:42.361174+0000","last_deep_scrub":"22'188","last_deep_scrub_stamp":"2024-04-22T07:22:42.361174+0000","last_clean_scrub_stamp":"2024-04-22T07:22:42.361174+0000","objects_scrubbed":0,"log_size":188,"log_dups_size":0,"ondisk_log_size":188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:56:16.952512+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":165,"num_write_kb":450560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"22'172","reported_seq":202,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:45.320009+0000","last_change":"2024-04-22T07:22:45.320049+0000","last_active":"2024-04-22T07:22:45.320009+0000","last_peered":"2024-04-22T07:22:45.320009+0000","last_clean":"2024-04-22T07:22:45.320009+0000","last_became_active":"2024-04-22T07:18:36.763812+0000","last_became_peered":"2024-04-22T07:18:36.763812+0000","last_unstale":"2024-04-22T07:22:45.320009+0000","last_undegraded":"2024-04-22T07:22:45.320009+0000","last_fullsized":"2024-04-22T07:22:45.320009+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'172","last_scrub_stamp":"2024-04-22T07:22:45.319876+0000","last_deep_scrub":"22'172","last_deep_scrub_stamp":"2024-04-22T07:22:45.319876+0000","last_clean_scrub_stamp":"2024-04-22T07:22:45.319876+0000","objects_scrubbed":0,"log_size":172,"log_dups_size":0,"ondisk_log_size":172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:59:42.504941+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":16384,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"22'156","reported_seq":187,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:43.306183+0000","last_change":"2024-04-22T07:22:43.306209+0000","last_active":"2024-04-22T07:22:43.306183+0000","last_peered":"2024-04-22T07:22:43.306183+0000","last_clean":"2024-04-22T07:22:43.306183+0000","last_became_active":"2024-04-22T07:18:36.762508+0000","last_became_peered":"2024-04-22T07:18:36.762508+0000","last_unstale":"2024-04-22T07:22:43.306183+0000","last_undegraded":"2024-04-22T07:22:43.306183+0000","last_fullsized":"2024-04-22T07:22:43.306183+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'156","last_scrub_stamp":"2024-04-22T07:22:43.306077+0000","last_deep_scrub":"22'156","last_deep_scrub_stamp":"2024-04-22T07:22:43.306077+0000","last_clean_scrub_stamp":"2024-04-22T07:22:43.306077+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:43:04.909469+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":20480,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"22'185","reported_seq":212,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:49.330128+0000","last_change":"2024-04-22T07:22:49.330172+0000","last_active":"2024-04-22T07:22:49.330128+0000","last_peered":"2024-04-22T07:22:49.330128+0000","last_clean":"2024-04-22T07:22:49.330128+0000","last_became_active":"2024-04-22T07:18:36.771425+0000","last_became_peered":"2024-04-22T07:18:36.771425+0000","last_unstale":"2024-04-22T07:22:49.330128+0000","last_undegraded":"2024-04-22T07:22:49.330128+0000","last_fullsized":"2024-04-22T07:22:49.330128+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'185","last_scrub_stamp":"2024-04-22T07:22:49.330031+0000","last_deep_scrub":"22'185","last_deep_scrub_stamp":"2024-04-22T07:22:49.330031+0000","last_clean_scrub_stamp":"2024-04-22T07:22:49.330031+0000","objects_scrubbed":0,"log_size":185,"log_dups_size":0,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:06:54.199115+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":159,"num_write_kb":434176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"22'202","reported_seq":235,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:46.501555+0000","last_change":"2024-04-22T07:22:46.501607+0000","last_active":"2024-04-22T07:22:46.501555+0000","last_peered":"2024-04-22T07:22:46.501555+0000","last_clean":"2024-04-22T07:22:46.501555+0000","last_became_active":"2024-04-22T07:18:36.773347+0000","last_became_peered":"2024-04-22T07:18:36.773347+0000","last_unstale":"2024-04-22T07:22:46.501555+0000","last_undegraded":"2024-04-22T07:22:46.501555+0000","last_fullsized":"2024-04-22T07:22:46.501555+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'202","last_scrub_stamp":"2024-04-22T07:22:46.501451+0000","last_deep_scrub":"22'202","last_deep_scrub_stamp":"2024-04-22T07:22:46.501451+0000","last_clean_scrub_stamp":"2024-04-22T07:22:46.501451+0000","objects_scrubbed":0,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:34:16.587640+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":28672,"num_write":177,"num_write_kb":483328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"22'172","reported_seq":203,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:52.322357+0000","last_change":"2024-04-22T07:22:52.322383+0000","last_active":"2024-04-22T07:22:52.322357+0000","last_peered":"2024-04-22T07:22:52.322357+0000","last_clean":"2024-04-22T07:22:52.322357+0000","last_became_active":"2024-04-22T07:18:36.773023+0000","last_became_peered":"2024-04-22T07:18:36.773023+0000","last_unstale":"2024-04-22T07:22:52.322357+0000","last_undegraded":"2024-04-22T07:22:52.322357+0000","last_fullsized":"2024-04-22T07:22:52.322357+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'172","last_scrub_stamp":"2024-04-22T07:22:52.322225+0000","last_deep_scrub":"22'172","last_deep_scrub_stamp":"2024-04-22T07:22:52.322225+0000","last_clean_scrub_stamp":"2024-04-22T07:22:52.322225+0000","objects_scrubbed":0,"log_size":172,"log_dups_size":0,"ondisk_log_size":172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:40:25.915163+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":20480,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"22'183","reported_seq":213,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:46.898455+0000","last_change":"2024-04-22T07:22:46.898480+0000","last_active":"2024-04-22T07:22:46.898455+0000","last_peered":"2024-04-22T07:22:46.898455+0000","last_clean":"2024-04-22T07:22:46.898455+0000","last_became_active":"2024-04-22T07:18:36.769544+0000","last_became_peered":"2024-04-22T07:18:36.769544+0000","last_unstale":"2024-04-22T07:22:46.898455+0000","last_undegraded":"2024-04-22T07:22:46.898455+0000","last_fullsized":"2024-04-22T07:22:46.898455+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'183","last_scrub_stamp":"2024-04-22T07:22:46.898352+0000","last_deep_scrub":"22'183","last_deep_scrub_stamp":"2024-04-22T07:22:46.898352+0000","last_clean_scrub_stamp":"2024-04-22T07:22:46.898352+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:45:32.680182+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":16384,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"22'213","reported_seq":244,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:42.833208+0000","last_change":"2024-04-22T07:22:42.833238+0000","last_active":"2024-04-22T07:22:42.833208+0000","last_peered":"2024-04-22T07:22:42.833208+0000","last_clean":"2024-04-22T07:22:42.833208+0000","last_became_active":"2024-04-22T07:18:36.762059+0000","last_became_peered":"2024-04-22T07:18:36.762059+0000","last_unstale":"2024-04-22T07:22:42.833208+0000","last_undegraded":"2024-04-22T07:22:42.833208+0000","last_fullsized":"2024-04-22T07:22:42.833208+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'213","last_scrub_stamp":"2024-04-22T07:22:42.833074+0000","last_deep_scrub":"22'213","last_deep_scrub_stamp":"2024-04-22T07:22:42.833074+0000","last_clean_scrub_stamp":"2024-04-22T07:22:42.833074+0000","objects_scrubbed":0,"log_size":213,"log_dups_size":0,"ondisk_log_size":213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:20:17.942703+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":20480,"num_write":183,"num_write_kb":499712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"22'163","reported_seq":193,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:36.834987+0000","last_change":"2024-04-22T07:22:36.835011+0000","last_active":"2024-04-22T07:22:36.834987+0000","last_peered":"2024-04-22T07:22:36.834987+0000","last_clean":"2024-04-22T07:22:36.834987+0000","last_became_active":"2024-04-22T07:18:36.761389+0000","last_became_peered":"2024-04-22T07:18:36.761389+0000","last_unstale":"2024-04-22T07:22:36.834987+0000","last_undegraded":"2024-04-22T07:22:36.834987+0000","last_fullsized":"2024-04-22T07:22:36.834987+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'163","last_scrub_stamp":"2024-04-22T07:22:36.834893+0000","last_deep_scrub":"22'163","last_deep_scrub_stamp":"2024-04-22T07:22:36.834893+0000","last_clean_scrub_stamp":"2024-04-22T07:22:36.834893+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:37:17.201794+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":16384,"num_write":135,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"22'175","reported_seq":206,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:38.516643+0000","last_change":"2024-04-22T07:22:38.516670+0000","last_active":"2024-04-22T07:22:38.516643+0000","last_peered":"2024-04-22T07:22:38.516643+0000","last_clean":"2024-04-22T07:22:38.516643+0000","last_became_active":"2024-04-22T07:18:36.767386+0000","last_became_peered":"2024-04-22T07:18:36.767386+0000","last_unstale":"2024-04-22T07:22:38.516643+0000","last_undegraded":"2024-04-22T07:22:38.516643+0000","last_fullsized":"2024-04-22T07:22:38.516643+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'175","last_scrub_stamp":"2024-04-22T07:22:38.516551+0000","last_deep_scrub":"22'175","last_deep_scrub_stamp":"2024-04-22T07:22:38.516551+0000","last_clean_scrub_stamp":"2024-04-22T07:22:38.516551+0000","objects_scrubbed":0,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:56:57.474257+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":20480,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"22'169","reported_seq":196,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:45.050505+0000","last_change":"2024-04-22T07:22:45.050558+0000","last_active":"2024-04-22T07:22:45.050505+0000","last_peered":"2024-04-22T07:22:45.050505+0000","last_clean":"2024-04-22T07:22:45.050505+0000","last_became_active":"2024-04-22T07:18:36.768507+0000","last_became_peered":"2024-04-22T07:18:36.768507+0000","last_unstale":"2024-04-22T07:22:45.050505+0000","last_undegraded":"2024-04-22T07:22:45.050505+0000","last_fullsized":"2024-04-22T07:22:45.050505+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'169","last_scrub_stamp":"2024-04-22T07:22:45.050400+0000","last_deep_scrub":"22'169","last_deep_scrub_stamp":"2024-04-22T07:22:45.050400+0000","last_clean_scrub_stamp":"2024-04-22T07:22:45.050400+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:43:06.653793+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"22'175","reported_seq":204,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:43.562413+0000","last_change":"2024-04-22T07:22:43.562478+0000","last_active":"2024-04-22T07:22:43.562413+0000","last_peered":"2024-04-22T07:22:43.562413+0000","last_clean":"2024-04-22T07:22:43.562413+0000","last_became_active":"2024-04-22T07:18:36.769114+0000","last_became_peered":"2024-04-22T07:18:36.769114+0000","last_unstale":"2024-04-22T07:22:43.562413+0000","last_undegraded":"2024-04-22T07:22:43.562413+0000","last_fullsized":"2024-04-22T07:22:43.562413+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'175","last_scrub_stamp":"2024-04-22T07:22:43.562310+0000","last_deep_scrub":"22'175","last_deep_scrub_stamp":"2024-04-22T07:22:43.562310+0000","last_clean_scrub_stamp":"2024-04-22T07:22:43.562310+0000","objects_scrubbed":0,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:36:29.085404+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"22'161","reported_seq":191,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:50.384673+0000","last_change":"2024-04-22T07:22:50.384699+0000","last_active":"2024-04-22T07:22:50.384673+0000","last_peered":"2024-04-22T07:22:50.384673+0000","last_clean":"2024-04-22T07:22:50.384673+0000","last_became_active":"2024-04-22T07:18:36.764865+0000","last_became_peered":"2024-04-22T07:18:36.764865+0000","last_unstale":"2024-04-22T07:22:50.384673+0000","last_undegraded":"2024-04-22T07:22:50.384673+0000","last_fullsized":"2024-04-22T07:22:50.384673+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'161","last_scrub_stamp":"2024-04-22T07:22:50.384556+0000","last_deep_scrub":"22'161","last_deep_scrub_stamp":"2024-04-22T07:22:50.384556+0000","last_clean_scrub_stamp":"2024-04-22T07:22:50.384556+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:06:55.253641+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":16384,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"22'173","reported_seq":193,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:41.320876+0000","last_change":"2024-04-22T07:22:41.320940+0000","last_active":"2024-04-22T07:22:41.320876+0000","last_peered":"2024-04-22T07:22:41.320876+0000","last_clean":"2024-04-22T07:22:41.320876+0000","last_became_active":"2024-04-22T07:19:17.896886+0000","last_became_peered":"2024-04-22T07:19:17.896886+0000","last_unstale":"2024-04-22T07:22:41.320876+0000","last_undegraded":"2024-04-22T07:22:41.320876+0000","last_fullsized":"2024-04-22T07:22:41.320876+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'173","last_scrub_stamp":"2024-04-22T07:22:41.320777+0000","last_deep_scrub":"22'173","last_deep_scrub_stamp":"2024-04-22T07:22:41.320777+0000","last_clean_scrub_stamp":"2024-04-22T07:22:41.320777+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:57:37.236039+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"22'176","reported_seq":205,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:38.367122+0000","last_change":"2024-04-22T07:22:38.367170+0000","last_active":"2024-04-22T07:22:38.367122+0000","last_peered":"2024-04-22T07:22:38.367122+0000","last_clean":"2024-04-22T07:22:38.367122+0000","last_became_active":"2024-04-22T07:18:36.764113+0000","last_became_peered":"2024-04-22T07:18:36.764113+0000","last_unstale":"2024-04-22T07:22:38.367122+0000","last_undegraded":"2024-04-22T07:22:38.367122+0000","last_fullsized":"2024-04-22T07:22:38.367122+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'176","last_scrub_stamp":"2024-04-22T07:22:38.367010+0000","last_deep_scrub":"22'176","last_deep_scrub_stamp":"2024-04-22T07:22:38.367010+0000","last_clean_scrub_stamp":"2024-04-22T07:22:38.367010+0000","objects_scrubbed":0,"log_size":176,"log_dups_size":0,"ondisk_log_size":176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:18:17.589397+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"22'200","reported_seq":230,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:50.351044+0000","last_change":"2024-04-22T07:22:50.351070+0000","last_active":"2024-04-22T07:22:50.351044+0000","last_peered":"2024-04-22T07:22:50.351044+0000","last_clean":"2024-04-22T07:22:50.351044+0000","last_became_active":"2024-04-22T07:18:36.771878+0000","last_became_peered":"2024-04-22T07:18:36.771878+0000","last_unstale":"2024-04-22T07:22:50.351044+0000","last_undegraded":"2024-04-22T07:22:50.351044+0000","last_fullsized":"2024-04-22T07:22:50.351044+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'200","last_scrub_stamp":"2024-04-22T07:22:50.350947+0000","last_deep_scrub":"22'200","last_deep_scrub_stamp":"2024-04-22T07:22:50.350947+0000","last_clean_scrub_stamp":"2024-04-22T07:22:50.350947+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:01:15.659724+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":16384,"num_write":165,"num_write_kb":450560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"22'177","reported_seq":207,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:45.862612+0000","last_change":"2024-04-22T07:22:45.862638+0000","last_active":"2024-04-22T07:22:45.862612+0000","last_peered":"2024-04-22T07:22:45.862612+0000","last_clean":"2024-04-22T07:22:45.862612+0000","last_became_active":"2024-04-22T07:18:36.769240+0000","last_became_peered":"2024-04-22T07:18:36.769240+0000","last_unstale":"2024-04-22T07:22:45.862612+0000","last_undegraded":"2024-04-22T07:22:45.862612+0000","last_fullsized":"2024-04-22T07:22:45.862612+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'177","last_scrub_stamp":"2024-04-22T07:22:45.862514+0000","last_deep_scrub":"22'177","last_deep_scrub_stamp":"2024-04-22T07:22:45.862514+0000","last_clean_scrub_stamp":"2024-04-22T07:22:45.862514+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:14:33.883821+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":16384,"num_write":153,"num_write_kb":417792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"22'151","reported_seq":178,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:42.975449+0000","last_change":"2024-04-22T07:22:42.975474+0000","last_active":"2024-04-22T07:22:42.975449+0000","last_peered":"2024-04-22T07:22:42.975449+0000","last_clean":"2024-04-22T07:22:42.975449+0000","last_became_active":"2024-04-22T07:18:36.765724+0000","last_became_peered":"2024-04-22T07:18:36.765724+0000","last_unstale":"2024-04-22T07:22:42.975449+0000","last_undegraded":"2024-04-22T07:22:42.975449+0000","last_fullsized":"2024-04-22T07:22:42.975449+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'151","last_scrub_stamp":"2024-04-22T07:22:42.975349+0000","last_deep_scrub":"22'151","last_deep_scrub_stamp":"2024-04-22T07:22:42.975349+0000","last_clean_scrub_stamp":"2024-04-22T07:22:42.975349+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:36:28.498444+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"22'191","reported_seq":221,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:48.336395+0000","last_change":"2024-04-22T07:22:48.336428+0000","last_active":"2024-04-22T07:22:48.336395+0000","last_peered":"2024-04-22T07:22:48.336395+0000","last_clean":"2024-04-22T07:22:48.336395+0000","last_became_active":"2024-04-22T07:18:36.765560+0000","last_became_peered":"2024-04-22T07:18:36.765560+0000","last_unstale":"2024-04-22T07:22:48.336395+0000","last_undegraded":"2024-04-22T07:22:48.336395+0000","last_fullsized":"2024-04-22T07:22:48.336395+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'191","last_scrub_stamp":"2024-04-22T07:22:48.336297+0000","last_deep_scrub":"22'191","last_deep_scrub_stamp":"2024-04-22T07:22:48.336297+0000","last_clean_scrub_stamp":"2024-04-22T07:22:48.336297+0000","objects_scrubbed":0,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:18:46.743537+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":16384,"num_write":156,"num_write_kb":425984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"22'147","reported_seq":177,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:40.585458+0000","last_change":"2024-04-22T07:22:40.585487+0000","last_active":"2024-04-22T07:22:40.585458+0000","last_peered":"2024-04-22T07:22:40.585458+0000","last_clean":"2024-04-22T07:22:40.585458+0000","last_became_active":"2024-04-22T07:18:36.769181+0000","last_became_peered":"2024-04-22T07:18:36.769181+0000","last_unstale":"2024-04-22T07:22:40.585458+0000","last_undegraded":"2024-04-22T07:22:40.585458+0000","last_fullsized":"2024-04-22T07:22:40.585458+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'147","last_scrub_stamp":"2024-04-22T07:22:40.585358+0000","last_deep_scrub":"22'147","last_deep_scrub_stamp":"2024-04-22T07:22:40.585358+0000","last_clean_scrub_stamp":"2024-04-22T07:22:40.585358+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:30:44.332156+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":16384,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"22'205","reported_seq":236,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:44.313557+0000","last_change":"2024-04-22T07:22:44.313620+0000","last_active":"2024-04-22T07:22:44.313557+0000","last_peered":"2024-04-22T07:22:44.313557+0000","last_clean":"2024-04-22T07:22:44.313557+0000","last_became_active":"2024-04-22T07:18:36.763146+0000","last_became_peered":"2024-04-22T07:18:36.763146+0000","last_unstale":"2024-04-22T07:22:44.313557+0000","last_undegraded":"2024-04-22T07:22:44.313557+0000","last_fullsized":"2024-04-22T07:22:44.313557+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'205","last_scrub_stamp":"2024-04-22T07:22:44.313430+0000","last_deep_scrub":"22'205","last_deep_scrub_stamp":"2024-04-22T07:22:44.313430+0000","last_clean_scrub_stamp":"2024-04-22T07:22:44.313430+0000","objects_scrubbed":0,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:42:14.356712+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":20480,"num_write":174,"num_write_kb":475136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"22'155","reported_seq":185,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:41.550069+0000","last_change":"2024-04-22T07:22:41.550097+0000","last_active":"2024-04-22T07:22:41.550069+0000","last_peered":"2024-04-22T07:22:41.550069+0000","last_clean":"2024-04-22T07:22:41.550069+0000","last_became_active":"2024-04-22T07:18:36.769274+0000","last_became_peered":"2024-04-22T07:18:36.769274+0000","last_unstale":"2024-04-22T07:22:41.550069+0000","last_undegraded":"2024-04-22T07:22:41.550069+0000","last_fullsized":"2024-04-22T07:22:41.550069+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'155","last_scrub_stamp":"2024-04-22T07:22:41.549964+0000","last_deep_scrub":"22'155","last_deep_scrub_stamp":"2024-04-22T07:22:41.549964+0000","last_clean_scrub_stamp":"2024-04-22T07:22:41.549964+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:39:47.287011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":16384,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"22'213","reported_seq":243,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:43.802273+0000","last_change":"2024-04-22T07:22:43.802300+0000","last_active":"2024-04-22T07:22:43.802273+0000","last_peered":"2024-04-22T07:22:43.802273+0000","last_clean":"2024-04-22T07:22:43.802273+0000","last_became_active":"2024-04-22T07:18:36.763656+0000","last_became_peered":"2024-04-22T07:18:36.763656+0000","last_unstale":"2024-04-22T07:22:43.802273+0000","last_undegraded":"2024-04-22T07:22:43.802273+0000","last_fullsized":"2024-04-22T07:22:43.802273+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'213","last_scrub_stamp":"2024-04-22T07:22:43.802171+0000","last_deep_scrub":"22'213","last_deep_scrub_stamp":"2024-04-22T07:22:43.802171+0000","last_clean_scrub_stamp":"2024-04-22T07:22:43.802171+0000","objects_scrubbed":0,"log_size":213,"log_dups_size":0,"ondisk_log_size":213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:39:49.539218+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":16384,"num_write":183,"num_write_kb":499712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"22'159","reported_seq":188,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:42.581528+0000","last_change":"2024-04-22T07:22:42.581557+0000","last_active":"2024-04-22T07:22:42.581528+0000","last_peered":"2024-04-22T07:22:42.581528+0000","last_clean":"2024-04-22T07:22:42.581528+0000","last_became_active":"2024-04-22T07:18:36.766614+0000","last_became_peered":"2024-04-22T07:18:36.766614+0000","last_unstale":"2024-04-22T07:22:42.581528+0000","last_undegraded":"2024-04-22T07:22:42.581528+0000","last_fullsized":"2024-04-22T07:22:42.581528+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'159","last_scrub_stamp":"2024-04-22T07:22:42.581435+0000","last_deep_scrub":"22'159","last_deep_scrub_stamp":"2024-04-22T07:22:42.581435+0000","last_clean_scrub_stamp":"2024-04-22T07:22:42.581435+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:39:48.318482+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"22'149","reported_seq":180,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:45.528558+0000","last_change":"2024-04-22T07:22:45.528558+0000","last_active":"2024-04-22T07:22:45.528558+0000","last_peered":"2024-04-22T07:22:45.528558+0000","last_clean":"2024-04-22T07:22:45.528558+0000","last_became_active":"2024-04-22T07:18:36.772827+0000","last_became_peered":"2024-04-22T07:18:36.772827+0000","last_unstale":"2024-04-22T07:22:45.528558+0000","last_undegraded":"2024-04-22T07:22:45.528558+0000","last_fullsized":"2024-04-22T07:22:45.528558+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'149","last_scrub_stamp":"2024-04-22T07:22:45.528395+0000","last_deep_scrub":"22'149","last_deep_scrub_stamp":"2024-04-22T07:22:45.528395+0000","last_clean_scrub_stamp":"2024-04-22T07:22:45.528395+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:27:45.697769+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":16384,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"22'130","reported_seq":163,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:40.976612+0000","last_change":"2024-04-22T07:22:40.976612+0000","last_active":"2024-04-22T07:22:40.976612+0000","last_peered":"2024-04-22T07:22:40.976612+0000","last_clean":"2024-04-22T07:22:40.976612+0000","last_became_active":"2024-04-22T07:18:36.762270+0000","last_became_peered":"2024-04-22T07:18:36.762270+0000","last_unstale":"2024-04-22T07:22:40.976612+0000","last_undegraded":"2024-04-22T07:22:40.976612+0000","last_fullsized":"2024-04-22T07:22:40.976612+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'130","last_scrub_stamp":"2024-04-22T07:22:40.976451+0000","last_deep_scrub":"22'130","last_deep_scrub_stamp":"2024-04-22T07:22:40.976451+0000","last_clean_scrub_stamp":"2024-04-22T07:22:40.976451+0000","objects_scrubbed":0,"log_size":130,"log_dups_size":0,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:30:44.723249+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":24576,"num_write":111,"num_write_kb":303104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"22'149","reported_seq":182,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:45.285262+0000","last_change":"2024-04-22T07:22:45.285262+0000","last_active":"2024-04-22T07:22:45.285262+0000","last_peered":"2024-04-22T07:22:45.285262+0000","last_clean":"2024-04-22T07:22:45.285262+0000","last_became_active":"2024-04-22T07:18:36.763770+0000","last_became_peered":"2024-04-22T07:18:36.763770+0000","last_unstale":"2024-04-22T07:22:45.285262+0000","last_undegraded":"2024-04-22T07:22:45.285262+0000","last_fullsized":"2024-04-22T07:22:45.285262+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'149","last_scrub_stamp":"2024-04-22T07:22:45.285078+0000","last_deep_scrub":"22'149","last_deep_scrub_stamp":"2024-04-22T07:22:45.285078+0000","last_clean_scrub_stamp":"2024-04-22T07:22:45.285078+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:27:05.581410+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":24576,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"22'148","reported_seq":178,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:39.408322+0000","last_change":"2024-04-22T07:22:39.408322+0000","last_active":"2024-04-22T07:22:39.408322+0000","last_peered":"2024-04-22T07:22:39.408322+0000","last_clean":"2024-04-22T07:22:39.408322+0000","last_became_active":"2024-04-22T07:18:36.770786+0000","last_became_peered":"2024-04-22T07:18:36.770786+0000","last_unstale":"2024-04-22T07:22:39.408322+0000","last_undegraded":"2024-04-22T07:22:39.408322+0000","last_fullsized":"2024-04-22T07:22:39.408322+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'148","last_scrub_stamp":"2024-04-22T07:22:39.408187+0000","last_deep_scrub":"22'148","last_deep_scrub_stamp":"2024-04-22T07:22:39.408187+0000","last_clean_scrub_stamp":"2024-04-22T07:22:39.408187+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:55:08.893191+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"22'176","reported_seq":208,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:44.818524+0000","last_change":"2024-04-22T07:22:44.818524+0000","last_active":"2024-04-22T07:22:44.818524+0000","last_peered":"2024-04-22T07:22:44.818524+0000","last_clean":"2024-04-22T07:22:44.818524+0000","last_became_active":"2024-04-22T07:18:36.765142+0000","last_became_peered":"2024-04-22T07:18:36.765142+0000","last_unstale":"2024-04-22T07:22:44.818524+0000","last_undegraded":"2024-04-22T07:22:44.818524+0000","last_fullsized":"2024-04-22T07:22:44.818524+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'176","last_scrub_stamp":"2024-04-22T07:22:44.818356+0000","last_deep_scrub":"22'176","last_deep_scrub_stamp":"2024-04-22T07:22:44.818356+0000","last_clean_scrub_stamp":"2024-04-22T07:22:44.818356+0000","objects_scrubbed":0,"log_size":176,"log_dups_size":0,"ondisk_log_size":176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:36:30.341450+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":20480,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"22'144","reported_seq":172,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:40.890254+0000","last_change":"2024-04-22T07:22:40.890285+0000","last_active":"2024-04-22T07:22:40.890254+0000","last_peered":"2024-04-22T07:22:40.890254+0000","last_clean":"2024-04-22T07:22:40.890254+0000","last_became_active":"2024-04-22T07:18:36.767951+0000","last_became_peered":"2024-04-22T07:18:36.767951+0000","last_unstale":"2024-04-22T07:22:40.890254+0000","last_undegraded":"2024-04-22T07:22:40.890254+0000","last_fullsized":"2024-04-22T07:22:40.890254+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'144","last_scrub_stamp":"2024-04-22T07:22:40.890137+0000","last_deep_scrub":"22'144","last_deep_scrub_stamp":"2024-04-22T07:22:40.890137+0000","last_clean_scrub_stamp":"2024-04-22T07:22:40.890137+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T19:21:49.330046+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"22'934","reported_seq":962,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:35.529759+0000","last_change":"2024-04-22T07:22:35.529759+0000","last_active":"2024-04-22T07:22:35.529759+0000","last_peered":"2024-04-22T07:22:35.529759+0000","last_clean":"2024-04-22T07:22:35.529759+0000","last_became_active":"2024-04-22T07:18:35.751219+0000","last_became_peered":"2024-04-22T07:18:35.751219+0000","last_unstale":"2024-04-22T07:22:35.529759+0000","last_undegraded":"2024-04-22T07:22:35.529759+0000","last_fullsized":"2024-04-22T07:22:35.529759+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'933","last_scrub_stamp":"2024-04-22T07:22:35.529644+0000","last_deep_scrub":"22'933","last_deep_scrub_stamp":"2024-04-22T07:22:35.529644+0000","last_clean_scrub_stamp":"2024-04-22T07:22:35.529644+0000","objects_scrubbed":1,"log_size":934,"log_dups_size":0,"ondisk_log_size":934,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:51:35.098152+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1952156,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":933,"num_write_kb":2805,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"22'154","reported_seq":185,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:36.002426+0000","last_change":"2024-04-22T07:22:36.002477+0000","last_active":"2024-04-22T07:22:36.002426+0000","last_peered":"2024-04-22T07:22:36.002426+0000","last_clean":"2024-04-22T07:22:36.002426+0000","last_became_active":"2024-04-22T07:18:36.757039+0000","last_became_peered":"2024-04-22T07:18:36.757039+0000","last_unstale":"2024-04-22T07:22:36.002426+0000","last_undegraded":"2024-04-22T07:22:36.002426+0000","last_fullsized":"2024-04-22T07:22:36.002426+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'154","last_scrub_stamp":"2024-04-22T07:22:36.002329+0000","last_deep_scrub":"22'154","last_deep_scrub_stamp":"2024-04-22T07:22:36.002329+0000","last_clean_scrub_stamp":"2024-04-22T07:22:36.002329+0000","objects_scrubbed":0,"log_size":154,"log_dups_size":0,"ondisk_log_size":154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:51:35.570836+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":20480,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":29,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:36.835076+0000","last_change":"2024-04-22T07:22:36.835117+0000","last_active":"2024-04-22T07:22:36.835076+0000","last_peered":"2024-04-22T07:22:36.835076+0000","last_clean":"2024-04-22T07:22:36.835076+0000","last_became_active":"2024-04-22T07:18:35.746198+0000","last_became_peered":"2024-04-22T07:18:35.746198+0000","last_unstale":"2024-04-22T07:22:36.835076+0000","last_undegraded":"2024-04-22T07:22:36.835076+0000","last_fullsized":"2024-04-22T07:22:36.835076+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"20'1","last_scrub_stamp":"2024-04-22T07:22:36.834955+0000","last_deep_scrub":"20'1","last_deep_scrub_stamp":"2024-04-22T07:22:36.834955+0000","last_clean_scrub_stamp":"2024-04-22T07:22:36.834955+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:35:47.173455+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":28,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:36.504281+0000","last_change":"2024-04-22T07:22:36.504304+0000","last_active":"2024-04-22T07:22:36.504281+0000","last_peered":"2024-04-22T07:22:36.504281+0000","last_clean":"2024-04-22T07:22:36.504281+0000","last_became_active":"2024-04-22T07:18:35.751545+0000","last_became_peered":"2024-04-22T07:18:35.751545+0000","last_unstale":"2024-04-22T07:22:36.504281+0000","last_undegraded":"2024-04-22T07:22:36.504281+0000","last_fullsized":"2024-04-22T07:22:36.504281+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:22:36.504196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:22:36.504196+0000","last_clean_scrub_stamp":"2024-04-22T07:22:36.504196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:18:35.392716+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"22'189","reported_seq":219,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:44.509312+0000","last_change":"2024-04-22T07:22:44.509341+0000","last_active":"2024-04-22T07:22:44.509312+0000","last_peered":"2024-04-22T07:22:44.509312+0000","last_clean":"2024-04-22T07:22:44.509312+0000","last_became_active":"2024-04-22T07:18:36.772067+0000","last_became_peered":"2024-04-22T07:18:36.772067+0000","last_unstale":"2024-04-22T07:22:44.509312+0000","last_undegraded":"2024-04-22T07:22:44.509312+0000","last_fullsized":"2024-04-22T07:22:44.509312+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'189","last_scrub_stamp":"2024-04-22T07:22:44.509212+0000","last_deep_scrub":"22'189","last_deep_scrub_stamp":"2024-04-22T07:22:44.509212+0000","last_clean_scrub_stamp":"2024-04-22T07:22:44.509212+0000","objects_scrubbed":0,"log_size":189,"log_dups_size":0,"ondisk_log_size":189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:11:28.881211+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":16384,"num_write":162,"num_write_kb":442368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":28,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:36.215404+0000","last_change":"2024-04-22T07:22:36.215430+0000","last_active":"2024-04-22T07:22:36.215404+0000","last_peered":"2024-04-22T07:22:36.215404+0000","last_clean":"2024-04-22T07:22:36.215404+0000","last_became_active":"2024-04-22T07:18:35.740665+0000","last_became_peered":"2024-04-22T07:18:35.740665+0000","last_unstale":"2024-04-22T07:22:36.215404+0000","last_undegraded":"2024-04-22T07:22:36.215404+0000","last_fullsized":"2024-04-22T07:22:36.215404+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:22:36.215301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:22:36.215301+0000","last_clean_scrub_stamp":"2024-04-22T07:22:36.215301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:56:55.173007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"22'181","reported_seq":210,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:41.580197+0000","last_change":"2024-04-22T07:22:41.580225+0000","last_active":"2024-04-22T07:22:41.580197+0000","last_peered":"2024-04-22T07:22:41.580197+0000","last_clean":"2024-04-22T07:22:41.580197+0000","last_became_active":"2024-04-22T07:18:36.766609+0000","last_became_peered":"2024-04-22T07:18:36.766609+0000","last_unstale":"2024-04-22T07:22:41.580197+0000","last_undegraded":"2024-04-22T07:22:41.580197+0000","last_fullsized":"2024-04-22T07:22:41.580197+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'181","last_scrub_stamp":"2024-04-22T07:22:41.580104+0000","last_deep_scrub":"22'181","last_deep_scrub_stamp":"2024-04-22T07:22:41.580104+0000","last_clean_scrub_stamp":"2024-04-22T07:22:41.580104+0000","objects_scrubbed":0,"log_size":181,"log_dups_size":0,"ondisk_log_size":181,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:30:45.326902+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"22'1","reported_seq":29,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:39.876163+0000","last_change":"2024-04-22T07:22:39.876189+0000","last_active":"2024-04-22T07:22:39.876163+0000","last_peered":"2024-04-22T07:22:39.876163+0000","last_clean":"2024-04-22T07:22:39.876163+0000","last_became_active":"2024-04-22T07:18:35.751757+0000","last_became_peered":"2024-04-22T07:18:35.751757+0000","last_unstale":"2024-04-22T07:22:39.876163+0000","last_undegraded":"2024-04-22T07:22:39.876163+0000","last_fullsized":"2024-04-22T07:22:39.876163+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'1","last_scrub_stamp":"2024-04-22T07:22:39.876081+0000","last_deep_scrub":"22'1","last_deep_scrub_stamp":"2024-04-22T07:22:39.876081+0000","last_clean_scrub_stamp":"2024-04-22T07:22:39.876081+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:09:55.537638+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"22'244","reported_seq":278,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:49.371110+0000","last_change":"2024-04-22T07:22:49.371132+0000","last_active":"2024-04-22T07:22:49.371110+0000","last_peered":"2024-04-22T07:22:49.371110+0000","last_clean":"2024-04-22T07:22:49.371110+0000","last_became_active":"2024-04-22T07:18:36.765647+0000","last_became_peered":"2024-04-22T07:18:36.765647+0000","last_unstale":"2024-04-22T07:22:49.371110+0000","last_undegraded":"2024-04-22T07:22:49.371110+0000","last_fullsized":"2024-04-22T07:22:49.371110+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'244","last_scrub_stamp":"2024-04-22T07:22:49.371002+0000","last_deep_scrub":"22'244","last_deep_scrub_stamp":"2024-04-22T07:22:49.371002+0000","last_clean_scrub_stamp":"2024-04-22T07:22:49.371002+0000","objects_scrubbed":0,"log_size":244,"log_dups_size":0,"ondisk_log_size":244,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:19:31.702588+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":32768,"num_write":219,"num_write_kb":598016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":28,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:37.217918+0000","last_change":"2024-04-22T07:22:37.217983+0000","last_active":"2024-04-22T07:22:37.217918+0000","last_peered":"2024-04-22T07:22:37.217918+0000","last_clean":"2024-04-22T07:22:37.217918+0000","last_became_active":"2024-04-22T07:18:35.747019+0000","last_became_peered":"2024-04-22T07:18:35.747019+0000","last_unstale":"2024-04-22T07:22:37.217918+0000","last_undegraded":"2024-04-22T07:22:37.217918+0000","last_fullsized":"2024-04-22T07:22:37.217918+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:22:37.217807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:22:37.217807+0000","last_clean_scrub_stamp":"2024-04-22T07:22:37.217807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:35:39.345305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"22'156","reported_seq":186,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:39.987974+0000","last_change":"2024-04-22T07:22:39.988001+0000","last_active":"2024-04-22T07:22:39.987974+0000","last_peered":"2024-04-22T07:22:39.987974+0000","last_clean":"2024-04-22T07:22:39.987974+0000","last_became_active":"2024-04-22T07:18:36.763068+0000","last_became_peered":"2024-04-22T07:18:36.763068+0000","last_unstale":"2024-04-22T07:22:39.987974+0000","last_undegraded":"2024-04-22T07:22:39.987974+0000","last_fullsized":"2024-04-22T07:22:39.987974+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'156","last_scrub_stamp":"2024-04-22T07:22:39.987861+0000","last_deep_scrub":"22'156","last_deep_scrub_stamp":"2024-04-22T07:22:39.987861+0000","last_clean_scrub_stamp":"2024-04-22T07:22:39.987861+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:35:42.115360+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":16384,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"22'10","reported_seq":38,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:36.664567+0000","last_change":"2024-04-22T07:22:36.664591+0000","last_active":"2024-04-22T07:22:36.664567+0000","last_peered":"2024-04-22T07:22:36.664567+0000","last_clean":"2024-04-22T07:22:36.664567+0000","last_became_active":"2024-04-22T07:18:35.750406+0000","last_became_peered":"2024-04-22T07:18:35.750406+0000","last_unstale":"2024-04-22T07:22:36.664567+0000","last_undegraded":"2024-04-22T07:22:36.664567+0000","last_fullsized":"2024-04-22T07:22:36.664567+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'10","last_scrub_stamp":"2024-04-22T07:22:36.664493+0000","last_deep_scrub":"22'10","last_deep_scrub_stamp":"2024-04-22T07:22:36.664493+0000","last_clean_scrub_stamp":"2024-04-22T07:22:36.664493+0000","objects_scrubbed":2,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:51:36.233000+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"22'165","reported_seq":193,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:39.867372+0000","last_change":"2024-04-22T07:22:39.867395+0000","last_active":"2024-04-22T07:22:39.867372+0000","last_peered":"2024-04-22T07:22:39.867372+0000","last_clean":"2024-04-22T07:22:39.867372+0000","last_became_active":"2024-04-22T07:18:36.767159+0000","last_became_peered":"2024-04-22T07:18:36.767159+0000","last_unstale":"2024-04-22T07:22:39.867372+0000","last_undegraded":"2024-04-22T07:22:39.867372+0000","last_fullsized":"2024-04-22T07:22:39.867372+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'165","last_scrub_stamp":"2024-04-22T07:22:39.867287+0000","last_deep_scrub":"22'165","last_deep_scrub_stamp":"2024-04-22T07:22:39.867287+0000","last_clean_scrub_stamp":"2024-04-22T07:22:39.867287+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:11:55.153240+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"22'2015","reported_seq":2043,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:40.920999+0000","last_change":"2024-04-22T07:22:40.921054+0000","last_active":"2024-04-22T07:22:40.920999+0000","last_peered":"2024-04-22T07:22:40.920999+0000","last_clean":"2024-04-22T07:22:40.920999+0000","last_became_active":"2024-04-22T07:18:35.752686+0000","last_became_peered":"2024-04-22T07:18:35.752686+0000","last_unstale":"2024-04-22T07:22:40.920999+0000","last_undegraded":"2024-04-22T07:22:40.920999+0000","last_fullsized":"2024-04-22T07:22:40.920999+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'2015","last_scrub_stamp":"2024-04-22T07:22:40.920880+0000","last_deep_scrub":"22'2015","last_deep_scrub_stamp":"2024-04-22T07:22:40.920880+0000","last_clean_scrub_stamp":"2024-04-22T07:22:40.920880+0000","objects_scrubbed":4,"log_size":2015,"log_dups_size":0,"ondisk_log_size":2015,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:56:59.878586+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2011,"num_write_kb":6027,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"22'175","reported_seq":208,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:46.301539+0000","last_change":"2024-04-22T07:22:46.301569+0000","last_active":"2024-04-22T07:22:46.301539+0000","last_peered":"2024-04-22T07:22:46.301539+0000","last_clean":"2024-04-22T07:22:46.301539+0000","last_became_active":"2024-04-22T07:18:36.767273+0000","last_became_peered":"2024-04-22T07:18:36.767273+0000","last_unstale":"2024-04-22T07:22:46.301539+0000","last_undegraded":"2024-04-22T07:22:46.301539+0000","last_fullsized":"2024-04-22T07:22:46.301539+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'175","last_scrub_stamp":"2024-04-22T07:22:46.301415+0000","last_deep_scrub":"22'175","last_deep_scrub_stamp":"2024-04-22T07:22:46.301415+0000","last_clean_scrub_stamp":"2024-04-22T07:22:46.301415+0000","objects_scrubbed":0,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:24:26.251704+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":28672,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"22'4","reported_seq":32,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:33.998335+0000","last_change":"2024-04-22T07:22:33.998390+0000","last_active":"2024-04-22T07:22:33.998335+0000","last_peered":"2024-04-22T07:22:33.998335+0000","last_clean":"2024-04-22T07:22:33.998335+0000","last_became_active":"2024-04-22T07:18:35.752060+0000","last_became_peered":"2024-04-22T07:18:35.752060+0000","last_unstale":"2024-04-22T07:22:33.998335+0000","last_undegraded":"2024-04-22T07:22:33.998335+0000","last_fullsized":"2024-04-22T07:22:33.998335+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'4","last_scrub_stamp":"2024-04-22T07:22:33.998248+0000","last_deep_scrub":"22'4","last_deep_scrub_stamp":"2024-04-22T07:22:33.998248+0000","last_clean_scrub_stamp":"2024-04-22T07:22:33.998248+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:22:03.016674+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"22'173","reported_seq":202,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:41.983441+0000","last_change":"2024-04-22T07:22:41.983470+0000","last_active":"2024-04-22T07:22:41.983441+0000","last_peered":"2024-04-22T07:22:41.983441+0000","last_clean":"2024-04-22T07:22:41.983441+0000","last_became_active":"2024-04-22T07:18:36.763834+0000","last_became_peered":"2024-04-22T07:18:36.763834+0000","last_unstale":"2024-04-22T07:22:41.983441+0000","last_undegraded":"2024-04-22T07:22:41.983441+0000","last_fullsized":"2024-04-22T07:22:41.983441+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'173","last_scrub_stamp":"2024-04-22T07:22:41.983319+0000","last_deep_scrub":"22'173","last_deep_scrub_stamp":"2024-04-22T07:22:41.983319+0000","last_clean_scrub_stamp":"2024-04-22T07:22:41.983319+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:39:47.720366+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":28,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:39.240448+0000","last_change":"2024-04-22T07:22:39.240488+0000","last_active":"2024-04-22T07:22:39.240448+0000","last_peered":"2024-04-22T07:22:39.240448+0000","last_clean":"2024-04-22T07:22:39.240448+0000","last_became_active":"2024-04-22T07:18:35.752527+0000","last_became_peered":"2024-04-22T07:18:35.752527+0000","last_unstale":"2024-04-22T07:22:39.240448+0000","last_undegraded":"2024-04-22T07:22:39.240448+0000","last_fullsized":"2024-04-22T07:22:39.240448+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:22:39.240347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:22:39.240347+0000","last_clean_scrub_stamp":"2024-04-22T07:22:39.240347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:39:44.977395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"22'196","reported_seq":217,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:40.359311+0000","last_change":"2024-04-22T07:22:40.359336+0000","last_active":"2024-04-22T07:22:40.359311+0000","last_peered":"2024-04-22T07:22:40.359311+0000","last_clean":"2024-04-22T07:22:40.359311+0000","last_became_active":"2024-04-22T07:19:17.878334+0000","last_became_peered":"2024-04-22T07:19:17.878334+0000","last_unstale":"2024-04-22T07:22:40.359311+0000","last_undegraded":"2024-04-22T07:22:40.359311+0000","last_fullsized":"2024-04-22T07:22:40.359311+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'196","last_scrub_stamp":"2024-04-22T07:22:40.359212+0000","last_deep_scrub":"22'196","last_deep_scrub_stamp":"2024-04-22T07:22:40.359212+0000","last_clean_scrub_stamp":"2024-04-22T07:22:40.359212+0000","objects_scrubbed":0,"log_size":196,"log_dups_size":0,"ondisk_log_size":196,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:10:30.412904+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":156,"num_write_kb":425984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":28,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:37.831756+0000","last_change":"2024-04-22T07:22:37.831786+0000","last_active":"2024-04-22T07:22:37.831756+0000","last_peered":"2024-04-22T07:22:37.831756+0000","last_clean":"2024-04-22T07:22:37.831756+0000","last_became_active":"2024-04-22T07:18:35.749453+0000","last_became_peered":"2024-04-22T07:18:35.749453+0000","last_unstale":"2024-04-22T07:22:37.831756+0000","last_undegraded":"2024-04-22T07:22:37.831756+0000","last_fullsized":"2024-04-22T07:22:37.831756+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:22:37.831636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:22:37.831636+0000","last_clean_scrub_stamp":"2024-04-22T07:22:37.831636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:18:17.054023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"22'188","reported_seq":223,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:47.864804+0000","last_change":"2024-04-22T07:22:47.864836+0000","last_active":"2024-04-22T07:22:47.864804+0000","last_peered":"2024-04-22T07:22:47.864804+0000","last_clean":"2024-04-22T07:22:47.864804+0000","last_became_active":"2024-04-22T07:18:36.771548+0000","last_became_peered":"2024-04-22T07:18:36.771548+0000","last_unstale":"2024-04-22T07:22:47.864804+0000","last_undegraded":"2024-04-22T07:22:47.864804+0000","last_fullsized":"2024-04-22T07:22:47.864804+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'188","last_scrub_stamp":"2024-04-22T07:22:47.864698+0000","last_deep_scrub":"22'188","last_deep_scrub_stamp":"2024-04-22T07:22:47.864698+0000","last_clean_scrub_stamp":"2024-04-22T07:22:47.864698+0000","objects_scrubbed":0,"log_size":188,"log_dups_size":0,"ondisk_log_size":188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:43:09.468091+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":36864,"num_write":159,"num_write_kb":434176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"22'13","reported_seq":41,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:37.349168+0000","last_change":"2024-04-22T07:22:37.349240+0000","last_active":"2024-04-22T07:22:37.349168+0000","last_peered":"2024-04-22T07:22:37.349168+0000","last_clean":"2024-04-22T07:22:37.349168+0000","last_became_active":"2024-04-22T07:18:35.748757+0000","last_became_peered":"2024-04-22T07:18:35.748757+0000","last_unstale":"2024-04-22T07:22:37.349168+0000","last_undegraded":"2024-04-22T07:22:37.349168+0000","last_fullsized":"2024-04-22T07:22:37.349168+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'13","last_scrub_stamp":"2024-04-22T07:22:37.349079+0000","last_deep_scrub":"22'13","last_deep_scrub_stamp":"2024-04-22T07:22:37.349079+0000","last_clean_scrub_stamp":"2024-04-22T07:22:37.349079+0000","objects_scrubbed":4,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:21:57.476037+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"22'212","reported_seq":245,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:47.334898+0000","last_change":"2024-04-22T07:22:47.334923+0000","last_active":"2024-04-22T07:22:47.334898+0000","last_peered":"2024-04-22T07:22:47.334898+0000","last_clean":"2024-04-22T07:22:47.334898+0000","last_became_active":"2024-04-22T07:18:36.768702+0000","last_became_peered":"2024-04-22T07:18:36.768702+0000","last_unstale":"2024-04-22T07:22:47.334898+0000","last_undegraded":"2024-04-22T07:22:47.334898+0000","last_fullsized":"2024-04-22T07:22:47.334898+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'212","last_scrub_stamp":"2024-04-22T07:22:47.334802+0000","last_deep_scrub":"22'212","last_deep_scrub_stamp":"2024-04-22T07:22:47.334802+0000","last_clean_scrub_stamp":"2024-04-22T07:22:47.334802+0000","objects_scrubbed":0,"log_size":212,"log_dups_size":0,"ondisk_log_size":212,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:18:45.742041+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":28672,"num_write":183,"num_write_kb":499712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"22'2","reported_seq":30,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:35.842189+0000","last_change":"2024-04-22T07:22:35.842218+0000","last_active":"2024-04-22T07:22:35.842189+0000","last_peered":"2024-04-22T07:22:35.842189+0000","last_clean":"2024-04-22T07:22:35.842189+0000","last_became_active":"2024-04-22T07:18:35.747271+0000","last_became_peered":"2024-04-22T07:18:35.747271+0000","last_unstale":"2024-04-22T07:22:35.842189+0000","last_undegraded":"2024-04-22T07:22:35.842189+0000","last_fullsized":"2024-04-22T07:22:35.842189+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'2","last_scrub_stamp":"2024-04-22T07:22:35.842097+0000","last_deep_scrub":"22'2","last_deep_scrub_stamp":"2024-04-22T07:22:35.842097+0000","last_clean_scrub_stamp":"2024-04-22T07:22:35.842097+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:42:06.469535+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"22'170","reported_seq":200,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:51.322305+0000","last_change":"2024-04-22T07:22:51.322333+0000","last_active":"2024-04-22T07:22:51.322305+0000","last_peered":"2024-04-22T07:22:51.322305+0000","last_clean":"2024-04-22T07:22:51.322305+0000","last_became_active":"2024-04-22T07:18:36.772537+0000","last_became_peered":"2024-04-22T07:18:36.772537+0000","last_unstale":"2024-04-22T07:22:51.322305+0000","last_undegraded":"2024-04-22T07:22:51.322305+0000","last_fullsized":"2024-04-22T07:22:51.322305+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'170","last_scrub_stamp":"2024-04-22T07:22:51.322205+0000","last_deep_scrub":"22'170","last_deep_scrub_stamp":"2024-04-22T07:22:51.322205+0000","last_clean_scrub_stamp":"2024-04-22T07:22:51.322205+0000","objects_scrubbed":0,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:00:21.787135+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":16384,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"22'3","reported_seq":31,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:36.339637+0000","last_change":"2024-04-22T07:22:36.339661+0000","last_active":"2024-04-22T07:22:36.339637+0000","last_peered":"2024-04-22T07:22:36.339637+0000","last_clean":"2024-04-22T07:22:36.339637+0000","last_became_active":"2024-04-22T07:18:35.746881+0000","last_became_peered":"2024-04-22T07:18:35.746881+0000","last_unstale":"2024-04-22T07:22:36.339637+0000","last_undegraded":"2024-04-22T07:22:36.339637+0000","last_fullsized":"2024-04-22T07:22:36.339637+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'3","last_scrub_stamp":"2024-04-22T07:22:36.339555+0000","last_deep_scrub":"22'3","last_deep_scrub_stamp":"2024-04-22T07:22:36.339555+0000","last_clean_scrub_stamp":"2024-04-22T07:22:36.339555+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:38:52.136950+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"22'159","reported_seq":187,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:53.309060+0000","last_change":"2024-04-22T07:22:53.309088+0000","last_active":"2024-04-22T07:22:53.309060+0000","last_peered":"2024-04-22T07:22:53.309060+0000","last_clean":"2024-04-22T07:22:53.309060+0000","last_became_active":"2024-04-22T07:18:36.773466+0000","last_became_peered":"2024-04-22T07:18:36.773466+0000","last_unstale":"2024-04-22T07:22:53.309060+0000","last_undegraded":"2024-04-22T07:22:53.309060+0000","last_fullsized":"2024-04-22T07:22:53.309060+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'159","last_scrub_stamp":"2024-04-22T07:22:53.308943+0000","last_deep_scrub":"22'159","last_deep_scrub_stamp":"2024-04-22T07:22:53.308943+0000","last_clean_scrub_stamp":"2024-04-22T07:22:53.308943+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:12:03.485790+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"22'2","reported_seq":30,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:35.681366+0000","last_change":"2024-04-22T07:22:35.681423+0000","last_active":"2024-04-22T07:22:35.681366+0000","last_peered":"2024-04-22T07:22:35.681366+0000","last_clean":"2024-04-22T07:22:35.681366+0000","last_became_active":"2024-04-22T07:18:35.749984+0000","last_became_peered":"2024-04-22T07:18:35.749984+0000","last_unstale":"2024-04-22T07:22:35.681366+0000","last_undegraded":"2024-04-22T07:22:35.681366+0000","last_fullsized":"2024-04-22T07:22:35.681366+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'2","last_scrub_stamp":"2024-04-22T07:22:35.681280+0000","last_deep_scrub":"22'2","last_deep_scrub_stamp":"2024-04-22T07:22:35.681280+0000","last_clean_scrub_stamp":"2024-04-22T07:22:35.681280+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:48:02.780155+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"22'162","reported_seq":191,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:47.290078+0000","last_change":"2024-04-22T07:22:47.290130+0000","last_active":"2024-04-22T07:22:47.290078+0000","last_peered":"2024-04-22T07:22:47.290078+0000","last_clean":"2024-04-22T07:22:47.290078+0000","last_became_active":"2024-04-22T07:18:36.764218+0000","last_became_peered":"2024-04-22T07:18:36.764218+0000","last_unstale":"2024-04-22T07:22:47.290078+0000","last_undegraded":"2024-04-22T07:22:47.290078+0000","last_fullsized":"2024-04-22T07:22:47.290078+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'162","last_scrub_stamp":"2024-04-22T07:22:47.289979+0000","last_deep_scrub":"22'162","last_deep_scrub_stamp":"2024-04-22T07:22:47.289979+0000","last_clean_scrub_stamp":"2024-04-22T07:22:47.289979+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:24:27.240268+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":28,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:34.341514+0000","last_change":"2024-04-22T07:22:34.341533+0000","last_active":"2024-04-22T07:22:34.341514+0000","last_peered":"2024-04-22T07:22:34.341514+0000","last_clean":"2024-04-22T07:22:34.341514+0000","last_became_active":"2024-04-22T07:18:35.743023+0000","last_became_peered":"2024-04-22T07:18:35.743023+0000","last_unstale":"2024-04-22T07:22:34.341514+0000","last_undegraded":"2024-04-22T07:22:34.341514+0000","last_fullsized":"2024-04-22T07:22:34.341514+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:22:34.341444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:22:34.341444+0000","last_clean_scrub_stamp":"2024-04-22T07:22:34.341444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:54:55.662166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"22'173","reported_seq":204,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:48.321865+0000","last_change":"2024-04-22T07:22:48.321891+0000","last_active":"2024-04-22T07:22:48.321865+0000","last_peered":"2024-04-22T07:22:48.321865+0000","last_clean":"2024-04-22T07:22:48.321865+0000","last_became_active":"2024-04-22T07:18:36.770678+0000","last_became_peered":"2024-04-22T07:18:36.770678+0000","last_unstale":"2024-04-22T07:22:48.321865+0000","last_undegraded":"2024-04-22T07:22:48.321865+0000","last_fullsized":"2024-04-22T07:22:48.321865+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'173","last_scrub_stamp":"2024-04-22T07:22:48.321761+0000","last_deep_scrub":"22'173","last_deep_scrub_stamp":"2024-04-22T07:22:48.321761+0000","last_clean_scrub_stamp":"2024-04-22T07:22:48.321761+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:19:30.653346+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":20480,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"22'119","reported_seq":187,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:38.275892+0000","last_change":"2024-04-22T07:22:38.275921+0000","last_active":"2024-04-22T07:22:38.275892+0000","last_peered":"2024-04-22T07:22:38.275892+0000","last_clean":"2024-04-22T07:22:38.275892+0000","last_became_active":"2024-04-22T07:18:26.515489+0000","last_became_peered":"2024-04-22T07:18:26.515489+0000","last_unstale":"2024-04-22T07:22:38.275892+0000","last_undegraded":"2024-04-22T07:22:38.275892+0000","last_fullsized":"2024-04-22T07:22:38.275892+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'119","last_scrub_stamp":"2024-04-22T07:22:38.275825+0000","last_deep_scrub":"22'119","last_deep_scrub_stamp":"2024-04-22T07:22:38.275825+0000","last_clean_scrub_stamp":"2024-04-22T07:22:38.275825+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:20:13.385454+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":29,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:38.216805+0000","last_change":"2024-04-22T07:22:38.216805+0000","last_active":"2024-04-22T07:22:38.216805+0000","last_peered":"2024-04-22T07:22:38.216805+0000","last_clean":"2024-04-22T07:22:38.216805+0000","last_became_active":"2024-04-22T07:18:35.748176+0000","last_became_peered":"2024-04-22T07:18:35.748176+0000","last_unstale":"2024-04-22T07:22:38.216805+0000","last_undegraded":"2024-04-22T07:22:38.216805+0000","last_fullsized":"2024-04-22T07:22:38.216805+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:22:38.216693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:22:38.216693+0000","last_clean_scrub_stamp":"2024-04-22T07:22:38.216693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:20:13.326322+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"22'178","reported_seq":206,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:43.528456+0000","last_change":"2024-04-22T07:22:43.528456+0000","last_active":"2024-04-22T07:22:43.528456+0000","last_peered":"2024-04-22T07:22:43.528456+0000","last_clean":"2024-04-22T07:22:43.528456+0000","last_became_active":"2024-04-22T07:18:36.771583+0000","last_became_peered":"2024-04-22T07:18:36.771583+0000","last_unstale":"2024-04-22T07:22:43.528456+0000","last_undegraded":"2024-04-22T07:22:43.528456+0000","last_fullsized":"2024-04-22T07:22:43.528456+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'178","last_scrub_stamp":"2024-04-22T07:22:43.528326+0000","last_deep_scrub":"22'178","last_deep_scrub_stamp":"2024-04-22T07:22:43.528326+0000","last_clean_scrub_stamp":"2024-04-22T07:22:43.528326+0000","objects_scrubbed":0,"log_size":178,"log_dups_size":0,"ondisk_log_size":178,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T19:14:32.218458+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":150,"num_write_kb":409600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":29,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:42.292766+0000","last_change":"2024-04-22T07:22:42.292804+0000","last_active":"2024-04-22T07:22:42.292766+0000","last_peered":"2024-04-22T07:22:42.292766+0000","last_clean":"2024-04-22T07:22:42.292766+0000","last_became_active":"2024-04-22T07:18:35.755471+0000","last_became_peered":"2024-04-22T07:18:35.755471+0000","last_unstale":"2024-04-22T07:22:42.292766+0000","last_undegraded":"2024-04-22T07:22:42.292766+0000","last_fullsized":"2024-04-22T07:22:42.292766+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:22:42.292673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:22:42.292673+0000","last_clean_scrub_stamp":"2024-04-22T07:22:42.292673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:43:03.896065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"22'165","reported_seq":198,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:36.978220+0000","last_change":"2024-04-22T07:22:36.978220+0000","last_active":"2024-04-22T07:22:36.978220+0000","last_peered":"2024-04-22T07:22:36.978220+0000","last_clean":"2024-04-22T07:22:36.978220+0000","last_became_active":"2024-04-22T07:18:36.757841+0000","last_became_peered":"2024-04-22T07:18:36.757841+0000","last_unstale":"2024-04-22T07:22:36.978220+0000","last_undegraded":"2024-04-22T07:22:36.978220+0000","last_fullsized":"2024-04-22T07:22:36.978220+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'165","last_scrub_stamp":"2024-04-22T07:22:36.978116+0000","last_deep_scrub":"22'165","last_deep_scrub_stamp":"2024-04-22T07:22:36.978116+0000","last_clean_scrub_stamp":"2024-04-22T07:22:36.978116+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:18:35.866636+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":24576,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"22'6","reported_seq":40,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:35.369435+0000","last_change":"2024-04-22T07:22:35.369435+0000","last_active":"2024-04-22T07:22:35.369435+0000","last_peered":"2024-04-22T07:22:35.369435+0000","last_clean":"2024-04-22T07:22:35.369435+0000","last_became_active":"2024-04-22T07:18:35.746371+0000","last_became_peered":"2024-04-22T07:18:35.746371+0000","last_unstale":"2024-04-22T07:22:35.369435+0000","last_undegraded":"2024-04-22T07:22:35.369435+0000","last_fullsized":"2024-04-22T07:22:35.369435+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'6","last_scrub_stamp":"2024-04-22T07:22:35.369307+0000","last_deep_scrub":"22'6","last_deep_scrub_stamp":"2024-04-22T07:22:35.369307+0000","last_clean_scrub_stamp":"2024-04-22T07:22:35.369307+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:51:08.282588+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":505,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"22'163","reported_seq":193,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:40.625158+0000","last_change":"2024-04-22T07:22:40.625158+0000","last_active":"2024-04-22T07:22:40.625158+0000","last_peered":"2024-04-22T07:22:40.625158+0000","last_clean":"2024-04-22T07:22:40.625158+0000","last_became_active":"2024-04-22T07:18:36.765661+0000","last_became_peered":"2024-04-22T07:18:36.765661+0000","last_unstale":"2024-04-22T07:22:40.625158+0000","last_undegraded":"2024-04-22T07:22:40.625158+0000","last_fullsized":"2024-04-22T07:22:40.625158+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'163","last_scrub_stamp":"2024-04-22T07:22:40.625018+0000","last_deep_scrub":"22'163","last_deep_scrub_stamp":"2024-04-22T07:22:40.625018+0000","last_clean_scrub_stamp":"2024-04-22T07:22:40.625018+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:35:42.752517+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":29,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:40.257628+0000","last_change":"2024-04-22T07:22:40.257628+0000","last_active":"2024-04-22T07:22:40.257628+0000","last_peered":"2024-04-22T07:22:40.257628+0000","last_clean":"2024-04-22T07:22:40.257628+0000","last_became_active":"2024-04-22T07:18:35.753860+0000","last_became_peered":"2024-04-22T07:18:35.753860+0000","last_unstale":"2024-04-22T07:22:40.257628+0000","last_undegraded":"2024-04-22T07:22:40.257628+0000","last_fullsized":"2024-04-22T07:22:40.257628+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:22:40.257514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:22:40.257514+0000","last_clean_scrub_stamp":"2024-04-22T07:22:40.257514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:36:25.780608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"22'169","reported_seq":199,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:37.835797+0000","last_change":"2024-04-22T07:22:37.835797+0000","last_active":"2024-04-22T07:22:37.835797+0000","last_peered":"2024-04-22T07:22:37.835797+0000","last_clean":"2024-04-22T07:22:37.835797+0000","last_became_active":"2024-04-22T07:18:36.762097+0000","last_became_peered":"2024-04-22T07:18:36.762097+0000","last_unstale":"2024-04-22T07:22:37.835797+0000","last_undegraded":"2024-04-22T07:22:37.835797+0000","last_fullsized":"2024-04-22T07:22:37.835797+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'169","last_scrub_stamp":"2024-04-22T07:22:37.835656+0000","last_deep_scrub":"22'169","last_deep_scrub_stamp":"2024-04-22T07:22:37.835656+0000","last_clean_scrub_stamp":"2024-04-22T07:22:37.835656+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:00:41.002694+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":29,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:39.621711+0000","last_change":"2024-04-22T07:22:39.621711+0000","last_active":"2024-04-22T07:22:39.621711+0000","last_peered":"2024-04-22T07:22:39.621711+0000","last_clean":"2024-04-22T07:22:39.621711+0000","last_became_active":"2024-04-22T07:18:35.758521+0000","last_became_peered":"2024-04-22T07:18:35.758521+0000","last_unstale":"2024-04-22T07:22:39.621711+0000","last_undegraded":"2024-04-22T07:22:39.621711+0000","last_fullsized":"2024-04-22T07:22:39.621711+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:22:39.621585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:22:39.621585+0000","last_clean_scrub_stamp":"2024-04-22T07:22:39.621585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:56:58.579290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"22'153","reported_seq":185,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:46.244782+0000","last_change":"2024-04-22T07:22:46.244782+0000","last_active":"2024-04-22T07:22:46.244782+0000","last_peered":"2024-04-22T07:22:46.244782+0000","last_clean":"2024-04-22T07:22:46.244782+0000","last_became_active":"2024-04-22T07:18:36.763728+0000","last_became_peered":"2024-04-22T07:18:36.763728+0000","last_unstale":"2024-04-22T07:22:46.244782+0000","last_undegraded":"2024-04-22T07:22:46.244782+0000","last_fullsized":"2024-04-22T07:22:46.244782+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'153","last_scrub_stamp":"2024-04-22T07:22:46.244589+0000","last_deep_scrub":"22'153","last_deep_scrub_stamp":"2024-04-22T07:22:46.244589+0000","last_clean_scrub_stamp":"2024-04-22T07:22:46.244589+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:59:43.429653+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":20480,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":29,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:44.340256+0000","last_change":"2024-04-22T07:22:44.340256+0000","last_active":"2024-04-22T07:22:44.340256+0000","last_peered":"2024-04-22T07:22:44.340256+0000","last_clean":"2024-04-22T07:22:44.340256+0000","last_became_active":"2024-04-22T07:18:35.758674+0000","last_became_peered":"2024-04-22T07:18:35.758674+0000","last_unstale":"2024-04-22T07:22:44.340256+0000","last_undegraded":"2024-04-22T07:22:44.340256+0000","last_fullsized":"2024-04-22T07:22:44.340256+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:22:44.340112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:22:44.340112+0000","last_clean_scrub_stamp":"2024-04-22T07:22:44.340112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:27:04.636444+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"22'160","reported_seq":191,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:45.572320+0000","last_change":"2024-04-22T07:22:45.572320+0000","last_active":"2024-04-22T07:22:45.572320+0000","last_peered":"2024-04-22T07:22:45.572320+0000","last_clean":"2024-04-22T07:22:45.572320+0000","last_became_active":"2024-04-22T07:18:36.772636+0000","last_became_peered":"2024-04-22T07:18:36.772636+0000","last_unstale":"2024-04-22T07:22:45.572320+0000","last_undegraded":"2024-04-22T07:22:45.572320+0000","last_fullsized":"2024-04-22T07:22:45.572320+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'160","last_scrub_stamp":"2024-04-22T07:22:45.572193+0000","last_deep_scrub":"22'160","last_deep_scrub_stamp":"2024-04-22T07:22:45.572193+0000","last_clean_scrub_stamp":"2024-04-22T07:22:45.572193+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:43:07.175586+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":16384,"num_write":135,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"22'19","reported_seq":48,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:38.625613+0000","last_change":"2024-04-22T07:22:38.625613+0000","last_active":"2024-04-22T07:22:38.625613+0000","last_peered":"2024-04-22T07:22:38.625613+0000","last_clean":"2024-04-22T07:22:38.625613+0000","last_became_active":"2024-04-22T07:18:35.753295+0000","last_became_peered":"2024-04-22T07:18:35.753295+0000","last_unstale":"2024-04-22T07:22:38.625613+0000","last_undegraded":"2024-04-22T07:22:38.625613+0000","last_fullsized":"2024-04-22T07:22:38.625613+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'19","last_scrub_stamp":"2024-04-22T07:22:38.625483+0000","last_deep_scrub":"22'19","last_deep_scrub_stamp":"2024-04-22T07:22:38.625483+0000","last_clean_scrub_stamp":"2024-04-22T07:22:38.625483+0000","objects_scrubbed":1,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:37:10.496029+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"22'160","reported_seq":192,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:39.561052+0000","last_change":"2024-04-22T07:22:39.561077+0000","last_active":"2024-04-22T07:22:39.561052+0000","last_peered":"2024-04-22T07:22:39.561052+0000","last_clean":"2024-04-22T07:22:39.561052+0000","last_became_active":"2024-04-22T07:18:36.767702+0000","last_became_peered":"2024-04-22T07:18:36.767702+0000","last_unstale":"2024-04-22T07:22:39.561052+0000","last_undegraded":"2024-04-22T07:22:39.561052+0000","last_fullsized":"2024-04-22T07:22:39.561052+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'160","last_scrub_stamp":"2024-04-22T07:22:39.560955+0000","last_deep_scrub":"22'160","last_deep_scrub_stamp":"2024-04-22T07:22:39.560955+0000","last_clean_scrub_stamp":"2024-04-22T07:22:39.560955+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:35:41.688454+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":24576,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"22'4","reported_seq":32,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:38.866533+0000","last_change":"2024-04-22T07:22:38.866556+0000","last_active":"2024-04-22T07:22:38.866533+0000","last_peered":"2024-04-22T07:22:38.866533+0000","last_clean":"2024-04-22T07:22:38.866533+0000","last_became_active":"2024-04-22T07:18:35.751393+0000","last_became_peered":"2024-04-22T07:18:35.751393+0000","last_unstale":"2024-04-22T07:22:38.866533+0000","last_undegraded":"2024-04-22T07:22:38.866533+0000","last_fullsized":"2024-04-22T07:22:38.866533+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'4","last_scrub_stamp":"2024-04-22T07:22:38.866465+0000","last_deep_scrub":"22'4","last_deep_scrub_stamp":"2024-04-22T07:22:38.866465+0000","last_clean_scrub_stamp":"2024-04-22T07:22:38.866465+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:18:37.754985+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"22'181","reported_seq":213,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:44.014153+0000","last_change":"2024-04-22T07:22:44.014153+0000","last_active":"2024-04-22T07:22:44.014153+0000","last_peered":"2024-04-22T07:22:44.014153+0000","last_clean":"2024-04-22T07:22:44.014153+0000","last_became_active":"2024-04-22T07:18:36.768253+0000","last_became_peered":"2024-04-22T07:18:36.768253+0000","last_unstale":"2024-04-22T07:22:44.014153+0000","last_undegraded":"2024-04-22T07:22:44.014153+0000","last_fullsized":"2024-04-22T07:22:44.014153+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'181","last_scrub_stamp":"2024-04-22T07:22:44.013977+0000","last_deep_scrub":"22'181","last_deep_scrub_stamp":"2024-04-22T07:22:44.013977+0000","last_clean_scrub_stamp":"2024-04-22T07:22:44.013977+0000","objects_scrubbed":0,"log_size":181,"log_dups_size":0,"ondisk_log_size":181,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T19:14:32.704109+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":20480,"num_write":156,"num_write_kb":425984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":28,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:43.306244+0000","last_change":"2024-04-22T07:22:43.306280+0000","last_active":"2024-04-22T07:22:43.306244+0000","last_peered":"2024-04-22T07:22:43.306244+0000","last_clean":"2024-04-22T07:22:43.306244+0000","last_became_active":"2024-04-22T07:18:35.758415+0000","last_became_peered":"2024-04-22T07:18:35.758415+0000","last_unstale":"2024-04-22T07:22:43.306244+0000","last_undegraded":"2024-04-22T07:22:43.306244+0000","last_fullsized":"2024-04-22T07:22:43.306244+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:22:43.306161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:22:43.306161+0000","last_clean_scrub_stamp":"2024-04-22T07:22:43.306161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:27:43.475535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"22'154","reported_seq":187,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:38.856539+0000","last_change":"2024-04-22T07:22:38.856560+0000","last_active":"2024-04-22T07:22:38.856539+0000","last_peered":"2024-04-22T07:22:38.856539+0000","last_clean":"2024-04-22T07:22:38.856539+0000","last_became_active":"2024-04-22T07:18:36.762546+0000","last_became_peered":"2024-04-22T07:18:36.762546+0000","last_unstale":"2024-04-22T07:22:38.856539+0000","last_undegraded":"2024-04-22T07:22:38.856539+0000","last_fullsized":"2024-04-22T07:22:38.856539+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'154","last_scrub_stamp":"2024-04-22T07:22:38.856461+0000","last_deep_scrub":"22'154","last_deep_scrub_stamp":"2024-04-22T07:22:38.856461+0000","last_clean_scrub_stamp":"2024-04-22T07:22:38.856461+0000","objects_scrubbed":0,"log_size":154,"log_dups_size":0,"ondisk_log_size":154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:19:35.207133+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":28672,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":28,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:34.651780+0000","last_change":"2024-04-22T07:22:34.651800+0000","last_active":"2024-04-22T07:22:34.651780+0000","last_peered":"2024-04-22T07:22:34.651780+0000","last_clean":"2024-04-22T07:22:34.651780+0000","last_became_active":"2024-04-22T07:18:35.748080+0000","last_became_peered":"2024-04-22T07:18:35.748080+0000","last_unstale":"2024-04-22T07:22:34.651780+0000","last_undegraded":"2024-04-22T07:22:34.651780+0000","last_fullsized":"2024-04-22T07:22:34.651780+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:22:34.651694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:22:34.651694+0000","last_clean_scrub_stamp":"2024-04-22T07:22:34.651694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:22:03.670120+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"22'170","reported_seq":201,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:42.560791+0000","last_change":"2024-04-22T07:22:42.560818+0000","last_active":"2024-04-22T07:22:42.560791+0000","last_peered":"2024-04-22T07:22:42.560791+0000","last_clean":"2024-04-22T07:22:42.560791+0000","last_became_active":"2024-04-22T07:18:36.768682+0000","last_became_peered":"2024-04-22T07:18:36.768682+0000","last_unstale":"2024-04-22T07:22:42.560791+0000","last_undegraded":"2024-04-22T07:22:42.560791+0000","last_fullsized":"2024-04-22T07:22:42.560791+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'170","last_scrub_stamp":"2024-04-22T07:22:42.560694+0000","last_deep_scrub":"22'170","last_deep_scrub_stamp":"2024-04-22T07:22:42.560694+0000","last_clean_scrub_stamp":"2024-04-22T07:22:42.560694+0000","objects_scrubbed":0,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:13:07.021822+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":20480,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":28,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:37.615672+0000","last_change":"2024-04-22T07:22:37.615693+0000","last_active":"2024-04-22T07:22:37.615672+0000","last_peered":"2024-04-22T07:22:37.615672+0000","last_clean":"2024-04-22T07:22:37.615672+0000","last_became_active":"2024-04-22T07:18:35.752804+0000","last_became_peered":"2024-04-22T07:18:35.752804+0000","last_unstale":"2024-04-22T07:22:37.615672+0000","last_undegraded":"2024-04-22T07:22:37.615672+0000","last_fullsized":"2024-04-22T07:22:37.615672+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:22:37.615586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:22:37.615586+0000","last_clean_scrub_stamp":"2024-04-22T07:22:37.615586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:18:36.504107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"22'162","reported_seq":193,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:47.529336+0000","last_change":"2024-04-22T07:22:47.529368+0000","last_active":"2024-04-22T07:22:47.529336+0000","last_peered":"2024-04-22T07:22:47.529336+0000","last_clean":"2024-04-22T07:22:47.529336+0000","last_became_active":"2024-04-22T07:18:36.774479+0000","last_became_peered":"2024-04-22T07:18:36.774479+0000","last_unstale":"2024-04-22T07:22:47.529336+0000","last_undegraded":"2024-04-22T07:22:47.529336+0000","last_fullsized":"2024-04-22T07:22:47.529336+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'162","last_scrub_stamp":"2024-04-22T07:22:47.529236+0000","last_deep_scrub":"22'162","last_deep_scrub_stamp":"2024-04-22T07:22:47.529236+0000","last_clean_scrub_stamp":"2024-04-22T07:22:47.529236+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:55:27.911018+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":20480,"num_write":135,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"22'4","reported_seq":32,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:40.319848+0000","last_change":"2024-04-22T07:22:40.319884+0000","last_active":"2024-04-22T07:22:40.319848+0000","last_peered":"2024-04-22T07:22:40.319848+0000","last_clean":"2024-04-22T07:22:40.319848+0000","last_became_active":"2024-04-22T07:18:35.754137+0000","last_became_peered":"2024-04-22T07:18:35.754137+0000","last_unstale":"2024-04-22T07:22:40.319848+0000","last_undegraded":"2024-04-22T07:22:40.319848+0000","last_fullsized":"2024-04-22T07:22:40.319848+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'4","last_scrub_stamp":"2024-04-22T07:22:40.319752+0000","last_deep_scrub":"22'4","last_deep_scrub_stamp":"2024-04-22T07:22:40.319752+0000","last_clean_scrub_stamp":"2024-04-22T07:22:40.319752+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:36:25.842846+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"22'150","reported_seq":179,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:41.881977+0000","last_change":"2024-04-22T07:22:41.882005+0000","last_active":"2024-04-22T07:22:41.881977+0000","last_peered":"2024-04-22T07:22:41.881977+0000","last_clean":"2024-04-22T07:22:41.881977+0000","last_became_active":"2024-04-22T07:18:36.759342+0000","last_became_peered":"2024-04-22T07:18:36.759342+0000","last_unstale":"2024-04-22T07:22:41.881977+0000","last_undegraded":"2024-04-22T07:22:41.881977+0000","last_fullsized":"2024-04-22T07:22:41.881977+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'150","last_scrub_stamp":"2024-04-22T07:22:41.881872+0000","last_deep_scrub":"22'150","last_deep_scrub_stamp":"2024-04-22T07:22:41.881872+0000","last_clean_scrub_stamp":"2024-04-22T07:22:41.881872+0000","objects_scrubbed":0,"log_size":150,"log_dups_size":0,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:35:44.009371+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"22'202","reported_seq":232,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:42.266871+0000","last_change":"2024-04-22T07:22:42.266895+0000","last_active":"2024-04-22T07:22:42.266871+0000","last_peered":"2024-04-22T07:22:42.266871+0000","last_clean":"2024-04-22T07:22:42.266871+0000","last_became_active":"2024-04-22T07:18:36.762392+0000","last_became_peered":"2024-04-22T07:18:36.762392+0000","last_unstale":"2024-04-22T07:22:42.266871+0000","last_undegraded":"2024-04-22T07:22:42.266871+0000","last_fullsized":"2024-04-22T07:22:42.266871+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'202","last_scrub_stamp":"2024-04-22T07:22:42.266770+0000","last_deep_scrub":"22'202","last_deep_scrub_stamp":"2024-04-22T07:22:42.266770+0000","last_clean_scrub_stamp":"2024-04-22T07:22:42.266770+0000","objects_scrubbed":0,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:45:28.048600+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":16384,"num_write":168,"num_write_kb":458752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"22'3","reported_seq":31,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:41.308167+0000","last_change":"2024-04-22T07:22:41.308230+0000","last_active":"2024-04-22T07:22:41.308167+0000","last_peered":"2024-04-22T07:22:41.308167+0000","last_clean":"2024-04-22T07:22:41.308167+0000","last_became_active":"2024-04-22T07:18:35.754877+0000","last_became_peered":"2024-04-22T07:18:35.754877+0000","last_unstale":"2024-04-22T07:22:41.308167+0000","last_undegraded":"2024-04-22T07:22:41.308167+0000","last_fullsized":"2024-04-22T07:22:41.308167+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'3","last_scrub_stamp":"2024-04-22T07:22:41.308068+0000","last_deep_scrub":"22'3","last_deep_scrub_stamp":"2024-04-22T07:22:41.308068+0000","last_clean_scrub_stamp":"2024-04-22T07:22:41.308068+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T19:14:29.998200+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"22'156","reported_seq":185,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:41.219613+0000","last_change":"2024-04-22T07:22:41.219644+0000","last_active":"2024-04-22T07:22:41.219613+0000","last_peered":"2024-04-22T07:22:41.219613+0000","last_clean":"2024-04-22T07:22:41.219613+0000","last_became_active":"2024-04-22T07:18:36.761181+0000","last_became_peered":"2024-04-22T07:18:36.761181+0000","last_unstale":"2024-04-22T07:22:41.219613+0000","last_undegraded":"2024-04-22T07:22:41.219613+0000","last_fullsized":"2024-04-22T07:22:41.219613+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'156","last_scrub_stamp":"2024-04-22T07:22:41.219468+0000","last_deep_scrub":"22'156","last_deep_scrub_stamp":"2024-04-22T07:22:41.219468+0000","last_clean_scrub_stamp":"2024-04-22T07:22:41.219468+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:14:29.240774+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"22'5","reported_seq":33,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:39.296733+0000","last_change":"2024-04-22T07:22:39.296763+0000","last_active":"2024-04-22T07:22:39.296733+0000","last_peered":"2024-04-22T07:22:39.296733+0000","last_clean":"2024-04-22T07:22:39.296733+0000","last_became_active":"2024-04-22T07:18:35.751866+0000","last_became_peered":"2024-04-22T07:18:35.751866+0000","last_unstale":"2024-04-22T07:22:39.296733+0000","last_undegraded":"2024-04-22T07:22:39.296733+0000","last_fullsized":"2024-04-22T07:22:39.296733+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'5","last_scrub_stamp":"2024-04-22T07:22:39.296658+0000","last_deep_scrub":"22'5","last_deep_scrub_stamp":"2024-04-22T07:22:39.296658+0000","last_clean_scrub_stamp":"2024-04-22T07:22:39.296658+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:21:44.452831+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"22'156","reported_seq":185,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:38.981055+0000","last_change":"2024-04-22T07:22:38.981055+0000","last_active":"2024-04-22T07:22:38.981055+0000","last_peered":"2024-04-22T07:22:38.981055+0000","last_clean":"2024-04-22T07:22:38.981055+0000","last_became_active":"2024-04-22T07:18:36.762882+0000","last_became_peered":"2024-04-22T07:18:36.762882+0000","last_unstale":"2024-04-22T07:22:38.981055+0000","last_undegraded":"2024-04-22T07:22:38.981055+0000","last_fullsized":"2024-04-22T07:22:38.981055+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'156","last_scrub_stamp":"2024-04-22T07:22:38.980929+0000","last_deep_scrub":"22'156","last_deep_scrub_stamp":"2024-04-22T07:22:38.980929+0000","last_clean_scrub_stamp":"2024-04-22T07:22:38.980929+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:56:57.938635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":30,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:37.477734+0000","last_change":"2024-04-22T07:22:37.477734+0000","last_active":"2024-04-22T07:22:37.477734+0000","last_peered":"2024-04-22T07:22:37.477734+0000","last_clean":"2024-04-22T07:22:37.477734+0000","last_became_active":"2024-04-22T07:18:35.758514+0000","last_became_peered":"2024-04-22T07:18:35.758514+0000","last_unstale":"2024-04-22T07:22:37.477734+0000","last_undegraded":"2024-04-22T07:22:37.477734+0000","last_fullsized":"2024-04-22T07:22:37.477734+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"20'1","last_scrub_stamp":"2024-04-22T07:22:37.477617+0000","last_deep_scrub":"20'1","last_deep_scrub_stamp":"2024-04-22T07:22:37.477617+0000","last_clean_scrub_stamp":"2024-04-22T07:22:37.477617+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:37:09.348163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"22'173","reported_seq":196,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:46.553783+0000","last_change":"2024-04-22T07:22:46.553808+0000","last_active":"2024-04-22T07:22:46.553783+0000","last_peered":"2024-04-22T07:22:46.553783+0000","last_clean":"2024-04-22T07:22:46.553783+0000","last_became_active":"2024-04-22T07:19:18.281158+0000","last_became_peered":"2024-04-22T07:19:18.281158+0000","last_unstale":"2024-04-22T07:22:46.553783+0000","last_undegraded":"2024-04-22T07:22:46.553783+0000","last_fullsized":"2024-04-22T07:22:46.553783+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'173","last_scrub_stamp":"2024-04-22T07:22:46.553688+0000","last_deep_scrub":"22'173","last_deep_scrub_stamp":"2024-04-22T07:22:46.553688+0000","last_clean_scrub_stamp":"2024-04-22T07:22:46.553688+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:27:46.723062+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1f","version":"22'6","reported_seq":35,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-22T07:22:34.993655+0000","last_change":"2024-04-22T07:22:34.993655+0000","last_active":"2024-04-22T07:22:34.993655+0000","last_peered":"2024-04-22T07:22:34.993655+0000","last_clean":"2024-04-22T07:22:34.993655+0000","last_became_active":"2024-04-22T07:18:35.753833+0000","last_became_peered":"2024-04-22T07:18:35.753833+0000","last_unstale":"2024-04-22T07:22:34.993655+0000","last_undegraded":"2024-04-22T07:22:34.993655+0000","last_fullsized":"2024-04-22T07:22:34.993655+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'6","last_scrub_stamp":"2024-04-22T07:22:34.993521+0000","last_deep_scrub":"22'6","last_deep_scrub_stamp":"2024-04-22T07:22:34.993521+0000","last_clean_scrub_stamp":"2024-04-22T07:22:34.993521+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:48:02.092396+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":256,"num_read_kb":1048576,"num_write":9216,"num_write_kb":25165824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10998,"ondisk_log_size":10998,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":6148435,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":3029,"num_write_kb":8867,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12361728,"data_stored":12296870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3033,"ondisk_log_size":3033,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574907,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56100,"kb_used_data":2716,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315740,"statfs":{"total":96636764160,"available":96579317760,"internally_reserved":0,"allocated":2781184,"data_stored":2626222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":54655434},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574906,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":57712,"kb_used_data":4328,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94314128,"statfs":{"total":96636764160,"available":96577667072,"internally_reserved":0,"allocated":4431872,"data_stored":4278092,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574906,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35564,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336276,"statfs":{"total":96636764160,"available":96600346624,"internally_reserved":0,"allocated":233472,"data_stored":83206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574906,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35572,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336268,"statfs":{"total":96636764160,"available":96600338432,"internally_reserved":0,"allocated":241664,"data_stored":83242,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574907,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":63784,"kb_used_data":6240,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94308056,"statfs":{"total":96636764160,"available":96571449344,"internally_reserved":0,"allocated":6389760,"data_stored":6230753,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":58915271},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574906,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31404,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340436,"statfs":{"total":96636764160,"available":96604606464,"internally_reserved":0,"allocated":233472,"data_stored":83621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574907,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31408,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340432,"statfs":{"total":96636764160,"available":96604602368,"internally_reserved":0,"allocated":237568,"data_stored":83276,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574906,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36152,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335688,"statfs":{"total":96636764160,"available":96599744512,"internally_reserved":0,"allocated":835584,"data_stored":674122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":6160384,"data_stored":6147637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4202496,"data_stored":4194976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1957888,"data_stored":1952738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-22T07:22:57.152 DEBUG:teuthology.orchestra.run.smithi037:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-04-22T07:22:57.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.287+0000 7f7726ba4640 1 Processor -- start 2024-04-22T07:22:57.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.288+0000 7f7726ba4640 1 -- start start 2024-04-22T07:22:57.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.288+0000 7f7726ba4640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f772015e2e0 0x7f772015b420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:57.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.288+0000 7f7726ba4640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f772006f010 con 0x7f7720155200 2024-04-22T07:22:57.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.288+0000 7f7726ba4640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f772015e7b0 con 0x7f772015b960 2024-04-22T07:22:57.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.288+0000 7f7726ba4640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f772015ea90 con 0x7f772015e2e0 2024-04-22T07:22:57.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.288+0000 7f7724940640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f7720155200 0x7f772006f860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:40542/0 (socket says 172.21.15.37:40542) 2024-04-22T07:22:57.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.288+0000 7f7724940640 1 -- 172.21.15.37:0/2101303710 learned_addr learned my addr 172.21.15.37:0/2101303710 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-04-22T07:22:57.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.289+0000 7f771ffff640 1 --2- 172.21.15.37:0/2101303710 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f772015e2e0 0x7f772015b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:57.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.289+0000 7f771f7fe640 1 -- 172.21.15.37:0/2101303710 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1275200627 0 0) 0x7f7710001110 con 0x7f7720155200 2024-04-22T07:22:57.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.289+0000 7f771f7fe640 1 -- 172.21.15.37:0/2101303710 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7708003520 con 0x7f7720155200 2024-04-22T07:22:57.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.289+0000 7f771f7fe640 1 -- 172.21.15.37:0/2101303710 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3739338294 0 0) 0x7f772015e7b0 con 0x7f772015b960 2024-04-22T07:22:57.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.289+0000 7f771f7fe640 1 -- 172.21.15.37:0/2101303710 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7710001110 con 0x7f772015b960 2024-04-22T07:22:57.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.289+0000 7f771f7fe640 1 -- 172.21.15.37:0/2101303710 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 258543474 0 0) 0x7f7708003520 con 0x7f7720155200 2024-04-22T07:22:57.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.289+0000 7f771f7fe640 1 -- 172.21.15.37:0/2101303710 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f772015e2e0 msgr2=0x7f772015b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:22:57.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.289+0000 7f771f7fe640 1 --2- 172.21.15.37:0/2101303710 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f772015e2e0 0x7f772015b420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:57.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.289+0000 7f771f7fe640 1 -- 172.21.15.37:0/2101303710 >> v1:172.21.15.196:6789/0 conn(0x7f772015b960 legacy=0x7f77200ce310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:57.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.289+0000 7f771f7fe640 1 -- 172.21.15.37:0/2101303710 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f772015ed70 con 0x7f7720155200 2024-04-22T07:22:57.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.289+0000 7f771f7fe640 1 -- 172.21.15.37:0/2101303710 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2576656170 0 0) 0x7f7710001840 con 0x7f7720155200 2024-04-22T07:22:57.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.289+0000 7f771f7fe640 1 -- 172.21.15.37:0/2101303710 >> v1:172.21.15.37:6789/0 conn(0x7f7720155200 legacy=0x7f772006f860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:57.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.289+0000 7f771f7fe640 1 --2- 172.21.15.37:0/2101303710 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7708003b70 0x7f7708003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:57.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.289+0000 7f771f7fe640 1 --2- 172.21.15.37:0/2101303710 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f772015e2e0 0x7f7708004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:57.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.289+0000 7f771f7fe640 1 --2- 172.21.15.37:0/2101303710 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7708004d40 0x7f77080051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:57.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.289+0000 7f771f7fe640 1 -- 172.21.15.37:0/2101303710 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f772015ea90 con 0x7f7708004d40 2024-04-22T07:22:57.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.289+0000 7f771f7fe640 1 -- 172.21.15.37:0/2101303710 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f770800ba70 con 0x7f7708003b70 2024-04-22T07:22:57.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.289+0000 7f771f7fe640 1 -- 172.21.15.37:0/2101303710 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f770800bc70 con 0x7f772015e2e0 2024-04-22T07:22:57.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.289+0000 7f7725141640 1 --2- 172.21.15.37:0/2101303710 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7708004d40 0x7f77080051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:57.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.289+0000 7f7724940640 1 --2- 172.21.15.37:0/2101303710 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7708003b70 0x7f7708003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:57.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.289+0000 7f771ffff640 1 --2- 172.21.15.37:0/2101303710 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f772015e2e0 0x7f7708004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:57.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.289+0000 7f7725141640 1 -- 172.21.15.37:0/2101303710 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f772015e2e0 msgr2=0x7f7708004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:22:57.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.289+0000 7f7725141640 1 --2- 172.21.15.37:0/2101303710 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f772015e2e0 0x7f7708004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:57.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.289+0000 7f7725141640 1 -- 172.21.15.37:0/2101303710 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7708003b70 msgr2=0x7f7708003f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:22:57.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.289+0000 7f7725141640 1 --2- 172.21.15.37:0/2101303710 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7708003b70 0x7f7708003f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:57.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.290+0000 7f7725141640 1 -- 172.21.15.37:0/2101303710 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7708003520 con 0x7f7708004d40 2024-04-22T07:22:57.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.290+0000 7f771ffff640 1 --2- 172.21.15.37:0/2101303710 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f772015e2e0 0x7f7708004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T07:22:57.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.290+0000 7f7725141640 1 --2- 172.21.15.37:0/2101303710 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7708004d40 0x7f77080051c0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f7718001fd0 tx=0x7f7708005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46491d3a3b186f75 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:22:57.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.290+0000 7f771f7fe640 1 -- 172.21.15.37:0/2101303710 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7718001bf0 con 0x7f7708004d40 2024-04-22T07:22:57.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.290+0000 7f771f7fe640 1 -- 172.21.15.37:0/2101303710 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7718003b70 con 0x7f7708004d40 2024-04-22T07:22:57.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.290+0000 7f771f7fe640 1 -- 172.21.15.37:0/2101303710 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77180050d0 con 0x7f7708004d40 2024-04-22T07:22:57.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.291+0000 7f7726ba4640 1 -- 172.21.15.37:0/2101303710 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7708004d40 msgr2=0x7f77080051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:57.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.291+0000 7f7726ba4640 1 --2- 172.21.15.37:0/2101303710 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7708004d40 0x7f77080051c0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f7718001fd0 tx=0x7f7708005830 comp rx=0 tx=0).stop 2024-04-22T07:22:57.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.291+0000 7f7725141640 1 -- 172.21.15.37:0/2101303710 reap_dead start 2024-04-22T07:22:57.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.291+0000 7f7726ba4640 1 -- 172.21.15.37:0/2101303710 shutdown_connections 2024-04-22T07:22:57.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.291+0000 7f7726ba4640 1 -- 172.21.15.37:0/2101303710 >> 172.21.15.37:0/2101303710 conn(0x7f7720067d90 msgr2=0x7f772006db80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:22:57.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.291+0000 7f7726ba4640 1 -- 172.21.15.37:0/2101303710 shutdown_connections 2024-04-22T07:22:57.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.291+0000 7f7726ba4640 1 -- 172.21.15.37:0/2101303710 wait complete. 2024-04-22T07:22:57.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.292+0000 7f7726ba4640 1 Processor -- start 2024-04-22T07:22:57.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.292+0000 7f7726ba4640 1 -- start start 2024-04-22T07:22:57.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.293+0000 7f7726ba4640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f77200cd670 0x7f772015a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:57.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.293+0000 7f7726ba4640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f77200cda50 0x7f77200c32c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:57.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.293+0000 7f7726ba4640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f77200c3800 0x7f77201422d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:57.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.293+0000 7f7726ba4640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f772006ff70 con 0x7f77200c3800 2024-04-22T07:22:57.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.293+0000 7f7726ba4640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f772015af00 con 0x7f77200cda50 2024-04-22T07:22:57.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.293+0000 7f7726ba4640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f77200700f0 con 0x7f77200cd670 2024-04-22T07:22:57.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.293+0000 7f7725141640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f77200c3800 0x7f77201422d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:57.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.293+0000 7f7725141640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f77200c3800 0x7f77201422d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42042/0 (socket says 172.21.15.37:42042) 2024-04-22T07:22:57.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.293+0000 7f7725141640 1 -- 172.21.15.37:0/2723257184 learned_addr learned my addr 172.21.15.37:0/2723257184 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:22:57.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.293+0000 7f771ffff640 1 --2- 172.21.15.37:0/2723257184 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f77200cda50 0x7f77200c32c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:57.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.293+0000 7f7724940640 1 --2- 172.21.15.37:0/2723257184 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f77200cd670 0x7f772015a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:57.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.293+0000 7f7725141640 1 -- 172.21.15.37:0/2723257184 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f77200cd670 msgr2=0x7f772015a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:57.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.293+0000 7f7725141640 1 --2- 172.21.15.37:0/2723257184 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f77200cd670 0x7f772015a8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:57.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.293+0000 7f7725141640 1 -- 172.21.15.37:0/2723257184 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f77200cda50 msgr2=0x7f77200c32c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:57.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.293+0000 7f7725141640 1 --2- 172.21.15.37:0/2723257184 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f77200cda50 0x7f77200c32c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:57.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.293+0000 7f7725141640 1 -- 172.21.15.37:0/2723257184 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77201f2230 con 0x7f77200c3800 2024-04-22T07:22:57.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.294+0000 7f7725141640 1 --2- 172.21.15.37:0/2723257184 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f77200c3800 0x7f77201422d0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f7718005040 tx=0x7f7718001650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:22:57.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.294+0000 7f771d7fa640 1 -- 172.21.15.37:0/2723257184 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7718001bf0 con 0x7f77200c3800 2024-04-22T07:22:57.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.294+0000 7f771d7fa640 1 -- 172.21.15.37:0/2723257184 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7718003970 con 0x7f77200c3800 2024-04-22T07:22:57.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.294+0000 7f7726ba4640 1 -- 172.21.15.37:0/2723257184 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7720158b40 con 0x7f77200c3800 2024-04-22T07:22:57.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.294+0000 7f771d7fa640 1 -- 172.21.15.37:0/2723257184 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77180052e0 con 0x7f77200c3800 2024-04-22T07:22:57.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.294+0000 7f7726ba4640 1 -- 172.21.15.37:0/2723257184 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7720159100 con 0x7f77200c3800 2024-04-22T07:22:57.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.295+0000 7f7726ba4640 1 -- 172.21.15.37:0/2723257184 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7720068b20 con 0x7f77200c3800 2024-04-22T07:22:57.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.295+0000 7f771d7fa640 1 -- 172.21.15.37:0/2723257184 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7718044020 con 0x7f77200c3800 2024-04-22T07:22:57.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.296+0000 7f771d7fa640 1 --2- 172.21.15.37:0/2723257184 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f770c06c8f0 0x7f770c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:57.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.296+0000 7f771d7fa640 1 -- 172.21.15.37:0/2723257184 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f77180ac7a0 con 0x7f77200c3800 2024-04-22T07:22:57.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.296+0000 7f7724940640 1 --2- 172.21.15.37:0/2723257184 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f770c06c8f0 0x7f770c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:57.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.297+0000 7f7724940640 1 --2- 172.21.15.37:0/2723257184 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f770c06c8f0 0x7f770c06edb0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f7710001050 tx=0x7f7710007970 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:22:57.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.300+0000 7f771d7fa640 1 -- 172.21.15.37:0/2723257184 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f771807ab80 con 0x7f77200c3800 2024-04-22T07:22:57.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.491+0000 7f7726ba4640 1 -- 172.21.15.37:0/2723257184 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7f7720152900 con 0x7f77200c3800 2024-04-22T07:22:57.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.494+0000 7f771d7fa640 1 -- 172.21.15.37:0/2723257184 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v10)=0 v10) ==== 123+0+0 (secure 0 0 0) 0x7f771807a480 con 0x7f77200c3800 2024-04-22T07:22:57.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.495+0000 7f771d7fa640 1 -- 172.21.15.37:0/2723257184 <== mon.0 v2:172.21.15.37:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f771807e830 con 0x7f77200c3800 2024-04-22T07:22:57.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.497+0000 7f7726ba4640 1 -- 172.21.15.37:0/2723257184 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f770c06c8f0 msgr2=0x7f770c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:57.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.497+0000 7f7726ba4640 1 --2- 172.21.15.37:0/2723257184 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f770c06c8f0 0x7f770c06edb0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f7710001050 tx=0x7f7710007970 comp rx=0 tx=0).stop 2024-04-22T07:22:57.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.497+0000 7f7726ba4640 1 -- 172.21.15.37:0/2723257184 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f77200c3800 msgr2=0x7f77201422d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:57.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.497+0000 7f7726ba4640 1 --2- 172.21.15.37:0/2723257184 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f77200c3800 0x7f77201422d0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f7718005040 tx=0x7f7718001650 comp rx=0 tx=0).stop 2024-04-22T07:22:57.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.497+0000 7f7726ba4640 1 -- 172.21.15.37:0/2723257184 shutdown_connections 2024-04-22T07:22:57.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.497+0000 7f7726ba4640 1 --2- 172.21.15.37:0/2723257184 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f770c06c8f0 0x7f770c06edb0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:57.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.497+0000 7f7726ba4640 1 --2- 172.21.15.37:0/2723257184 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f77200c3800 0x7f77201422d0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:57.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.497+0000 7f7726ba4640 1 --2- 172.21.15.37:0/2723257184 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f77200cda50 0x7f77200c32c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:57.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.497+0000 7f7726ba4640 1 --2- 172.21.15.37:0/2723257184 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f77200cd670 0x7f772015a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:57.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.497+0000 7f7726ba4640 1 -- 172.21.15.37:0/2723257184 >> 172.21.15.37:0/2723257184 conn(0x7f7720067d90 msgr2=0x7f7720153f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:22:57.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.497+0000 7f7726ba4640 1 -- 172.21.15.37:0/2723257184 shutdown_connections 2024-04-22T07:22:57.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.497+0000 7f7726ba4640 1 -- 172.21.15.37:0/2723257184 wait complete. 2024-04-22T07:22:57.507 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-22T07:22:57.507 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-22T07:22:57.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.609+0000 7fd463996640 1 Processor -- start 2024-04-22T07:22:57.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.609+0000 7fd463996640 1 -- start start 2024-04-22T07:22:57.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.610+0000 7fd463996640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fd45c151180 0x7fd45c0c7850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:57.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.610+0000 7fd463996640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd45c0c8410 0x7fd45c06f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:57.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.610+0000 7fd463996640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd45c151560 0x7fd45c06f720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:57.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.610+0000 7fd463996640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fd45c0c7d90 con 0x7fd45c0c8410 2024-04-22T07:22:57.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.610+0000 7fd463996640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7fd45c157b30 con 0x7fd45c151180 2024-04-22T07:22:57.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.610+0000 7fd463996640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fd45c158050 con 0x7fd45c151560 2024-04-22T07:22:57.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.610+0000 7fd460f31640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd45c0c8410 0x7fd45c06f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:57.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.610+0000 7fd460f31640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd45c0c8410 0x7fd45c06f1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42048/0 (socket says 172.21.15.37:42048) 2024-04-22T07:22:57.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.610+0000 7fd460f31640 1 -- 172.21.15.37:0/3012646114 learned_addr learned my addr 172.21.15.37:0/3012646114 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:22:57.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.610+0000 7fd461f33640 1 --2- 172.21.15.37:0/3012646114 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd45c151560 0x7fd45c06f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:57.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.610+0000 7fd461732640 1 --2- 172.21.15.37:0/3012646114 >> v2:172.21.15.196:3300/0 conn(0x7fd45c151180 0x7fd45c0c7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:57.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.610+0000 7fd460f31640 1 -- 172.21.15.37:0/3012646114 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd45c151560 msgr2=0x7fd45c06f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:22:57.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.610+0000 7fd460f31640 1 --2- 172.21.15.37:0/3012646114 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd45c151560 0x7fd45c06f720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:57.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.610+0000 7fd460f31640 1 -- 172.21.15.37:0/3012646114 >> v2:172.21.15.196:3300/0 conn(0x7fd45c151180 msgr2=0x7fd45c0c7850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:22:57.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.610+0000 7fd460f31640 1 --2- 172.21.15.37:0/3012646114 >> v2:172.21.15.196:3300/0 conn(0x7fd45c151180 0x7fd45c0c7850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:57.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.610+0000 7fd460f31640 1 -- 172.21.15.37:0/3012646114 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd45c157d70 con 0x7fd45c0c8410 2024-04-22T07:22:57.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.610+0000 7fd461732640 1 --2- 172.21.15.37:0/3012646114 >> v2:172.21.15.196:3300/0 conn(0x7fd45c151180 0x7fd45c0c7850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-22T07:22:57.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.611+0000 7fd460f31640 1 --2- 172.21.15.37:0/3012646114 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd45c0c8410 0x7fd45c06f1e0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fd45c06fe40 tx=0x7fd44c02b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d7eaa1ff7ac3f37 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:22:57.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.611+0000 7fd453fff640 1 -- 172.21.15.37:0/3012646114 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd44c034070 con 0x7fd45c0c8410 2024-04-22T07:22:57.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.611+0000 7fd453fff640 1 -- 172.21.15.37:0/3012646114 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fd44c030840 con 0x7fd45c0c8410 2024-04-22T07:22:57.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.611+0000 7fd453fff640 1 -- 172.21.15.37:0/3012646114 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd44c030c30 con 0x7fd45c0c8410 2024-04-22T07:22:57.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.612+0000 7fd463996640 1 -- 172.21.15.37:0/3012646114 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd45c0c8410 msgr2=0x7fd45c06f1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:57.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.612+0000 7fd463996640 1 --2- 172.21.15.37:0/3012646114 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd45c0c8410 0x7fd45c06f1e0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fd45c06fe40 tx=0x7fd44c02b980 comp rx=0 tx=0).stop 2024-04-22T07:22:57.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.612+0000 7fd463996640 1 -- 172.21.15.37:0/3012646114 shutdown_connections 2024-04-22T07:22:57.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.612+0000 7fd463996640 1 --2- 172.21.15.37:0/3012646114 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd45c151560 0x7fd45c06f720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:57.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.612+0000 7fd463996640 1 --2- 172.21.15.37:0/3012646114 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd45c0c8410 0x7fd45c06f1e0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:57.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.612+0000 7fd463996640 1 --2- 172.21.15.37:0/3012646114 >> v2:172.21.15.196:3300/0 conn(0x7fd45c151180 0x7fd45c0c7850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:57.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.612+0000 7fd463996640 1 -- 172.21.15.37:0/3012646114 >> 172.21.15.37:0/3012646114 conn(0x7fd45c06b970 msgr2=0x7fd45c06bd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:22:57.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.612+0000 7fd463996640 1 -- 172.21.15.37:0/3012646114 shutdown_connections 2024-04-22T07:22:57.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.612+0000 7fd463996640 1 -- 172.21.15.37:0/3012646114 wait complete. 2024-04-22T07:22:57.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.613+0000 7fd463996640 1 Processor -- start 2024-04-22T07:22:57.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.613+0000 7fd463996640 1 -- start start 2024-04-22T07:22:57.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.614+0000 7fd463996640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd45c0c8410 0x7fd45c14c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:57.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.614+0000 7fd463996640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd45c151180 0x7fd45c14a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:57.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.614+0000 7fd463996640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd45c151560 0x7fd45c0cbf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:57.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.614+0000 7fd463996640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd45c0c7330 con 0x7fd45c151560 2024-04-22T07:22:57.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.614+0000 7fd463996640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fd45c0c7050 con 0x7fd45c151180 2024-04-22T07:22:57.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.614+0000 7fd463996640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fd45c071890 con 0x7fd45c0c8410 2024-04-22T07:22:57.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.614+0000 7fd461f33640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd45c151560 0x7fd45c0cbf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:57.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.614+0000 7fd461f33640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd45c151560 0x7fd45c0cbf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42052/0 (socket says 172.21.15.37:42052) 2024-04-22T07:22:57.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.614+0000 7fd461f33640 1 -- 172.21.15.37:0/1301726238 learned_addr learned my addr 172.21.15.37:0/1301726238 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:22:57.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.614+0000 7fd461732640 1 --2- 172.21.15.37:0/1301726238 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd45c0c8410 0x7fd45c14c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:57.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.614+0000 7fd460f31640 1 --2- 172.21.15.37:0/1301726238 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd45c151180 0x7fd45c14a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:57.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.614+0000 7fd461f33640 1 -- 172.21.15.37:0/1301726238 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd45c0c8410 msgr2=0x7fd45c14c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:57.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.614+0000 7fd461f33640 1 --2- 172.21.15.37:0/1301726238 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd45c0c8410 0x7fd45c14c6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:57.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.614+0000 7fd461f33640 1 -- 172.21.15.37:0/1301726238 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd45c151180 msgr2=0x7fd45c14a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:57.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.614+0000 7fd461f33640 1 --2- 172.21.15.37:0/1301726238 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd45c151180 0x7fd45c14a6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:57.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.614+0000 7fd461f33640 1 -- 172.21.15.37:0/1301726238 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd45c14d6c0 con 0x7fd45c151560 2024-04-22T07:22:57.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.615+0000 7fd461f33640 1 --2- 172.21.15.37:0/1301726238 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd45c151560 0x7fd45c0cbf70 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fd454007e60 tx=0x7fd45400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:22:57.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.615+0000 7fd451ffb640 1 -- 172.21.15.37:0/1301726238 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd454014420 con 0x7fd45c151560 2024-04-22T07:22:57.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.615+0000 7fd451ffb640 1 -- 172.21.15.37:0/1301726238 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fd454019070 con 0x7fd45c151560 2024-04-22T07:22:57.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.615+0000 7fd463996640 1 -- 172.21.15.37:0/1301726238 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd45c14d100 con 0x7fd45c151560 2024-04-22T07:22:57.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.615+0000 7fd451ffb640 1 -- 172.21.15.37:0/1301726238 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd454014840 con 0x7fd45c151560 2024-04-22T07:22:57.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.615+0000 7fd463996640 1 -- 172.21.15.37:0/1301726238 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd45c0cb490 con 0x7fd45c151560 2024-04-22T07:22:57.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.616+0000 7fd463996640 1 -- 172.21.15.37:0/1301726238 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd45c069cc0 con 0x7fd45c151560 2024-04-22T07:22:57.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.616+0000 7fd451ffb640 1 -- 172.21.15.37:0/1301726238 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd4540149e0 con 0x7fd45c151560 2024-04-22T07:22:57.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.617+0000 7fd451ffb640 1 --2- 172.21.15.37:0/1301726238 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fd44006c8f0 0x7fd44006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:57.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.617+0000 7fd451ffb640 1 -- 172.21.15.37:0/1301726238 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7fd45408c3c0 con 0x7fd45c151560 2024-04-22T07:22:57.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.617+0000 7fd461732640 1 --2- 172.21.15.37:0/1301726238 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fd44006c8f0 0x7fd44006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:57.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.617+0000 7fd461732640 1 --2- 172.21.15.37:0/1301726238 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fd44006c8f0 0x7fd44006edb0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fd458006b10 tx=0x7fd458008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:22:57.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.621+0000 7fd451ffb640 1 -- 172.21.15.37:0/1301726238 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fd45405a090 con 0x7fd45c151560 2024-04-22T07:22:57.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.846+0000 7fd463996640 1 -- 172.21.15.37:0/1301726238 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd45c073a30 con 0x7fd45c151560 2024-04-22T07:22:57.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.846+0000 7fd451ffb640 1 -- 172.21.15.37:0/1301726238 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6827 (secure 0 0 0) 0x7fd45405e390 con 0x7fd45c151560 2024-04-22T07:22:57.845 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-22T07:22:57.845 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4265,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6839/671847354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6835","nonce":671847354},{"type":"v1","addr":"172.21.15.196:6839","nonce":671847354}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6833/1549427395","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1549427395},{"type":"v1","addr":"172.21.15.37:6833","nonce":1549427395}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6836/3825988951","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":3825988951},{"type":"v1","addr":"172.21.15.37:6836","nonce":3825988951}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4272,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/611771502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6835","nonce":611771502},{"type":"v1","addr":"172.21.15.37:6837","nonce":611771502}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4291,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6837/3055080225","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6834","nonce":3055080225},{"type":"v1","addr":"172.21.15.196:6837","nonce":3055080225}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-22T07:18:36.111618+0000","modified":"2024-04-22T07:18:41.783857+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.196:6838/3264179771","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6836","nonce":3264179771},{"type":"v1","addr":"172.21.15.196:6838","nonce":3264179771}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4294,"qdb_cluster":[4294]},"id":1}]} 2024-04-22T07:22:57.845 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 8 2024-04-22T07:22:57.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.848+0000 7fd463996640 1 -- 172.21.15.37:0/1301726238 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fd44006c8f0 msgr2=0x7fd44006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:57.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.848+0000 7fd463996640 1 --2- 172.21.15.37:0/1301726238 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fd44006c8f0 0x7fd44006edb0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fd458006b10 tx=0x7fd458008040 comp rx=0 tx=0).stop 2024-04-22T07:22:57.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.848+0000 7fd463996640 1 -- 172.21.15.37:0/1301726238 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd45c151560 msgr2=0x7fd45c0cbf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:57.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.848+0000 7fd463996640 1 --2- 172.21.15.37:0/1301726238 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd45c151560 0x7fd45c0cbf70 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fd454007e60 tx=0x7fd45400e4b0 comp rx=0 tx=0).stop 2024-04-22T07:22:57.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.848+0000 7fd463996640 1 -- 172.21.15.37:0/1301726238 shutdown_connections 2024-04-22T07:22:57.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.848+0000 7fd463996640 1 --2- 172.21.15.37:0/1301726238 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7fd44006c8f0 0x7fd44006edb0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:57.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.848+0000 7fd463996640 1 --2- 172.21.15.37:0/1301726238 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd45c151560 0x7fd45c0cbf70 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:57.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.848+0000 7fd463996640 1 --2- 172.21.15.37:0/1301726238 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd45c151180 0x7fd45c14a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:57.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.848+0000 7fd463996640 1 --2- 172.21.15.37:0/1301726238 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd45c0c8410 0x7fd45c14c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:57.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.848+0000 7fd463996640 1 -- 172.21.15.37:0/1301726238 >> 172.21.15.37:0/1301726238 conn(0x7fd45c06b970 msgr2=0x7fd45c072fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:22:57.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.848+0000 7fd463996640 1 -- 172.21.15.37:0/1301726238 shutdown_connections 2024-04-22T07:22:57.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.848+0000 7fd463996640 1 -- 172.21.15.37:0/1301726238 wait complete. 2024-04-22T07:22:57.858 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-22T07:22:57.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.961+0000 7f4063d96640 1 Processor -- start 2024-04-22T07:22:57.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.961+0000 7f4063d96640 1 -- start start 2024-04-22T07:22:57.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.962+0000 7f4063d96640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f405c0c5360 0x7f405c15b420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:57.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.962+0000 7f4063d96640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f405c0c9ea0 0x7f405c15b960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:57.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.962+0000 7f4063d96640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f405c0c9040 con 0x7f405c1550c0 2024-04-22T07:22:57.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.962+0000 7f4063d96640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f405c0c8e10 con 0x7f405c0c5360 2024-04-22T07:22:57.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.962+0000 7f4063d96640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f405c06b970 con 0x7f405c0c9ea0 2024-04-22T07:22:57.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.962+0000 7f4061331640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f405c0c5360 0x7f405c15b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:57.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.962+0000 7f4061331640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f405c0c5360 0x7f405c15b420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42060/0 (socket says 172.21.15.37:42060) 2024-04-22T07:22:57.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.962+0000 7f4061331640 1 -- 172.21.15.37:0/840500019 learned_addr learned my addr 172.21.15.37:0/840500019 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:22:57.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.962+0000 7f4061b32640 1 --1- 172.21.15.37:0/840500019 >> v1:172.21.15.37:6789/0 conn(0x7f405c1550c0 0x7f405c0ce360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:40556/0 (socket says 172.21.15.37:40556) 2024-04-22T07:22:57.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.962+0000 7f4062333640 1 --2- 172.21.15.37:0/840500019 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f405c0c9ea0 0x7f405c15b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:57.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.962+0000 7f4061331640 1 -- 172.21.15.37:0/840500019 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f405c0c9ea0 msgr2=0x7f405c15b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:22:57.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.962+0000 7f4061331640 1 --2- 172.21.15.37:0/840500019 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f405c0c9ea0 0x7f405c15b960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:57.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.962+0000 7f4061331640 1 -- 172.21.15.37:0/840500019 >> v1:172.21.15.37:6789/0 conn(0x7f405c1550c0 legacy=0x7f405c0ce360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:57.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.962+0000 7f4060b30640 1 -- 172.21.15.37:0/840500019 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2621826971 0 0) 0x7f405c0c9040 con 0x7f405c1550c0 2024-04-22T07:22:57.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.962+0000 7f4061331640 1 -- 172.21.15.37:0/840500019 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f405c06bc50 con 0x7f405c0c5360 2024-04-22T07:22:57.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.963+0000 7f4061331640 1 --2- 172.21.15.37:0/840500019 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f405c0c5360 0x7f405c15b420 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f404c009870 tx=0x7f404c02ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce7bf7699f73e549 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:22:57.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.963+0000 7f4060b30640 1 -- 172.21.15.37:0/840500019 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f404c02f840 con 0x7f405c0c5360 2024-04-22T07:22:57.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.963+0000 7f4060b30640 1 -- 172.21.15.37:0/840500019 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f404c02f9e0 con 0x7f405c0c5360 2024-04-22T07:22:57.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.963+0000 7f4060b30640 1 -- 172.21.15.37:0/840500019 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f404c02fdd0 con 0x7f405c0c5360 2024-04-22T07:22:57.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.964+0000 7f4063d96640 1 -- 172.21.15.37:0/840500019 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f405c0c5360 msgr2=0x7f405c15b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:57.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.964+0000 7f4063d96640 1 --2- 172.21.15.37:0/840500019 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f405c0c5360 0x7f405c15b420 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f404c009870 tx=0x7f404c02ba20 comp rx=0 tx=0).stop 2024-04-22T07:22:57.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.964+0000 7f4063d96640 1 -- 172.21.15.37:0/840500019 shutdown_connections 2024-04-22T07:22:57.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.964+0000 7f4063d96640 1 --2- 172.21.15.37:0/840500019 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f405c0c9ea0 0x7f405c15b960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:57.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.964+0000 7f4063d96640 1 --2- 172.21.15.37:0/840500019 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f405c0c5360 0x7f405c15b420 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:57.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.964+0000 7f4063d96640 1 -- 172.21.15.37:0/840500019 >> 172.21.15.37:0/840500019 conn(0x7f405c06db80 msgr2=0x7f405c06df60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:22:57.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.964+0000 7f4063d96640 1 -- 172.21.15.37:0/840500019 shutdown_connections 2024-04-22T07:22:57.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.964+0000 7f4063d96640 1 -- 172.21.15.37:0/840500019 wait complete. 2024-04-22T07:22:57.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.965+0000 7f4063d96640 1 Processor -- start 2024-04-22T07:22:57.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.965+0000 7f4063d96640 1 -- start start 2024-04-22T07:22:57.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.966+0000 7f4063d96640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f405c0c5360 0x7f405c153710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:57.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.966+0000 7f4063d96640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f405c0c9ea0 0x7f405c1f1100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:57.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.966+0000 7f4063d96640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f405c1550c0 0x7f405c0cc210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:57.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.966+0000 7f4063d96640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f405c15ae90 con 0x7f405c1550c0 2024-04-22T07:22:57.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.966+0000 7f4063d96640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f405c06c210 con 0x7f405c0c9ea0 2024-04-22T07:22:57.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.966+0000 7f4063d96640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f405c0cea70 con 0x7f405c0c5360 2024-04-22T07:22:57.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.966+0000 7f4062333640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f405c1550c0 0x7f405c0cc210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:57.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.966+0000 7f4062333640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f405c1550c0 0x7f405c0cc210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42062/0 (socket says 172.21.15.37:42062) 2024-04-22T07:22:57.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.966+0000 7f4062333640 1 -- 172.21.15.37:0/847419787 learned_addr learned my addr 172.21.15.37:0/847419787 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:22:57.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.966+0000 7f4061b32640 1 --2- 172.21.15.37:0/847419787 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f405c0c5360 0x7f405c153710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:57.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.966+0000 7f4061331640 1 --2- 172.21.15.37:0/847419787 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f405c0c9ea0 0x7f405c1f1100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:57.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.966+0000 7f4062333640 1 -- 172.21.15.37:0/847419787 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f405c0c5360 msgr2=0x7f405c153710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:57.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.966+0000 7f4062333640 1 --2- 172.21.15.37:0/847419787 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f405c0c5360 0x7f405c153710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:57.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.966+0000 7f4062333640 1 -- 172.21.15.37:0/847419787 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f405c0c9ea0 msgr2=0x7f405c1f1100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:57.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.966+0000 7f4062333640 1 --2- 172.21.15.37:0/847419787 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f405c0c9ea0 0x7f405c1f1100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:57.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.966+0000 7f4062333640 1 -- 172.21.15.37:0/847419787 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f405c1522c0 con 0x7f405c1550c0 2024-04-22T07:22:57.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.966+0000 7f4062333640 1 --2- 172.21.15.37:0/847419787 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f405c1550c0 0x7f405c0cc210 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f4054007e40 tx=0x7f405400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:22:57.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.966+0000 7f40527fc640 1 -- 172.21.15.37:0/847419787 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4054014620 con 0x7f405c1550c0 2024-04-22T07:22:57.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.967+0000 7f40527fc640 1 -- 172.21.15.37:0/847419787 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f4054019070 con 0x7f405c1550c0 2024-04-22T07:22:57.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.967+0000 7f4063d96640 1 -- 172.21.15.37:0/847419787 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f405c1525a0 con 0x7f405c1550c0 2024-04-22T07:22:57.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.967+0000 7f40527fc640 1 -- 172.21.15.37:0/847419787 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4054014a40 con 0x7f405c1550c0 2024-04-22T07:22:57.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.967+0000 7f4063d96640 1 -- 172.21.15.37:0/847419787 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f405c152b60 con 0x7f405c1550c0 2024-04-22T07:22:57.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.967+0000 7f4063d96640 1 -- 172.21.15.37:0/847419787 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f405c069cc0 con 0x7f405c1550c0 2024-04-22T07:22:57.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.968+0000 7f40527fc640 1 -- 172.21.15.37:0/847419787 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4054014be0 con 0x7f405c1550c0 2024-04-22T07:22:57.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.968+0000 7f40527fc640 1 --2- 172.21.15.37:0/847419787 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f404006c8f0 0x7f404006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:57.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.969+0000 7f40527fc640 1 -- 172.21.15.37:0/847419787 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f405408c390 con 0x7f405c1550c0 2024-04-22T07:22:57.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.969+0000 7f4061b32640 1 --2- 172.21.15.37:0/847419787 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f404006c8f0 0x7f404006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:57.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.969+0000 7f4061b32640 1 --2- 172.21.15.37:0/847419787 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f404006c8f0 0x7f404006edb0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f4058007fd0 tx=0x7f4058007de0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:22:57.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:57.973+0000 7f40527fc640 1 -- 172.21.15.37:0/847419787 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f405405a0f0 con 0x7f405c1550c0 2024-04-22T07:22:58.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.199+0000 7f4063d96640 1 -- 172.21.15.37:0/847419787 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f405c070c20 con 0x7f405c1550c0 2024-04-22T07:22:58.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.200+0000 7f40527fc640 1 -- 172.21.15.37:0/847419787 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6827 (secure 0 0 0) 0x7f405405e3f0 con 0x7f405c1550c0 2024-04-22T07:22:58.199 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-22T07:22:58.199 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4265,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6839/671847354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6835","nonce":671847354},{"type":"v1","addr":"172.21.15.196:6839","nonce":671847354}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6833/1549427395","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1549427395},{"type":"v1","addr":"172.21.15.37:6833","nonce":1549427395}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6836/3825988951","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":3825988951},{"type":"v1","addr":"172.21.15.37:6836","nonce":3825988951}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4272,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/611771502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6835","nonce":611771502},{"type":"v1","addr":"172.21.15.37:6837","nonce":611771502}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4291,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6837/3055080225","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6834","nonce":3055080225},{"type":"v1","addr":"172.21.15.196:6837","nonce":3055080225}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-22T07:18:36.111618+0000","modified":"2024-04-22T07:18:41.783857+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.196:6838/3264179771","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6836","nonce":3264179771},{"type":"v1","addr":"172.21.15.196:6838","nonce":3264179771}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4294,"qdb_cluster":[4294]},"id":1}]} 2024-04-22T07:22:58.199 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 8 2024-04-22T07:22:58.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.202+0000 7f4063d96640 1 -- 172.21.15.37:0/847419787 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f404006c8f0 msgr2=0x7f404006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:58.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.202+0000 7f4063d96640 1 --2- 172.21.15.37:0/847419787 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f404006c8f0 0x7f404006edb0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f4058007fd0 tx=0x7f4058007de0 comp rx=0 tx=0).stop 2024-04-22T07:22:58.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.202+0000 7f4063d96640 1 -- 172.21.15.37:0/847419787 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f405c1550c0 msgr2=0x7f405c0cc210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:58.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.202+0000 7f4063d96640 1 --2- 172.21.15.37:0/847419787 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f405c1550c0 0x7f405c0cc210 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f4054007e40 tx=0x7f405400e4b0 comp rx=0 tx=0).stop 2024-04-22T07:22:58.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.202+0000 7f4063d96640 1 -- 172.21.15.37:0/847419787 shutdown_connections 2024-04-22T07:22:58.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.202+0000 7f4063d96640 1 --2- 172.21.15.37:0/847419787 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f404006c8f0 0x7f404006edb0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:58.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.202+0000 7f4063d96640 1 --2- 172.21.15.37:0/847419787 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f405c1550c0 0x7f405c0cc210 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:58.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.202+0000 7f4063d96640 1 --2- 172.21.15.37:0/847419787 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f405c0c9ea0 0x7f405c1f1100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:58.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.202+0000 7f4063d96640 1 --2- 172.21.15.37:0/847419787 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f405c0c5360 0x7f405c153710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:58.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.202+0000 7f4063d96640 1 -- 172.21.15.37:0/847419787 >> 172.21.15.37:0/847419787 conn(0x7f405c06db80 msgr2=0x7f405c0ca380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:22:58.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.202+0000 7f4063d96640 1 -- 172.21.15.37:0/847419787 shutdown_connections 2024-04-22T07:22:58.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.202+0000 7f4063d96640 1 -- 172.21.15.37:0/847419787 wait complete. 2024-04-22T07:22:58.212 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-22T07:22:58.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.313+0000 7f65ceb59640 1 Processor -- start 2024-04-22T07:22:58.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.313+0000 7f65ceb59640 1 -- start start 2024-04-22T07:22:58.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.314+0000 7f65ceb59640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f65c806cbf0 0x7f65c806b970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:58.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.314+0000 7f65ceb59640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f65c815b420 0x7f65c815b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:58.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.314+0000 7f65ceb59640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65c815bdf0 con 0x7f65c8155190 2024-04-22T07:22:58.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.314+0000 7f65ceb59640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f65c806d010 con 0x7f65c806cbf0 2024-04-22T07:22:58.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.314+0000 7f65ceb59640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f65c815e440 con 0x7f65c815b420 2024-04-22T07:22:58.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.314+0000 7f65cc8f5640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f65c8155190 0x7f65c80676b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:40558/0 (socket says 172.21.15.37:40558) 2024-04-22T07:22:58.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.314+0000 7f65cc8f5640 1 -- 172.21.15.37:0/2879867183 learned_addr learned my addr 172.21.15.37:0/2879867183 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-04-22T07:22:58.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.314+0000 7f65cd0f6640 1 --2- 172.21.15.37:0/2879867183 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f65c815b420 0x7f65c815b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:58.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.314+0000 7f65c7fff640 1 --2- 172.21.15.37:0/2879867183 >> v2:172.21.15.196:3300/0 conn(0x7f65c806cbf0 0x7f65c806b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:58.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.314+0000 7f65c77fe640 1 -- 172.21.15.37:0/2879867183 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 897507299 0 0) 0x7f65c815bdf0 con 0x7f65c8155190 2024-04-22T07:22:58.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.314+0000 7f65c77fe640 1 -- 172.21.15.37:0/2879867183 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f65b4003520 con 0x7f65c8155190 2024-04-22T07:22:58.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.315+0000 7f65c77fe640 1 -- 172.21.15.37:0/2879867183 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3199170183 0 0) 0x7f65b4003520 con 0x7f65c8155190 2024-04-22T07:22:58.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.315+0000 7f65c77fe640 1 -- 172.21.15.37:0/2879867183 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f65c815b420 msgr2=0x7f65c815b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:22:58.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.315+0000 7f65c77fe640 1 --2- 172.21.15.37:0/2879867183 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f65c815b420 0x7f65c815b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:58.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.315+0000 7f65c77fe640 1 -- 172.21.15.37:0/2879867183 >> v2:172.21.15.196:3300/0 conn(0x7f65c806cbf0 msgr2=0x7f65c806b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:22:58.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.315+0000 7f65c77fe640 1 --2- 172.21.15.37:0/2879867183 >> v2:172.21.15.196:3300/0 conn(0x7f65c806cbf0 0x7f65c806b970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:58.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.315+0000 7f65c77fe640 1 -- 172.21.15.37:0/2879867183 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65c815e690 con 0x7f65c8155190 2024-04-22T07:22:58.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.315+0000 7f65c77fe640 1 -- 172.21.15.37:0/2879867183 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2576656170 0 0) 0x7f65c00019f0 con 0x7f65c8155190 2024-04-22T07:22:58.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.315+0000 7f65c77fe640 1 -- 172.21.15.37:0/2879867183 >> v1:172.21.15.37:6789/0 conn(0x7f65c8155190 legacy=0x7f65c80676b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:58.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.315+0000 7f65c77fe640 1 --2- 172.21.15.37:0/2879867183 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f65b40039b0 0x7f65b4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:58.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.315+0000 7f65c77fe640 1 --2- 172.21.15.37:0/2879867183 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f65b4004800 0x7f65b4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:58.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.315+0000 7f65c77fe640 1 --2- 172.21.15.37:0/2879867183 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f65c815b420 0x7f65b40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:58.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.315+0000 7f65c77fe640 1 -- 172.21.15.37:0/2879867183 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f65c806d010 con 0x7f65b40039b0 2024-04-22T07:22:58.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.315+0000 7f65c77fe640 1 -- 172.21.15.37:0/2879867183 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f65c815e440 con 0x7f65b4004800 2024-04-22T07:22:58.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.315+0000 7f65c77fe640 1 -- 172.21.15.37:0/2879867183 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f65b400b9c0 con 0x7f65c815b420 2024-04-22T07:22:58.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.315+0000 7f65cc8f5640 1 --2- 172.21.15.37:0/2879867183 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f65b40039b0 0x7f65b4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:58.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.315+0000 7f65c7fff640 1 --2- 172.21.15.37:0/2879867183 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f65b4004800 0x7f65b4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:58.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.315+0000 7f65cd0f6640 1 --2- 172.21.15.37:0/2879867183 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f65c815b420 0x7f65b40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:58.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.315+0000 7f65cc8f5640 1 -- 172.21.15.37:0/2879867183 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f65c815b420 msgr2=0x7f65b40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:22:58.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.315+0000 7f65cc8f5640 1 --2- 172.21.15.37:0/2879867183 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f65c815b420 0x7f65b40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:58.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.315+0000 7f65cc8f5640 1 -- 172.21.15.37:0/2879867183 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f65b4004800 msgr2=0x7f65b4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:22:58.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.315+0000 7f65cc8f5640 1 --2- 172.21.15.37:0/2879867183 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f65b4004800 0x7f65b4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:58.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.315+0000 7f65cc8f5640 1 -- 172.21.15.37:0/2879867183 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65b4003520 con 0x7f65b40039b0 2024-04-22T07:22:58.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.316+0000 7f65cc8f5640 1 --2- 172.21.15.37:0/2879867183 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f65b40039b0 0x7f65b4003dd0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f65c000a920 tx=0x7f65b4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b888988cbd8f0a3c server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:22:58.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.316+0000 7f65c77fe640 1 -- 172.21.15.37:0/2879867183 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65c000a4c0 con 0x7f65b40039b0 2024-04-22T07:22:58.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.316+0000 7f65c77fe640 1 -- 172.21.15.37:0/2879867183 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f65c0034650 con 0x7f65b40039b0 2024-04-22T07:22:58.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.316+0000 7f65c77fe640 1 -- 172.21.15.37:0/2879867183 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65c0034a60 con 0x7f65b40039b0 2024-04-22T07:22:58.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.317+0000 7f65ceb59640 1 -- 172.21.15.37:0/2879867183 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f65b40039b0 msgr2=0x7f65b4003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:58.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.317+0000 7f65ceb59640 1 --2- 172.21.15.37:0/2879867183 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f65b40039b0 0x7f65b4003dd0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f65c000a920 tx=0x7f65b4005830 comp rx=0 tx=0).stop 2024-04-22T07:22:58.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.317+0000 7f65cd0f6640 1 -- 172.21.15.37:0/2879867183 reap_dead start 2024-04-22T07:22:58.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.317+0000 7f65ceb59640 1 -- 172.21.15.37:0/2879867183 shutdown_connections 2024-04-22T07:22:58.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.317+0000 7f65ceb59640 1 -- 172.21.15.37:0/2879867183 >> 172.21.15.37:0/2879867183 conn(0x7f65c80cd460 msgr2=0x7f65c80cd870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:22:58.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.317+0000 7f65ceb59640 1 -- 172.21.15.37:0/2879867183 shutdown_connections 2024-04-22T07:22:58.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.317+0000 7f65ceb59640 1 -- 172.21.15.37:0/2879867183 wait complete. 2024-04-22T07:22:58.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.318+0000 7f65ceb59640 1 Processor -- start 2024-04-22T07:22:58.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.318+0000 7f65ceb59640 1 -- start start 2024-04-22T07:22:58.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.319+0000 7f65ceb59640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f65b40039b0 0x7f65c815de30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:58.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.319+0000 7f65ceb59640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f65c80c6570 0x7f65c81f05d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:58.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.319+0000 7f65ceb59640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f65c80c7280 0x7f65c814abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:58.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.319+0000 7f65ceb59640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f65c815ef30 con 0x7f65b40039b0 2024-04-22T07:22:58.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.319+0000 7f65ceb59640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f65c815ec50 con 0x7f65c80c7280 2024-04-22T07:22:58.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.319+0000 7f65ceb59640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f65c815f210 con 0x7f65c80c6570 2024-04-22T07:22:58.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.319+0000 7f65cc8f5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f65b40039b0 0x7f65c815de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:58.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.319+0000 7f65cc8f5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f65b40039b0 0x7f65c815de30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42074/0 (socket says 172.21.15.37:42074) 2024-04-22T07:22:58.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.319+0000 7f65cc8f5640 1 -- 172.21.15.37:0/1294018395 learned_addr learned my addr 172.21.15.37:0/1294018395 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:22:58.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.319+0000 7f65c7fff640 1 --2- 172.21.15.37:0/1294018395 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f65c80c6570 0x7f65c81f05d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:58.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.319+0000 7f65cd0f6640 1 --2- 172.21.15.37:0/1294018395 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f65c80c7280 0x7f65c814abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:58.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.319+0000 7f65cc8f5640 1 -- 172.21.15.37:0/1294018395 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f65c80c6570 msgr2=0x7f65c81f05d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:58.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.319+0000 7f65cc8f5640 1 --2- 172.21.15.37:0/1294018395 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f65c80c6570 0x7f65c81f05d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:58.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.319+0000 7f65cc8f5640 1 -- 172.21.15.37:0/1294018395 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f65c80c7280 msgr2=0x7f65c814abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:58.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.319+0000 7f65cc8f5640 1 --2- 172.21.15.37:0/1294018395 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f65c80c7280 0x7f65c814abc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:58.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.319+0000 7f65cc8f5640 1 -- 172.21.15.37:0/1294018395 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65c8155970 con 0x7f65b40039b0 2024-04-22T07:22:58.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.319+0000 7f65cd0f6640 1 --2- 172.21.15.37:0/1294018395 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f65c80c7280 0x7f65c814abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-22T07:22:58.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.319+0000 7f65cc8f5640 1 --2- 172.21.15.37:0/1294018395 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f65b40039b0 0x7f65c815de30 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f65c002ccb0 tx=0x7f65c80c5750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:22:58.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.320+0000 7f65c57fa640 1 -- 172.21.15.37:0/1294018395 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65c0043020 con 0x7f65b40039b0 2024-04-22T07:22:58.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.320+0000 7f65c57fa640 1 -- 172.21.15.37:0/1294018395 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f65c0001a40 con 0x7f65b40039b0 2024-04-22T07:22:58.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.320+0000 7f65ceb59640 1 -- 172.21.15.37:0/1294018395 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65c80c5d90 con 0x7f65b40039b0 2024-04-22T07:22:58.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.320+0000 7f65c57fa640 1 -- 172.21.15.37:0/1294018395 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65c0034a00 con 0x7f65b40039b0 2024-04-22T07:22:58.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.320+0000 7f65ceb59640 1 -- 172.21.15.37:0/1294018395 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65c815d570 con 0x7f65b40039b0 2024-04-22T07:22:58.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.321+0000 7f65ceb59640 1 -- 172.21.15.37:0/1294018395 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65c8069cc0 con 0x7f65b40039b0 2024-04-22T07:22:58.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.321+0000 7f65c57fa640 1 -- 172.21.15.37:0/1294018395 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f65c0046020 con 0x7f65b40039b0 2024-04-22T07:22:58.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.322+0000 7f65c57fa640 1 --2- 172.21.15.37:0/1294018395 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f65a806c920 0x7f65a806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:58.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.322+0000 7f65c57fa640 1 -- 172.21.15.37:0/1294018395 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f65c00ae300 con 0x7f65b40039b0 2024-04-22T07:22:58.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.322+0000 7f65c7fff640 1 --2- 172.21.15.37:0/1294018395 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f65a806c920 0x7f65a806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:58.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.322+0000 7f65c7fff640 1 --2- 172.21.15.37:0/1294018395 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f65a806c920 0x7f65a806ede0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f65c80c6fc0 tx=0x7f65b0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:22:58.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.326+0000 7f65c57fa640 1 -- 172.21.15.37:0/1294018395 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f65c004d030 con 0x7f65b40039b0 2024-04-22T07:22:58.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.514+0000 7f65ceb59640 1 -- 172.21.15.37:0/1294018395 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f65c806bfc0 con 0x7f65b40039b0 2024-04-22T07:22:58.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.515+0000 7f65c57fa640 1 -- 172.21.15.37:0/1294018395 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16775 (secure 0 0 0) 0x7f65c007c580 con 0x7f65b40039b0 2024-04-22T07:22:58.514 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-22T07:22:58.514 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":22,"fsid":"10d90a41-52d3-4e09-8022-c8ac67897ad1","created":"2024-04-22T07:18:12.420756+0000","modified":"2024-04-22T07:19:17.871666+0000","last_up_change":"2024-04-22T07:18:23.649808+0000","last_in_change":"2024-04-22T07:18:14.506974+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-22T07:18:24.602243+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-22T07:18:34.673639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-22T07:18:35.055184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e248f6e1-13ad-48e0-a8f8-ec3059995654","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":1488290385},{"type":"v1","addr":"172.21.15.37:6801","nonce":1488290385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1488290385},{"type":"v1","addr":"172.21.15.37:6803","nonce":1488290385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1488290385},{"type":"v1","addr":"172.21.15.37:6807","nonce":1488290385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1488290385},{"type":"v1","addr":"172.21.15.37:6805","nonce":1488290385}]},"public_addr":"172.21.15.37:6801/1488290385","cluster_addr":"172.21.15.37:6803/1488290385","heartbeat_back_addr":"172.21.15.37:6807/1488290385","heartbeat_front_addr":"172.21.15.37:6805/1488290385","state":["exists","up"]},{"osd":1,"uuid":"01c71ab7-1326-432b-b73a-e5847abe5132","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3918584183},{"type":"v1","addr":"172.21.15.37:6811","nonce":3918584183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6813","nonce":3918584183},{"type":"v1","addr":"172.21.15.37:6816","nonce":3918584183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":3918584183},{"type":"v1","addr":"172.21.15.37:6823","nonce":3918584183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":3918584183},{"type":"v1","addr":"172.21.15.37:6821","nonce":3918584183}]},"public_addr":"172.21.15.37:6811/3918584183","cluster_addr":"172.21.15.37:6816/3918584183","heartbeat_back_addr":"172.21.15.37:6823/3918584183","heartbeat_front_addr":"172.21.15.37:6821/3918584183","state":["exists","up"]},{"osd":2,"uuid":"33a780fd-013a-41c8-9970-136c9e080897","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1895439419},{"type":"v1","addr":"172.21.15.37:6825","nonce":1895439419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1895439419},{"type":"v1","addr":"172.21.15.37:6827","nonce":1895439419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1895439419},{"type":"v1","addr":"172.21.15.37:6831","nonce":1895439419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1895439419},{"type":"v1","addr":"172.21.15.37:6829","nonce":1895439419}]},"public_addr":"172.21.15.37:6825/1895439419","cluster_addr":"172.21.15.37:6827/1895439419","heartbeat_back_addr":"172.21.15.37:6831/1895439419","heartbeat_front_addr":"172.21.15.37:6829/1895439419","state":["exists","up"]},{"osd":3,"uuid":"b46e53c4-e5b9-4098-b243-ab5a0f1f3885","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6809","nonce":1160021017},{"type":"v1","addr":"172.21.15.37:6810","nonce":1160021017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1160021017},{"type":"v1","addr":"172.21.15.37:6814","nonce":1160021017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":1160021017},{"type":"v1","addr":"172.21.15.37:6820","nonce":1160021017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6815","nonce":1160021017},{"type":"v1","addr":"172.21.15.37:6817","nonce":1160021017}]},"public_addr":"172.21.15.37:6810/1160021017","cluster_addr":"172.21.15.37:6814/1160021017","heartbeat_back_addr":"172.21.15.37:6820/1160021017","heartbeat_front_addr":"172.21.15.37:6817/1160021017","state":["exists","up"]},{"osd":4,"uuid":"cd1032c6-6a83-4e33-b7b1-baddf92a83af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":374829049},{"type":"v1","addr":"172.21.15.196:6809","nonce":374829049}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":374829049},{"type":"v1","addr":"172.21.15.196:6811","nonce":374829049}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":374829049},{"type":"v1","addr":"172.21.15.196:6815","nonce":374829049}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":374829049},{"type":"v1","addr":"172.21.15.196:6813","nonce":374829049}]},"public_addr":"172.21.15.196:6809/374829049","cluster_addr":"172.21.15.196:6811/374829049","heartbeat_back_addr":"172.21.15.196:6815/374829049","heartbeat_front_addr":"172.21.15.196:6813/374829049","state":["exists","up"]},{"osd":5,"uuid":"f561d48a-5f2d-4deb-8681-4329aed36bae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":479311302},{"type":"v1","addr":"172.21.15.196:6801","nonce":479311302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":479311302},{"type":"v1","addr":"172.21.15.196:6803","nonce":479311302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":479311302},{"type":"v1","addr":"172.21.15.196:6807","nonce":479311302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":479311302},{"type":"v1","addr":"172.21.15.196:6805","nonce":479311302}]},"public_addr":"172.21.15.196:6801/479311302","cluster_addr":"172.21.15.196:6803/479311302","heartbeat_back_addr":"172.21.15.196:6807/479311302","heartbeat_front_addr":"172.21.15.196:6805/479311302","state":["exists","up"]},{"osd":6,"uuid":"1b239c7e-2504-42e0-b308-70f4e62519c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6817","nonce":691777224},{"type":"v1","addr":"172.21.15.196:6819","nonce":691777224}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6821","nonce":691777224},{"type":"v1","addr":"172.21.15.196:6823","nonce":691777224}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6829","nonce":691777224},{"type":"v1","addr":"172.21.15.196:6831","nonce":691777224}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6825","nonce":691777224},{"type":"v1","addr":"172.21.15.196:6827","nonce":691777224}]},"public_addr":"172.21.15.196:6819/691777224","cluster_addr":"172.21.15.196:6823/691777224","heartbeat_back_addr":"172.21.15.196:6831/691777224","heartbeat_front_addr":"172.21.15.196:6827/691777224","state":["exists","up"]},{"osd":7,"uuid":"084318d4-d1fd-4b58-8c33-b1d7856fe323","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":3106266066},{"type":"v1","addr":"172.21.15.196:6818","nonce":3106266066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":3106266066},{"type":"v1","addr":"172.21.15.196:6822","nonce":3106266066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":3106266066},{"type":"v1","addr":"172.21.15.196:6830","nonce":3106266066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":3106266066},{"type":"v1","addr":"172.21.15.196:6826","nonce":3106266066}]},"public_addr":"172.21.15.196:6818/3106266066","cluster_addr":"172.21.15.196:6822/3106266066","heartbeat_back_addr":"172.21.15.196:6830/3106266066","heartbeat_front_addr":"172.21.15.196:6826/3106266066","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:18:19.587791+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:18:19.706541+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:18:19.690674+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:18:19.648354+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:18:19.666671+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:18:19.560709+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:18:19.661412+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:18:19.770650+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.13","mappings":[{"from":7,"to":2}]},{"pgid":"3.1e","mappings":[{"from":3,"to":1}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.3c","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-22T07:22:58.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.517+0000 7f65ceb59640 1 -- 172.21.15.37:0/1294018395 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f65a806c920 msgr2=0x7f65a806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:58.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.517+0000 7f65ceb59640 1 --2- 172.21.15.37:0/1294018395 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f65a806c920 0x7f65a806ede0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f65c80c6fc0 tx=0x7f65b0008040 comp rx=0 tx=0).stop 2024-04-22T07:22:58.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.517+0000 7f65ceb59640 1 -- 172.21.15.37:0/1294018395 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f65b40039b0 msgr2=0x7f65c815de30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:58.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.517+0000 7f65ceb59640 1 --2- 172.21.15.37:0/1294018395 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f65b40039b0 0x7f65c815de30 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f65c002ccb0 tx=0x7f65c80c5750 comp rx=0 tx=0).stop 2024-04-22T07:22:58.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.517+0000 7f65ceb59640 1 -- 172.21.15.37:0/1294018395 shutdown_connections 2024-04-22T07:22:58.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.517+0000 7f65ceb59640 1 --2- 172.21.15.37:0/1294018395 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f65a806c920 0x7f65a806ede0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:58.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.517+0000 7f65ceb59640 1 --2- 172.21.15.37:0/1294018395 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f65c80c7280 0x7f65c814abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:58.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.517+0000 7f65ceb59640 1 --2- 172.21.15.37:0/1294018395 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f65c80c6570 0x7f65c81f05d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:58.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.517+0000 7f65ceb59640 1 --2- 172.21.15.37:0/1294018395 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f65b40039b0 0x7f65c815de30 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:58.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.517+0000 7f65ceb59640 1 -- 172.21.15.37:0/1294018395 >> 172.21.15.37:0/1294018395 conn(0x7f65c80cd460 msgr2=0x7f65c806fc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:22:58.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.517+0000 7f65ceb59640 1 -- 172.21.15.37:0/1294018395 shutdown_connections 2024-04-22T07:22:58.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.517+0000 7f65ceb59640 1 -- 172.21.15.37:0/1294018395 wait complete. 2024-04-22T07:22:58.527 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-22T07:22:58.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.630+0000 7f9ce598e640 1 Processor -- start 2024-04-22T07:22:58.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.630+0000 7f9ce598e640 1 -- start start 2024-04-22T07:22:58.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.631+0000 7f9ce598e640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9ce0155250 0x7f9ce015af40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:58.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.631+0000 7f9ce598e640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f9ce00b35b0 0x7f9ce00cd430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:58.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.631+0000 7f9ce598e640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ce00b3bd0 con 0x7f9ce00b3190 2024-04-22T07:22:58.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.631+0000 7f9ce598e640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f9ce00cb6a0 con 0x7f9ce00b35b0 2024-04-22T07:22:58.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.631+0000 7f9ce598e640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f9ce015e4b0 con 0x7f9ce0155250 2024-04-22T07:22:58.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.631+0000 7f9cdeffd640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9ce0155250 0x7f9ce015af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:58.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.631+0000 7f9cdf7fe640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f9ce00b35b0 0x7f9ce00cd430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:58.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.631+0000 7f9cde7fc640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7f9ce00b3190 0x7f9ce00ccd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.37:33882/0 (socket says 172.21.15.37:33882) 2024-04-22T07:22:58.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.631+0000 7f9cde7fc640 1 -- 172.21.15.37:0/1528747609 learned_addr learned my addr 172.21.15.37:0/1528747609 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-04-22T07:22:58.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.631+0000 7f9cdeffd640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9ce0155250 0x7f9ce015af40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.37:46324/0 (socket says 172.21.15.37:46324) 2024-04-22T07:22:58.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.632+0000 7f9cdeffd640 1 -- 172.21.15.37:0/1528747609 >> v2:172.21.15.196:3300/0 conn(0x7f9ce00b35b0 msgr2=0x7f9ce00cd430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:22:58.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.632+0000 7f9cdeffd640 1 --2- 172.21.15.37:0/1528747609 >> v2:172.21.15.196:3300/0 conn(0x7f9ce00b35b0 0x7f9ce00cd430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:58.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.632+0000 7f9cdeffd640 1 -- 172.21.15.37:0/1528747609 >> v1:172.21.15.196:6789/0 conn(0x7f9ce00b3190 legacy=0x7f9ce00ccd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:58.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.632+0000 7f9cddffb640 1 -- 172.21.15.37:0/1528747609 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2288627311 0 0) 0x7f9ce00b3bd0 con 0x7f9ce00b3190 2024-04-22T07:22:58.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.632+0000 7f9cdeffd640 1 -- 172.21.15.37:0/1528747609 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ce00b3eb0 con 0x7f9ce0155250 2024-04-22T07:22:58.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.632+0000 7f9cdeffd640 1 --2- 172.21.15.37:0/1528747609 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9ce0155250 0x7f9ce015af40 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f9cd80097a0 tx=0x7f9cd802b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=62dd4594ce92c814 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:22:58.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.633+0000 7f9cddffb640 1 -- 172.21.15.37:0/1528747609 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cd8035020 con 0x7f9ce0155250 2024-04-22T07:22:58.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.633+0000 7f9cddffb640 1 -- 172.21.15.37:0/1528747609 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f9cd8031830 con 0x7f9ce0155250 2024-04-22T07:22:58.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.633+0000 7f9cddffb640 1 -- 172.21.15.37:0/1528747609 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cd8031c20 con 0x7f9ce0155250 2024-04-22T07:22:58.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.633+0000 7f9ce598e640 1 -- 172.21.15.37:0/1528747609 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9ce0155250 msgr2=0x7f9ce015af40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:58.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.633+0000 7f9ce598e640 1 --2- 172.21.15.37:0/1528747609 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9ce0155250 0x7f9ce015af40 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f9cd80097a0 tx=0x7f9cd802b8d0 comp rx=0 tx=0).stop 2024-04-22T07:22:58.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.633+0000 7f9ce598e640 1 -- 172.21.15.37:0/1528747609 shutdown_connections 2024-04-22T07:22:58.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.633+0000 7f9ce598e640 1 --2- 172.21.15.37:0/1528747609 >> v2:172.21.15.196:3300/0 conn(0x7f9ce00b35b0 0x7f9ce00cd430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:58.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.633+0000 7f9ce598e640 1 --2- 172.21.15.37:0/1528747609 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9ce0155250 0x7f9ce015af40 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:58.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.633+0000 7f9ce598e640 1 -- 172.21.15.37:0/1528747609 >> 172.21.15.37:0/1528747609 conn(0x7f9ce0071f90 msgr2=0x7f9ce00723a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:22:58.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.633+0000 7f9ce598e640 1 -- 172.21.15.37:0/1528747609 shutdown_connections 2024-04-22T07:22:58.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.633+0000 7f9ce598e640 1 -- 172.21.15.37:0/1528747609 wait complete. 2024-04-22T07:22:58.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.634+0000 7f9ce598e640 1 Processor -- start 2024-04-22T07:22:58.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.634+0000 7f9ce598e640 1 -- start start 2024-04-22T07:22:58.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.635+0000 7f9ce598e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ce00b3190 0x7f9ce015c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:58.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.635+0000 7f9ce598e640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9ce00b35b0 0x7f9ce0159230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:58.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.635+0000 7f9ce598e640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9ce0155250 0x7f9ce00cf910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:58.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.635+0000 7f9ce598e640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f9ce015ecc0 con 0x7f9ce00b3190 2024-04-22T07:22:58.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.635+0000 7f9ce598e640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f9ce015e9e0 con 0x7f9ce00b35b0 2024-04-22T07:22:58.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.635+0000 7f9ce598e640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f9ce0155630 con 0x7f9ce0155250 2024-04-22T07:22:58.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.635+0000 7f9cdeffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ce00b3190 0x7f9ce015c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:58.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.635+0000 7f9cdeffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ce00b3190 0x7f9ce015c0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42084/0 (socket says 172.21.15.37:42084) 2024-04-22T07:22:58.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.635+0000 7f9cdeffd640 1 -- 172.21.15.37:0/2404536894 learned_addr learned my addr 172.21.15.37:0/2404536894 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:22:58.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.635+0000 7f9cdf7fe640 1 --2- 172.21.15.37:0/2404536894 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9ce0155250 0x7f9ce00cf910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:58.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.635+0000 7f9cde7fc640 1 --2- 172.21.15.37:0/2404536894 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9ce00b35b0 0x7f9ce0159230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:58.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.636+0000 7f9cdeffd640 1 -- 172.21.15.37:0/2404536894 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9ce0155250 msgr2=0x7f9ce00cf910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:58.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.636+0000 7f9cdeffd640 1 --2- 172.21.15.37:0/2404536894 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9ce0155250 0x7f9ce00cf910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:58.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.636+0000 7f9cdeffd640 1 -- 172.21.15.37:0/2404536894 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9ce00b35b0 msgr2=0x7f9ce0159230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:58.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.636+0000 7f9cdeffd640 1 --2- 172.21.15.37:0/2404536894 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9ce00b35b0 0x7f9ce0159230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:58.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.636+0000 7f9cdeffd640 1 -- 172.21.15.37:0/2404536894 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ce015d8b0 con 0x7f9ce00b3190 2024-04-22T07:22:58.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.636+0000 7f9cdeffd640 1 --2- 172.21.15.37:0/2404536894 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ce00b3190 0x7f9ce015c0a0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f9cd8000c00 tx=0x7f9cd80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:22:58.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.636+0000 7f9cc7fff640 1 -- 172.21.15.37:0/2404536894 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cd8035050 con 0x7f9ce00b3190 2024-04-22T07:22:58.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.636+0000 7f9cc7fff640 1 -- 172.21.15.37:0/2404536894 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f9cd8004230 con 0x7f9ce00b3190 2024-04-22T07:22:58.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.636+0000 7f9ce598e640 1 -- 172.21.15.37:0/2404536894 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ce015db90 con 0x7f9ce00b3190 2024-04-22T07:22:58.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.636+0000 7f9cc7fff640 1 -- 172.21.15.37:0/2404536894 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cd803b6c0 con 0x7f9ce00b3190 2024-04-22T07:22:58.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.636+0000 7f9ce598e640 1 -- 172.21.15.37:0/2404536894 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ce015e150 con 0x7f9ce00b3190 2024-04-22T07:22:58.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.637+0000 7f9ce598e640 1 -- 172.21.15.37:0/2404536894 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ce0069cc0 con 0x7f9ce00b3190 2024-04-22T07:22:58.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.638+0000 7f9cc7fff640 1 -- 172.21.15.37:0/2404536894 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9cd8038020 con 0x7f9ce00b3190 2024-04-22T07:22:58.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.638+0000 7f9cc7fff640 1 --2- 172.21.15.37:0/2404536894 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f9ccc06c8f0 0x7f9ccc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:58.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.638+0000 7f9cc7fff640 1 -- 172.21.15.37:0/2404536894 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f9cd80ada60 con 0x7f9ce00b3190 2024-04-22T07:22:58.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.638+0000 7f9cde7fc640 1 --2- 172.21.15.37:0/2404536894 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f9ccc06c8f0 0x7f9ccc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:58.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.639+0000 7f9cde7fc640 1 --2- 172.21.15.37:0/2404536894 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f9ccc06c8f0 0x7f9ccc06edb0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f9ce00caf70 tx=0x7f9cd4007c00 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:22:58.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.642+0000 7f9cc7fff640 1 -- 172.21.15.37:0/2404536894 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f9cd8040070 con 0x7f9ce00b3190 2024-04-22T07:22:58.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.871+0000 7f9ce598e640 1 -- 172.21.15.37:0/2404536894 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f9ce015be80 con 0x7f9ce00b3190 2024-04-22T07:22:58.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.873+0000 7f9cc7fff640 1 -- 172.21.15.37:0/2404536894 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) ==== 161+0+0 (secure 0 0 0) 0x7f9cd8031800 con 0x7f9ce00b3190 2024-04-22T07:22:58.871 INFO:teuthology.orchestra.run.smithi037.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-22T07:22:58.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.875+0000 7f9ce598e640 1 -- 172.21.15.37:0/2404536894 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f9ccc06c8f0 msgr2=0x7f9ccc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:58.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.875+0000 7f9ce598e640 1 --2- 172.21.15.37:0/2404536894 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f9ccc06c8f0 0x7f9ccc06edb0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f9ce00caf70 tx=0x7f9cd4007c00 comp rx=0 tx=0).stop 2024-04-22T07:22:58.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.875+0000 7f9ce598e640 1 -- 172.21.15.37:0/2404536894 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ce00b3190 msgr2=0x7f9ce015c0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:58.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.875+0000 7f9ce598e640 1 --2- 172.21.15.37:0/2404536894 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ce00b3190 0x7f9ce015c0a0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f9cd8000c00 tx=0x7f9cd80046c0 comp rx=0 tx=0).stop 2024-04-22T07:22:58.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.875+0000 7f9ce598e640 1 -- 172.21.15.37:0/2404536894 shutdown_connections 2024-04-22T07:22:58.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.875+0000 7f9ce598e640 1 --2- 172.21.15.37:0/2404536894 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f9ccc06c8f0 0x7f9ccc06edb0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:58.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.875+0000 7f9ce598e640 1 --2- 172.21.15.37:0/2404536894 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9ce0155250 0x7f9ce00cf910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:58.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.875+0000 7f9ce598e640 1 --2- 172.21.15.37:0/2404536894 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9ce00b35b0 0x7f9ce0159230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:58.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.875+0000 7f9ce598e640 1 --2- 172.21.15.37:0/2404536894 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ce00b3190 0x7f9ce015c0a0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:58.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.875+0000 7f9ce598e640 1 -- 172.21.15.37:0/2404536894 >> 172.21.15.37:0/2404536894 conn(0x7f9ce0071f90 msgr2=0x7f9ce0152640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:22:58.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.875+0000 7f9ce598e640 1 -- 172.21.15.37:0/2404536894 shutdown_connections 2024-04-22T07:22:58.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.876+0000 7f9ce598e640 1 -- 172.21.15.37:0/2404536894 wait complete. 2024-04-22T07:22:58.887 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-22T07:22:58.918 INFO:tasks.ceph.mds.f.smithi196.stdout:starting mds.f at 2024-04-22T07:22:58.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.990+0000 7f647bda4640 1 Processor -- start 2024-04-22T07:22:58.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.991+0000 7f647bda4640 1 -- start start 2024-04-22T07:22:58.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.991+0000 7f647bda4640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f6474070ee0 0x7f647406b970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:58.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.991+0000 7f647bda4640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f647415ea50 con 0x7f647406beb0 2024-04-22T07:22:58.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.991+0000 7f647bda4640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f64740c8600 con 0x7f6474154f60 2024-04-22T07:22:58.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.991+0000 7f647bda4640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f647406cf60 con 0x7f6474070ee0 2024-04-22T07:22:58.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.992+0000 7f647a341640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f647406beb0 0x7f647406c300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:40574/0 (socket says 172.21.15.37:40574) 2024-04-22T07:22:58.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.992+0000 7f647a341640 1 -- 172.21.15.37:0/2552462709 learned_addr learned my addr 172.21.15.37:0/2552462709 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-04-22T07:22:58.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.992+0000 7f647933f640 1 --2- 172.21.15.37:0/2552462709 >> v2:172.21.15.196:3300/0 conn(0x7f6474070ee0 0x7f647406b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:58.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.992+0000 7f6478b3e640 1 -- 172.21.15.37:0/2552462709 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2135679997 0 0) 0x7f647415ea50 con 0x7f647406beb0 2024-04-22T07:22:58.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.992+0000 7f6478b3e640 1 -- 172.21.15.37:0/2552462709 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6460003520 con 0x7f647406beb0 2024-04-22T07:22:58.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.992+0000 7f647933f640 1 -- 172.21.15.37:0/2552462709 >> v1:172.21.15.196:6789/0 conn(0x7f6474154f60 legacy=0x7f647415e340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:58.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.992+0000 7f6478b3e640 1 -- 172.21.15.37:0/2552462709 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3611246058 0 0) 0x7f64740c8600 con 0x7f6474154f60 2024-04-22T07:22:58.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.992+0000 7f647933f640 1 -- 172.21.15.37:0/2552462709 >> v1:172.21.15.37:6789/0 conn(0x7f647406beb0 legacy=0x7f647406c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:58.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.992+0000 7f647933f640 1 -- 172.21.15.37:0/2552462709 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f647415ae60 con 0x7f6474070ee0 2024-04-22T07:22:58.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.993+0000 7f647933f640 1 --2- 172.21.15.37:0/2552462709 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6474070ee0 0x7f647406b970 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f64640097a0 tx=0x7f646402b9f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d91ad59f7d15cdca server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:22:58.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.993+0000 7f6478b3e640 1 -- 172.21.15.37:0/2552462709 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f646402f810 con 0x7f6474070ee0 2024-04-22T07:22:58.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.993+0000 7f6478b3e640 1 -- 172.21.15.37:0/2552462709 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f646402f9b0 con 0x7f6474070ee0 2024-04-22T07:22:58.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.993+0000 7f6478b3e640 1 -- 172.21.15.37:0/2552462709 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f646402fda0 con 0x7f6474070ee0 2024-04-22T07:22:58.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.994+0000 7f647bda4640 1 -- 172.21.15.37:0/2552462709 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6474070ee0 msgr2=0x7f647406b970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:58.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.994+0000 7f647bda4640 1 --2- 172.21.15.37:0/2552462709 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6474070ee0 0x7f647406b970 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f64640097a0 tx=0x7f646402b9f0 comp rx=0 tx=0).stop 2024-04-22T07:22:58.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.994+0000 7f647bda4640 1 -- 172.21.15.37:0/2552462709 shutdown_connections 2024-04-22T07:22:58.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.994+0000 7f647bda4640 1 --2- 172.21.15.37:0/2552462709 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6474070ee0 0x7f647406b970 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:58.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.994+0000 7f647bda4640 1 -- 172.21.15.37:0/2552462709 >> 172.21.15.37:0/2552462709 conn(0x7f64740c9f60 msgr2=0x7f64740ca370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:22:58.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.994+0000 7f647bda4640 1 -- 172.21.15.37:0/2552462709 shutdown_connections 2024-04-22T07:22:58.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.994+0000 7f647bda4640 1 -- 172.21.15.37:0/2552462709 wait complete. 2024-04-22T07:22:58.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.995+0000 7f647bda4640 1 Processor -- start 2024-04-22T07:22:58.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.995+0000 7f647bda4640 1 -- start start 2024-04-22T07:22:58.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.995+0000 7f647bda4640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f647406beb0 0x7f64740c6980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:58.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.996+0000 7f647bda4640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6474070ee0 0x7f64741422d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:58.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.996+0000 7f647bda4640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6474154f60 0x7f64740cb260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:58.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.996+0000 7f647bda4640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f647415b700 con 0x7f6474154f60 2024-04-22T07:22:58.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.996+0000 7f647bda4640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f647415b420 con 0x7f6474070ee0 2024-04-22T07:22:58.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.996+0000 7f647bda4640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f647415bc20 con 0x7f647406beb0 2024-04-22T07:22:58.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.996+0000 7f647a341640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6474154f60 0x7f64740cb260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:58.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.996+0000 7f647a341640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6474154f60 0x7f64740cb260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42086/0 (socket says 172.21.15.37:42086) 2024-04-22T07:22:58.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.996+0000 7f647a341640 1 -- 172.21.15.37:0/672363811 learned_addr learned my addr 172.21.15.37:0/672363811 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:22:58.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.996+0000 7f6479b40640 1 --2- 172.21.15.37:0/672363811 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f647406beb0 0x7f64740c6980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:58.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.996+0000 7f647933f640 1 --2- 172.21.15.37:0/672363811 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6474070ee0 0x7f64741422d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:58.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.996+0000 7f647a341640 1 -- 172.21.15.37:0/672363811 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f647406beb0 msgr2=0x7f64740c6980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:58.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.996+0000 7f647a341640 1 --2- 172.21.15.37:0/672363811 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f647406beb0 0x7f64740c6980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:58.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.996+0000 7f647a341640 1 -- 172.21.15.37:0/672363811 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6474070ee0 msgr2=0x7f64741422d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:58.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.996+0000 7f647a341640 1 --2- 172.21.15.37:0/672363811 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6474070ee0 0x7f64741422d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:58.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.996+0000 7f647a341640 1 -- 172.21.15.37:0/672363811 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64740cc3c0 con 0x7f6474154f60 2024-04-22T07:22:58.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.996+0000 7f647a341640 1 --2- 172.21.15.37:0/672363811 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6474154f60 0x7f64740cb260 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f646c00cb40 tx=0x7f646c00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:22:58.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.996+0000 7f646a7fc640 1 -- 172.21.15.37:0/672363811 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f646c017070 con 0x7f6474154f60 2024-04-22T07:22:58.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.996+0000 7f646a7fc640 1 -- 172.21.15.37:0/672363811 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f646c00ac40 con 0x7f6474154f60 2024-04-22T07:22:58.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.996+0000 7f647bda4640 1 -- 172.21.15.37:0/672363811 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6474147b30 con 0x7f6474154f60 2024-04-22T07:22:58.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.996+0000 7f646a7fc640 1 -- 172.21.15.37:0/672363811 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f646c012640 con 0x7f6474154f60 2024-04-22T07:22:58.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.996+0000 7f647bda4640 1 -- 172.21.15.37:0/672363811 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6474149b60 con 0x7f6474154f60 2024-04-22T07:22:58.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.997+0000 7f647bda4640 1 -- 172.21.15.37:0/672363811 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6474148050 con 0x7f6474154f60 2024-04-22T07:22:59.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.998+0000 7f646a7fc640 1 -- 172.21.15.37:0/672363811 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f646c01a070 con 0x7f6474154f60 2024-04-22T07:22:59.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.998+0000 7f646a7fc640 1 --2- 172.21.15.37:0/672363811 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f645806c920 0x7f645806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:59.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.998+0000 7f646a7fc640 1 -- 172.21.15.37:0/672363811 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5911+0+0 (secure 0 0 0) 0x7f646c08b9b0 con 0x7f6474154f60 2024-04-22T07:22:59.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.998+0000 7f6479b40640 1 --2- 172.21.15.37:0/672363811 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f645806c920 0x7f645806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:59.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:58.999+0000 7f6479b40640 1 --2- 172.21.15.37:0/672363811 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f645806c920 0x7f645806ede0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f6470000f60 tx=0x7f6470009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:22:59.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:59.002+0000 7f646a7fc640 1 -- 172.21.15.37:0/672363811 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f6474148050 con 0x7f6474154f60 2024-04-22T07:22:59.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:59.229+0000 7f647bda4640 1 -- 172.21.15.37:0/672363811 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f647406ca10 con 0x7f6474154f60 2024-04-22T07:22:59.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:59.886+0000 7f646a7fc640 1 -- 172.21.15.37:0/672363811 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) ==== 104+0+0 (secure 0 0 0) 0x7f646c059640 con 0x7f6474154f60 2024-04-22T07:22:59.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:59.889+0000 7f647bda4640 1 -- 172.21.15.37:0/672363811 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f645806c920 msgr2=0x7f645806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:59.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:59.889+0000 7f647bda4640 1 --2- 172.21.15.37:0/672363811 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f645806c920 0x7f645806ede0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f6470000f60 tx=0x7f6470009040 comp rx=0 tx=0).stop 2024-04-22T07:22:59.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:59.889+0000 7f647bda4640 1 -- 172.21.15.37:0/672363811 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6474154f60 msgr2=0x7f64740cb260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:59.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:59.889+0000 7f647bda4640 1 --2- 172.21.15.37:0/672363811 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6474154f60 0x7f64740cb260 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f646c00cb40 tx=0x7f646c00a060 comp rx=0 tx=0).stop 2024-04-22T07:22:59.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:59.889+0000 7f647bda4640 1 -- 172.21.15.37:0/672363811 shutdown_connections 2024-04-22T07:22:59.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:59.889+0000 7f647bda4640 1 --2- 172.21.15.37:0/672363811 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f645806c920 0x7f645806ede0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:59.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:59.889+0000 7f647bda4640 1 --2- 172.21.15.37:0/672363811 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6474154f60 0x7f64740cb260 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:59.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:59.889+0000 7f647bda4640 1 --2- 172.21.15.37:0/672363811 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6474070ee0 0x7f64741422d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:59.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:59.889+0000 7f647bda4640 1 --2- 172.21.15.37:0/672363811 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f647406beb0 0x7f64740c6980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:59.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:59.889+0000 7f647bda4640 1 -- 172.21.15.37:0/672363811 >> 172.21.15.37:0/672363811 conn(0x7f64740c9f60 msgr2=0x7f647406c300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:22:59.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:59.889+0000 7f647bda4640 1 -- 172.21.15.37:0/672363811 shutdown_connections 2024-04-22T07:22:59.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:22:59.889+0000 7f647bda4640 1 -- 172.21.15.37:0/672363811 wait complete. 2024-04-22T07:22:59.904 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-22T07:23:00.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:23:00.014+0000 7f9530243640 1 Processor -- start 2024-04-22T07:23:00.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:23:00.015+0000 7f9530243640 1 -- start start 2024-04-22T07:23:00.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:23:00.015+0000 7f9530243640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f95281552c0 0x7f95280c5fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:23:00.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:23:00.015+0000 7f9530243640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f95280cdd60 0x7f952815b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:23:00.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:23:00.015+0000 7f9530243640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95280c6990 con 0x7f95280cb010 2024-04-22T07:23:00.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:23:00.015+0000 7f9530243640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f95281556a0 con 0x7f95281552c0 2024-04-22T07:23:00.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:23:00.015+0000 7f9530243640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f95280c66b0 con 0x7f95280cdd60 2024-04-22T07:23:00.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:23:00.015+0000 7f952dfdf640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f95281552c0 0x7f95280c5fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:23:00.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:23:00.016+0000 7f952dfdf640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f95281552c0 0x7f95280c5fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57458/0 (socket says 172.21.15.37:57458) 2024-04-22T07:23:00.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:23:00.016+0000 7f952dfdf640 1 -- 172.21.15.37:0/3590420383 learned_addr learned my addr 172.21.15.37:0/3590420383 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:23:00.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:23:00.016+0000 7f952d7de640 1 --1- 172.21.15.37:0/3590420383 >> v1:172.21.15.37:6789/0 conn(0x7f95280cb010 0x7f95280676b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:50140/0 (socket says 172.21.15.37:50140) 2024-04-22T07:23:00.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:23:00.016+0000 7f952e7e0640 1 --2- 172.21.15.37:0/3590420383 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f95280cdd60 0x7f952815b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:23:00.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:23:00.016+0000 7f952dfdf640 1 -- 172.21.15.37:0/3590420383 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f95280cdd60 msgr2=0x7f952815b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:23:00.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:23:00.016+0000 7f952dfdf640 1 --2- 172.21.15.37:0/3590420383 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f95280cdd60 0x7f952815b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:23:00.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:23:00.016+0000 7f952dfdf640 1 -- 172.21.15.37:0/3590420383 >> v1:172.21.15.37:6789/0 conn(0x7f95280cb010 legacy=0x7f95280676b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:23:00.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:23:00.016+0000 7f952dfdf640 1 -- 172.21.15.37:0/3590420383 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95280cc560 con 0x7f95281552c0 2024-04-22T07:23:00.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:23:00.017+0000 7f952dfdf640 1 --2- 172.21.15.37:0/3590420383 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95281552c0 0x7f95280c5fe0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f9524009870 tx=0x7f952402b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=362fa65c8be8271e server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:23:00.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:23:00.017+0000 7f952cfdd640 1 -- 172.21.15.37:0/3590420383 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9524034070 con 0x7f95281552c0 2024-04-22T07:23:00.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:23:00.017+0000 7f952cfdd640 1 -- 172.21.15.37:0/3590420383 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f9524030840 con 0x7f95281552c0 2024-04-22T07:23:00.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:23:00.017+0000 7f952cfdd640 1 -- 172.21.15.37:0/3590420383 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9524030c30 con 0x7f95281552c0 2024-04-22T07:23:00.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:23:00.017+0000 7f9530243640 1 -- 172.21.15.37:0/3590420383 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95281552c0 msgr2=0x7f95280c5fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:23:00.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:23:00.017+0000 7f9530243640 1 --2- 172.21.15.37:0/3590420383 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95281552c0 0x7f95280c5fe0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f9524009870 tx=0x7f952402b980 comp rx=0 tx=0).stop 2024-04-22T07:23:00.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:23:00.017+0000 7f9530243640 1 -- 172.21.15.37:0/3590420383 shutdown_connections 2024-04-22T07:23:00.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:23:00.017+0000 7f9530243640 1 --2- 172.21.15.37:0/3590420383 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f95280cdd60 0x7f952815b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:23:00.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:23:00.017+0000 7f9530243640 1 --2- 172.21.15.37:0/3590420383 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95281552c0 0x7f95280c5fe0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:23:00.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:23:00.017+0000 7f9530243640 1 -- 172.21.15.37:0/3590420383 >> 172.21.15.37:0/3590420383 conn(0x7f952806d330 msgr2=0x7f952806c290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:23:00.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:23:00.018+0000 7f9530243640 1 -- 172.21.15.37:0/3590420383 shutdown_connections 2024-04-22T07:23:00.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:23:00.018+0000 7f9530243640 1 -- 172.21.15.37:0/3590420383 wait complete. 2024-04-22T07:23:00.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:23:00.019+0000 7f9530243640 1 Processor -- start 2024-04-22T07:23:00.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:23:00.019+0000 7f9530243640 1 -- start start 2024-04-22T07:23:00.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:23:00.019+0000 7f9530243640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f95280cb010 0x7f9528145220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:23:00.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:23:00.019+0000 7f9530243640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f95280cdd60 0x7f95280cf570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:23:00.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:23:00.019+0000 7f9530243640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95281552c0 0x7f95280b4790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:23:00.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:23:00.019+0000 7f9530243640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f95280cce00 con 0x7f95281552c0 2024-04-22T07:23:00.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:23:00.019+0000 7f9530243640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f95280ccb20 con 0x7f95280cb010 2024-04-22T07:23:00.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:23:00.019+0000 7f9530243640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f9528067dc0 con 0x7f95280cdd60 2024-04-22T07:23:00.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:23:00.020+0000 7f952e7e0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95281552c0 0x7f95280b4790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:23:00.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:23:00.020+0000 7f952e7e0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95281552c0 0x7f95280b4790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57474/0 (socket says 172.21.15.37:57474) 2024-04-22T07:23:00.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:23:00.020+0000 7f952e7e0640 1 -- 172.21.15.37:0/574424010 learned_addr learned my addr 172.21.15.37:0/574424010 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:23:00.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:23:00.020+0000 7f952d7de640 1 --2- 172.21.15.37:0/574424010 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f95280cdd60 0x7f95280cf570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:23:00.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:23:00.020+0000 7f952dfdf640 1 --2- 172.21.15.37:0/574424010 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f95280cb010 0x7f9528145220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:23:00.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:23:00.020+0000 7f952e7e0640 1 -- 172.21.15.37:0/574424010 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f95280cdd60 msgr2=0x7f95280cf570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:23:00.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:23:00.020+0000 7f952e7e0640 1 --2- 172.21.15.37:0/574424010 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f95280cdd60 0x7f95280cf570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:23:00.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:23:00.020+0000 7f952e7e0640 1 -- 172.21.15.37:0/574424010 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f95280cb010 msgr2=0x7f9528145220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:23:00.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:23:00.020+0000 7f952e7e0640 1 --2- 172.21.15.37:0/574424010 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f95280cb010 0x7f9528145220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:23:00.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:23:00.020+0000 7f952e7e0640 1 -- 172.21.15.37:0/574424010 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9528146060 con 0x7f95281552c0 2024-04-22T07:23:00.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:23:00.020+0000 7f952dfdf640 1 --2- 172.21.15.37:0/574424010 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f95280cb010 0x7f9528145220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T07:23:00.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:23:00.020+0000 7f952e7e0640 1 --2- 172.21.15.37:0/574424010 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95281552c0 0x7f95280b4790 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f9520007e90 tx=0x7f952000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:23:00.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:23:00.020+0000 7f951e7fc640 1 -- 172.21.15.37:0/574424010 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9520014420 con 0x7f95281552c0 2024-04-22T07:23:00.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:23:00.020+0000 7f951e7fc640 1 -- 172.21.15.37:0/574424010 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f9520019070 con 0x7f95281552c0 2024-04-22T07:23:00.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:23:00.020+0000 7f9530243640 1 -- 172.21.15.37:0/574424010 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95280d0d00 con 0x7f95281552c0 2024-04-22T07:23:00.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:23:00.020+0000 7f951e7fc640 1 -- 172.21.15.37:0/574424010 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9520014820 con 0x7f95281552c0 2024-04-22T07:23:00.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:23:00.020+0000 7f9530243640 1 -- 172.21.15.37:0/574424010 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95280d12a0 con 0x7f95281552c0 2024-04-22T07:23:00.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:23:00.021+0000 7f9530243640 1 -- 172.21.15.37:0/574424010 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9528069cc0 con 0x7f95281552c0 2024-04-22T07:23:00.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:23:00.022+0000 7f951e7fc640 1 -- 172.21.15.37:0/574424010 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f95200149c0 con 0x7f95281552c0 2024-04-22T07:23:00.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:23:00.022+0000 7f951e7fc640 1 --2- 172.21.15.37:0/574424010 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f950c06c920 0x7f950c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:23:00.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:23:00.022+0000 7f951e7fc640 1 -- 172.21.15.37:0/574424010 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5911+0+0 (secure 0 0 0) 0x7f952008c490 con 0x7f95281552c0 2024-04-22T07:23:00.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:23:00.023+0000 7f952dfdf640 1 --2- 172.21.15.37:0/574424010 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f950c06c920 0x7f950c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:23:00.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:23:00.023+0000 7f952dfdf640 1 --2- 172.21.15.37:0/574424010 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f950c06c920 0x7f950c06ede0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f9524036000 tx=0x7f952403b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:23:00.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:23:00.027+0000 7f951e7fc640 1 -- 172.21.15.37:0/574424010 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f952005a760 con 0x7f95281552c0 2024-04-22T07:23:00.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:23:00.210+0000 7f9530243640 1 -- 172.21.15.37:0/574424010 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f9528158c90 con 0x7f95281552c0 2024-04-22T07:23:00.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:23:00.897+0000 7f951e7fc640 1 -- 172.21.15.37:0/574424010 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v24) ==== 181+0+0 (secure 0 0 0) 0x7f952005a060 con 0x7f95281552c0 2024-04-22T07:23:00.895 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_metadata' removed 2024-04-22T07:23:00.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:23:00.900+0000 7f9530243640 1 -- 172.21.15.37:0/574424010 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f950c06c920 msgr2=0x7f950c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:23:00.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:23:00.900+0000 7f9530243640 1 --2- 172.21.15.37:0/574424010 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f950c06c920 0x7f950c06ede0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f9524036000 tx=0x7f952403b040 comp rx=0 tx=0).stop 2024-04-22T07:23:00.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:23:00.900+0000 7f9530243640 1 -- 172.21.15.37:0/574424010 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95281552c0 msgr2=0x7f95280b4790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:23:00.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:23:00.900+0000 7f9530243640 1 --2- 172.21.15.37:0/574424010 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95281552c0 0x7f95280b4790 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f9520007e90 tx=0x7f952000e4b0 comp rx=0 tx=0).stop 2024-04-22T07:23:00.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:23:00.900+0000 7f9530243640 1 -- 172.21.15.37:0/574424010 shutdown_connections 2024-04-22T07:23:00.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:23:00.900+0000 7f9530243640 1 --2- 172.21.15.37:0/574424010 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f950c06c920 0x7f950c06ede0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:23:00.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:23:00.900+0000 7f9530243640 1 --2- 172.21.15.37:0/574424010 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95281552c0 0x7f95280b4790 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:23:00.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:23:00.900+0000 7f9530243640 1 --2- 172.21.15.37:0/574424010 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f95280cdd60 0x7f95280cf570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:23:00.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:23:00.900+0000 7f9530243640 1 --2- 172.21.15.37:0/574424010 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f95280cb010 0x7f9528145220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:23:00.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:23:00.900+0000 7f9530243640 1 -- 172.21.15.37:0/574424010 >> 172.21.15.37:0/574424010 conn(0x7f952806d330 msgr2=0x7f95281528e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:23:00.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:23:00.900+0000 7f9530243640 1 -- 172.21.15.37:0/574424010 shutdown_connections 2024-04-22T07:23:00.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:23:00.901+0000 7f9530243640 1 -- 172.21.15.37:0/574424010 wait complete. 2024-04-22T07:23:00.915 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-22T07:23:01.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:23:01.031+0000 7f3c04315640 1 Processor -- start 2024-04-22T07:23:01.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:23:01.031+0000 7f3c04315640 1 -- start start 2024-04-22T07:23:01.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:23:01.032+0000 7f3c04315640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f3bfc158590 0x7f3bfc06b970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:23:01.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:23:01.032+0000 7f3c04315640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3bfc06c380 0x7f3bfc06c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:23:01.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:23:01.032+0000 7f3c04315640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3bfc15b840 con 0x7f3bfc070420 2024-04-22T07:23:01.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:23:01.032+0000 7f3c04315640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f3bfc06ffc0 con 0x7f3bfc158590 2024-04-22T07:23:01.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:23:01.032+0000 7f3c04315640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f3bfc15bb00 con 0x7f3bfc06c380 2024-04-22T07:23:01.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:23:01.032+0000 7f3c018b0640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f3bfc070420 0x7f3bfc0c3ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:50154/0 (socket says 172.21.15.37:50154) 2024-04-22T07:23:01.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:23:01.032+0000 7f3c018b0640 1 -- 172.21.15.37:0/135689125 learned_addr learned my addr 172.21.15.37:0/135689125 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-04-22T07:23:01.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:23:01.032+0000 7f3c020b1640 1 --2- 172.21.15.37:0/135689125 >> v2:172.21.15.196:3300/0 conn(0x7f3bfc158590 0x7f3bfc06b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:23:01.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:23:01.032+0000 7f3c028b2640 1 --2- 172.21.15.37:0/135689125 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3bfc06c380 0x7f3bfc06c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:23:01.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:23:01.032+0000 7f3c010af640 1 -- 172.21.15.37:0/135689125 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2946385378 0 0) 0x7f3bfc15b840 con 0x7f3bfc070420 2024-04-22T07:23:01.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:23:01.032+0000 7f3c010af640 1 -- 172.21.15.37:0/135689125 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3be8003520 con 0x7f3bfc070420 2024-04-22T07:23:01.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:23:01.032+0000 7f3c010af640 1 -- 172.21.15.37:0/135689125 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3791584289 0 0) 0x7f3be8003520 con 0x7f3bfc070420 2024-04-22T07:23:01.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:23:01.032+0000 7f3c010af640 1 -- 172.21.15.37:0/135689125 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3bfc06c380 msgr2=0x7f3bfc06c7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:23:01.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:23:01.032+0000 7f3c010af640 1 --2- 172.21.15.37:0/135689125 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3bfc06c380 0x7f3bfc06c7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:23:01.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:23:01.032+0000 7f3c010af640 1 -- 172.21.15.37:0/135689125 >> v2:172.21.15.196:3300/0 conn(0x7f3bfc158590 msgr2=0x7f3bfc06b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:23:01.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:23:01.032+0000 7f3c010af640 1 --2- 172.21.15.37:0/135689125 >> v2:172.21.15.196:3300/0 conn(0x7f3bfc158590 0x7f3bfc06b970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:23:01.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:23:01.032+0000 7f3c010af640 1 -- 172.21.15.37:0/135689125 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bfc06f200 con 0x7f3bfc070420 2024-04-22T07:23:01.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:23:01.033+0000 7f3c010af640 1 -- 172.21.15.37:0/135689125 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2576656170 0 0) 0x7f3bec001670 con 0x7f3bfc070420 2024-04-22T07:23:01.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:23:01.033+0000 7f3c010af640 1 -- 172.21.15.37:0/135689125 >> v1:172.21.15.37:6789/0 conn(0x7f3bfc070420 legacy=0x7f3bfc0c3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:23:01.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:23:01.033+0000 7f3c010af640 1 --2- 172.21.15.37:0/135689125 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3be80039b0 0x7f3be8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:23:01.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:23:01.033+0000 7f3c010af640 1 --2- 172.21.15.37:0/135689125 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3be8004800 0x7f3be8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:23:01.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:23:01.033+0000 7f3c010af640 1 --2- 172.21.15.37:0/135689125 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3bfc06c380 0x7f3be80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:23:01.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:23:01.033+0000 7f3c010af640 1 -- 172.21.15.37:0/135689125 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3bfc06ffc0 con 0x7f3be80039b0 2024-04-22T07:23:01.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:23:01.033+0000 7f3c010af640 1 -- 172.21.15.37:0/135689125 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f3bfc15bb00 con 0x7f3be8004800 2024-04-22T07:23:01.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:23:01.033+0000 7f3c010af640 1 -- 172.21.15.37:0/135689125 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f3be800b9c0 con 0x7f3bfc06c380 2024-04-22T07:23:01.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:23:01.033+0000 7f3c020b1640 1 --2- 172.21.15.37:0/135689125 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3be80039b0 0x7f3be8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:23:01.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:23:01.033+0000 7f3c018b0640 1 --2- 172.21.15.37:0/135689125 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3be8004800 0x7f3be8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:23:01.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:23:01.033+0000 7f3c028b2640 1 --2- 172.21.15.37:0/135689125 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3bfc06c380 0x7f3be80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:23:01.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:23:01.033+0000 7f3c020b1640 1 -- 172.21.15.37:0/135689125 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3bfc06c380 msgr2=0x7f3be80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:23:01.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:23:01.033+0000 7f3c020b1640 1 --2- 172.21.15.37:0/135689125 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3bfc06c380 0x7f3be80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:23:01.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:23:01.033+0000 7f3c020b1640 1 -- 172.21.15.37:0/135689125 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3be8004800 msgr2=0x7f3be8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:23:01.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:23:01.033+0000 7f3c020b1640 1 --2- 172.21.15.37:0/135689125 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3be8004800 0x7f3be8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:23:01.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:23:01.033+0000 7f3c020b1640 1 -- 172.21.15.37:0/135689125 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3be8003520 con 0x7f3be80039b0 2024-04-22T07:23:01.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:23:01.034+0000 7f3c020b1640 1 --2- 172.21.15.37:0/135689125 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3be80039b0 0x7f3be8003dd0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f3bf8009ac0 tx=0x7f3be8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7aa11705e15a7fc4 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:23:01.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:23:01.034+0000 7f3c010af640 1 -- 172.21.15.37:0/135689125 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bf8039070 con 0x7f3be80039b0 2024-04-22T07:23:01.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:23:01.034+0000 7f3c010af640 1 -- 172.21.15.37:0/135689125 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f3bf802c710 con 0x7f3be80039b0 2024-04-22T07:23:01.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:23:01.034+0000 7f3c010af640 1 -- 172.21.15.37:0/135689125 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bf8009690 con 0x7f3be80039b0 2024-04-22T07:23:01.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:23:01.034+0000 7f3c04315640 1 -- 172.21.15.37:0/135689125 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3be80039b0 msgr2=0x7f3be8003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:23:01.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:23:01.034+0000 7f3c04315640 1 --2- 172.21.15.37:0/135689125 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3be80039b0 0x7f3be8003dd0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f3bf8009ac0 tx=0x7f3be8005830 comp rx=0 tx=0).stop 2024-04-22T07:23:01.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:23:01.034+0000 7f3c028b2640 1 -- 172.21.15.37:0/135689125 reap_dead start 2024-04-22T07:23:01.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:23:01.035+0000 7f3c04315640 1 -- 172.21.15.37:0/135689125 shutdown_connections 2024-04-22T07:23:01.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:23:01.035+0000 7f3c04315640 1 -- 172.21.15.37:0/135689125 >> 172.21.15.37:0/135689125 conn(0x7f3bfc071580 msgr2=0x7f3bfc071960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:23:01.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:23:01.035+0000 7f3c04315640 1 -- 172.21.15.37:0/135689125 shutdown_connections 2024-04-22T07:23:01.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:23:01.035+0000 7f3c04315640 1 -- 172.21.15.37:0/135689125 wait complete. 2024-04-22T07:23:01.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:23:01.036+0000 7f3c04315640 1 Processor -- start 2024-04-22T07:23:01.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:23:01.036+0000 7f3c04315640 1 -- start start 2024-04-22T07:23:01.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:23:01.036+0000 7f3c04315640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3be80039b0 0x7f3bfc1f0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:23:01.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:23:01.037+0000 7f3c04315640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3bfc150760 0x7f3bfc0cb220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:23:01.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:23:01.037+0000 7f3c04315640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3bfc151fa0 0x7f3bfc0cdde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:23:01.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:23:01.037+0000 7f3c04315640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3bfc06faa0 con 0x7f3bfc151fa0 2024-04-22T07:23:01.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:23:01.037+0000 7f3c04315640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f3bfc06f7c0 con 0x7f3be80039b0 2024-04-22T07:23:01.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:23:01.037+0000 7f3c04315640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f3bfc0c45b0 con 0x7f3bfc150760 2024-04-22T07:23:01.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:23:01.037+0000 7f3c028b2640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3bfc151fa0 0x7f3bfc0cdde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:23:01.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:23:01.037+0000 7f3c028b2640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3bfc151fa0 0x7f3bfc0cdde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57504/0 (socket says 172.21.15.37:57504) 2024-04-22T07:23:01.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:23:01.037+0000 7f3c028b2640 1 -- 172.21.15.37:0/1508239173 learned_addr learned my addr 172.21.15.37:0/1508239173 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-22T07:23:01.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:23:01.037+0000 7f3c020b1640 1 --2- 172.21.15.37:0/1508239173 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3be80039b0 0x7f3bfc1f0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:23:01.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:23:01.037+0000 7f3c018b0640 1 --2- 172.21.15.37:0/1508239173 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3bfc150760 0x7f3bfc0cb220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:23:01.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:23:01.037+0000 7f3c028b2640 1 -- 172.21.15.37:0/1508239173 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3bfc150760 msgr2=0x7f3bfc0cb220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:23:01.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:23:01.037+0000 7f3c028b2640 1 --2- 172.21.15.37:0/1508239173 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3bfc150760 0x7f3bfc0cb220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:23:01.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:23:01.037+0000 7f3c028b2640 1 -- 172.21.15.37:0/1508239173 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3be80039b0 msgr2=0x7f3bfc1f0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:23:01.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:23:01.037+0000 7f3c028b2640 1 --2- 172.21.15.37:0/1508239173 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3be80039b0 0x7f3bfc1f0bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:23:01.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:23:01.037+0000 7f3c028b2640 1 -- 172.21.15.37:0/1508239173 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bfc0cd620 con 0x7f3bfc151fa0 2024-04-22T07:23:01.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:23:01.037+0000 7f3c028b2640 1 --2- 172.21.15.37:0/1508239173 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3bfc151fa0 0x7f3bfc0cdde0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f3bfc073570 tx=0x7f3bf400f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:23:01.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:23:01.037+0000 7f3bf2ffd640 1 -- 172.21.15.37:0/1508239173 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bf400fdb0 con 0x7f3bfc151fa0 2024-04-22T07:23:01.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:23:01.037+0000 7f3bf2ffd640 1 -- 172.21.15.37:0/1508239173 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f3bf401d070 con 0x7f3bfc151fa0 2024-04-22T07:23:01.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:23:01.037+0000 7f3bf2ffd640 1 -- 172.21.15.37:0/1508239173 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bf4015690 con 0x7f3bfc151fa0 2024-04-22T07:23:01.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:23:01.037+0000 7f3c04315640 1 -- 172.21.15.37:0/1508239173 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3bfc1f1200 con 0x7f3bfc151fa0 2024-04-22T07:23:01.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:23:01.037+0000 7f3c04315640 1 -- 172.21.15.37:0/1508239173 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3bfc1f17c0 con 0x7f3bfc151fa0 2024-04-22T07:23:01.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:23:01.038+0000 7f3c04315640 1 -- 172.21.15.37:0/1508239173 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3bfc069cc0 con 0x7f3bfc151fa0 2024-04-22T07:23:01.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:23:01.039+0000 7f3bf2ffd640 1 -- 172.21.15.37:0/1508239173 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3bf4015830 con 0x7f3bfc151fa0 2024-04-22T07:23:01.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:23:01.039+0000 7f3bf2ffd640 1 --2- 172.21.15.37:0/1508239173 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f3be006c8f0 0x7f3be006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:23:01.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:23:01.039+0000 7f3bf2ffd640 1 -- 172.21.15.37:0/1508239173 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5473+0+0 (secure 0 0 0) 0x7f3bf408c2f0 con 0x7f3bfc151fa0 2024-04-22T07:23:01.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:23:01.039+0000 7f3c020b1640 1 --2- 172.21.15.37:0/1508239173 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f3be006c8f0 0x7f3be006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:23:01.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:23:01.040+0000 7f3c020b1640 1 --2- 172.21.15.37:0/1508239173 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f3be006c8f0 0x7f3be006edb0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f3bf8036000 tx=0x7f3bf8030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:23:01.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:23:01.043+0000 7f3bf2ffd640 1 -- 172.21.15.37:0/1508239173 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f3bf4010040 con 0x7f3bfc151fa0 2024-04-22T07:23:01.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:23:01.229+0000 7f3c04315640 1 -- 172.21.15.37:0/1508239173 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f3bfc0c5730 con 0x7f3bfc151fa0 2024-04-22T07:23:01.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:23:01.898+0000 7f3bf2ffd640 1 -- 172.21.15.37:0/1508239173 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v25) ==== 169+0+0 (secure 0 0 0) 0x7f3bf405a120 con 0x7f3bfc151fa0 2024-04-22T07:23:01.896 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_data' removed 2024-04-22T07:23:01.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:23:01.902+0000 7f3c04315640 1 -- 172.21.15.37:0/1508239173 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f3be006c8f0 msgr2=0x7f3be006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:23:01.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:23:01.902+0000 7f3c04315640 1 --2- 172.21.15.37:0/1508239173 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f3be006c8f0 0x7f3be006edb0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f3bf8036000 tx=0x7f3bf8030000 comp rx=0 tx=0).stop 2024-04-22T07:23:01.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:23:01.902+0000 7f3c04315640 1 -- 172.21.15.37:0/1508239173 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3bfc151fa0 msgr2=0x7f3bfc0cdde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:23:01.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:23:01.902+0000 7f3c04315640 1 --2- 172.21.15.37:0/1508239173 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3bfc151fa0 0x7f3bfc0cdde0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f3bfc073570 tx=0x7f3bf400f580 comp rx=0 tx=0).stop 2024-04-22T07:23:01.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:23:01.903+0000 7f3c04315640 1 -- 172.21.15.37:0/1508239173 shutdown_connections 2024-04-22T07:23:01.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:23:01.903+0000 7f3c04315640 1 --2- 172.21.15.37:0/1508239173 >> [v2:172.21.15.196:6832/321987173,v1:172.21.15.196:6833/321987173] conn(0x7f3be006c8f0 0x7f3be006edb0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:23:01.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:23:01.903+0000 7f3c04315640 1 --2- 172.21.15.37:0/1508239173 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3bfc151fa0 0x7f3bfc0cdde0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:23:01.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:23:01.903+0000 7f3c04315640 1 --2- 172.21.15.37:0/1508239173 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3bfc150760 0x7f3bfc0cb220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:23:01.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:23:01.903+0000 7f3c04315640 1 --2- 172.21.15.37:0/1508239173 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3be80039b0 0x7f3bfc1f0bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:23:01.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:23:01.903+0000 7f3c04315640 1 -- 172.21.15.37:0/1508239173 >> 172.21.15.37:0/1508239173 conn(0x7f3bfc071580 msgr2=0x7f3bfc155120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:23:01.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:23:01.903+0000 7f3c04315640 1 -- 172.21.15.37:0/1508239173 shutdown_connections 2024-04-22T07:23:01.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-22T07:23:01.903+0000 7f3c04315640 1 -- 172.21.15.37:0/1508239173 wait complete. 2024-04-22T07:23:01.919 INFO:teuthology.misc:Shutting down mds daemons... 2024-04-22T07:23:01.919 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-22T07:23:01.919 INFO:teuthology.orchestra.run:waiting for 300 2024-04-22T07:23:01.929 INFO:tasks.ceph.mds.a:Stopped 2024-04-22T07:23:01.930 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-22T07:23:01.930 INFO:teuthology.orchestra.run:waiting for 300 2024-04-22T07:23:01.979 INFO:tasks.ceph.mds.c:Stopped 2024-04-22T07:23:01.980 DEBUG:tasks.ceph.mds.e:waiting for process to exit 2024-04-22T07:23:01.980 INFO:teuthology.orchestra.run:waiting for 300 2024-04-22T07:23:02.029 INFO:tasks.ceph.mds.e:Stopped 2024-04-22T07:23:02.030 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-22T07:23:02.030 INFO:teuthology.orchestra.run:waiting for 300 2024-04-22T07:23:02.040 INFO:tasks.ceph.mds.b:Stopped 2024-04-22T07:23:02.040 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-22T07:23:02.041 INFO:teuthology.orchestra.run:waiting for 300 2024-04-22T07:23:02.091 INFO:tasks.ceph.mds.d:Stopped 2024-04-22T07:23:02.091 DEBUG:tasks.ceph.mds.f:waiting for process to exit 2024-04-22T07:23:02.091 INFO:teuthology.orchestra.run:waiting for 300 2024-04-22T07:23:02.141 INFO:tasks.ceph.mds.f:Stopped 2024-04-22T07:23:02.142 INFO:teuthology.misc:Shutting down osd daemons... 2024-04-22T07:23:02.142 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-04-22T07:23:02.142 INFO:teuthology.orchestra.run:waiting for 300 2024-04-22T07:23:02.173 INFO:tasks.ceph.osd.0:Stopped 2024-04-22T07:23:02.173 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-04-22T07:23:02.173 INFO:teuthology.orchestra.run:waiting for 300 2024-04-22T07:23:02.241 INFO:tasks.ceph.osd.1:Stopped 2024-04-22T07:23:02.241 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-04-22T07:23:02.241 INFO:teuthology.orchestra.run:waiting for 300 2024-04-22T07:23:02.313 INFO:tasks.ceph.osd.2:Stopped 2024-04-22T07:23:02.313 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-04-22T07:23:02.313 INFO:teuthology.orchestra.run:waiting for 300 2024-04-22T07:23:02.384 INFO:tasks.ceph.osd.3:Stopped 2024-04-22T07:23:02.384 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-04-22T07:23:02.384 INFO:teuthology.orchestra.run:waiting for 300 2024-04-22T07:23:02.421 INFO:tasks.ceph.osd.4:Stopped 2024-04-22T07:23:02.421 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-04-22T07:23:02.421 INFO:teuthology.orchestra.run:waiting for 300 2024-04-22T07:23:02.489 INFO:tasks.ceph.osd.5:Stopped 2024-04-22T07:23:02.490 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-04-22T07:23:02.490 INFO:teuthology.orchestra.run:waiting for 300 2024-04-22T07:23:02.564 INFO:tasks.ceph.osd.6:Stopped 2024-04-22T07:23:02.564 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-04-22T07:23:02.564 INFO:teuthology.orchestra.run:waiting for 300 2024-04-22T07:23:02.640 INFO:tasks.ceph.osd.7:Stopped 2024-04-22T07:23:02.641 INFO:teuthology.misc:Shutting down mgr daemons... 2024-04-22T07:23:02.641 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-04-22T07:23:02.641 INFO:teuthology.orchestra.run:waiting for 300 2024-04-22T07:23:02.667 INFO:tasks.ceph.mgr.y:Stopped 2024-04-22T07:23:02.667 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-04-22T07:23:02.668 INFO:teuthology.orchestra.run:waiting for 300 2024-04-22T07:23:02.708 INFO:tasks.ceph.mgr.x:Stopped 2024-04-22T07:23:02.708 INFO:teuthology.misc:Shutting down mon daemons... 2024-04-22T07:23:02.709 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-04-22T07:23:02.709 INFO:teuthology.orchestra.run:waiting for 300 2024-04-22T07:23:02.720 INFO:tasks.ceph.mon.a:Stopped 2024-04-22T07:23:02.721 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-04-22T07:23:02.721 INFO:teuthology.orchestra.run:waiting for 300 2024-04-22T07:23:02.760 INFO:tasks.ceph.mon.b:Stopped 2024-04-22T07:23:02.761 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-04-22T07:23:02.761 INFO:teuthology.orchestra.run:waiting for 300 2024-04-22T07:23:02.813 INFO:tasks.ceph.mon.c:Stopped 2024-04-22T07:23:02.813 INFO:tasks.ceph:Checking cluster log for badness... 2024-04-22T07:23:02.813 DEBUG:teuthology.orchestra.run.smithi037:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'overall HEALTH_' | egrep -v '\(OSDMAP_FLAGS\)' | egrep -v '\(OSD_' | egrep -v '\(PG_' | egrep -v '\(POOL_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(OBJECT_' | egrep -v '\(SLOW_OPS\)' | egrep -v '\(REQUEST_SLOW\)' | egrep -v '\(TOO_FEW_PGS\)' | egrep -v 'slow request' | egrep -v 'timeout on replica' | egrep -v 'late reservation from' | egrep -v MON_DOWN | egrep -v OSDMAP_FLAGS | egrep -v OSD_DOWN | egrep -v PG_DEGRADED | egrep -v PG_AVAILABILITY | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'mons down' | egrep -v 'mon down' | egrep -v 'out of quorum' | head -n 1 2024-04-22T07:23:02.862 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi037.front.sepia.ceph.com 2024-04-22T07:23:02.862 DEBUG:teuthology.orchestra.run.smithi037:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-04-22T07:23:03.080 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi037.front.sepia.ceph.com 2024-04-22T07:23:03.080 DEBUG:teuthology.orchestra.run.smithi037:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-04-22T07:23:03.152 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi037.front.sepia.ceph.com 2024-04-22T07:23:03.153 DEBUG:teuthology.orchestra.run.smithi037:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-04-22T07:23:03.209 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi037.front.sepia.ceph.com 2024-04-22T07:23:03.210 DEBUG:teuthology.orchestra.run.smithi037:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-04-22T07:23:03.278 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi196.front.sepia.ceph.com 2024-04-22T07:23:03.278 DEBUG:teuthology.orchestra.run.smithi196:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-04-22T07:23:03.477 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi196.front.sepia.ceph.com 2024-04-22T07:23:03.477 DEBUG:teuthology.orchestra.run.smithi196:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-04-22T07:23:03.563 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi196.front.sepia.ceph.com 2024-04-22T07:23:03.563 DEBUG:teuthology.orchestra.run.smithi196:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-04-22T07:23:03.613 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi196.front.sepia.ceph.com 2024-04-22T07:23:03.613 DEBUG:teuthology.orchestra.run.smithi196:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-04-22T07:23:03.670 INFO:tasks.ceph:Archiving mon data... 2024-04-22T07:23:03.671 DEBUG:teuthology.misc:Transferring archived files from smithi037:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/leonidus-2024-04-22_05:52:53-fs-wip-lusov-quiescer-distro-default-smithi/7668166/data/mon.a.tgz 2024-04-22T07:23:03.671 DEBUG:teuthology.orchestra.run.smithi037:> mktemp 2024-04-22T07:23:03.689 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/tmp.deP1AU4p5h 2024-04-22T07:23:03.689 DEBUG:teuthology.orchestra.run.smithi037:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.deP1AU4p5h 2024-04-22T07:23:03.820 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 0666 /tmp/tmp.deP1AU4p5h 2024-04-22T07:23:03.905 DEBUG:teuthology.orchestra.remote:smithi037:/tmp/tmp.deP1AU4p5h is 290KB 2024-04-22T07:23:04.001 DEBUG:teuthology.orchestra.run.smithi037:> rm -fr /tmp/tmp.deP1AU4p5h 2024-04-22T07:23:04.016 DEBUG:teuthology.misc:Transferring archived files from smithi196:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/leonidus-2024-04-22_05:52:53-fs-wip-lusov-quiescer-distro-default-smithi/7668166/data/mon.b.tgz 2024-04-22T07:23:04.017 DEBUG:teuthology.orchestra.run.smithi196:> mktemp 2024-04-22T07:23:04.034 INFO:teuthology.orchestra.run.smithi196.stdout:/tmp/tmp.r5Vyb8LVvV 2024-04-22T07:23:04.034 DEBUG:teuthology.orchestra.run.smithi196:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.r5Vyb8LVvV 2024-04-22T07:23:04.190 DEBUG:teuthology.orchestra.run.smithi196:> sudo chmod 0666 /tmp/tmp.r5Vyb8LVvV 2024-04-22T07:23:04.275 DEBUG:teuthology.orchestra.remote:smithi196:/tmp/tmp.r5Vyb8LVvV is 391KB 2024-04-22T07:23:04.370 DEBUG:teuthology.orchestra.run.smithi196:> rm -fr /tmp/tmp.r5Vyb8LVvV 2024-04-22T07:23:04.385 DEBUG:teuthology.misc:Transferring archived files from smithi196:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/leonidus-2024-04-22_05:52:53-fs-wip-lusov-quiescer-distro-default-smithi/7668166/data/mon.c.tgz 2024-04-22T07:23:04.385 DEBUG:teuthology.orchestra.run.smithi196:> mktemp 2024-04-22T07:23:04.439 INFO:teuthology.orchestra.run.smithi196.stdout:/tmp/tmp.8cUjAEunbN 2024-04-22T07:23:04.439 DEBUG:teuthology.orchestra.run.smithi196:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.8cUjAEunbN 2024-04-22T07:23:04.575 DEBUG:teuthology.orchestra.run.smithi196:> sudo chmod 0666 /tmp/tmp.8cUjAEunbN 2024-04-22T07:23:04.656 DEBUG:teuthology.orchestra.remote:smithi196:/tmp/tmp.8cUjAEunbN is 391KB 2024-04-22T07:23:04.752 DEBUG:teuthology.orchestra.run.smithi196:> rm -fr /tmp/tmp.8cUjAEunbN 2024-04-22T07:23:04.766 INFO:tasks.ceph:Cleaning ceph cluster... 2024-04-22T07:23:04.766 DEBUG:teuthology.orchestra.run.smithi037:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-22T07:23:04.769 DEBUG:teuthology.orchestra.run.smithi196:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-22T07:23:04.853 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-22T07:23:04.883 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-22T07:23:04.883 INFO:tasks.ceph:Archiving crash dumps... 2024-04-22T07:23:04.884 DEBUG:teuthology.misc:Transferring archived files from smithi037:/var/lib/ceph/crash to /home/teuthworker/archive/leonidus-2024-04-22_05:52:53-fs-wip-lusov-quiescer-distro-default-smithi/7668166/remote/smithi037/crash 2024-04-22T07:23:04.885 DEBUG:teuthology.orchestra.run.smithi037:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-22T07:23:04.920 DEBUG:teuthology.misc:Transferring archived files from smithi196:/var/lib/ceph/crash to /home/teuthworker/archive/leonidus-2024-04-22_05:52:53-fs-wip-lusov-quiescer-distro-default-smithi/7668166/remote/smithi196/crash 2024-04-22T07:23:04.921 DEBUG:teuthology.orchestra.run.smithi196:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-22T07:23:04.945 INFO:tasks.ceph:Shutting down logrotate 2024-04-22T07:23:04.946 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-22T07:23:04.965 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-22T07:23:05.033 DEBUG:teuthology.orchestra.run.smithi037:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-04-22T07:23:05.059 DEBUG:teuthology.orchestra.run.smithi196:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-04-22T07:23:05.082 INFO:tasks.ceph:Compressing logs... 2024-04-22T07:23:05.082 DEBUG:teuthology.orchestra.run.smithi037:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-22T07:23:05.102 DEBUG:teuthology.orchestra.run.smithi196:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-22T07:23:05.124 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46060.log 2024-04-22T07:23:05.124 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39591.log 2024-04-22T07:23:05.167 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-22T07:23:05.168 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.f.log 2024-04-22T07:23:05.168 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-22T07:23:05.168 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-mds.f.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-04-22T07:23:05.168 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-04-22T07:23:05.168 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-04-22T07:23:05.168 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-osd.7.log: /var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-04-22T07:23:05.168 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-osd.5.log: gzip 92.1% -5 --verbose -- /var/log/ceph/ceph-client.admin.33283.log 2024-04-22T07:23:05.168 INFO:teuthology.orchestra.run.smithi196.stderr: -- replaced with /var/log/ceph/ceph.log.gz 2024-04-22T07:23:05.168 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-osd.4.log: 93.9% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-22T07:23:05.168 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33112.log 2024-04-22T07:23:05.168 INFO:teuthology.orchestra.run.smithi196.stderr:gzip 92.8% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-04-22T07:23:05.168 INFO:teuthology.orchestra.run.smithi196.stderr: -5/var/log/ceph/ceph-client.admin.33283.log: --verbose -- /var/log/ceph/ceph-client.admin.33323.log 2024-04-22T07:23:05.169 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.33112.log: gzip -5 --verbose 89.0% -- replaced with /var/log/ceph/ceph-client.admin.33283.log.gz 2024-04-22T07:23:05.169 INFO:teuthology.orchestra.run.smithi196.stderr: -- /var/log/ceph/ceph-client.admin.33192.log 2024-04-22T07:23:05.169 INFO:teuthology.orchestra.run.smithi196.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.33112.log.gz/var/log/ceph/ceph-client.admin.33323.log: 2024-04-22T07:23:05.169 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-04-22T07:23:05.169 INFO:teuthology.orchestra.run.smithi196.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.33323.log.gz 2024-04-22T07:23:05.169 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.33192.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-04-22T07:23:05.169 INFO:teuthology.orchestra.run.smithi196.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.33192.log.gz 2024-04-22T07:23:05.169 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-04-22T07:23:05.169 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33403.log 2024-04-22T07:23:05.169 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33363.log 2024-04-22T07:23:05.169 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.33403.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.33403.log.gz 2024-04-22T07:23:05.169 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33236.log 2024-04-22T07:23:05.169 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.33363.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.33363.log.gz 2024-04-22T07:23:05.169 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-04-22T07:23:05.169 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.33236.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.33236.log.gz 2024-04-22T07:23:05.170 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-04-22T07:23:05.170 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-mds.d.log: 92.8% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-04-22T07:23:05.170 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33152.log 2024-04-22T07:23:05.172 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-mon.b.log: /var/log/ceph/ceph-client.admin.33152.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.33152.log.gz 2024-04-22T07:23:05.207 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.46060.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42320.log 2024-04-22T07:23:05.207 INFO:teuthology.orchestra.run.smithi037.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46060.log.gz 2024-04-22T07:23:05.207 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.39591.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42488.log 2024-04-22T07:23:05.207 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.42320.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44994.log 2024-04-22T07:23:05.207 INFO:teuthology.orchestra.run.smithi037.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.39591.log.gz 2024-04-22T07:23:05.207 INFO:teuthology.orchestra.run.smithi037.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42320.log.gz 2024-04-22T07:23:05.207 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.42488.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39275.log 2024-04-22T07:23:05.207 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.44994.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42488.log.gz 2024-04-22T07:23:05.207 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39717.log 2024-04-22T07:23:05.208 INFO:teuthology.orchestra.run.smithi037.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44994.log.gz 2024-04-22T07:23:05.208 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.39275.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38893.log 2024-04-22T07:23:05.208 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.39717.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40230.log 2024-04-22T07:23:05.208 INFO:teuthology.orchestra.run.smithi037.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.39275.log.gz 2024-04-22T07:23:05.208 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.38893.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33172.log 2024-04-22T07:23:05.208 INFO:teuthology.orchestra.run.smithi037.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.39717.log.gz 2024-04-22T07:23:05.208 INFO:teuthology.orchestra.run.smithi037.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.38893.log.gz 2024-04-22T07:23:05.208 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.40230.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39359.log 2024-04-22T07:23:05.208 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.33172.log: gzip 88.6% -5 -- replaced with /var/log/ceph/ceph-client.admin.40230.log.gz 2024-04-22T07:23:05.208 INFO:teuthology.orchestra.run.smithi037.stderr: --verbose -- /var/log/ceph/ceph-client.admin.39231.log 2024-04-22T07:23:05.208 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.39359.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39401.log 2024-04-22T07:23:05.208 INFO:teuthology.orchestra.run.smithi037.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.33172.log.gz 2024-04-22T07:23:05.208 INFO:teuthology.orchestra.run.smithi037.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.39359.log.gz 2024-04-22T07:23:05.209 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.39231.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44603.log 2024-04-22T07:23:05.209 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.39401.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.39231.log.gz 2024-04-22T07:23:05.209 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45892.log 2024-04-22T07:23:05.209 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.44603.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.39401.log.gz 2024-04-22T07:23:05.209 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45708.log 2024-04-22T07:23:05.209 INFO:teuthology.orchestra.run.smithi037.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44603.log.gz 2024-04-22T07:23:05.209 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.45892.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43902.log 2024-04-22T07:23:05.209 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.45708.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45078.log 2024-04-22T07:23:05.209 INFO:teuthology.orchestra.run.smithi037.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45892.log.gz 2024-04-22T07:23:05.209 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.43902.log: gzip 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45708.log.gz -5 2024-04-22T07:23:05.210 INFO:teuthology.orchestra.run.smithi037.stderr: --verbose -- /var/log/ceph/ceph-client.admin.40228.log 2024-04-22T07:23:05.210 INFO:teuthology.orchestra.run.smithi037.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43902.log.gz 2024-04-22T07:23:05.210 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.45078.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-22T07:23:05.210 INFO:teuthology.orchestra.run.smithi037.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45078.log.gz/var/log/ceph/ceph-client.admin.40228.log: 2024-04-22T07:23:05.210 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39885.log 2024-04-22T07:23:05.210 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- 88.1% /var/log/ceph/ceph-client.admin.40571.log 2024-04-22T07:23:05.210 INFO:teuthology.orchestra.run.smithi037.stderr: -- replaced with /var/log/ceph/ceph-client.admin.40228.log.gz 2024-04-22T07:23:05.210 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.39885.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-04-22T07:23:05.210 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.40571.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.39885.log.gz 2024-04-22T07:23:05.210 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41187.log 2024-04-22T07:23:05.210 INFO:teuthology.orchestra.run.smithi037.stderr: 85.7% -- replaced with /var/log/ceph/ceph.log.gz 2024-04-22T07:23:05.210 INFO:teuthology.orchestra.run.smithi037.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.40571.log.gz 2024-04-22T07:23:05.211 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40907.log 2024-04-22T07:23:05.211 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.41187.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44420.log 2024-04-22T07:23:05.211 INFO:teuthology.orchestra.run.smithi037.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.41187.log.gz 2024-04-22T07:23:05.211 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.40907.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41397.log 2024-04-22T07:23:05.211 INFO:teuthology.orchestra.run.smithi037.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.40907.log.gz 2024-04-22T07:23:05.211 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.44420.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41271.log 2024-04-22T07:23:05.211 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.41397.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44420.log.gz 2024-04-22T07:23:05.211 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42530.log 2024-04-22T07:23:05.211 INFO:teuthology.orchestra.run.smithi037.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.41397.log.gz/var/log/ceph/ceph-client.admin.41271.log: 2024-04-22T07:23:05.211 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40232.log 2024-04-22T07:23:05.211 INFO:teuthology.orchestra.run.smithi037.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.41271.log.gz 2024-04-22T07:23:05.211 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.42530.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44910.log 2024-04-22T07:23:05.211 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.40232.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42530.log.gz 2024-04-22T07:23:05.212 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45666.log 2024-04-22T07:23:05.212 INFO:teuthology.orchestra.run.smithi037.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.40232.log.gz 2024-04-22T07:23:05.212 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.44910.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39843.log 2024-04-22T07:23:05.212 INFO:teuthology.orchestra.run.smithi037.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.44910.log.gz 2024-04-22T07:23:05.212 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.45666.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40903.log 2024-04-22T07:23:05.212 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.39843.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.45666.log.gzgzip 2024-04-22T07:23:05.212 INFO:teuthology.orchestra.run.smithi037.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.45768.log 2024-04-22T07:23:05.212 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.40903.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.39843.log.gz 2024-04-22T07:23:05.212 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43034.log 2024-04-22T07:23:05.212 INFO:teuthology.orchestra.run.smithi037.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.40903.log.gz 2024-04-22T07:23:05.212 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.45768.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-22T07:23:05.212 INFO:teuthology.orchestra.run.smithi037.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45768.log.gz 2024-04-22T07:23:05.212 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.43034.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41523.log 2024-04-22T07:23:05.212 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph.audit.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43034.log.gz 2024-04-22T07:23:05.212 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43174.log 2024-04-22T07:23:05.212 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.41523.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41649.log 2024-04-22T07:23:05.213 INFO:teuthology.orchestra.run.smithi037.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.41523.log.gz 2024-04-22T07:23:05.213 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.43174.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45036.log 2024-04-22T07:23:05.213 INFO:teuthology.orchestra.run.smithi037.stderr: 89.3% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-22T07:23:05.213 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.41649.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42908.log 2024-04-22T07:23:05.213 INFO:teuthology.orchestra.run.smithi037.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.43174.log.gz 2024-04-22T07:23:05.213 INFO:teuthology.orchestra.run.smithi037.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.41649.log.gz 2024-04-22T07:23:05.213 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.45036.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43387.log 2024-04-22T07:23:05.213 INFO:teuthology.orchestra.run.smithi037.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.45036.log.gz 2024-04-22T07:23:05.213 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.42908.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42950.log 2024-04-22T07:23:05.213 INFO:teuthology.orchestra.run.smithi037.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42908.log.gz 2024-04-22T07:23:05.213 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.43387.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40011.log 2024-04-22T07:23:05.213 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.42950.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43387.log.gz 2024-04-22T07:23:05.214 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44729.log 2024-04-22T07:23:05.214 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.40011.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.42950.log.gz 2024-04-22T07:23:05.214 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41835.log 2024-04-22T07:23:05.214 INFO:teuthology.orchestra.run.smithi037.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.40011.log.gz 2024-04-22T07:23:05.214 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.44729.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-04-22T07:23:05.214 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.41835.log: 88.5%gzip -- replaced with /var/log/ceph/ceph-client.admin.44729.log.gz 2024-04-22T07:23:05.214 INFO:teuthology.orchestra.run.smithi037.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.44952.log 2024-04-22T07:23:05.214 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-osd.3.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.41835.log.gz 2024-04-22T07:23:05.214 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44645.log 2024-04-22T07:23:05.214 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.44952.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42614.log 2024-04-22T07:23:05.214 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.44645.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44952.log.gz 2024-04-22T07:23:05.214 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41103.log 2024-04-22T07:23:05.215 INFO:teuthology.orchestra.run.smithi037.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44645.log.gz 2024-04-22T07:23:05.215 INFO:teuthology.orchestra.run.smithi037.stderr:gzip/var/log/ceph/ceph-client.admin.42614.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.43945.log 2024-04-22T07:23:05.215 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.41103.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39675.log 2024-04-22T07:23:05.215 INFO:teuthology.orchestra.run.smithi037.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42614.log.gz 2024-04-22T07:23:05.215 INFO:teuthology.orchestra.run.smithi037.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.41103.log.gz 2024-04-22T07:23:05.215 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.43945.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45414.log 2024-04-22T07:23:05.215 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45498.log 2024-04-22T07:23:05.215 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.39675.log: /var/log/ceph/ceph-client.admin.45414.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.27146.log 2024-04-22T07:23:05.215 INFO:teuthology.orchestra.run.smithi037.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.39675.log.gz 2024-04-22T07:23:05.215 INFO:teuthology.orchestra.run.smithi037.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.43945.log.gz 2024-04-22T07:23:05.215 INFO:teuthology.orchestra.run.smithi037.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45414.log.gz 2024-04-22T07:23:05.215 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.45498.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46102.log 2024-04-22T07:23:05.215 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33540.log 2024-04-22T07:23:05.215 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph.tmp-client.admin.27146.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45498.log.gz 2024-04-22T07:23:05.216 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.27146.log.gz 2024-04-22T07:23:05.216 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45162.log 2024-04-22T07:23:05.216 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.46102.log: /var/log/ceph/ceph-client.admin.33540.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-04-22T07:23:05.216 INFO:teuthology.orchestra.run.smithi037.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.46102.log.gz 2024-04-22T07:23:05.216 INFO:teuthology.orchestra.run.smithi037.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.33540.log.gz 2024-04-22T07:23:05.216 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.45162.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42698.log 2024-04-22T07:23:05.216 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45582.log 2024-04-22T07:23:05.216 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-mds.c.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45162.log.gz 2024-04-22T07:23:05.216 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.42698.log: -- /var/log/ceph/ceph-client.0.42184.log 2024-04-22T07:23:05.216 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.45582.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39189.log 2024-04-22T07:23:05.216 INFO:teuthology.orchestra.run.smithi037.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.42698.log.gz 2024-04-22T07:23:05.216 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.0.42184.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45582.log.gz 2024-04-22T07:23:05.216 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.42184.log.gz 2024-04-22T07:23:05.216 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40567.log 2024-04-22T07:23:05.217 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-04-22T07:23:05.217 INFO:teuthology.orchestra.run.smithi037.stderr: 93.1% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-04-22T07:23:05.217 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.39189.log: /var/log/ceph/ceph-client.admin.40567.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-04-22T07:23:05.217 INFO:teuthology.orchestra.run.smithi037.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.39189.log.gz 2024-04-22T07:23:05.217 INFO:teuthology.orchestra.run.smithi037.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.40567.log.gz 2024-04-22T07:23:05.217 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42992.log 2024-04-22T07:23:05.217 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43793.log 2024-04-22T07:23:05.217 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.42992.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43836.log 2024-04-22T07:23:05.217 INFO:teuthology.orchestra.run.smithi037.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.42992.log.gz 2024-04-22T07:23:05.217 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.43793.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-04-22T07:23:05.217 INFO:teuthology.orchestra.run.smithi037.stderr:gzip/var/log/ceph/ceph-client.admin.43836.log: -5 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43793.log.gz 2024-04-22T07:23:05.217 INFO:teuthology.orchestra.run.smithi037.stderr: --verbose -- /var/log/ceph/ceph-client.admin.45372.log 2024-04-22T07:23:05.217 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40570.log 2024-04-22T07:23:05.217 INFO:teuthology.orchestra.run.smithi037.stderr: 91.0%/var/log/ceph/ceph-client.admin.45372.log: -- replaced with /var/log/ceph/ceph-client.admin.43836.log.gz 2024-04-22T07:23:05.218 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44868.log 2024-04-22T07:23:05.218 INFO:teuthology.orchestra.run.smithi037.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45372.log.gz 2024-04-22T07:23:05.218 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.40570.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41565.log 2024-04-22T07:23:05.218 INFO:teuthology.orchestra.run.smithi037.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.40570.log.gz 2024-04-22T07:23:05.218 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.44868.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41229.log 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44868.log.gz 2024-04-22T07:23:05.218 INFO:teuthology.orchestra.run.smithi037.stderr: 2024-04-22T07:23:05.218 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.41565.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41145.log 2024-04-22T07:23:05.218 INFO:teuthology.orchestra.run.smithi037.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.41565.log.gz 2024-04-22T07:23:05.218 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.41229.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43430.log 2024-04-22T07:23:05.218 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.41145.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.41229.log.gz 2024-04-22T07:23:05.218 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44075.log 2024-04-22T07:23:05.218 INFO:teuthology.orchestra.run.smithi037.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.41145.log.gz/var/log/ceph/ceph-client.admin.43430.log: 2024-04-22T07:23:05.218 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40235.log 2024-04-22T07:23:05.218 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.44075.log: gzip 90.6% -- replaced with /var/log/ceph/ceph-client.admin.43430.log.gz 2024-04-22T07:23:05.219 INFO:teuthology.orchestra.run.smithi037.stderr: -5 --verbose 93.5% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-04-22T07:23:05.219 INFO:teuthology.orchestra.run.smithi037.stderr: -- /var/log/ceph/ceph-client.admin.45288.log 2024-04-22T07:23:05.219 INFO:teuthology.orchestra.run.smithi037.stderr:gzip 91.0% -- replaced with /var/log/ceph/ceph-client.admin.44075.log.gz 2024-04-22T07:23:05.219 INFO:teuthology.orchestra.run.smithi037.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.39801.log 2024-04-22T07:23:05.219 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.40235.log: /var/log/ceph/ceph-client.admin.45288.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43302.log 2024-04-22T07:23:05.219 INFO:teuthology.orchestra.run.smithi037.stderr: 87.4%/var/log/ceph/ceph-client.admin.39801.log: -- replaced with /var/log/ceph/ceph-client.admin.45288.log.gz 2024-04-22T07:23:05.219 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41439.log 2024-04-22T07:23:05.219 INFO:teuthology.orchestra.run.smithi037.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.40235.log.gz 2024-04-22T07:23:05.219 INFO:teuthology.orchestra.run.smithi037.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.39801.log.gz 2024-04-22T07:23:05.219 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.43302.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43708.log 2024-04-22T07:23:05.219 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.41439.log: gzip -5 --verbose -- 91.1% -- replaced with /var/log/ceph/ceph-client.admin.43302.log.gz 2024-04-22T07:23:05.219 INFO:teuthology.orchestra.run.smithi037.stderr: /var/log/ceph/ceph-client.admin.41607.log 2024-04-22T07:23:05.219 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.43708.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.41439.log.gz 2024-04-22T07:23:05.219 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43665.log 2024-04-22T07:23:05.219 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.41607.log: gzip -5 --verbose 90.7% -- replaced with /var/log/ceph/ceph-client.admin.43708.log.gz 2024-04-22T07:23:05.220 INFO:teuthology.orchestra.run.smithi037.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.41607.log.gz 2024-04-22T07:23:05.220 INFO:teuthology.orchestra.run.smithi037.stderr: -- /var/log/ceph/ceph-mon.a.log 2024-04-22T07:23:05.220 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.43665.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42362.log 2024-04-22T07:23:05.220 INFO:teuthology.orchestra.run.smithi037.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43665.log.gz 2024-04-22T07:23:05.220 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40563.log 2024-04-22T07:23:05.220 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.42362.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40569.log 2024-04-22T07:23:05.220 INFO:teuthology.orchestra.run.smithi037.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.42362.log.gz 2024-04-22T07:23:05.220 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.40563.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40899.log 2024-04-22T07:23:05.220 INFO:teuthology.orchestra.run.smithi037.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.40563.log.gz/var/log/ceph/ceph-client.admin.40569.log: 2024-04-22T07:23:05.220 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45850.log 2024-04-22T07:23:05.220 INFO:teuthology.orchestra.run.smithi037.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.40569.log.gz/var/log/ceph/ceph-client.admin.40899.log: 2024-04-22T07:23:05.220 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- 88.0% -- replaced with /var/log/ceph/ceph-client.admin.40899.log.gz 2024-04-22T07:23:05.220 INFO:teuthology.orchestra.run.smithi037.stderr: /var/log/ceph/ceph-client.admin.45456.log 2024-04-22T07:23:05.220 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.45850.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41355.log 2024-04-22T07:23:05.221 INFO:teuthology.orchestra.run.smithi037.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.45850.log.gz 2024-04-22T07:23:05.221 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.45456.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39759.log 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45456.log.gz 2024-04-22T07:23:05.221 INFO:teuthology.orchestra.run.smithi037.stderr: 2024-04-22T07:23:05.221 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.41355.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40906.log 2024-04-22T07:23:05.221 INFO:teuthology.orchestra.run.smithi037.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.41355.log.gz 2024-04-22T07:23:05.221 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.39759.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45330.log 2024-04-22T07:23:05.221 INFO:teuthology.orchestra.run.smithi037.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.39759.log.gz 2024-04-22T07:23:05.221 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.40906.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45808.log 2024-04-22T07:23:05.221 INFO:teuthology.orchestra.run.smithi037.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.40906.log.gz/var/log/ceph/ceph-client.admin.45330.log: 2024-04-22T07:23:05.221 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40233.log 2024-04-22T07:23:05.221 INFO:teuthology.orchestra.run.smithi037.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.45330.log.gz 2024-04-22T07:23:05.221 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.45808.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33449.log 2024-04-22T07:23:05.221 INFO:teuthology.orchestra.run.smithi037.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45808.log.gz/var/log/ceph/ceph-client.admin.40233.log: 2024-04-22T07:23:05.221 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45204.log 2024-04-22T07:23:05.222 INFO:teuthology.orchestra.run.smithi037.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.40233.log.gz 2024-04-22T07:23:05.222 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.33449.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40226.log 2024-04-22T07:23:05.222 INFO:teuthology.orchestra.run.smithi037.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.33449.log.gz 2024-04-22T07:23:05.222 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.45204.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39969.log 2024-04-22T07:23:05.222 INFO:teuthology.orchestra.run.smithi037.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45204.log.gz 2024-04-22T07:23:05.222 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.40226.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40557.log 2024-04-22T07:23:05.222 INFO:teuthology.orchestra.run.smithi037.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.40226.log.gz 2024-04-22T07:23:05.222 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.39969.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42824.log 88.5% -- replaced with /var/log/ceph/ceph-client.admin.39969.log.gz 2024-04-22T07:23:05.222 INFO:teuthology.orchestra.run.smithi037.stderr: 2024-04-22T07:23:05.222 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.40557.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45540.log 2024-04-22T07:23:05.222 INFO:teuthology.orchestra.run.smithi037.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.40557.log.gz 2024-04-22T07:23:05.222 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.42824.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45120.log 2024-04-22T07:23:05.222 INFO:teuthology.orchestra.run.smithi037.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.42824.log.gz 2024-04-22T07:23:05.222 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.45540.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.e.log 2024-04-22T07:23:05.223 INFO:teuthology.orchestra.run.smithi037.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45540.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42656.log 2024-04-22T07:23:05.223 INFO:teuthology.orchestra.run.smithi037.stderr: 2024-04-22T07:23:05.223 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.45120.log: /var/log/ceph/ceph-mds.e.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45246.log 2024-04-22T07:23:05.223 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.42656.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45120.log.gz 2024-04-22T07:23:05.223 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40566.log 2024-04-22T07:23:05.223 INFO:teuthology.orchestra.run.smithi037.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.42656.log.gz 2024-04-22T07:23:05.223 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.45246.log: gzip 93.0% -- replaced with /var/log/ceph/ceph-mds.e.log.gz 2024-04-22T07:23:05.223 INFO:teuthology.orchestra.run.smithi037.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.40234.log 2024-04-22T07:23:05.223 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.40566.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40901.log 2024-04-22T07:23:05.223 INFO:teuthology.orchestra.run.smithi037.stderr: 88.5% 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45246.log.gz 2024-04-22T07:23:05.223 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.40234.log: -- replaced with /var/log/ceph/ceph-client.admin.40566.log.gz 2024-04-22T07:23:05.223 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 88.0% --verbose -- /var/log/ceph/ceph-client.admin.42782.log 2024-04-22T07:23:05.223 INFO:teuthology.orchestra.run.smithi037.stderr: -- replaced with /var/log/ceph/ceph-client.admin.40234.log.gz 2024-04-22T07:23:05.224 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.40901.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42404.log 2024-04-22T07:23:05.224 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.42782.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.40901.log.gz 2024-04-22T07:23:05.224 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44561.log 2024-04-22T07:23:05.224 INFO:teuthology.orchestra.run.smithi037.stderr: 88.7%gzip -- replaced with /var/log/ceph/ceph-client.admin.42782.log.gz 2024-04-22T07:23:05.224 INFO:teuthology.orchestra.run.smithi037.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.44032.log 2024-04-22T07:23:05.224 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.44561.log: /var/log/ceph/ceph-client.admin.42404.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40767.log 2024-04-22T07:23:05.224 INFO:teuthology.orchestra.run.smithi037.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44561.log.gz 2024-04-22T07:23:05.224 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.44032.log: 88.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42446.log 2024-04-22T07:23:05.224 INFO:teuthology.orchestra.run.smithi037.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44032.log.gz 2024-04-22T07:23:05.224 INFO:teuthology.orchestra.run.smithi037.stderr: -- replaced with /var/log/ceph/ceph-client.admin.42404.log.gz/var/log/ceph/ceph-client.admin.40767.log: 2024-04-22T07:23:05.224 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- 88.2% -- replaced with /var/log/ceph/ceph-client.admin.40767.log.gz 2024-04-22T07:23:05.224 INFO:teuthology.orchestra.run.smithi037.stderr: /var/log/ceph/ceph-client.admin.42572.log 2024-04-22T07:23:05.224 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.42446.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43259.log 2024-04-22T07:23:05.224 INFO:teuthology.orchestra.run.smithi037.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.42446.log.gz 2024-04-22T07:23:05.224 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.42572.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45934.log 2024-04-22T07:23:05.225 INFO:teuthology.orchestra.run.smithi037.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.42572.log.gz 2024-04-22T07:23:05.225 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39531.log 2024-04-22T07:23:05.225 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.43259.log: /var/log/ceph/ceph-client.admin.45934.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39317.log 2024-04-22T07:23:05.225 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.39531.log: 89.1% 89.2% -- replaced with /var/log/ceph/ceph-client.admin.45934.log.gz 2024-04-22T07:23:05.225 INFO:teuthology.orchestra.run.smithi037.stderr: -- replaced with /var/log/ceph/ceph-client.admin.43259.log.gz 2024-04-22T07:23:05.225 INFO:teuthology.orchestra.run.smithi037.stderr: 89.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40053.log 2024-04-22T07:23:05.225 INFO:teuthology.orchestra.run.smithi037.stderr: -- replaced with /var/log/ceph/ceph-client.admin.39531.log.gz 2024-04-22T07:23:05.225 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.39317.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45976.log 2024-04-22T07:23:05.225 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.40053.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39443.log 2024-04-22T07:23:05.225 INFO:teuthology.orchestra.run.smithi037.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.39317.log.gz 2024-04-22T07:23:05.225 INFO:teuthology.orchestra.run.smithi037.stderr: 88.6%/var/log/ceph/ceph-client.admin.45976.log: -- replaced with /var/log/ceph/ceph-client.admin.40053.log.gz 2024-04-22T07:23:05.225 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39089.log 2024-04-22T07:23:05.225 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.39443.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.45976.log.gz 2024-04-22T07:23:05.225 INFO:teuthology.orchestra.run.smithi037.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.39443.log.gz 2024-04-22T07:23:05.225 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42740.log 2024-04-22T07:23:05.226 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-04-22T07:23:05.226 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.39089.log: /var/log/ceph/ceph-client.admin.42740.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44687.log 2024-04-22T07:23:05.226 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-mds.a.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.39089.log.gz 2024-04-22T07:23:05.226 INFO:teuthology.orchestra.run.smithi037.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.42740.log.gz 2024-04-22T07:23:05.226 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46018.log 2024-04-22T07:23:05.226 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.44687.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39927.log 2024-04-22T07:23:05.226 INFO:teuthology.orchestra.run.smithi037.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44687.log.gz 2024-04-22T07:23:05.226 INFO:teuthology.orchestra.run.smithi037.stderr: 93.0%/var/log/ceph/ceph-client.admin.46018.log: -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-04-22T07:23:05.226 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38974.log 2024-04-22T07:23:05.226 INFO:teuthology.orchestra.run.smithi037.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.46018.log.gz 2024-04-22T07:23:05.226 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.39927.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44463.log 2024-04-22T07:23:05.226 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.38974.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.39927.log.gz 2024-04-22T07:23:05.226 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41313.log 2024-04-22T07:23:05.226 INFO:teuthology.orchestra.run.smithi037.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.38974.log.gz/var/log/ceph/ceph-client.admin.44463.log: 2024-04-22T07:23:05.227 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40229.log 2024-04-22T07:23:05.227 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.41313.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39633.log 2024-04-22T07:23:05.227 INFO:teuthology.orchestra.run.smithi037.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.44463.log.gz 2024-04-22T07:23:05.227 INFO:teuthology.orchestra.run.smithi037.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.41313.log.gz 2024-04-22T07:23:05.227 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.40229.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40905.log 2024-04-22T07:23:05.227 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.39633.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42866.log 2024-04-22T07:23:05.227 INFO:teuthology.orchestra.run.smithi037.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.40229.log.gz 2024-04-22T07:23:05.227 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.40905.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45624.log 88.4% 2024-04-22T07:23:05.227 INFO:teuthology.orchestra.run.smithi037.stderr: -- replaced with /var/log/ceph/ceph-client.admin.39633.log.gz 2024-04-22T07:23:05.227 INFO:teuthology.orchestra.run.smithi037.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.40905.log.gzgzip 2024-04-22T07:23:05.227 INFO:teuthology.orchestra.run.smithi037.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.40902.log 2024-04-22T07:23:05.227 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.42866.log: /var/log/ceph/ceph-client.admin.45624.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40558.log 2024-04-22T07:23:05.227 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.40902.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42866.log.gz 2024-04-22T07:23:05.227 INFO:teuthology.orchestra.run.smithi037.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45624.log.gz 2024-04-22T07:23:05.227 INFO:teuthology.orchestra.run.smithi037.stderr:gzip 87.5% -- replaced with /var/log/ceph/ceph-client.admin.40902.log.gz 2024-04-22T07:23:05.228 INFO:teuthology.orchestra.run.smithi037.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.43092.log 2024-04-22T07:23:05.228 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.40558.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41733.log 2024-04-22T07:23:05.228 INFO:teuthology.orchestra.run.smithi037.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.40558.log.gz/var/log/ceph/ceph-client.admin.43092.log: 2024-04-22T07:23:05.228 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41481.log 2024-04-22T07:23:05.228 INFO:teuthology.orchestra.run.smithi037.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.43092.log.gz/var/log/ceph/ceph-client.admin.41733.log: 2024-04-22T07:23:05.228 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41691.log 2024-04-22T07:23:05.228 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39487.log 2024-04-22T07:23:05.228 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.41481.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.41733.log.gz 2024-04-22T07:23:05.228 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.41691.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.41481.log.gz 2024-04-22T07:23:05.228 INFO:teuthology.orchestra.run.smithi037.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.41691.log.gz 2024-04-22T07:23:05.228 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.39487.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.39487.log.gz 2024-04-22T07:23:05.229 INFO:teuthology.orchestra.run.smithi196.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-04-22T07:23:05.269 INFO:teuthology.orchestra.run.smithi196.stderr: 92.0% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-04-22T07:23:05.292 INFO:teuthology.orchestra.run.smithi196.stderr: 92.1% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-04-22T07:23:05.362 INFO:teuthology.orchestra.run.smithi037.stderr: 90.9% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-04-22T07:23:05.573 INFO:teuthology.orchestra.run.smithi037.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-04-22T07:23:05.619 INFO:teuthology.orchestra.run.smithi196.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-04-22T07:23:05.629 INFO:teuthology.orchestra.run.smithi037.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-04-22T07:23:05.732 INFO:teuthology.orchestra.run.smithi037.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-04-22T07:23:05.841 INFO:teuthology.orchestra.run.smithi196.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-04-22T07:23:05.917 INFO:teuthology.orchestra.run.smithi196.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-04-22T07:23:06.007 INFO:teuthology.orchestra.run.smithi196.stderr: 94.5% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-04-22T07:23:06.032 INFO:teuthology.orchestra.run.smithi037.stderr: 94.2% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-04-22T07:23:06.034 INFO:teuthology.orchestra.run.smithi037.stderr: 2024-04-22T07:23:06.034 INFO:teuthology.orchestra.run.smithi037.stderr:real 0m0.919s 2024-04-22T07:23:06.034 INFO:teuthology.orchestra.run.smithi037.stderr:user 0m2.602s 2024-04-22T07:23:06.034 INFO:teuthology.orchestra.run.smithi037.stderr:sys 0m0.194s 2024-04-22T07:23:06.250 INFO:teuthology.orchestra.run.smithi196.stderr: 95.7% -- replaced with /var/log/ceph/ceph-mds.f.log.gz 2024-04-22T07:23:06.252 INFO:teuthology.orchestra.run.smithi196.stderr: 2024-04-22T07:23:06.252 INFO:teuthology.orchestra.run.smithi196.stderr:real 0m1.115s 2024-04-22T07:23:06.252 INFO:teuthology.orchestra.run.smithi196.stderr:user 0m4.073s 2024-04-22T07:23:06.252 INFO:teuthology.orchestra.run.smithi196.stderr:sys 0m0.169s 2024-04-22T07:23:06.252 INFO:tasks.ceph:Archiving logs... 2024-04-22T07:23:06.252 DEBUG:teuthology.misc:Transferring archived files from smithi037:/var/log/ceph to /home/teuthworker/archive/leonidus-2024-04-22_05:52:53-fs-wip-lusov-quiescer-distro-default-smithi/7668166/remote/smithi037/log 2024-04-22T07:23:06.253 DEBUG:teuthology.orchestra.run.smithi037:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-22T07:23:06.746 DEBUG:teuthology.misc:Transferring archived files from smithi196:/var/log/ceph to /home/teuthworker/archive/leonidus-2024-04-22_05:52:53-fs-wip-lusov-quiescer-distro-default-smithi/7668166/remote/smithi196/log 2024-04-22T07:23:06.747 DEBUG:teuthology.orchestra.run.smithi196:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-22T07:23:07.290 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-04-22T07:23:07.300 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-04-22T07:23:07.300 DEBUG:teuthology.orchestra.run.smithi037:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-22T07:23:07.303 DEBUG:teuthology.orchestra.run.smithi196:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-22T07:23:07.409 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-04-22T07:23:07.418 INFO:teuthology.task.clock:Checking final clock skew... 2024-04-22T07:23:07.418 DEBUG:teuthology.orchestra.run.smithi037:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-22T07:23:07.421 DEBUG:teuthology.orchestra.run.smithi196:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-22T07:23:07.435 INFO:teuthology.orchestra.run.smithi037.stderr:bash: line 1: ntpq: command not found 2024-04-22T07:23:07.436 INFO:teuthology.orchestra.run.smithi196.stderr:bash: line 1: ntpq: command not found 2024-04-22T07:23:07.440 INFO:teuthology.orchestra.run.smithi196.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-22T07:23:07.440 INFO:teuthology.orchestra.run.smithi196.stdout:=============================================================================== 2024-04-22T07:23:07.440 INFO:teuthology.orchestra.run.smithi196.stdout:^- hv01.front.sepia.ceph.com 2 6 377 44 +1213us[+1213us] +/- 602ms 2024-04-22T07:23:07.440 INFO:teuthology.orchestra.run.smithi196.stdout:^* hv02.front.sepia.ceph.com 3 6 377 44 +12us[ +39us] +/- 58ms 2024-04-22T07:23:07.440 INFO:teuthology.orchestra.run.smithi196.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 43 +9401ns[+9401ns] +/- 61ms 2024-04-22T07:23:07.441 INFO:teuthology.orchestra.run.smithi196.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-04-22T07:23:07.442 INFO:teuthology.orchestra.run.smithi037.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-22T07:23:07.442 INFO:teuthology.orchestra.run.smithi037.stdout:=============================================================================== 2024-04-22T07:23:07.442 INFO:teuthology.orchestra.run.smithi037.stdout:^- hv01.front.sepia.ceph.com 2 6 377 44 +1210us[+1205us] +/- 602ms 2024-04-22T07:23:07.442 INFO:teuthology.orchestra.run.smithi037.stdout:^* hv02.front.sepia.ceph.com 3 6 377 43 -11us[ -16us] +/- 58ms 2024-04-22T07:23:07.443 INFO:teuthology.orchestra.run.smithi037.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 45 -6805ns[ -11us] +/- 61ms 2024-04-22T07:23:07.443 INFO:teuthology.orchestra.run.smithi037.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-04-22T07:23:07.443 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-04-22T07:23:07.490 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-04-22T07:23:07.491 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-04-22T07:23:07.503 DEBUG:teuthology.orchestra.run.smithi037:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-22T07:23:07.574 DEBUG:teuthology.orchestra.run.smithi196:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-22T07:23:07.635 DEBUG:teuthology.orchestra.run.smithi037:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-22T07:23:07.665 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-22T07:23:07.666 DEBUG:teuthology.orchestra.run.smithi196:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-22T07:23:07.692 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-22T07:23:07.693 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-04-22T07:23:07.703 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-04-22T07:23:07.712 INFO:teuthology.task.internal:Duration was 674.025897 seconds 2024-04-22T07:23:07.712 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-04-22T07:23:07.721 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-04-22T07:23:07.722 DEBUG:teuthology.orchestra.run.smithi037:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-22T07:23:07.724 DEBUG:teuthology.orchestra.run.smithi196:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-22T07:23:07.764 INFO:teuthology.orchestra.run.smithi037.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-22T07:23:07.770 INFO:teuthology.orchestra.run.smithi196.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-22T07:23:07.924 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-04-22T07:23:07.924 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi037.front.sepia.ceph.com 2024-04-22T07:23:07.925 DEBUG:teuthology.orchestra.run.smithi037:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-22T07:23:07.986 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi196.front.sepia.ceph.com 2024-04-22T07:23:07.987 DEBUG:teuthology.orchestra.run.smithi196:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-22T07:23:08.013 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-04-22T07:23:08.013 DEBUG:teuthology.orchestra.run.smithi037:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-22T07:23:08.029 DEBUG:teuthology.orchestra.run.smithi196:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-22T07:23:08.078 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-04-22T07:23:08.078 DEBUG:teuthology.orchestra.run.smithi037:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-22T07:23:08.097 DEBUG:teuthology.orchestra.run.smithi196:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-22T07:23:08.209 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-04-22T07:23:08.220 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-04-22T07:23:08.220 DEBUG:teuthology.orchestra.run.smithi037:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-22T07:23:08.245 DEBUG:teuthology.orchestra.run.smithi196:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-22T07:23:08.268 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-04-22T07:23:08.280 DEBUG:teuthology.orchestra.run.smithi037:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-22T07:23:08.287 DEBUG:teuthology.orchestra.run.smithi196:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-22T07:23:08.308 INFO:teuthology.orchestra.run.smithi037.stdout:kernel.core_pattern = core 2024-04-22T07:23:08.330 INFO:teuthology.orchestra.run.smithi196.stdout:kernel.core_pattern = core 2024-04-22T07:23:08.377 DEBUG:teuthology.orchestra.run.smithi037:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-22T07:23:08.391 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-22T07:23:08.391 DEBUG:teuthology.orchestra.run.smithi196:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-22T07:23:08.431 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-22T07:23:08.431 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-04-22T07:23:08.442 INFO:teuthology.task.internal:Transferring archived files... 2024-04-22T07:23:08.442 DEBUG:teuthology.misc:Transferring archived files from smithi037:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/leonidus-2024-04-22_05:52:53-fs-wip-lusov-quiescer-distro-default-smithi/7668166/remote/smithi037 2024-04-22T07:23:08.443 DEBUG:teuthology.orchestra.run.smithi037:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-22T07:23:08.475 DEBUG:teuthology.misc:Transferring archived files from smithi196:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/leonidus-2024-04-22_05:52:53-fs-wip-lusov-quiescer-distro-default-smithi/7668166/remote/smithi196 2024-04-22T07:23:08.476 DEBUG:teuthology.orchestra.run.smithi196:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-22T07:23:08.506 INFO:teuthology.task.internal:Removing archive directory... 2024-04-22T07:23:08.507 DEBUG:teuthology.orchestra.run.smithi037:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-22T07:23:08.512 DEBUG:teuthology.orchestra.run.smithi196:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-22T07:23:08.557 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-04-22T07:23:08.569 INFO:teuthology.task.internal:Not uploading archives. 2024-04-22T07:23:08.570 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-04-22T07:23:08.580 INFO:teuthology.task.internal:Tidying up after the test... 2024-04-22T07:23:08.580 DEBUG:teuthology.orchestra.run.smithi037:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-22T07:23:08.582 DEBUG:teuthology.orchestra.run.smithi196:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-22T07:23:08.594 INFO:teuthology.orchestra.run.smithi037.stdout: 262213 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 22 07:23 /home/ubuntu/cephtest 2024-04-22T07:23:08.611 INFO:teuthology.orchestra.run.smithi196.stdout: 262161 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 22 07:23 /home/ubuntu/cephtest 2024-04-22T07:23:08.612 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-04-22T07:23:08.623 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-04-22T07:23:08.647 INFO:teuthology.run:Summary data: description: fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-bitmap overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down pg_health prefetch_dirfrags/no prefetch_dirfrags/yes prefetch_entire_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/1 tasks/{1-thrash/with-quiesce 2-workunit/suites/iozone}} duration: 674.0258967876434 flavor: default owner: scheduled_leonidus@teuthology success: true 2024-04-22T07:23:08.647 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-22T07:23:08.731 INFO:teuthology.run:pass